Web Scraping and Text Processing 2018

April 4, 2018
Dates: Monday, May 21 - Friday, May 25, 2018
Morning Session | 10:00am - 12:00pm
Afternoon Session | 1:00pm - 3:00pm+
Location: Sherrerd Hall 001 (May 21) and Sharrerd Hall 101 (May 22-25)
Instructors: Will Lowe & Hubert Jin

Over the last decade, both the variety and amount of data available to social scientists have expanded. These new data sources include administrative records e.g., voter files, campaign finance and lobbying records, geo-referenced data e.g., satellite maps, geocoded event data, and texts e.g., speeches, court rulings, legislative bills. Many of these data sources can be accessed through the web and as a consequence, techniques such as web scraping have become an essential part of a social scientist's toolkit.

The objective of this workshop is to introduce basic tools and techniques for automatic content extraction from the web, parsing, and other data-handling tasks that are commonly encountered in data-intensive research projects.

This year, the 5-day workshop will be divided into 3 sections. You can register for all or any of the sections you require.

Section 1: Introduction to Python.
Section 2: Introduction to web scraping using R. This section presupposes prior experience using R.
Section 3: Introduction to web scraping using Python. This section presupposes prior experience using Python.

See the syllabi below for more detail on course content.

Please check the Web Scraping and Text Processing 2018 page for updates and more information.

If you are interested in attending this workshop, you must register.  Please sign up here. You will be added to the Blackboard class which will give you access to materials and the discussion board.

2018-syllabus1.pdf25 KB
2018-syllabus2.pdf30 KB
2018-syllabus3.pdf28 KB