Web Scraping and Social Media Scraping 2400-DS1WSMS

Course contents:
- responsible scraping & good practices
- the structure of webpages
- scraping static web pages with Beautiful Soup
- scraping static web pages with Scrapy
- scraping static and dynamic web pages with Selenium

Course coordinators

Term 2024L:

Ewelina Jakubowska
Marta Kruszelnicka

Term 2023L:

Maximilian Reinhardt

Type of course

obligatory courses

Learning outcomes

- Student has knowledge about web scraping
- Student is familiar with web scraping methodology
- Student is able to use knowledge about web scraping to conduct his/her own research
- Student gains and processes data independently
- Student is capable of working in groups and co-operating with others
- Student is able to formulate his/her point of view and express it in the discussion
K_W01, K_U01, K_U02, K_U03, K_U04, K_U05, KS_01, K_U06

Assessment criteria

Evaluation of students’ attendance, group projects (50%), homeworks (30%) and students’ activity (20%). One has to score at least 50% of total number of points to advance. Students are supposed to submit their work in the way indicated by the lecturer.

Bibliography

R. Mitchell (2018). Web Scraping with Python: Collecting Data from the Modern Web. 2nd Edition. O’Reilly Media.