Gathering data from the web¶

Resources¶

Installing BeautifulSoup¶

To install BeautifulSoup on your class VM, run:

sudo pip3 install --upgrade beautifulsoup4
sudo pip3 install --upgrade html5lib

The password is the usual student account password.

Lab¶

Using Twitter API Example¶

get_tweets.py

Basic HTML example¶

Hello.html

Examples from 2014-15 Course Catalog¶