Webscraping met Python

Webscraping automates data collection from internet without browser. Practical example: waste calendar automation for household with four containers (plastic, GFT, paper, rest). Python program on Raspberry Pi Zero sends daily email/SMS message which container should be placed on the street. Hardware: Raspberry Pi Zero (€10) with WiFi and internet access, Python3 standard in Raspbian Linux. Software: crontab scheduler runs program daily, smtplib sends email, urllib visits website, Beautiful Soup library formats/organizes HTML parsing. Program analyzes waste calendar website (afvalkalender.dar.nl/adres/postcode:nummer), bs.find_all(class_=’date’) searches tags, procedure sendmail() sends email on collection day. Alternative: Google Chrome browser developer tools show desired data in HTML tags for webscraping. Complete example code with imports (datetime, smtplib, locale, urllib, Beautiful Soup), sendMail() function and analyseer() main procedure.

Project Details

• Type: Electronics & Microcontroller Project
• Category: Electronics

Download Project PDF

Download Full Project PDF