Webscrapping in Python for Beginners

Go to class

Project detail

Overview

Web scraping is the art of picking out data from a website by looking at the HTML code and identifying patterns that can be used to identify your data. This data can then be gathered and later used for your own analysis.

In this course we will go over the basic of web scraping, learning all about how we can extract data from websites, and all of this is guided along by a work example.

At the end of the course you should be able to go off on your own, and pick out most common websites, and be able to extract all the relevant data you may need just through using Python code.

Syllabus

Introduction
Prerequisit libraries
Introduction to The Modulus Operation
Introduction to Simple Error Handling
Introduction to Pandas
Response Status Codes From a HTTP Request
Reading The Response Text From Our Request
First Approach at Parsing The Data
Understanding the Exception Cases
Parsing Out All Data for One Company
Determining Where We Can Get More Ticker Symbols
Extracting Company Ticker Symbols Part 1
Extracting Company Ticker Symbols Part 2
Getting Data For All Parsed Companies
Final Data For All Parsed Companies
Final Result Static Websites
Prerequisite Libraries for Dynamic Web Scrapping
Short review: Recursive Functions
Getting started with Selenium
View The Page Source
Website Elements and XPath
Navigating Deeper Into The Page Source
Identifying The Path To Our Data
Using The XPath To Our Data
Parsing Out Our Data
Getting Our Final Data
Final Results Dynamic Websites
WebscrapingPythonOutro

Job Detail