Scrapy is a powerful web scrapign framework for Python, we can use it to following links and crawl a website, in this case I am going to scrape product data from an online store following each category link one by one and export the data to a CSV file.

Scrapy for Beginners - https://youtu.be/s4jtkzHhLzY

Support Me:

# Amazon US: https://amzn.to/2OzqL1M
# Amazon UK: https://amzn.to/2OYuMwo
# Hosting: Digital Ocean: https://m.do.co/c/c7c90f161ff6
# Gear Used: https://jhnwr.com/gear/ (NEW)
# Patreon: https://www.patreon.com/johnwatsonrooney (NEW)

-------------------------------------
Disclaimer: These are affiliate links and as an Amazon Associate I earn from qualifying purchases
-------------------------------------

# Timestamps
00:00 - Intro
00:30 - Startproject & genspider
01:30 - Website categories
02:25 - Scrapy Shell

05:15 - Follow Links
07:15 - Parse product data
13:33 - Scrapy Crawl
14:15 - Results CSV
15:05 - Summary & Outro