Serverless Web Scraping in Python for AI, Fun and Profit
(Using Step Functions and Lambdas)
This material is also covered in Chapter 7 of Pragmatic AI
Web Scraping for AI/ML consists of three phases:
A. Doing the Work
B. Scheduling the Work
C. Modeling the Work
A. Web Scraping Techniques (Doing the Work)
B. Orchestrating Retrieval (Scheduling the Work)
C. Wiring Results into A Machine Learning Pipeline (Modeling the Work)