Web crawler and scraper based on Scrapy and Playwright's headless browser.
MIT License
Bot releases are hidden (Show)
v2.1 release notes:
-rs / --random-sleep
option,Web crawler and scraper written in Python and based on Scrapy and Playwright's headless browser.
Published by ivan-sincek 5 months ago
v1.7 release notes:
argparse
dependency,Web crawler and scraper written in Python and based on Scrapy and Playwright's headless browser.
Published by ivan-sincek 7 months ago
v1.6 release notes:
-at
option,-s
option for sleeping between two consecutive requests to the same domain,Web crawler and scraper written in Python and based on Scrapy and Playwright's headless browser.
Published by ivan-sincek 7 months ago
v1.5 release notes:
Web crawler and scraper written in Python and based on Scrapy and Playwright's headless browser.
Published by ivan-sincek 10 months ago
v1.4 release notes:
yes
or no
value,-d
option has been changed to directory -dir
option,Web crawler and scraper written in Python and based on Scrapy and Playwright's headless browser.
Published by ivan-sincek 11 months ago
Web crawler and scraper written in Python and based on Scrapy and Playwright's headless browser.