scrapy-cluster
This Scrapy project uses Redis and Kafka to create a distributed on demand scraping cluster.
MIT License
Bot releases are visible (Hide)
Intermittent release to support changes outside of this project. No major code updates
Published by madisonb over 7 years ago
The next official release of Scrapy Cluster
Published by madisonb over 7 years ago
Release Candidate for Scrapy Cluster 1.2
Published by madisonb over 8 years ago
The next official release of Scrapy Cluster
Published by madisonb over 9 years ago
This is the initial release of Scrapy Cluster 1.0. Please see the documentation at http://scrapy-cluster.readthedocs.org/ for more information.
