Cross-platform persistent and distributed web crawler
MIT License
Redis Go client
A fast Golang Redis client that supports Client Side Caching, Auto Pipelining, Generics OM, Redis...
An Efficient ProxyPool with Getter, Tester and Server
Redis-based components for Scrapy.
This Scrapy project uses Redis and Kafka to create a distributed on demand scraping cluster.