admin ui for scrapy/open source scrapinghub
Web app for Scrapyd cluster management, Scrapy log analysis & visualization, Auto packaging, Time...
boris-spider是一款使用Python语言编写的爬虫框架,于多年的爬虫业务中不断磨合而诞生,相比于scrapy,该框架更易上手,且又满足复杂的需求,支持分布式及批次采集。
A tool for parsing Scrapy log files periodically and incrementally, extending the HTTP JSON API o...
A distributed crawler for weibo, building with celery and requests.
owllook-小说搜索引擎
Python3网络爬虫实战:淘宝、京东、网易云、B站、12306、抖音、笔趣阁、漫画小说下载、音乐电影下载等
scrapy best practice
A Python wrapper for working with Scrapyd's API.
An open source webapp for scraping: towards a public service for webscraping
Collection of Cloudfeaster spiders for various gaming services
A collection of self-using anime-related crawlers.
🚀🚀🚀feapder is an easy to use, powerful crawler framework | feapder是一款上手简单,功能强大的Python爬虫框架。内置AirSp...
Set up free and scalable Scrapyd cluster for distributed web-crawling with just a few clicks. DEMO
This Scrapy project uses Redis and Kafka to create a distributed on demand scraping cluster.
INFO-SPIDER 是一个集众多数据源于一身的爬虫工具箱🧰,旨在安全快捷的帮助用户拿回自己的数据,工具代码开源,流程透明。支持数据源包括GitHub、QQ邮箱、网易邮箱、阿里邮箱、新浪邮箱、...