Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台,支持任何语言和框架
BSD-3-CLAUSE License
Bot releases are hidden (Show)
Published by tikazyq almost 5 years ago
Published by wo10378931 about 5 years ago
1、fix 非自定义爬虫前端无法查看爬虫的问题
2、fix kill主进程未kill子进程的问题
3、fix 爬虫异常退出状态错误的问题
4、fix kill进程后状态错误的问题
Published by wo10378931 about 5 years ago
1、fix mongo 密码特殊字符串错误的问题
2、fix 创建临时目录错误的问题
3、fix MD5值判断不正确的问题
Published by wo10378931 about 5 years ago
1、重构爬虫同步流程,修改为直接从GridFs上同步爬虫
2、fix 爬虫日志无法正常获取的问题
3、fix 爬虫无法正常同步的问题
4、fix 爬虫无法正常删除的问题
5、fix 任务状态无法正常停止的问题
6、优化爬虫列表的搜索
Published by tikazyq about 5 years ago
Published by tikazyq about 5 years ago
Published by tikazyq over 5 years ago
Published by tikazyq over 5 years ago
Published by tikazyq over 5 years ago
Published by tikazyq over 5 years ago
Published by tikazyq over 5 years ago