Cross-platform persistent and distributed web crawler
MIT License
Simple, fast web crawler designed for easy, quick discovery of endpoints and assets within a web ...
A auto restart scrapper