Detect the availability of the URLs with txt file or webpage 批量检测在线或本地文本中 URL 的有效性
Machine-readable .txt blocklist of phishing URLs and IP Addresses from the Chống Lừa Đảo (https:/...
JSFinder is a tool for quickly extracting URLs and subdomains from JS files on a website.
A python script that finds endpoints in JavaScript files
Python入门网络爬虫之精华版
silic - simple link checker written in python
pylinkvalidator is a standalone and pure python link validator and crawler that traverses a web s...
Checks and fixes URLs in code and documentation.
Visual App for Testing URLs and User-agents blocked by robots.txt Files
A fast vulnerability scanner helps pentesters pinpoint possibly vulnerable targets from a large n...
A lightweight tool to test availability and content of websites and webservices
Broken link checker
RobotScraper is a simple tool written in Python to check each of the paths found in the robots.tx...
Python bot that crawls your website looking for dead stuff
check links in web documents or full websites
Check and Fix Outdated URLs