A command-line utility to fetch Links of a given seed URL. It will also recursively fetch links for a given depth.
MIT License
Reduce and normalize the components of a WHATWG URL.
To extract main article from given URL with Node.js
Determine the relation between two URLs.
Crawlyx is an open-source command-line interface (CLI) based web crawler built using Node.js. It ...
🕷A simple but *really* fast crawler built with Node.js & TypeScript
🐶 A wrapper around Fetch just for JSON (with TypeScript declarations)
Scraplink library, for scraping links and images url from a webpage
CLI tool for saving a faithful copy of a complete web page in a single HTML file
Find broken links, missing images, etc within your HTML.