Get all urls from a Feed/Atom/RSS/Sitemap xml markup.
MIT License
Check if an URL is a valid HTTP URL.
Lightweight module for parse an URI.
Get input as normalized WHATWG URL.
List of the top 500 domains and pages on the web.
A set of functions for manipuliating data URIs.
It parses HTML markup and returns you all the scripts.
Given an URL, it resolves as fast as possible, performing a GET without downloading the body.
Get `Content-Length` from the input.
Simple DSL based on <key,value> designed to work together fulltext search engines.
Get all urls from a HTML markup
A simple, pre-cached, ready-to-use way to interact with Wappalyzer.
A Node.js library for converting HTML documents of arbitrary encoding into a target encoding (utf...
A list of common crawler user agents useful for retrieving metadata from links.
Regex for matching localhost alike URLs
counting things, as microservice