Get all urls from a Feed/Atom/RSS/Sitemap xml markup.
MIT License
No README available, please check again later.
counting things, as microservice
A list of common crawler user agents useful for retrieving metadata from links.
It parses HTML markup and returns you all the scripts.
Regex for matching localhost alike URLs
Given an URL, it resolves as fast as possible, performing a GET without downloading the body.
Get `Content-Length` from the input.
List of the top 500 domains and pages on the web.
Lightweight module for parse an URI.
Get all urls from a HTML markup
A simple, pre-cached, ready-to-use way to interact with Wappalyzer.
A Node.js library for converting HTML documents of arbitrary encoding into a target encoding (utf...
Simple DSL based on <key,value> designed to work together fulltext search engines.
Check if an URL is a valid HTTP URL.
Get input as normalized WHATWG URL.
A set of functions for manipuliating data URIs.