x-crawl is a flexible Node.js AI-assisted crawler library. Making crawler work more efficient, intelligent and convenient. ------ x-crawl 是一个灵活的 Node.js AI 辅助爬虫库。使爬虫工作变得更加高效、智能和便捷。(v10 版本已发布)
MIT License
a reliable high-level web crawling & scraping framework for Node.js.
Htcrawl is nodejs module for the recursive crawling of single page applications (SPA) using javas...
Web Extension for saving a faithful copy of a complete web page in a single HTML file
A universal web-util for PHP.
This package is designed to bypass puppeteer's bot-detecting captchas such as Cloudflare. It acts...
A crawler implemented using a headless browser (Chrome).
The fastest web crawler written in Rust. Maintained by @a11ywatch.
Prerender your Single-Page Application. 📸
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In ...
🐕🦺 Simple utility to go to a URL and wait for the HTTP response
Distributed crawler powered by Headless Chrome
A Node.js Framework to imitate human internet browsing behavior on Chrome