crawlerr

A simple and fully customizable web crawler/spider for Node.js with server-side DOM. Comes with elegant and hell-simple APIs.

MIT License

Downloads
15
Stars
25
View Code on GitHub Visit Website
Ecosystems: Node.js
Package Rankings
Top 14.0% on Npmjs.org
Badges
Extracted from project README
Greenkeeper badge Build Status License npm version npm downloads
Related Projects
node-http-server-tools

Some wrappers around the standard node:http API

31 Aug 2024 0
http-proxy-middleware

The one-liner node.js http-proxy middleware for connect, express, next.js and more

14 Mar 2015 10,722
jsdom

A JavaScript implementation of various web standards, for use with Node.js

19 Jan 2010 19,941
body-parser

Node.js body parsing middleware

06 Jan 2014 5,435
websight

🕷A simple but *really* fast crawler built with Node.js & TypeScript

14 Jul 2019 18
spiderable-middleware

🤖 Prerendering for JavaScript powered websites. Great solution for PWAs (Progressive Web Apps), S...

12 Mar 2016 34
axios

Promise based HTTP client for the browser and node.js

18 Aug 2014 104,005
node-crawler

Web Crawler/Spider for NodeJS + server-side jQuery ;-)

25 Nov 2010 6,629
article-extractor

To extract main article from given URL with Node.js

29 Nov 2015 1,570