crawler

A Website Crawler Implementation written in PHP. High extendible, Indexes PDFs and is very memory efficient.

MIT License

Downloads
19.7K
Stars
10
Committers
2