CC-News-Tools

Tools relating to the CC-News-En Collection

Stars
18
View Code on GitHub
Ecosystems: Java

Issue Statistics

Past Year

All Time

Total Pull Requests
0
3
Merged Pull Requests
0
1
Total Issues
0
4
Time to Close Issues
N/A
about 2 months
Related Projects
SimpleCommonCrawlExtractor

Simple wrapper around IIPC Web Commons to take a literal warc.gz and extract standalone binaries

21 Jul 2015 4
commoncrawl-fetcher-lite

Simplified version of a common crawl fetcher

17 Mar 2023 9
CommonCrawlDocumentDownload

A small tool which uses the CommonCrawl URL Index to download documents with certain file types o...

22 Apr 2015 62
IndexTextCollect

Indexing TREC corpora and Wikipedia using Lucene

17 Dec 2013 11