NutchPigHive

crawl GooglePlay data with Nutch, ETL with Pig, analyze with Hive

Stars

Ecosystems: Java

Statistics for this project are still being loaded, please check back later.

Apache Nutch is an extensible and scalable web crawler

HiBench is a big data benchmark suite.

Mirror of Apache Pig

Simplified version of a common crawl fetcher

Easy to use lightweight web crawler（易用的轻量化网络爬虫）

Code Library for My Blog

DataX集成可视化页面，选择数据源即可一键生成数据同步任务，支持RDBMS、Hive、HBase、ClickHouse、MongoDB等数据源，批量创建RDBMS数据同步任务，集成开源调度系统...

一个简单、敏捷、分布式的支持SpringBoot的Java爬虫框架;An agile, distributed crawler framework.

ehviewer，用爱发电，快乐前行

🔥🔥🔥 A read-only ORM focusing on advanced query, naturally supports joined tables, and avoids DTO/...

Katta - distributed Lucene