Apache Atlas (incubating) Overview
Apache Atlas framework is an extensible set of core foundational governance services – enabling enterprises to effectively and efficiently meet their compliance requirements within Hadoop and allows integration with the whole enterprise data ecosystem.
This will provide true visibility in Hadoop by using both a prescriptive and forensic model, along with technical and operational audit as well as lineage enriched by business taxonomical metadata. It also enables any metadata consumer to work inter-operably without discrete interfaces to each other -- the metadata store is common.
The metadata veracity is maintained by leveraging Apache Ranger to prevent non-authorized access paths to data at runtime. Security is both role based (RBAC) and attribute based (ABAC).
Apache Atlas is an effort undergoing incubation at the Apache Software Foundation (ASF), sponsored by the Apache Incubator PMC.
For more information about the incubation status of the Apache Atlas project you can go to the following page: http://incubator.apache.org/projects/atlas.html
Get Atlas sources to your local directory, for example with following commands $ cd $ git clone https://github.com/apache/incubator-atlas.git $ cd incubator-atlas
$ git checkout
$ git checkout tags/
Execute the following commands to build Apache Atlas
$ export MAVEN_OPTS="-Xms2g -Xmx2g -XX:MaxPermSize=512M" $ mvn clean install
$ mvn clean -DskipTests install
$ mvn clean package -Pdist
After above build commands successfully complete, you should see the following files
webapp/target/atlas-webapp-.war addons/falcon-bridge/target/falcon-bridge-.jar addons/hive-bridge/target/hive-bridge-.jar addons/sqoop-bridge/target/sqoop-bridge-.jar addons/storm-bridge/target/storm-bridge-.jar