Simple and efficient java Tools for importing OSM (OpenStreetMap) datas in ESRI File Geodatabases, Avro and CSV
Patrice Freydiere - 2015 - 2016 - 2017
Yet An Other OSM Import Tools for OSM data - Change Log
This project aim to provide a simple command line for ingesting OSM Data in a GIS.
The output result are tables or featureclasses inside one or multiple output FileGeodatabase (ready to use in GIS software). CSV output files are also supported since 0.6 version, allowing to have a smooth BigData shift.
This tools is currently used on Windows (x64) and Linux (x64).
For performances or filtering capability, see architecture and doc folder
Windows / Linux friendly
A minimum of 5go of RAM is necessary for a first load
Nota : RAM is used for processing complete ways and polygons, if RAM is not available, subsequent input file read are going to be done and will lead to decrease performances.
A typical 32 Gb or RAM permit to handle France territory in a very nice timeframe. (please give us your benchmarks feedbacks and configurations). Special tuning could be done for an optimized process. (message regularisation limites, depending on the available memory).
The tool currenlty only support WGS84 coordinate system as the osm datas use this coordinate system and it is quite easy to reproject thoses in an other coordinate system afterward.
for huge integration (more than 1gb of PBF), or less that 2h country integration, consider using the osm-flink-tools
to preprocess the input file, this is MUCH FASTER. This is done for avro prepared files
test it :-), we got lots of fast feedback for planet extract / transforms.
Openstreet france provide OSM extracts at this location : http://download.openstreetmap.fr/extracts/
Prepared avro data files are available at this url : https://s3-eu-west-1.amazonaws.com/avroosm/index.html
Take a tour at 5 mins setup guide to launch your first command line.
Existing Scripts folder contains a bunch of existing scripts for already configured OSM transformation and filtering
If you want to go further and customize the scripts, see How to write Scripts. It explain how to customize or configure your scripts for your usage.
other documentations can be found in the doc folder
don't hesitate to send pull requests or comments.
Contributions are welcome on :