C++ & Python API for Scientific I/O
LGPL-3.0 License
Bot releases are hidden (Show)
Published by ax3l over 1 year ago
Published by ax3l over 1 year ago
This release adds error recovery mechanisms, in order to access erroneous datasets, created e.g. by crashing simulations. The BP5 engine of ADIOS2 v2.9 is fully supported by this release, including access to its various features for more fine-grained control of memory usage. Various I/O performance improvements for HDF5 are activated by default. Runtime configuration of openPMD and its backends, e.g. selection of backends and compression, is now consistently done via JSON, and alternatively via TOML for better readability. The data storage/retrieval API now consistently supports all common C++ pointer types (raw and smart pointers), implementing automatic memory optimizations for ADIOS2 BP5 if using unique pointers.
The miminum required C++ version is now C++17. Supported Python versions add Python 3.10 and 3.11.
Thanks to Axel Huebl, Franz Poeschel, Jean Luc Bez, Junmin Gu, Bernhard Manfred Gruber, and Nils Schild for contributing to this release!
Published by ax3l over 2 years ago
This release improves reading back iterations that overflow the specified zero-pattern. ADIOS1, ADIOS2 and HDF5 backend stability and performance were improved. Python bindings got additional wheel platform support and various smaller issues were fixed.
Thanks to Axel Huebl, Franz Poeschel, and Jean Luca Bez for contributing to this release!
Published by ax3l over 2 years ago
This release fixes various read/parsing bugs and increases compatibility with upcoming versions of ADIOS and old releases of Intel icpc
. An installation issue for pip
-based installs from source in the last release was fixed and Python 3.10 support added. Various documentation and installation warnings have been fixed.
Thanks to Axel Huebl and Franz Poeschel for contributing to this release!
Published by ax3l almost 3 years ago
This release makes reads more robust by fixing small API, file-based parsing and test bugs. Building the library in C++14 and using it in C++17 will not result in incompatible ABIs anymore. HDF5 1.10.1+ performance was improved significantly.
Thanks to Axel Huebl, Franz Poeschel and Jean Luca Bez for contributing to this release!
Published by ax3l about 3 years ago
Published by ax3l about 3 years ago
Fix a regression with file handling for ADIOS2 when using explicit close logic, especially with interleaved writes to multiple iterations. Also fix an issue with ADIOS1 builds that potentially picked up headers from older, installed openPMD-api versions.
Thanks to Franz Poeschel and Axel Huebl for contributing to this release!
Published by ax3l about 3 years ago
This release adds support for resizable data sets. For data-processing, support for Dask (parallel) and Pandas (serial) are added and lazy reader parsing of iterations is now supported. ADIOS2 adds an experimental variable-based iteration encoding. An openPMD Series can now be flushed from non-Series objects and write buffers can be requested upfront to avoid unnecessary data copies in some situations.
Thanks to Axel Huebl, Franz Poeschel, Erik Schnetter, Junmin Gu, John Kirkham, and Dmitry Ganyushin for contributing to this release!
Published by ax3l over 3 years ago
Published by ax3l over 3 years ago
Published by ax3l over 3 years ago
Published by ax3l almost 4 years ago
Published by ax3l almost 4 years ago
This release adds first support for streaming I/O via ADIOS2's SST engine. More I/O benchmarks have been added with realistic application load patterns. Many Python properties for openPMD attributes have been modernized, with slight breaking changes in Iteration and Mesh data order. This release requires C++14 and adds support for Python 3.9. With this release, we leave the "alpha" phase of the software and declare "beta" status.
Thanks to Axel Huebl, Franz Poeschel, Junmin Gu, Richard Pausch, and Sergei Bastrakov for contributing to this release!
Published by ax3l about 4 years ago
This release adds data type support for complex numbers, allows to close iterations and adds first support for backend configuration options (via JSON), which are currently implemented for ADIOS2. Further installation options have been added (homebrew and CLI tool support with pip). New free standing functions and macro defines are provided for version checks.
Thanks to Axel Huebl, Franz Poeschel, and Lígia Diana Amorim for contributing to this release!
Published by ax3l over 4 years ago
Published by ax3l over 4 years ago
Published by ax3l almost 5 years ago
Published by ax3l almost 5 years ago
Published by ax3l almost 5 years ago
This releases improves the initial time spend when parsing data series with the ADIOS2 backend. Compile problems when using the CUDA NVCC compiler in downstream projects have been fixed. We adopted a Code of Conduct in openPMD.
Thanks to Axel Huebl, Franz Poeschel, William F. Godoy, Ligia Diana Amorim, and Remi Lehe for contributing to this release!