parquet-dotnet

Fully managed Apache Parquet implementation

MIT License

Stars
596
Committers
100

Bot releases are visible (Hide)

parquet-dotnet - https://github.com/aloneguid/parquet-dotnet/releases/tag/3.7.6

Published by aloneguid over 4 years ago

Changes:

  • #58: Dictionary nulls multi page fix
  • #57: Reading dictionary-encoded string columns with null values from multi-page parquet files yields misaligned data

This list of changes was auto generated.

parquet-dotnet - https://github.com/aloneguid/parquet-dotnet/releases/tag/3.7.5

Published by aloneguid over 4 years ago

parquet-dotnet - https://github.com/aloneguid/parquet-dotnet/releases/tag/3.7.4

Published by aloneguid over 4 years ago

Changes:

  • #48: Parquet.Net Version 3.6.0 assembly not signed with a strong name

This list of changes was auto generated.

parquet-dotnet -

Published by aloneguid over 4 years ago

  • Fixes Snappy encoding issues #53 #56.
  • Snappy write speeds are up to x40 times faster comparing to v3.6.x

Huge thanks to @skyyearxp for amazing work on Snappy!

parquet-dotnet -

Published by aloneguid over 4 years ago

Changes:

  • #21: New SNAPPY Implementation

This list of changes was auto generated.

parquet-dotnet -

Published by aloneguid over 4 years ago

Changes:

  • e0fd30ca16e25f724104535c29d6f549dd538e93 Fix issue with reading and writing table with empty list field of structs (#50)
  • 92a1d3c130f5c377cdd46e2064cbae8018ffe795 Update writing.md
  • ee76e8babca9d0dce58e34b9842166cbbe614ee5 16 integer serialization (#45)
  • b6ee39ef3d60b68818ac20c11140bc6e48c16bba Added public static IEnumerable<T[]> DeserializeGroups(Stream inpu… (#44)
  • b125f1f423e16046ff55de9c02f30c2a185fccb8 Fix issue with repetition levels when having nested lists in a table (#43)
  • b755350969217cd92305a5426a0ba9e7b14e6d99 Fix parsing of Decimal types

This list of changes was auto generated.

parquet-dotnet - https://github.com/aloneguid/parquet-dotnet/releases/tag/3.6.0

Published by aloneguid over 4 years ago

Changes:

  • a9c87c4cd1f014777556ec6b03e3b4a2717881f5 ParquetConvert.Serialize supports [ParquetIgnore] attribute (ability to ignore properties) (#31)
  • 901ccc05cc586d80ceeaef50b5e4abf04e17f6db Updated documentation for prerelease feeds. (#33)
  • 23d302346c17888bb87a621d18af91317a2ebc82 ParquetConvert.Deserialize can deserialise part of the file by row group index (#32) [ #27 ]
  • 67a78ed24c7b71a55e427bc6b4651fb329f92864 bug fixed: [ParquetColumn] was totally ignored on deserialization (#30)
  • 9d72bad1258f7b4ae8a3eb1b585ca4a2b6317718 Mac build agent is working again
  • 536010962d05ca869ed70adc96872055741d7a76 Support for legacy list schema with single repeated field (#22)
  • 4bf6905e7fb90cf31fba18dbd3079e9040d97894 parq tool supports CSV output (#19)

This list of changes was auto generated.

parquet-dotnet - https://github.com/aloneguid/parquet-dotnet/releases/tag/3.5.3

Published by aloneguid almost 5 years ago

Changes:

  • 057451b376fa7d3581f2d1801fb0965afbeaa0c2 add support for reading and writing custom metadata (#17)

This list of changes was auto generated.

parquet-dotnet - https://github.com/aloneguid/parquet-dotnet/releases/tag/3.5.2

Published by aloneguid almost 5 years ago

Changes:

  • b34d3f3af0b07f4b52a7d43659d39f2677f47a52 bug fixed: string statistics was including byte prefix (#14)

This list of changes was auto generated.

parquet-dotnet - https://github.com/aloneguid/parquet-dotnet/releases/tag/3.5.1

Published by aloneguid almost 5 years ago

Changes:

  • 8139c37d3ec5a34718726b730ee7579f2934ac93 Local time offset was lost when writing DateTimeOffset in non UTC format (#13)

This list of changes was auto generated.

parquet-dotnet - https://github.com/aloneguid/parquet-dotnet/releases/tag/3.5.0

Published by aloneguid almost 5 years ago

Changes:

  • 5d0db454e5277c834f4cd061679bc9c0ce9ea225 support calculating column statistics for basic types(#8)
  • 90685974fecc921f3d1bdb77bd3be0a7c8fd780f do not push release packages to internal feed
  • 40b238dc92b505078523da5f836317f0c859290f all builds (PR, develop) push packages to internal feed
  • 68d801c565f30b23a7f4dd44de2c9366a6237d8d updated readme.md to enable sponsorship options
  • 1df9f20423db493cc1af16ea3ab1aa72449ff169 Create FUNDING.yml
  • 60e454520eae7f7945bea471b0e9cb888c09cae9 branch rules
  • 8b598ed6355c247ac00ae3b25728ee5a109a8f19 create develop branch

This list of changes was auto generated.

parquet-dotnet - https://github.com/aloneguid/parquet-dotnet/releases/tag/3.4.3

Published by aloneguid almost 5 years ago

Changes:

  • ddeceee9608b1a8e53995f996fc8e3d03d8de5f0 enable github releases
  • 13a66bc7d880e1fbd7f6a5972362b604632304de oops mac agent doesnt' support .net core 3
  • 7f38e62ed30b5b4504b6f1ff214eea14f132dc33 update to latest thrift spec (#7)
  • 1271f5386c1a6eb11587962941a2be3469a40b4e fix null bug
  • f2eabd5a7c1f844b64d72137e34de6784850048e netcoreapp 3.1 is not yet supported by azure pipelines
  • 6b5dfe2323bb75776e41201029b463b70d044928 csproj typo
  • 6f8ff9a11a8b58681dce1cba9074b7fb834a52eb kill parquet.cli.test
  • 1a3ddb834411facf4d3499551bfa97aade0c11ae support more target frameworks (#6)
  • a383b467045bd707fdb4cb4fe20dd0115c9ca346 remove unsupported parquet-cli commands (#4)
  • bd0047bed561e60eba1a90e558c606a2bff5365d upgrading to the latest parquet specs

This list of changes was auto generated.

parquet-dotnet - 3.4.2

Published by aloneguid almost 5 years ago

when using gzip compression, you can specify compression level