Bot releases are visible (Hide)
Published by github-actions[bot] about 1 month ago
Stream
overload for non file-based operations.Decode
methods to returning the actual destination length, by @artnim in #543.[ParquetIgnore]
is supported in addition to [JsonIgnore]
for class properties. This is useful when you want to ignore a property in Parquet serialization but not in JSON serialization. Thanks to @rhvieira1980 in #411.FileMerger
utility which can merge multiple parquet files into a single file by either merging files or actual data together.TimeSpan
support in ParquetSerializer
by @cliedeman in #409.DataFrame
support for int16/uint16
types by @asmirnov82 in #469.ParquetReader
is now easier to use in LINQ expressions thanks to @danielearwicker in #509.Published by github-actions[bot] 7 months ago
Published by github-actions[bot] 9 months ago
Fixed regression in schema discovery of nullables for DateTime
, DateOnly
, TimeOnly
.
Published by github-actions[bot] 9 months ago
Fixed regression in schema discovery of nullable decimal
data types. Thanks to @stefer in #465 for investigating and reporting this.
Published by github-actions[bot] 9 months ago
FIXED_LEN_BYTE_ARRAY
generated by Python in #463 thanks to @AndrewDavidLees by @aloneguid.Published by github-actions[bot] 9 months ago
Published by github-actions[bot] 9 months ago
ParquetToFlatTableConverter
to simplify conversion of parquet files to flat data destinations.DateOnly
and TimeOnly
deserialization was failing due to schema validation errors (#395).TimeOnly
nullability wasn't respected.[ParquetTimestamp]
, [ParquetMicroSecondsTime]
or [ParquetDecimal]
were ignored for nullable class properties (408).Published by github-actions[bot] 9 months ago
Published by github-actions[bot] 10 months ago
ParquetSerializer
DeserializeAsync
overloads accepting local file path (#379)DataFrameReader
did not handle files with multiple row groups (#365)byte[]
columns are left-aligned.Published by github-actions[bot] 10 months ago
NetBox
was exposing some internal types (#451)Parquet Floor (reference implementation of desktop viewer) user interface improvements.
Published by github-actions[bot] 10 months ago
Support Writing Int64 timestamp MICROS unit (#362).
Cross-platform desktop app called Floor is published as a part of this release.
Published by github-actions[bot] 10 months ago
Looking forward to your thoughts!
Published by github-actions[bot] 10 months ago
Critical bug fix: reverting #423 as it introducing some side effects that prevent from generating correct files.
Published by github-actions[bot] 10 months ago
This is the next stability improvements release, and a big thanks to everyone who contributed! Without you this project would not be possible.
Please don't forget to star this project on GitHub if you like it, this helps the project grow and motivates the fellow contributors to keep contributing!
.NET 8
by @aloneguid.DataFrameMapper
returns incompatible DataFrameColumn
by @aloneguid (#343).Published by github-actions[bot] 11 months ago
This is a community bugfix release. As a maintainer I have only approved PRs raised by this wonderful community. Thanks everyone, and keep doing what you do.
RowGroupReader
s by @ddrinka in #423/#422.ParquetSerializer
doesn't support different JsonPropertyName
and ClrPropertyName
on struct fields by @mrinal-thomas in #410.ParquetSerializer
can sometimes fail when populating _typeToAssembler
cache in parallel by @scottfavre in #420/#411.Published by github-actions[bot] about 1 year ago
Class serializer was writing map key as optional (#396). Schema reflector for class serializer now emits non-nullable keys.
Validation for maps keys in schema was also added.
Published by github-actions[bot] about 1 year ago
Delta encoding can be optionally turned off (thanks to @itayfisz for suggestion in #392).
Published by github-actions[bot] about 1 year ago
Critical Bug Fix in DELTA_BINARY_PACKED Decoding: Adding first value to destination array before reading the block, by @ee-naveen in #391.
Published by github-actions[bot] about 1 year ago