tablesaw

• Fix InstantColumnType.create
• Bump jackson-databind to pull in security fix

• InstantColumn support in Row and DataFrameJoiner
• Additional DataFrameReader parameter validation

• Add InstantColumn support to Relation

Features

• Add InstantColumn (https://github.com/jtablesaw/tablesaw/pull/518)
• More configurable column type detection (https://github.com/jtablesaw/tablesaw/pull/521)
• Added option for turning off html escaping in html table output
• Additional date parsing capabilities (https://github.com/jtablesaw/tablesaw/issues/506)

Fixes

• Fix for precision of 0 in JdbcResultSet (https://github.com/jtablesaw/tablesaw/pull/523)

Cleanup

• Remove circular dependency between reader packages and core package
• Remove unused epoch conversion methods (https://github.com/jtablesaw/tablesaw/pull/513)

• Implemented maxCharsPerColumn CSV parser setting
• Fix DateTimeParser issue
• Switch from reflections to classgraph
• Updated pebble version in jsplot

• Use header option in HtmlReader

• Fix HTMLReader when using InputStream
• Fix reading from URL when charset is specified

• Major improvements to HtmlWriter
• Fixed print(1)
• Added marker support for bar and histogram

• Improved interface for DataWriter

• Optional DataReader modules are now working

• Introduce ReaderRegistry and new DataFrameReader methods

Major features

• XLSX support (https://github.com/jtablesaw/tablesaw/pull/470). Thanks @hallvard
• New optional module structure, which was unfortunately broken (https://github.com/jtablesaw/tablesaw/pull/475)

Enhancements

• Implemented plot.ly's categoryOrder
• Support comment character in CSV files (https://github.com/jtablesaw/tablesaw/pull/483). Thanks @jmcgonegal
• Plot.ly template customization (#482). Thanks @hallvard
• Configure shade plugin to create OSGi bundles (https://github.com/jtablesaw/tablesaw/pull/481). Thanks @hallvard

Bug fixes

• Fixed stepWithRows

Development

• Upgrade to junit 5 (https://github.com/jtablesaw/tablesaw/pull/476)

• Fat columns returned from file readers by default
• Fixed-width file support (Thanks @Sparow199)
• Improved marker support
• Support for custom color bars on scatter charts with scaled colors
• Additional table creation validation
• Fixed numeric to string conversion

• Adds ability to read and write JSON data

• Fix for NullPointerException in Table.read().csv()
• Fix for marker color
• Minor join performance improvements
• Fix for Windows line ending issues
• Fix for reading SQL result set
• Allow pie charts to take floating points
• Fixed sorting in TimeSeriesPlot

• Tweaks to CSV sampling
• Fix isMissing for StringColumn and TextColumn. Thanks @armarti

• Improved Smile integration
• Pivot table functionality
• Bug fix for conversion from Hive bigInt
• SQL number type mapping. Thanks @gregorco
• Bug fix for unique()
• Improved null handling for StringColumn
• SQL Date support

With this release we wanted to strike a balance between making the implementation and maintenance of the library more approachable, reducing memory usage, and providing powerful operations.

We provide non-double numeric column types so that data can be held in memory in a less memory-intensive manner. All computations return DoubleColumn. The alternative would be supporting every pair-wise type of numeric, which would quickly make the library too difficult to contribute to and maintain. The user can convert DoubleColumn to less memory intensive column types like IntColumn as they choose to reduce in-memory overhead for large tables. For small tables, users may be comfortable keeping all columns as DoubleColumn.

Other improvements include:

• Improvements to Smile machine learning integration
• Additional CSV parsing options
• Bug fixes

Thanks to @hallvard, @Ebalaitung, @jln-ho, @gregorco for contributing to this release

• Switched to Univocity library for CSV handling

• Fixed generics warnings
• CSV read performance enhancement