octosql

Changelog

• (Feature) OctoSQL now explicitly operates on int64 values, so integer operation results shouldn't be affected on 32-bit platforms. (#332) (Thanks @tjungblu!)

Changelog

• (Maintenance) Update Go dependecies (#324) (Thanks @jauderho!)
• (Maintenance) update badge url as per https://github.com/badges/shields/issues/8671 (#322) (Thanks @phanirithvij!)
• (Bugfix) Prevent creating ~/.octosql dir if XDG dirs exists (#316) (Thanks @Tony-Sol!)

Changelog

• (Feature) Add support for the XDG Spec (thanks @Tony-Sol for the contribution!).

Changelog

• (Feature) Change the semantics of double quotes from a string literal to a literal identifier (so they work the same way as backticks).
• (Bugfix) Fix division using slash as an operator. Require a space between operands for it to be usable.

Changelog

• (Feature) Improve CSV value formatting.
• (Feature) Add configuration parameters for JSON maximum line size as well as file reader buffer size.
• (Feature) Add boolean to int conversion function.
• (Performance) Hashing optimizations to reduce unnecessary allocations.

Changelog

• (Feature) Switch to using a hashmap instead of a BTree in some (not all yet) places where ordering is not important. This yields a small performance improvement for most group by queries, and a huge one (up to 4x measured) for groupings with a lot of keys.
• (Bug) Fix bug where variables only used by a distinct node can be optimized out, making the distinct node work improperly.

Changelog

• (Feature) Parallelize JSON processing. Can result in 2x+ performance improvements for queries bottlenecked by JSON parsing.
• (Stability) Improve error message when non-SELECT statement is used.

Contributions

• Improve installation documentation (#294). Thanks @arikgrahl !

Changelog

• Internal Refactors

Changelog

• (Bug) Fix object field access for fields that have periods in them. I.e. object->`my.field`

Changelog

• (Feature) Add overloads for len function handling lists, objects and tuples.
• (Feature) Improve automatic column naming based on variable names.
• (Stability) Improve stdin reader error handling.
• (Stability) Bump the number of schema introspection rows for the CSV datasource to 100, to keep it consistent with the JSON datasource.

Changelog

• (Feature) Make all file access consistent and available through the alternative <file_type>.<path> notation.
• (Bug) Fix --describe to display names without qualifiers, if there are no duplicates.

Changelog

• (feature) Allow querying from stdin (using stdin.<format> file name).
• (feature) Add support for the tsv format.
• (feature) Add file tailing support to the json and lines datasources, using the option file.json?tail=true.
• (feature) Don't print field name qualifiers in user-visible output.

Changelog

• (Feature) Print records live even if no watermarks are sent, as long as all records have zero event times.
• (Feature) Add object explosion operator.
• (Feature) Add shorthand flag for output format.
• (Feature) Rename ln to log. Add more snapshot test for functions.
• (Performance) Fix short-circuiting of outer LIMIT.
• (Performance) If no retractions are possible and we have an ORDER BY ... LIMIT ... clause, only store the top N records.
• (Performance) Use the generic implementation of google/btree for group by's.
• (Bug) Fix panic in docs datasource, when selecting no fields (i.e. COUNT(1) or COUNT(*)).

Changelog

• Add LEFT, RIGHT and OUTER joins.
• Rewrite ORDER BY and LIMIT handling, fixing multiple bugs and improving how they work in nested queries.

Changelog

• Add dual table.
• Add position function.

Changelog

• Flush logs on exit.

Changelog

• Fix batch order by with live_table output format resulting in panic.
• Fix bug in stream join on event timed streams dropping record buffer too early.
• Fix bug related to removing unused fields from filter nodes.
• Use btree PathHints for slightly improved performance.
• Improve performance of distinct by using a generic btree implementation.

Changelog

• Add purego build tag to fix Parquet datasource crash on amd64 systems without AVX2.

Changelog

• Add initial Parquet file support.
• Fix file extension table naming regression.
• Switch to generic btree for Stream Join.
• Add stream join optimization eliminating buffering of the bigger one of the two input tables.
• Introduce a faster and simpler GroupBy node for common and simple use cases. (Used automatically when possible.)
• Add time_to_unix function.
• Use faster library for JSON output.
• Add built-in profiling available behind the profile flag.

Changelog

• Switch to fastjson for JSON processing, resulting in a huge performance improvement when querying JSON files.
• Add lines datasource for analyzing arbitrary text files.
• Fix custom file extension handling for plugins.