Breaking changes

• Now relative paths are used as repository_id instead of folder name

Bugfixes

• rule: fix squash rule with convert_dates
• cmd/server/commands: use relative path as id instead of last part (#816)
• handle backslashes correctly

New features

• function: implement is_vendor function (#830)

Bugfixes

• vendor: upgrade go-mysql-server

Known issues

• After updating Vitess MySQL server, we are having some problems connecting from JDBC MariaDB drivers (https://github.com/src-d/gitbase/issues/807) (https://github.com/vitessio/vitess/issues/4603)

Breaking changes

• COUNT expression is returning now int64 instead of int32
• uast_extract function now returns a JSON for pos instead of a custom format

Bugfixes

• sql/plan: make sure outdated indexes can be dropped
• sql/analyzer: correctly qualify aliases with the same name as col
• Fix validation rule to detect tuples in projections or groupbys (https://github.com/src-d/go-mysql-server/pull/672)
• sql/analyzer: only check aliases to qualify in the topmost project (https://github.com/src-d/go-mysql-server/pull/690)
• Fix special case for aggregation in ORDER BY
• Try to order by function (https://github.com/src-d/go-mysql-server/pull/692)
• Don't skip repositories for remotes table with more than 1 URL https://github.com/src-d/gitbase/pull/789
• server: correctly set binary charset on blob fields
• sql/parse: allow qualified table names on SHOW CREATE TABLE
• plan: types in lowercase on SHOW CREATE TABLE
• Skip a directory if gitbase has no permission to read it https://github.com/src-d/gitbase/pull/738
• Close iterators correctly to avoid too many open files error https://github.com/src-d/gitbase/pull/772
• Check projection aliases when assigned to index https://github.com/src-d/go-mysql-server/issues/639
• Add charset to fields to avoid invalid column types when using JDBC clients https://github.com/src-d/go-mysql-server/pull/637
• Fix prune columns for describe queries https://github.com/src-d/go-mysql-server/pull/634
• Allow all expressions in grouping, resolve order by expressions https://github.com/src-d/go-mysql-server/pull/633
• KILL query always takes processlist_id https://github.com/src-d/go-mysql-server/pull/636
• Recover panic for partitions https://github.com/src-d/go-mysql-server/pull/626

New features

• Suggest table/column/indexes names on missing errors
• sql: HAVING clause
• Support SHOW SCHEMAS (upgrade vitess to v1.6.0) (https://github.com/src-d/go-mysql-server/pull/696)
• function: LOC function implementation (#798)
• sql/expression: new DATE function
• sql: add support for intervals, DATE_SUB and DATE_ADD
• sql: from_base64 and to_base64 functions
• sql: add SLEEP function
• COUNT expression now returns an int64 number instead of int32 https://github.com/src-d/go-mysql-server/issues/642
• Dockerfile: include zero-config MySQL client https://github.com/src-d/gitbase/pull/737
• uast_extract function now returns a JSON for pos instead of a custom format https://github.com/src-d/gitbase/pull/715

Documentation

• Now all relevant go-mysql-server documentation is directly accessible from gitbase docs instead of pointing to external links.
• Docs: document in-memory joins in optimization docs https://github.com/src-d/gitbase/pull/742

Performance improvements

• Make mapping per partition on Index creation, improving performance (https://github.com/src-d/go-mysql-server/pull/681).
• sql/index/pilosa: parallelize index creation
• Perf: improve the way we check if refs are not pointing to commits https://github.com/src-d/gitbase/pull/780
• Plan: compute all inner joins in memory if they fit https://github.com/src-d/go-mysql-server/issues/577
• Perf: Avoid call to Checksum if there are no indexes https://github.com/src-d/go-mysql-server/pull/631

Known issues

• After updating Vitess MySQL server, we are having some problems connecting from JDBC MariaDB drivers (https://github.com/src-d/gitbase/issues/807) (https://github.com/vitessio/vitess/issues/4603)

Bugfixes

• sql/plan: make sure outdated indexes can be dropped
• sql/analyzer: correctly qualify aliases with the same name as col
• Fix validation rule to detect tuples in projections or groupbys (https://github.com/src-d/go-mysql-server/pull/672)
• sql/analyzer: only check aliases to qualify in the topmost project (https://github.com/src-d/go-mysql-server/pull/690)
• Fix special case for aggregation in ORDER BY
• Try to order by function (https://github.com/src-d/go-mysql-server/pull/692)

New features

• Suggest table/column/indexes names on missing errors
• sql: HAVING clause
• Support SHOW SCHEMAS (upgrade vitess to v1.6.0) (https://github.com/src-d/go-mysql-server/pull/696)
• function: LOC function implementation (#798)

Performance improvements

• Make mapping per partition on Index creation, improving performance (https://github.com/src-d/go-mysql-server/pull/681).

Known issues

• Index creation is abnormally slow. We are working to improve that.

Bugfixes

• Don't skip repositories for remotes table with more than 1 URL https://github.com/src-d/gitbase/pull/789
• server: correctly set binary charset on blob fields
• sql/parse: allow qualified table names on SHOW CREATE TABLE
• plan: types in lowercase on SHOW CREATE TABLE

New features

• sql/expression: new DATE function
• sql: add support for intervals, DATE_SUB and DATE_ADD
• sql: from_base64 and to_base64 functions
• sql: add SLEEP function

Documentation

• Now all relevant go-mysql-server documentation is directly accessible from gitbase docs instead of pointing to external links.

Performance improvements

• sql/index/pilosa: parallelize index creation

Bugfixing

• Set correct version: https://github.com/src-d/gitbase/pull/786

Breaking changes

• COUNT expression is returning now int64 instead of int32
• uast_extract function now returns a JSON for pos instead of a custom format

Bugfixes

• Skip a directory if gitbase has no permission to read it https://github.com/src-d/gitbase/pull/738
• Close iterators correctly to avoid too many open files error https://github.com/src-d/gitbase/pull/772
• Check projection aliases when assigned to index https://github.com/src-d/go-mysql-server/issues/639
• Add charset to fields to avoid invalid column types when using JDBC clients https://github.com/src-d/go-mysql-server/pull/637
• Fix prune columns for describe queries https://github.com/src-d/go-mysql-server/pull/634
• Allow all expressions in grouping, resolve order by expressions https://github.com/src-d/go-mysql-server/pull/633
• KILL query always takes processlist_id https://github.com/src-d/go-mysql-server/pull/636
• Recover panic for partitions https://github.com/src-d/go-mysql-server/pull/626

New features

• COUNT expression now returns an int64 number instead of int32 https://github.com/src-d/go-mysql-server/issues/642
• Dockerfile: include zero-config MySQL client https://github.com/src-d/gitbase/pull/737
• uast_extract function now returns a JSON for pos instead of a custom format https://github.com/src-d/gitbase/pull/715

Documentation

• Docs: document in-memory joins in optimization docs https://github.com/src-d/gitbase/pull/742

Performance improvements

• Perf: improve the way we check if refs are not pointing to commits https://github.com/src-d/gitbase/pull/780
• Plan: compute all inner joins in memory if they fit https://github.com/src-d/go-mysql-server/issues/577
• Perf: Avoid call to Checksum if there are no indexes https://github.com/src-d/go-mysql-server/pull/631

Breaking changes

• The way commits are iterated now changed. The new functionality is similar to git log --all command. It is ~3 times faster, but we are ignoring orphan commits (as git does).
• 0.18.0 indexes are not compatible with this new version.

Bugfixes

• Fix KILL QUERY command
• Regression bug: Panic on go-git cache https://github.com/src-d/gitbase/pull/711
• Fix checksum on indexes https://github.com/src-d/go-mysql-server/issues/612
• SHOW WARNINGS doesn't clean warnings from one query to another https://github.com/src-d/go-mysql-server/issues/600
• REGEXP invalid patterns doesn't break now https://github.com/src-d/go-mysql-server/issues/606
• Improved function parameter errors https://github.com/src-d/go-mysql-server/issues/591
• Problem combining some OR filters with AND filters in non-squashed tables.
• Solved a problem causing subqueries to cancel the main query.

New features

• Update Bblfsh and Enry dependencies https://github.com/src-d/gitbase/pull/707
• cli: add --log-level option
• Adds a new optional feature behind EXPERIMENTAL_IN_MEMORY_JOIN environment variable to activate in-memory inner joins, which are faster but less memory efficient.
• Index checksum. If the index does not match the previous checksum, they're not used. That is, if the repositories changed. NOTE: indexes created prior to this version will not work.
• e2e tests against built binary.

Documentation

• Add security section

Performance improvements

• Perf: Traverse commit history instead of reading the packfile

Bugfixing

• Fix KILL QUERY command

Bugfixing

• Regression bug: Panic on go-git cache https://github.com/src-d/gitbase/pull/711

New features

• Update Bblfsh and Enry dependencies https://github.com/src-d/gitbase/pull/707

Documentation

• Add security section

Breaking changes

• The way commits are iterated now changed. The new functionality is similar to git log --all command. It is ~3 times faster, but we are ignoring orphan commits (as git does).

Performance improvements

• Perf: Traverse commit history instead of reading the packfile

Bugfixing

• Fix checksum on indexes https://github.com/src-d/go-mysql-server/issues/612
• SHOW WARNINGS doesn't clean warnings from one query to another https://github.com/src-d/go-mysql-server/issues/600
• REGEXP invalid patterns doesn't break now https://github.com/src-d/go-mysql-server/issues/606
• Improved function parameter errors https://github.com/src-d/go-mysql-server/issues/591

New features

• cli: add --log-level option
• Adds a new optional feature behind EXPERIMENTAL_IN_MEMORY_JOIN environment variable to activate in-memory inner joins, which are faster but less memory efficient.

Do not use this release, it's an experimental release

New features

• Adds a new optional feature behind EXPERIMENTAL_IN_MEMORY_JOIN environment variable to activate in-memory inner joins, which are faster but less memory efficient.

Bugfixes

• Problem combining some OR filters with AND filters in non-squashed tables.

New features

• Index checksum. If the index does not match the previous checksum, they're not used. That is, if the repositories changed. NOTE: indexes created prior to this version will not work.
• e2e tests against built binary.

Bugfixes

• Solved a problem causing subqueries to cancel the main query.

Bugfixing

• Replace one regex by pool of regex matchers to avoid panics on machines with a lot of cores.
• *: fix query cancellation
• Fix uast_extract panic.
• Add explicit error when ON clause is missed on JOIN
• Add error for subqueries as expressions (not supported)
• Fix on filtered lookups using pilosa in
• server: make gitbase the current database (#593)
• sql/(plan, parse): fix show table status behavior
• SQL: process list now shows client addres

New features

• Show pushed down properties to tables in explain
• Initialize global open tracing
• multi-stage docker file
• add warns to session on uast functions
• function: implement NOW function
• Follow symlinks on repository loading phase
• IFNULL function
• NULLIF function
• MID and SUBSTR functions
• TRIM, LTRIM, RTRIM functions
• REVERSE, REPEAT, REPLACE functions
• Upgrade MySQL + tableau support + auth interface.
• function: make max bblfsh blob size configurable
• *: make UAST functions fail on connection errors
• function: log bblfsh errors on UAST instead of returning them
• add information_schema db.
• cli/server: use new auth interface
• Add Trim, Ltrim, Rtrim
• sql: add information_schema.schemata table
• RPAD, LPAD
• Add WarningCount to sql.Session interface
• Add support for information_schema.columns
• sql, function: add weekday and dayofweek
• Implement DATABASE() function.
• sql, function: add concat_ws
• Add support for DEFAULT
• sql: collect warnings and errors in the session
• sql: function, added soundex
• Add ln, log, log2, log10
• sql/(parse,expression): implement unary minus
• sql: support more timestamp formats
• Implement group by index
• feature: Power and Sqrt
• modify uast functions and session to make use of bblfsh/client-go.v3
• sql/(parse,expression): implement unary minus
• sql: support more timestamp formats
• sql: implement SHOW CREATE DATABASE statement
• *: implement LOCK and UNLOCK of tables
• *: add information_schema db with files and column_statistics tables
• function: add CONNECTION_ID UDF
• function: implement JSON_EXTRACT UDF
• sql: expression: function: Add CEIL, CEILING, FLOOR
• sql: expression: function: Add ROUND()
• sql: plan: Add SHOW CREATE TABLE
• Implementation of COALESCE function.
• sql: implement SHOW FIELDS statement
• sql: implement LIKE expression
• sql: expression: function: Add LOWER, UPPER
• sql/parse: strip comments from queries

Performance improvements

• Remove duplicate filters in squashed ref_commits
• Do not iterate all references in squashed ref_commits
• Update go-git version to 4.8.1
• analyzer: add rule to prune unnecessary columns
• Update Dockerfile to reduce image size
• sql/analyzer: add rule to avoid unnecessary casts
• update to [email protected]
• sql: add timing info to span traces

Documentation

• Upgrade bblfshd version in docs.
• docs: add explanation about using explain to assess performance issues
• docs: add example of how to use show processlist
• examples: added repository_ids in non-natural joins
• docs: add missing supported expressions
• docs: reflect changes introduced by UAST v2 in the documentation
• docs: add supported clients

Bugfixing

• Fix uast_extract panic.
• Add explicit error when ON clause is missed on JOIN
• Add error for subqueries as expressions (not supported)
• Fix on filtered lookups using pilosa indexes.

New features

• Follow symlinks on repository loading phase
• IFNULL function
• NULLIF function
• MID and SUBSTR functions
• TRIM, LTRIM, RTRIM functions
• REVERSE, REPEAT, REPLACE functions

Bugfixing

• server: make gitbase the current database (#593)
• sql/(plan, parse): fix show table status behavior
• SQL: process list now shows client address

New features

• Upgrade MySQL + tableau support + auth interface.
• function: make max bblfsh blob size configurable
• *: make UAST functions fail on connection errors
• function: log bblfsh errors on UAST instead of returning them
• add information_schema db.
• cli/server: use new auth interface
• Add Trim, Ltrim, Rtrim
• sql: add information_schema.schemata table
• RPAD, LPAD
• Add WarningCount to sql.Session interface
• Add support for information_schema.columns
• sql, function: add weekday and dayofweek
• Implement DATABASE() function.
• sql, function: add concat_ws
• Add support for DEFAULT
• sql: collect warnings and errors in the session
• sql: function, added soundex
• Add ln, log, log2, log10
• sql/(parse,expression): implement unary minus
• sql: support more timestamp formats
• Implement group by index
• feature: Power and Sqrt

Performance improvements

• Update Dockerfile to reduce image size
• sql/analyzer: add rule to avoid unnecessary casts
• update to [email protected]

Documentation

• docs: add example of how to use show processlist
• examples: added repository_ids in non-natural joins
• docs: add missing supported expressions

Breaking changes

• Old queries using UAST functions might not be compatible after upgrade bblfsh to latest v3 client version. Some Xpath queries changed.

New features

• modify uast functions and session to make use of bblfsh/client-go.v3
• sql/(parse,expression): implement unary minus
• sql: support more timestamp formats
• sql: implement SHOW CREATE DATABASE statement
• *: implement LOCK and UNLOCK of tables
• *: add information_schema db with files and column_statistics tables
• function: add CONNECTION_ID UDF
• function: implement JSON_EXTRACT UDF
• sql: expression: function: Add CEIL, CEILING, FLOOR
• sql: expression: function: Add ROUND()
• sql: plan: Add SHOW CREATE TABLE
• Implementation of COALESCE function.
• sql: implement SHOW FIELDS statement
• sql: implement LIKE expression
• sql: expression: function: Add LOWER, UPPER
• sql/parse: strip comments from queries

Performance improvements

• sql: add timing info to span traces

Documentation

• docs: reflect changes introduced by UAST v2 in the documentation
• docs: add supported clients

Bugfixing

• Fix error using indexes