databricks-sql-python

What's new

• Backported fix: remove cookie handling code (#379)

Full Changelog: https://github.com/databricks/databricks-sql-python/compare/v2.9.5...v2.9.6

What's Changed

• Fix cookie setting by @benc-db in https://github.com/databricks/databricks-sql-python/pull/379
• Fixing a couple type problems: how I would address most of #381 by @wyattscarpenter in https://github.com/databricks/databricks-sql-python/pull/382
• fix the return types of the classes' enter functions by @wyattscarpenter in https://github.com/databricks/databricks-sql-python/pull/384

New Contributors

• @wyattscarpenter made their first contribution in https://github.com/databricks/databricks-sql-python/pull/382

Full Changelog: https://github.com/databricks/databricks-sql-python/compare/v3.1.1...v3.1.2

What's Changed

• Backporting a fix to give a default retry-after on 429s/503s

What's Changed

• [PECO-1440] Expose current query id on cursor object by @kravets-levko in https://github.com/databricks/databricks-sql-python/pull/364
• Add a default for retry after by @benc-db in https://github.com/databricks/databricks-sql-python/pull/371
• Fix boolean literals by @aholyoke in https://github.com/databricks/databricks-sql-python/pull/357
• Don't retry network requests that fail with code 403 by @susodapop in https://github.com/databricks/databricks-sql-python/pull/373

New Contributors

• @kravets-levko made their first contribution in https://github.com/databricks/databricks-sql-python/pull/364
• @aholyoke made their first contribution in https://github.com/databricks/databricks-sql-python/pull/357

Full Changelog: https://github.com/databricks/databricks-sql-python/compare/v3.1.0...v3.1.1

What's Changed

Fix: Cloud fetch file download errors (https://github.com/databricks/databricks-sql-python/pull/356)
Fix: Redact the URL query parameters from the urllib3.connectionpool logs (https://github.com/databricks/databricks-sql-python/pull/341)

Full Changelog: https://github.com/databricks/databricks-sql-python/compare/v2.9.3...v2.9.4

What's Changed

• Support Databricks OAuth on GCP (#338)
• Support Databricks OAuth on Azure (#351)
• Revert retry-after behavior to be exponential backoff (#349)

What's Changed

• Fix: Cloud fetch file download errors (#356)
• Fix: Redact the URL query parameters from the urllib3.connectionpool logs (#341)

What's Changed

• Fix: Revised docstrings and examples for OAuth (#339)
• Fix: Redact the URL query parameters from the urllib3.connectionpool logs ((#341)

In this release:

SQLAlchemy dialect now supports table and column comments (thanks @cbornet!)
Fix: SQLAlchemy dialect now correctly reflects TINYINT types (thanks @TimTheinAtTabs!)
Fix: server_hostname URIs that included https:// would raise an exception
Other: pinned to pandas<=2.1 and urllib3>=1.26 to avoid runtime errors in dbt-databricks (#330)

In this release:

• Other: updated docstring comment about default parameterization approach (#287)
• Other: added tests for reading complex types and revised docstrings and type hints (#293)
• Fix: SQLAlchemy dialect raised DeprecationWarning due to dbapi classmethod (#294)
• Fix: SQLAlchemy dialect could not reflect TIMESTAMP_NTZ columns (#296)

You can now pip install databricks-sql-connector==3.0.0.

This release:

• Removes support for Python 3.7
• Adds support for native parameterized SQL queries. Requires DBR 14.2 and above. See here for more information.
• Includes our completely rewritten SQLAlchemy dialect:
  • Adds support for SQLAlchemy >= 2.0 and drops support for SQLAlchemy 1.x
  • Full e2e test coverage of all supported features
  • Detailed usage notes available here
  • Adds support for:
    • New types: TIME, TIMESTAMP, TIMESTAMP_NTZ, TINYINT
    • Numeric type scale and precision, like Numeric(10,2)
    • Reading and writing PrimaryKeyConstraint and ForeignKeyConstraint
    • Reading and writing composite keys
    • Reading and writing from views
    • Writing Identity to tables (i.e. autoincrementing primary keys)
    • LIMIT and OFFSET for paging through results
    • Caching metadata calls
• Enables cloud fetch by default. To disable, set use_cloud_fetch=False when building databricks.sql.client.
• Add integration tests for Databricks UC Volumes ingestion queries
• Retries:
  • Add _retry_max_redirects config
  • Set _enable_v3_retries=True and warn if users override it.
• Security: Bumps minimum pyarrow version to 14.0.1 (CVE-2023-47248)

In this release:

• Fix: Connections failed when urllib3~=1.0.0 is installed (#206)

⚠️ This release has been yanked from Pypi. See https://github.com/databricks/databricks-sql-python/pull/222 for details.

In this release:

• Other: Add examples/v3_retries_query_execute.py
• Other: suppress log message when _enable_v3_retries is not True
• Other: make this connector backwards compatible with urllib3>=1.0.0

⚠️ This release has been yanked from Pypi. See https://github.com/databricks/databricks-sql-python/pull/222 for details.

In this release:

• Other: Explicitly pin urllib3 to ^2.0.0

In this release:

• Replace retry handling with DatabricksRetryPolicy. This is disabled by default. To enable, set _enable_v3_retries=True when creating databricks.sql.client
• Other: Fix typo in README quick start example
• Other: Add autospec to Client mocks and tidy up make_request

This release includes the following changes:

• Add support for Cloud Fetch (#146, #151, #154)
• SQLAlchemy has_table function now honours schema= argument and adds catalog= argument (#174)
• SQLAlchemy set non_native_boolean_check_constraint False as it's not supported by Databricks (#120)
• Fix: Revised SQLAlchemy dialect and examples for compatibility with SQLAlchemy==1.3.x (#173)
• Fix: oauth would fail if expired credentials appeared in ~/.netrc (#122)
• Fix: Python HTTP proxies were broken after switch to urllib3 (#158)
• Other: remove unused import in SQLAlchemy dialect
• Other: Relax pandas dependency constraint to allow ^2.0.0 (#164)
• Other: Connector now logs operation handle guids as hexadecimal instead of bytes (#170)
• Other: test_socket_timeout_user_defined e2e test was broken (#144)

This minor version adds support for Azure OAuth and other fixes found in the CHANGELOG.

This release includes:

• Fix: Retry GetOperationStatus requests for http errors

This release patches our handling of HTTP connections which raised BadStatusLine errors in some cases.

This release incorporates support for HTTP 1.1 and a default socket timeout for thrift responses.

Note: support for proxies is un-tested in this release. Please report any problems with proxies via GitHub issues.