nessie

Nessie: Transactional Catalog for Data Lakes with Git-like semantics

APACHE-2.0 License

Downloads
3.9K
Stars
824
Committers
57
View Code on GitHub Visit Website View on X
Ecosystems: Apache Spark, Git, Java

Bot releases are visible (Hide)

nessie - Nessie 0.77.1

Published by github-actions[bot] 8 months ago

Nessie 0.77.1 release

Try it

The attached nessie-quarkus-0.77.1-runner.jar is a standalone uber-jar file that runs on Java 17 or newer and it is also available via Maven Central. Download and run it (requires Java 17):

wget https://github.com/projectnessie/nessie/releases/download/nessie-0.77.1/nessie-quarkus-0.77.1-runner.jar
java -jar nessie-quarkus-0.77.1-runner.jar

Nessie GC tool is attached as nessie-gc-0.77.1, which is an executable.
(chmod 744 nessie-gc-0.77.1 after download.)
Can also be run using java -jar nessie-gc-0.77.1, because it is actually a Java archive.
Shell completion can be generated from the nessie-gc tool.
Nessie GC tool is also available as a Docker image:
docker run --rm ghcr.io/projectnessie/nessie-gc:0.77.1 --help.

The attached nessie-helm-0.77.1.tgz is a packaged Helm chart, which can be downloaded and installed via Helm.
There is also the Nessie Helm chart repo, which can be added and used to install the Nessie Helm chart.

Changelog

Highlights

  • The Nessie GC tool is now published as a Docker image. See the GC Tool documentation
    page     for more.
  • Remove synchronizing to docker.io container registry, only publish to ghcr.io and quay.io.

Upgrade notes

  • Projectnessie no longer publishes container images to docker.io/Docker Hub. Container images are
    available from ghcr.io and quay.io.

New Features

  • Add some configuration checks to highlight probably production issues
  • Publish Docker images for the GC tool

Changes

  • Disable default OIDC tenant when authentication is disabled
  • Disable OpenTelemetry SDK when no endpoint is defined

Fixes

  • Fix VersionStore panels of the Grafana dashboard

Full Changelog (minus renovate commits):

  • Fix release-publishing (#8069)
nessie - Nessie 0.76.6

Published by github-actions[bot] 9 months ago

Nessie 0.76.6 release

Try it

The attached nessie-quarkus-0.76.6-runner.jar is a standalone uber-jar file that runs on Java 17 or newer and it is also available via Maven Central. Download and run it (requires Java 17):

wget https://github.com/projectnessie/nessie/releases/download/nessie-0.76.6/nessie-quarkus-0.76.6-runner.jar
java -jar nessie-quarkus-0.76.6-runner.jar

Nessie GC tool is attached as nessie-gc-0.76.6, which is an executable.
(chmod 744 nessie-gc-0.76.6 after download.)
Can also be run using java -jar nessie-gc-0.76.6, because it is actually a Java archive.
Shell completion can be generated from the nessie-gc tool.

The attached nessie-helm-0.76.6.tgz is a packaged Helm chart, which can be downloaded and installed via Helm.
There is also the Nessie Helm chart repo, which can be added and used to install the Nessie Helm chart.

Changelog

Changes

  • Nessie Docker images now contain Java 21
  • Helm: Make ingressClassName configurable
  • Helm: Use auto scaling
  • Improve error message when JDBC/C* columns are missing

Full Changelog (minus renovate commits):

  • Bump Spark 3.3 from 3.3.3 to 3.3.4 (#7990)
  • Ninja: update CHANGELOG
  • Helm chart: use autoscaling/v2 (#7982)
  • Make ingressClassName configurable (#7979)
  • Coordinated Tasks: make service-impl CDI-friendly (#7974)
  • Use Java 21 in published Docker images (#7973)
  • Coordinated Tasks (#7947)
  • Build: add some more javac linting (#7965)
  • nessie-events-quarkus: remove deprecation warnings (#7964)
  • Bump Spark 3.4 from 3.4.1 to 3.4.2 (#7963)
  • Improve error message when JDBC/C* columns are missing (#7961)
  • Bump logback-classic from 1.2.12 to 1.2.13 (#7962)
nessie - Nessie 0.76.3

Published by github-actions[bot] 9 months ago

Nessie 0.76.3 release

Try it

The attached nessie-quarkus-0.76.3-runner.jar is a standalone uber-jar file that runs on Java 17 or newer and it is also available via Maven Central. Download and run it (requires Java 17):

wget https://github.com/projectnessie/nessie/releases/download/nessie-0.76.3/nessie-quarkus-0.76.3-runner.jar
java -jar nessie-quarkus-0.76.3-runner.jar

Nessie GC tool is attached as nessie-gc-0.76.3, which is an executable.
(chmod 744 nessie-gc-0.76.3 after download.)
Can also be run using java -jar nessie-gc-0.76.3, because it is actually a Java archive.
Shell completion can be generated from the nessie-gc tool.

The attached nessie-helm-0.76.3.tgz is a packaged Helm chart, which can be downloaded and installed via Helm.
There is also the Nessie Helm chart repo, which can be added and used to install the Nessie Helm chart.

Changelog

Highlights

  • The Nessie client supports two new authentication flows when using OAuth 2 authentication:
    the Authorization Code flow and the Device Code flow. These flows are well suited for use within
    a command line program, such as a Spark SQL shell, where a user is interacting with Nessie using a
    terminal. In these flows, the user must use their web browser to authenticate with the identity
    provider. See the
    Nessie documentation
    for details. The two new flows are enabled by the following new grant types:
    • authorization_code: enables the Authorization Code flow; this flow can only be used with
      a local shell session running on the user's machine.
    • device_code: enables the Device Code flow; this flow can be used with either a local or a
      remote shell session.
  • The Nessie client now supports endpoint discovery when using OAuth 2 authentication. If an
    identity provider supports the OpenID Connect Discovery mechanism, the Nessie client can be
    configured to use it to discover the OAuth 2 endpoints. See the
    Nessie documentation
    for details.

Upgrade notes

  • Some storage backends will require a schema upgrade:
    • JDBC: the following SQL statement must be executed on the Nessie database (please adapt the
      statement to the actual database SQL dialect): 
      ALTER TABLE objs 
  ADD COLUMN obj_vers VARCHAR;
      You may drop the no longer needed x_class column.
    • Cassandra: the following CQL statement must be executed on the Nessie database and keyspace: 
      ALTER TABLE <keyspace>.objs 
  ADD obj_vers text;
      You may drop the no longer needed x_class column.

New Features

  • Nessie client: the OAUTH2 authentication provider now supports programmatic configuration. See the
    Nessie documentation for details.

Fixes

  • Fix potential NPE when fetching commit log with fetch option ALL and access checks enabled.

Full Changelog (minus renovate commits):

  • Fix URL endpoint for injected NessieApi from OldNessieServer (#7958)
  • Improve test coverage in ProtoSerialization (#7943)
  • Use fluent ObjIdHasher (#7957)
  • Mention JAVA_TOOL_OPTIONS in the docs (#7952)
  • Fix "unlimited" behavior flexible cache (#7949)
  • remove unused jersey-test-framework-provider dependencies (#7946)
  • Persist: Conditional deletes + updates (#7932)
  • Fix RockDB config properties (#7942)
  • Shrink heap footprint of ObjIdGeneric (#7934)
  • Caching behavior per object type (#7931)
  • HttpClient: ability to define per-request authentication (#7928)
nessie - Nessie 0.76.2

Published by github-actions[bot] 9 months ago

Nessie 0.76.2 release

Try it

The attached nessie-quarkus-0.76.2-runner.jar is a standalone uber-jar file that runs on Java 17 or newer and it is also available via Maven Central. Download and run it (requires Java 17):

wget https://github.com/projectnessie/nessie/releases/download/nessie-0.76.2/nessie-quarkus-0.76.2-runner.jar
java -jar nessie-quarkus-0.76.2-runner.jar

Nessie GC tool is attached as nessie-gc-0.76.2, which is an executable.
(chmod 744 nessie-gc-0.76.2 after download.)
Can also be run using java -jar nessie-gc-0.76.2, because it is actually a Java archive.
Shell completion can be generated from the nessie-gc tool.

The attached nessie-helm-0.76.2.tgz is a packaged Helm chart, which can be downloaded and installed via Helm.
There is also the Nessie Helm chart repo, which can be added and used to install the Nessie Helm chart.

Changelog

Highlights

  • The Nessie client supports two new authentication flows when using OAuth 2 authentication:
    the Authorization Code flow and the Device Code flow. These flows are well suited for use within
    a command line program, such as a Spark SQL shell, where a user is interacting with Nessie using a
    terminal. In these flows, the user must use their web browser to authenticate with the identity
    provider. See the
    Nessie documentation
    for details. The two new flows are enabled by the following new grant types:
    • authorization_code: enables the Authorization Code flow; this flow can only be used with
      a local shell session running on the user's machine.
    • device_code: enables the Device Code flow; this flow can be used with either a local or a
      remote shell session.
  • The Nessie client now supports endpoint discovery when using OAuth 2 authentication. If an
    identity provider supports the OpenID Connect Discovery mechanism, the Nessie client can be
    configured to use it to discover the OAuth 2 endpoints. See the
    Nessie documentation
    for details.

New Features

  • Nessie client: the OAUTH2 authentication provider now supports programmatic configuration. See the
    Nessie documentation for details.

Fixes

  • Fix potential NPE when fetching commit log with fetch option ALL and access checks enabled.

Full Changelog (minus renovate commits):

  • fix free-disk-space action (#7937)
  • Nit: let OAuth2Client use switch for enum (#7933)
  • Adapt OAuth2Client to per-request base URIs (#7925)
nessie - Nessie 0.76.1

Published by github-actions[bot] 9 months ago

Nessie 0.76.1 release

Try it

The attached nessie-quarkus-0.76.1-runner.jar is a standalone uber-jar file that runs on Java 17 or newer and it is also available via Maven Central. Download and run it (requires Java 17):

wget https://github.com/projectnessie/nessie/releases/download/nessie-0.76.1/nessie-quarkus-0.76.1-runner.jar
java -jar nessie-quarkus-0.76.1-runner.jar

Nessie GC tool is attached as nessie-gc-0.76.1, which is an executable.
(chmod 744 nessie-gc-0.76.1 after download.)
Can also be run using java -jar nessie-gc-0.76.1, because it is actually a Java archive.
Shell completion can be generated from the nessie-gc tool.

The attached nessie-helm-0.76.1.tgz is a packaged Helm chart, which can be downloaded and installed via Helm.
There is also the Nessie Helm chart repo, which can be added and used to install the Nessie Helm chart.

Changelog

Highlights

  • The Nessie client supports two new authentication flows when using OAuth 2 authentication:
    the Authorization Code flow and the Device Code flow. These flows are well suited for use within
    a command line program, such as a Spark SQL shell, where a user is interacting with Nessie using a
    terminal. In these flows, the user must use their web browser to authenticate with the identity
    provider. See the
    Nessie documentation
    for details. The two new flows are enabled by the following new grant types:
    • authorization_code: enables the Authorization Code flow; this flow can only be used with
      a local shell session running on the user's machine.
    • device_code: enables the Device Code flow; this flow can be used with either a local or a
      remote shell session.
  • The Nessie client now supports endpoint discovery when using OAuth 2 authentication. If an
    identity provider supports the OpenID Connect Discovery mechanism, the Nessie client can be
    configured to use it to discover the OAuth 2 endpoints. See the
    Nessie documentation
    for details.

New Features

  • Nessie client: the OAUTH2 authentication provider now supports programmatic configuration. See the
    Nessie documentation for details.

Fixes

  • Fix potential NPE when fetching commit log with fetch option ALL and access checks enabled.

Full Changelog (minus renovate commits):

  • Allow per-request base URIs in HttpClient (#7922)
  • Compile services and SPI for java 8 (#7924)
  • Fix Device Code flow tests with Java 21 (#7920)
  • Custom obj types should not persist class name (#7915)
  • Site: Fix TOC in client_config.md (#7906)
  • Nit: remove mention of "Hive" on project web site (#7905)
nessie - Nessie 0.76.0

Published by github-actions[bot] 10 months ago

Nessie 0.76.0 release

Try it

The attached nessie-quarkus-0.76.0-runner.jar is a standalone uber-jar file that runs on Java 17 or newer and it is also available via Maven Central. Download and run it (requires Java 17):

wget https://github.com/projectnessie/nessie/releases/download/nessie-0.76.0/nessie-quarkus-0.76.0-runner.jar
java -jar nessie-quarkus-0.76.0-runner.jar

Nessie GC tool is attached as nessie-gc-0.76.0, which is an executable.
(chmod 744 nessie-gc-0.76.0 after download.)
Can also be run using java -jar nessie-gc-0.76.0, because it is actually a Java archive.
Shell completion can be generated from the nessie-gc tool.

The attached nessie-helm-0.76.0.tgz is a packaged Helm chart, which can be downloaded and installed via Helm.
There is also the Nessie Helm chart repo, which can be added and used to install the Nessie Helm chart.

Changelog

Highlights

  • The Nessie client supports two new authentication flows when using OAuth 2 authentication:
    the Authorization Code flow and the Device Code flow. These flows are well suited for use within
    a command line program, such as a Spark SQL shell, where a user is interacting with Nessie using a
    terminal. In these flows, the user must use their web browser to authenticate with the identity
    provider. See the
    Nessie documentation
    for details. The two new flows are enabled by the following new grant types:
    • authorization_code: enables the Authorization Code flow; this flow can only be used with
      a local shell session running on the user's machine.
    • device_code: enables the Device Code flow; this flow can be used with either a local or a
      remote shell session.
  • The Nessie client now supports endpoint discovery when using OAuth 2 authentication. If an
    identity provider supports the OpenID Connect Discovery mechanism, the Nessie client can be
    configured to use it to discover the OAuth 2 endpoints. See the
    Nessie documentation
    for details.

New Features

  • Nessie client: the OAUTH2 authentication provider now supports programmatic configuration. See the
    Nessie documentation for details.

Fixes

  • Fix potential NPE when fetching commit log with fetch option ALL and access checks enabled.

Full Changelog (minus renovate commits):

  • Revert "Add detach-history command to the ContentGenerator tool (#7867)" (#7907)
  • Add Quarkus tests for the OAuth2 Device Code flow (#7900)
  • OAuth2 client: support for Device Code Flow (#7899)
  • OAuth2 client: programmatic creation of OAuth2Authenticator (#7894)
  • OAuth2 client: support endpoint discovery (#7884)
  • HttpClient: properly close resources (#7898)
  • Persist: simplify JsonObj (#7866)
  • Add documentation page for repository migration (#7895)
  • Quarkus CLI: minor cleanup after #6890 (#7896)
  • Fix Helm CI tests (#7893)
  • Nessie Client: support for Authorization Code grant (#7872)
  • Fix NPE when fetching commit log with access checks enabled. (#7886)
  • Add detach-history command to the ContentGenerator tool (#7867)
nessie - Nessie 0.75.0

Published by github-actions[bot] 10 months ago

Nessie 0.75.0 release

Try it

The attached nessie-quarkus-0.75.0-runner.jar is a standalone uber-jar file that runs on Java 17 or newer and it is also available via Maven Central. Download and run it (requires Java 17):

wget https://github.com/projectnessie/nessie/releases/download/nessie-0.75.0/nessie-quarkus-0.75.0-runner.jar
java -jar nessie-quarkus-0.75.0-runner.jar

Nessie GC tool is attached as nessie-gc-0.75.0, which is an executable.
(chmod 744 nessie-gc-0.75.0 after download.)
Can also be run using java -jar nessie-gc-0.75.0, because it is actually a Java archive.
Shell completion can be generated from the nessie-gc tool.

The attached nessie-helm-0.75.0.tgz is a packaged Helm chart, which can be downloaded and installed via Helm.
There is also the Nessie Helm chart repo, which can be added and used to install the Nessie Helm chart.

Changelog

Upgrade notes

  • Nessie Quarkus parts are now built against Java 17 and Java 17 is required to run Nessie Quarkus Server directly.
    If you use the Docker image, nothing needs to be done, because the image already contains a compatible Java runtime.
  • Due to the introduction of new object types in the storage layer, some storage backends
    will require a schema upgrade:
    • JDBC: the following SQL statement must be executed on the Nessie database (please adapt the
      statement to the actual database SQL dialect): 
      ALTER TABLE objs 
  ADD COLUMN x_class VARCHAR,
  ADD COLUMN x_data BYTEA,
  ADD COLUMN x_compress VARCHAR,
  ADD COLUMN u_space VARCHAR,
  ADD COLUMN u_value BYTEA;
    • Cassandra: the following CQL statement must be executed on the Nessie database and keyspace: 
      ALTER TABLE <keyspace>.objs 
  ADD x_class text, 
  ADD x_data blob,
  ADD x_compress text,
  ADD u_space text,
  ADD u_value blob;
  • When using one of the legacy and deprecated version-store implementations based on "database adapter",
    make sure to migrate to the new storage model before upgrading to this version or newer Nessie
    versions.

Breaking changes

  • The deprecated version-store implementations based on "database datapter" have been removed from the
    code base.

Full Changelog (minus renovate commits):

  • Quarkus ITs: Remove LoggerFinder error log message (#7862)
  • Quarkus-tests: do not log OIDC connection + tracing warnings (#7860)
  • Let OAuth2 errors not lot stack traces (#7859)
  • stop testing spark-extensions 3.2 on iceberg main (#7863)
  • Fix Quarkus warning @Inject on private field (#7857)
  • Use / as the resteasy base path in Quarkus (#7854)
  • Extract reusable REST related functionality (#7838)
  • Move authN/Z code to separate module (#7851)
  • Make DiffParams work with resteasy-reactive (#7846)
  • Make server-side components use only Jakarta EE (#7837)
  • Remove dependency-resolution workaround for guava/listenablefuture (#7841)
  • renovate: reduce awssdk update frequency (#7840)
  • Helm chart: remove mentions of legacy storage types (#7830)
  • Persist: simplify serialization of custom objects (#7832)
  • Ignore Obj.type() when using Smile serialization (#7828)
  • Fix "older Jackson versions" tests in :nessie-client (#7820)
  • Expose HttpClient from NessieApi when available (#7808)
  • Expose request-URI in HttpResponse (#7807)
  • Build: remove no longer needed reflection-config-plugin (#7800)
  • Nit: Remove unsed Quarkus config options (#7799)
  • Remove unused @RegisterForReflection annotations (#7797)
  • Remove invalid @Startup annotation (#7796)
  • Ensure that content IDs are unique in a Nessie repository (#7757)
  • Remove database adapter code (#6890)
  • Persist/custom objects: allow compression (#7795)
  • CassandraPersist: minor code cleanup (#7793)
  • Extensible object types (#7771)
  • Require Java 17 for the build, prepare for Quarkus 3.7 (#7783)
  • Update issue templates (#7787)
  • CI: Add concurrency to CI-Mac/Win + newer-Java workflows (#7785)
  • GH WF: Remove no-longer existing images to remove (#7784)
  • Move ObjIdSerializer.java to test scope (#7782)
  • Add LABELs to Dockerfile-jvm (#7775)
  • ClientSideGetMultipleNamespaces: push some predicates down to the server (#7758)
nessie - Nessie 0.74.0

Published by github-actions[bot] 11 months ago

Nessie 0.74.0 release

Try it

The attached nessie-quarkus-0.74.0-runner.jar is a standalone uber-jar file that runs on Java 11 or newer and it is also available via Maven Central. Download and run it (requires Java 11):

wget https://github.com/projectnessie/nessie/releases/download/nessie-0.74.0/nessie-quarkus-0.74.0-runner.jar
java -jar nessie-quarkus-0.74.0-runner.jar

Nessie GC tool is attached as nessie-gc-0.74.0, which is an executable.
(chmod 744 nessie-gc-0.74.0 after download.)
Can also be run using java -jar nessie-gc-0.74.0, because it is actually a Java archive.
Shell completion can be generated from the nessie-gc tool.

The attached nessie-helm-0.74.0.tgz is a packaged Helm chart, which can be downloaded and installed via Helm.
There is also the Nessie Helm chart repo, which can be added and used to install the Nessie Helm chart.

Changelog

New Features

  • Nessie-GC: Support Google Cloud Storage (GCS) (experimental)
  • Nessie-GC: Support Azure Blob Storage (experimental)

Fixes

  • Add namespace validation for rename operation.
  • Namespace validation now correctly reports only one conflict when deleting a namespace that has
    children, whereas previously it reported one conflict for each child.

Full Changelog (minus renovate commits):

  • Fix wrong cache capacity unit in NessiePersistCache (#7746)
  • Persist: enforce that null array elements are legal (#7741)
  • BigTable: set QUALIFIER_OBJ_TYPE cell when upserting (#7731)
  • Fix Nesqueit after #7715 (#7722)
  • Renovate: only add one label (#7720)
  • Nessie-GC: Support Azure Blob Storage (experimental) (#7715)
  • Minor doc enhancements around authentication providers (#7710)
  • Nessie-GC: Support Google Cloud Storage (GCS) (experimental) (#7709)
  • Report a single conflict when deleting a namespace with many children (#7704)
  • Add nessie-client-testextension to nessie-bom (#7703)
  • Fix Maven-Central search URL in release notes (#7696)
  • Align opentelemetry-alpha version (#7694)
  • Fix snapshot publishing (#7692)
  • Add namespace validation for rename operation (#7650)
  • fix JUnit Jupiter references (#7690)
  • DynamoDB: fix wrong error message when key schema invalid (#7685)
  • OAuth2Client: improve stack traces and reduce log frequency (#7678)
  • ITOAuth2Client: improve shutdown sequence (#7676)
  • ITOAuth2Client: use less aggressive token lifespans (#7675)
nessie - Nessie 0.73.0

Published by github-actions[bot] 12 months ago

Nessie 0.73.0 release

Try it

The attached nessie-quarkus-0.73.0-runner.jar is a standalone uber-jar file that runs on Java 11 or newer and it is also available via Maven Central. Download and run it (requires Java 11):

wget https://github.com/projectnessie/nessie/releases/download/nessie-0.73.0/nessie-quarkus-0.73.0-runner.jar
java -jar nessie-quarkus-0.73.0-runner.jar

Nessie GC tool is attached as nessie-gc-0.73.0, which is an executable.
(chmod 744 nessie-gc-0.73.0 after download.)
Can also be run using java -jar nessie-gc-0.73.0, because it is actually a Java archive.
Shell completion can be generated from the nessie-gc tool.

The attached nessie-helm-0.73.0.tgz is a packaged Helm chart, which can be downloaded and installed via Helm.
There is also the Nessie Helm chart repo, which can be added and used to install the Nessie Helm chart.

Changelog

Highlights

  • Nessie API spec was upgraded to 2.1.3. The only change is that when a commit attempts to create a content
    inside a non-existing namespace, the server will not only return a NAMESPACE_ABSENT conflict for the
    non-existing namespace itself, but will also return additional NAMESPACE_ABSENT conflicts for all the
    non-existing ancestor namespaces.

New Features

  • Nessie client: the OAuth2 authentication provider is now able to recover from transient failures when
    refreshing the access token.

Full Changelog (minus renovate commits):

  • Update CHANGELOG.md (#7674)
  • Expose full set of Bigtable retry settings in BigTableClientsConfig (#7672)
  • Report all missing namespaces at once (#7671)
  • OAuth2Client: implement fault tolerance (#7669)
  • Make Conflict.conflictType non nullable (#7667)
  • OAuth2Client: forbid recursive calls to renewTokens() (#7663)
nessie - Nessie 0.72.4

Published by github-actions[bot] 12 months ago

Nessie 0.72.4 release

Try it

The attached nessie-quarkus-0.72.4-runner.jar is a standalone uber-jar file that runs on Java 11 or newer and it is also available via Maven Central. Download and run it (requires Java 11):

wget https://github.com/projectnessie/nessie/releases/download/nessie-0.72.4/nessie-quarkus-0.72.4-runner.jar
java -jar nessie-quarkus-0.72.4-runner.jar

Nessie GC tool is attached as nessie-gc-0.72.4, which is an executable.
(chmod 744 nessie-gc-0.72.4 after download.)
Can also be run using java -jar nessie-gc-0.72.4, because it is actually a Java archive.
Shell completion can be generated from the nessie-gc tool.

The attached nessie-helm-0.72.4.tgz is a packaged Helm chart, which can be downloaded and installed via Helm.
There is also the Nessie Helm chart repo, which can be added and used to install the Nessie Helm chart.

Changelog

Fixes

  • Docker images again honor environment variables such as JAVA_OPTS_APPEND that are used to pass
    additional JVM options to the Nessie server. See the
    ubi8/openjdk-17
    base image documentation for the list of all supported environment variables.

Full Changelog (minus renovate commits):

  • Docker: re-enable JAVA_OPTS_APPEND env var (#7659)
  • Relax CacheSizing validation rules. (#7660)
  • OAuth2Client: propagate scheduling failures when calling authenticate() (#7656)
  • Remove commit-meta property containing the merge-parent commit-ID (#7646)
  • Enhance released jars (#7651)
nessie - Nessie 0.72.2

Published by github-actions[bot] almost 1 year ago

Nessie 0.72.2 release

Try it

The attached nessie-quarkus-0.72.2-runner.jar is a standalone uber-jar file that runs on Java 11 or newer and it is also available via Maven Central. Download and run it (requires Java 11):

wget https://github.com/projectnessie/nessie/releases/download/nessie-0.72.2/nessie-quarkus-0.72.2-runner.jar
java -jar nessie-quarkus-0.72.2-runner.jar

Nessie GC tool is attached as nessie-gc-0.72.2, which is an executable.
(chmod 744 nessie-gc-0.72.2 after download.)
Can also be run using java -jar nessie-gc-0.72.2, because it is actually a Java archive.
Shell completion can be generated from the nessie-gc tool.

The attached nessie-helm-0.72.2.tgz is a packaged Helm chart, which can be downloaded and installed via Helm.
There is also the Nessie Helm chart repo, which can be added and used to install the Nessie Helm chart.

Changelog

New Features

  • Exposes object cache metrics, meters use the tags application="Nessie",cache="nessie-objects"

Fixes

  • Fix incorrectly calculated object cache maximum weight.

Full Changelog (minus renovate commits):

  • Expose object cache metrics (#7643)
  • Cleanup: remove dependency on immutables-value-fixtures (#7644)
nessie - Nessie 0.72.1

Published by github-actions[bot] about 1 year ago

Nessie 0.72.1 release

Try it

The attached nessie-quarkus-0.72.1-runner.jar is a standalone uber-jar file that runs on Java 11 or newer and it is also available via Maven Central. Download and run it (requires Java 11):

wget https://github.com/projectnessie/nessie/releases/download/nessie-0.72.1/nessie-quarkus-0.72.1-runner.jar
java -jar nessie-quarkus-0.72.1-runner.jar

Nessie GC tool is attached as nessie-gc-0.72.1, which is an executable.
(chmod 744 nessie-gc-0.72.1 after download.)
Can also be run using java -jar nessie-gc-0.72.1, because it is actually a Java archive.
Shell completion can be generated from the nessie-gc tool.

The attached nessie-helm-0.72.1.tgz is a packaged Helm chart, which can be downloaded and installed via Helm.
There is also the Nessie Helm chart repo, which can be added and used to install the Nessie Helm chart.

Changelog

New Features

  • Spark SQL extensions now support the DROP ... IF EXISTS syntax for branches and tags.
  • table-prefix configuration option added to DynamoDB version store.
  • Ability to export repositories in V1 format. This is useful for migrating repositories to older
    Nessie servers that do not support the new storage model.
  • Added support for Spark 3.5, removed support for Spark 3.1 - along with the version bump of Apache Iceberg to 1.4.0.
  • Functionality that records current-HEAD changes of named references and APIs to expose the information.
    This is useful to recover from a scenario when a "primary data center/region/zone" has been lost and
    replication of a distributed database has been interrupted.

Changes

  • Introduces sizing of the Nessie object cache using a relative value of the max Java heap size.
    The defaults have been changed to 70% of the Java max heap size (from the previous default of 64MB).
    If a fixed cache size setting has been explicitly configured, consider to change it to the fraction based one.
  • Relative hashes are now supported in table references, thus allowing SQL queries to specify a relative hash
    in the FROM clause, e.g. FROM table1@main#1234^1.
  • BigTable backend: ability to disable telemetry (which is enabled by default).
  • Spark SQL extensions use Nessie API V2 now.
  • DynamoDB backend now supports table prefixes.
  • Advanced configuration options for BigTable backend.

Fixes

  • Quarkus 3.4.3 includes a Netty version bump to address CVE-2023-44487 (HTTP/2 rapid reset). Note: Nessie uses undertow only for testing purposes, so the undertow release used in Nessie does not expose this CVE to users.

Full Changelog (minus renovate commits):

  • Set OAuth2Client idle when Nessie client is idle (#7626)
  • BigTable: simplify configuration of clients (#7639)
  • Allow Bigtable RPC retries (#7636)
  • Update undertow to 2.2.28.Final (#7616)
  • Site: some maintenance (#7634)
  • SQL+Cassandra: add new refs columns to schema check (#7631)
  • CI/Publish: Mitigate Gradle's annoying CME bug and GH's HTTP/502 (#7625)
nessie - Nessie 0.72.0

Published by github-actions[bot] about 1 year ago

Nessie 0.72.0 release

Try it

The attached nessie-quarkus-0.72.0-runner.jar is a standalone uber-jar file that runs on Java 11 or newer and it is also available via Maven Central. Download and run it (requires Java 11):

wget https://github.com/projectnessie/nessie/releases/download/nessie-0.72.0/nessie-quarkus-0.72.0-runner.jar
java -jar nessie-quarkus-0.72.0-runner.jar

Nessie GC tool is attached as nessie-gc-0.72.0, which is an executable.
(chmod 744 nessie-gc-0.72.0 after download.)
Can also be run using java -jar nessie-gc-0.72.0, because it is actually a Java archive.
Shell completion can be generated from the nessie-gc tool.

The attached nessie-helm-0.72.0.tgz is a packaged Helm chart, which can be downloaded and installed via Helm.
There is also the Nessie Helm chart repo, which can be added and used to install the Nessie Helm chart.

Changelog

New Features

  • Spark SQL extensions now support the DROP ... IF EXISTS syntax for branches and tags.
  • table-prefix configuration option added to DynamoDB version store.
  • Ability to export repositories in V1 format. This is useful for migrating repositories to older
    Nessie servers that do not support the new storage model.
  • Added support for Spark 3.5, removed support for Spark 3.1 - along with the version bump of Apache Iceberg to 1.4.0.
  • Functionality that records current-HEAD changes of named references and APIs to expose the information.
    This is useful to recover from a scenario when a "primary data center/region/zone" has been lost and
    replication of a distributed database has been interrupted.

Upgrade notes

  • When using a Postgres (compatible) database, ensure that the new column prev_ptr of type BYTEA exists in the refs table
  • When using a Cassandra (compatible) database, ensure that the new column pref_ptr of type BLOB exists in the refs table

Changes

  • Introduces sizing of the Nessie object cache using a relative value of the max Java heap size.
    The defaults have been changed to 70% of the Java max heap size (from the previous default of 64MB).
    If a fixed cache size setting has been explicitly configured, consider to change it to the fraction based one.
  • Relative hashes are now supported in table references, thus allowing SQL queries to specify a relative hash
    in the FROM clause, e.g. FROM table1@main#1234^1.
  • BigTable backend: ability to disable telemetry (which is enabled by default).
  • Spark SQL extensions use Nessie API V2 now.
  • DynamoDB backend now supports table prefixes.
  • Advanced configuration options for BigTable backend.

Fixes

  • Quarkus 3.4.3 includes a Netty version bump to address CVE-2023-44487 (HTTP/2 rapid reset). Note: Nessie uses undertow only for testing purposes, so the undertow release used in Nessie does not expose this CVE to users.

Full Changelog (minus renovate commits):

  • Record previous HEADs of named references (#7607)
  • Ninja: Changelog note wrt CVE-2023-44487, fixed via Quarkus 3.4.3
  • Remove OTel workaround for tests (#7623)
  • Nit: replace TODO with comment (#7624)
  • CI/NesQuEIT: Switch Iceberg master->main (#7618)
  • CI: Use Java 21 in "newer java versions" workflow (#7525)
  • Workaround to run events-service tests with Java 21 (#7617)
  • Tag all Nessie multi-environment tests (#7577)
  • BigTable: reimplement scanAllObjects with server-side filtering (#7610)
  • Spark 3.1 left-overs (#7612)
  • Ninja: Changelog updates
  • IntelliJ: Generate required classes (#7611)
  • Update SQL extensions code to use API V2 (#7573)
  • Bump Iceberg to 1.4.0, support Spark 3.5 (#7539)
  • BigTable backend: ability to disable telemetry (#7597)
  • Cassandra backend: remove ALLOW FILTERING when fetching objects (#7604)
  • Ability to export repositories in V1 format (#7596)
  • Add option for table prefix to DynamoDB (#7598)
  • SQL extensions: add support for DROP IF EXISTS (#7570)
  • Fix docs on website (#7559)
  • Allow relative hashes in table references (#7565)
  • CI: Remove Spark 3.1 from NesQuEIT job (removed in Iceberg 1.4) (#7564)
  • Cleanup: explicitly annotate ignoreUnknown for types that allow this (#7561)
  • BigTable: custom channel-pool settings, make retry-timeout configurable (#7552)
  • Add client-based test for request parameter validation (#7557)
  • Fix Nessie java client groupId in docs (#7554)
  • Docs: Update Metadata authorization (#7553)
  • Remove unused type parameter in BigTablePersist.doBulkFetch (#7551)
  • Store-cache: allow cache sizing based on max-heap-size (#7540)
  • Configure BigTable client to use MAX_BULK_READS (#7548)
  • BigTable: Use parallel reads for some objects to fetch (#7547)
  • Combined Nessie server+client for testing (#7527)
  • GH actions - allow fork of Nessie in projectnessie (#7529)
  • Bump Spark to 3.3.3/3.4.1 (#7538)
  • Bump Scala 2.13 to 2.13.12 (#7537)
  • CI/NesQuEIT: Change temp branch back to "normal" (#7534)
  • Build: allow Spark/Java configuration for JavaExec as well (#7531)
nessie - Nessie 0.71.1

Published by github-actions[bot] about 1 year ago

Nessie 0.71.1 release

Try it

The attached nessie-quarkus-0.71.1-runner.jar is a standalone uber-jar file that runs on Java 11 or newer and it is also available via Maven Central. Download and run it (requires Java 11):

wget https://github.com/projectnessie/nessie/releases/download/nessie-0.71.1/nessie-quarkus-0.71.1-runner.jar
java -jar nessie-quarkus-0.71.1-runner.jar

Nessie GC tool is attached as nessie-gc-0.71.1, which is an executable.
(chmod 744 nessie-gc-0.71.1 after download.)
Can also be run using java -jar nessie-gc-0.71.1, because it is actually a Java archive.
Shell completion can be generated from the nessie-gc tool.

The attached nessie-helm-0.71.1.tgz is a packaged Helm chart, which can be downloaded and installed via Helm.
There is also the Nessie Helm chart repo, which can be added and used to install the Nessie Helm chart.

Changelog

Changes

  • Configuration of the NessieClientBuilder now uses system properties, environment, ~/.config/nessie/nessie-client.properties and ~/.env

Deprecations

  • HttpClientBuilder class has been deprecated for removal, use NessieClientBuilder instead.

Full Changelog (minus renovate commits):

  • Ninja: Fix release-create WF
nessie - Nessie 0.71.0

Published by github-actions[bot] about 1 year ago

Nessie 0.71.0 release

Try it

The attached nessie-quarkus-0.71.0-runner.jar is a standalone uber-jar file that runs on Java 11 or newer and it is also available via Maven Central. Download and run it (requires Java 11):

wget https://github.com/projectnessie/nessie/releases/download/nessie-0.71.0/nessie-quarkus-0.71.0-runner.jar
java -jar nessie-quarkus-0.71.0-runner.jar

Nessie GC tool is attached as nessie-gc-0.71.0, which is an executable.
(chmod 744 nessie-gc-0.71.0 after download.)
Can also be run using java -jar nessie-gc-0.71.0, because it is actually a Java archive.
Shell completion can be generated from the nessie-gc tool.

The attached nessie-helm-0.71.0.tgz is a packaged Helm chart, which can be downloaded and installed via Helm.
There is also the Nessie Helm chart repo, which can be added and used to install the Nessie Helm chart.

Changelog

Changes

  • Configuration of the NessieClientBuilder now uses system properties, environment, ~/.config/nessie/nessie-client.properties and ~/.env

Deprecations

  • HttpClientBuilder class has been deprecated for removal, use NessieClientBuilder instead.

Full Changelog (minus renovate commits):

  • Ninja: changelog
  • Cleanup nessie-client (#7516)
nessie - Nessie 0.70.3

Published by github-actions[bot] about 1 year ago

Nessie 0.70.3 release

Try it

The attached nessie-quarkus-0.70.3-runner.jar is a standalone uber-jar file that runs on Java 11 or newer and it is also available via Maven Central. Download and run it (requires Java 11):

wget https://github.com/projectnessie/nessie/releases/download/nessie-0.70.3/nessie-quarkus-0.70.3-runner.jar
java -jar nessie-quarkus-0.70.3-runner.jar

Nessie GC tool is attached as nessie-gc-0.70.3, which is an executable.
(chmod 744 nessie-gc-0.70.3 after download.)
Can also be run using java -jar nessie-gc-0.70.3, because it is actually a Java archive.
Shell completion can be generated from the nessie-gc tool.

The attached nessie-helm-0.70.3.tgz is a packaged Helm chart, which can be downloaded and installed via Helm.
There is also the Nessie Helm chart repo, which can be added and used to install the Nessie Helm chart.

Changelog

Fixes

  • Fix wrong New value for key 'some-key' must not have a content ID when swapping tables.

Full Changelog (minus renovate commits):

  • Avoid re-running previously validated access checks on commit retries. (#7524)
  • Make sure effectiveReference is not present in v1 REST API responses (#7512)
  • Add OTel span events for commit retry sleeps (#7509)
  • IntellJ workaround when using Iceberg snapshot builds (#7504)
  • Remove superfluous dependsOn (#7505)
  • Remove ref-log code (#7500)
nessie - Nessie 0.70.2

Published by github-actions[bot] about 1 year ago

Nessie 0.70.2 release

Try it

The attached nessie-quarkus-0.70.2-runner.jar is a standalone uber-jar file that runs on Java 11 or newer and it is also available via Maven Central. Download and run it (requires Java 11):

wget https://github.com/projectnessie/nessie/releases/download/nessie-0.70.2/nessie-quarkus-0.70.2-runner.jar
java -jar nessie-quarkus-0.70.2-runner.jar

Nessie GC tool is attached as nessie-gc-0.70.2, which is an executable.
(chmod 744 nessie-gc-0.70.2 after download.)
Can also be run using java -jar nessie-gc-0.70.2, because it is actually a Java archive.
Shell completion can be generated from the nessie-gc tool.

The attached nessie-helm-0.70.2.tgz is a packaged Helm chart, which can be downloaded and installed via Helm.
There is also the Nessie Helm chart repo, which can be added and used to install the Nessie Helm chart.

Changelog

Fixes

  • Fix wrong New value for key 'some-key' must not have a content ID when swapping tables.

Full Changelog (minus renovate commits):

  • Fix behavior when swapping tables (#7498)
nessie - Nessie 0.70.1

Published by github-actions[bot] about 1 year ago

Nessie 0.70.1 release

Try it

The attached nessie-quarkus-0.70.1-runner.jar is a standalone uber-jar file that runs on Java 11 or newer and it is also available via Maven Central. Download and run it (requires Java 11):

wget https://github.com/projectnessie/nessie/releases/download/nessie-0.70.1/nessie-quarkus-0.70.1-runner.jar
java -jar nessie-quarkus-0.70.1-runner.jar

Nessie GC tool is attached as nessie-gc-0.70.1, which is an executable.
(chmod 744 nessie-gc-0.70.1 after download.)
Can also be run using java -jar nessie-gc-0.70.1, because it is actually a Java archive.
Shell completion can be generated from the nessie-gc tool.

The attached nessie-helm-0.70.1.tgz is a packaged Helm chart, which can be downloaded and installed via Helm.
There is also the Nessie Helm chart repo, which can be added and used to install the Nessie Helm chart.

Changelog

Changes

  • Content Generator tool: added new --limit parameter to commits, references and entries
    commands.
  • Content Generator tool: tool now prints the total number of elements returned when running the
    commits, references and entries commands.
  • Helm charts: OpenTelemetry SDK is now completely disabled when tracing is disabled.
  • Helm charts: when auth is disabled, Quarkus OIDC doesn't print warnings anymore during startup.

Fixes

  • GC: Handle delete manifests and row level delete files

Full Changelog (minus renovate commits):

  • Ninja: update CHANGELOG
  • GC: Handle delete manifests and row level delete files (#7481)
  • GC: Bump spark version for integration tests (#7482)
  • MultiEnvTestEngine: append the environment name to test names (#7478)
  • Fix default-OLTP-port typo in docs (#7474)
  • Add NessieUnavailableException (HTTP 503) (#7465)
  • Helm chart: disable OIDC warnings when authentication is disabled (#7460)
  • Helm chart: disable OpenTelemetry SDK when tracing is disabled (#7459)
  • Content generator: add --limit parameter and print totals (#7457)
nessie - Nessie 0.70.0

Published by github-actions[bot] about 1 year ago

Nessie 0.70.0 release

Try it

The attached nessie-quarkus-0.70.0-runner.jar is a standalone uber-jar file that runs on Java 11 or newer and it is also available via Maven Central. Download and run it (requires Java 11):

wget https://github.com/projectnessie/nessie/releases/download/nessie-0.70.0/nessie-quarkus-0.70.0-runner.jar
java -jar nessie-quarkus-0.70.0-runner.jar

Nessie GC tool is attached as nessie-gc-0.70.0, which is an executable.
(chmod 744 nessie-gc-0.70.0 after download.)
Can also be run using java -jar nessie-gc-0.70.0, because it is actually a Java archive.
Shell completion can be generated from the nessie-gc tool.

The attached nessie-helm-0.70.0.tgz is a packaged Helm chart, which can be downloaded and installed via Helm.
There is also the Nessie Helm chart repo, which can be added and used to install the Nessie Helm chart.

Changelog

New Features

  • Content Generator tool: added new --hash parameter to commits, content and entries
    commands.

Changes

  • Content Generator tool: commit hashes are now printed in full when running the commits command.
  • For a "get-keys" operation that requests the content objects as well, the content objects are now
    fetched using bulk-requests.

Fixes

  • Fixed potential index corruption when importing repositories with many keys into the new storage
    model that could cause some contents to become inaccessible.

Full Changelog (minus renovate commits):

  • Propagate index stripes from parent to child commits (#7452)
  • Build: fix removal of superfluous system-property for NesQuEIT (#7455)
  • Build: remove superfluous system-property hack (#7451)
  • Bulk-fetch contents for get-keys (#7450)
  • Print full hashes in commits command (#7449)
  • Add --hash parameter to content-generator commands (#7448)
nessie - Nessie 0.69.2

Published by github-actions[bot] about 1 year ago

Nessie 0.69.2 release

Try it

The attached nessie-quarkus-0.69.2-runner.jar is a standalone uber-jar file that runs on Java 11 or newer and it is also available via Maven Central. Download and run it (requires Java 11):

wget https://github.com/projectnessie/nessie/releases/download/nessie-0.69.2/nessie-quarkus-0.69.2-runner.jar
java -jar nessie-quarkus-0.69.2-runner.jar

Nessie GC tool is attached as nessie-gc-0.69.2, which is an executable.
(chmod 744 nessie-gc-0.69.2 after download.)
Can also be run using java -jar nessie-gc-0.69.2, because it is actually a Java archive.
Shell completion can be generated from the nessie-gc tool.

The attached nessie-helm-0.69.2.tgz is a packaged Helm chart, which can be downloaded and installed via Helm.
There is also the Nessie Helm chart repo, which can be added and used to install the Nessie Helm chart.

Changelog

Fixes

  • Nessie CLI: check-content command was incorrectly reporting deleted keys as missing content, when
    using new storage model.
  • GC Tool handles JDBC config via environment correctly

Full Changelog (minus renovate commits):

  • Process outer test instances in clientFactoryForContext (#7444)
Package Rankings
Top 10.5% on Repo1.maven.org
Top 5.72% on Pypi.org
Badges
Extracted from project README
Zulip Group Discussion Twitter Website Maven Central PyPI quay.io Docker Artifact Hub Swagger Hub Build Status Query Engines CI macOS Build
Related Projects
Knowledge-Base

IT Knowledge Base from 20 years in DevOps, Linux, Cloud, Big Data, AWS, GCP etc - gradually porti...

22 Nov 2023 70
jreleaser

Release projects quickly and easily with JReleaser

28 Nov 2020 882
video-series-app

This is an example project to to offer you a very simple example of a CQRS architecture.

06 Dec 2022 6
JavaKeeper

✍️ Java 工程师必备架构体系知识总结：涵盖分布式、微服务、RPC等互联网公司常用架构，以及数据存储、缓存、搜索等必备技能

03 Sep 2019 1,866
mysql-binlog-connector-java

MySQL Binary Log connector

11 Jul 2013 2,206
qualitoast

Angular+Spring Boot application, made with JHipster

20 Apr 2017 8
markdowner

Markdowner is a parser project exclusively made for mardown files.

08 Feb 2016 3
oshi

Native Operating System and Hardware Information

10 Feb 2012 4,685
quarkus

Quarkus: Supersonic Subatomic Java.

06 Jul 2018 13,030