spark-connector-common-java

Common library for Exasol Apache Spark based connectors

MIT License

Stars
0
Committers
4

Bot releases are hidden (Show)

spark-connector-common-java - 2.0.3: Update transitive dependencies to fix CVEs

Published by Shmuma 11 months ago

Summary

Updated transitive dependencies to fix:

  • zookeeper: CVE-2023-44981, severity CWE-639: Authorization Bypass Through User-Controlled Key (9.1)
  • exasol-testcontainers: CVE-2023-4043, severity CWE-20: Improper Input Validation (7.5)
  • arvo: CVE-2023-39410, severity CWE-502: Deserialization of Untrusted Data (7.5)

CVE-2023-4586 is silenced, as there is no fix at the moment.

Features

  • #27: Fixed vulnerabilities in zookeeper, parsson, avro

Dependency Updates

Compile Dependency Updates

  • Added org.apache.avro:avro:1.11.3
  • Added org.apache.zookeeper:zookeeper:3.7.2

Test Dependency Updates

  • Updated com.exasol:exasol-testcontainers:6.6.2 to 7.0.0

Plugin Dependency Updates

  • Updated com.exasol:error-code-crawler-maven-plugin:1.3.0 to 1.3.1
  • Updated com.exasol:project-keeper-maven-plugin:2.9.12 to 2.9.16
  • Updated org.apache.maven.plugins:maven-enforcer-plugin:3.4.0 to 3.4.1
  • Updated org.apache.maven.plugins:maven-failsafe-plugin:3.1.2 to 3.2.2
  • Updated org.apache.maven.plugins:maven-javadoc-plugin:3.5.0 to 3.6.2
  • Updated org.apache.maven.plugins:maven-surefire-plugin:3.1.2 to 3.2.2
  • Updated org.codehaus.mojo:versions-maven-plugin:2.16.0 to 2.16.1
  • Updated org.jacoco:jacoco-maven-plugin:0.8.10 to 0.8.11
  • Updated org.sonarsource.scanner.maven:sonar-maven-plugin:3.9.1.2184 to 3.10.0.2594
spark-connector-common-java - 2.0.2: Update dependencies to fix CVEs

Published by Shmuma about 1 year ago

Summary

Update transitive dependencies to fix CVE-2023-42503, CVE-2023-43642, CVE-2022-46751 and CVE-2022-46751.

Security

  • #23: Updated deps to fix CVE-2023-42503, CVE-2023-43642, CVE-2022-46751 and CVE-2022-46751

Dependency Updates

Compile Dependency Updates

  • Added org.apache.commons:commons-compress:1.24.0
  • Added org.apache.ivy:ivy:2.5.2
  • Added org.xerial.snappy:snappy-java:1.1.10.5

Test Dependency Updates

  • Updated com.exasol:exasol-testcontainers:6.6.1 to 6.6.2
  • Updated com.exasol:hamcrest-resultset-matcher:1.6.0 to 1.6.1
  • Updated com.exasol:test-db-builder-java:3.4.2 to 3.5.1
  • Updated nl.jqno.equalsverifier:equalsverifier:3.15 to 3.15.2
  • Updated org.mockito:mockito-core:5.4.0 to 5.5.0
  • Updated org.mockito:mockito-junit-jupiter:5.4.0 to 5.5.0
  • Updated org.testcontainers:junit-jupiter:1.18.3 to 1.19.0

Plugin Dependency Updates

  • Updated com.exasol:project-keeper-maven-plugin:2.9.10 to 2.9.12
  • Updated org.apache.maven.plugins:maven-enforcer-plugin:3.3.0 to 3.4.0
spark-connector-common-java - 2.0.1: Added helper method to get key-value options pairs

Published by morazow about 1 year ago

Summary

This release adds a helper method to get key-value options pairs.

Refactorings

  • #21: Added get method for key-value options pairs

Dependency Updates

Plugin Dependency Updates

  • Updated com.exasol:project-keeper-maven-plugin:2.9.9 to 2.9.10
spark-connector-common-java - 2.0.0: Added Spark filter converter

Published by morazow about 1 year ago

Summary

In this release we added a common class to convert Apache Spark filter expressions into Exasol SQL WHERE clauses. This helps to enrich the user queries and push the predicate conditions down to the Exasol database.

Features

  • #18: Added Spark filter converter implementation

Dependency Updates

Test Dependency Updates

  • Updated com.exasol:exasol-testcontainers:6.6.0 to 6.6.1
  • Updated nl.jqno.equalsverifier:equalsverifier:3.14.3 to 3.15
  • Updated org.junit.jupiter:junit-jupiter-api:5.9.3 to 5.10.0
  • Updated org.junit.jupiter:junit-jupiter:5.9.3 to 5.10.0

Plugin Dependency Updates

  • Updated com.exasol:error-code-crawler-maven-plugin:1.2.3 to 1.3.0
  • Updated com.exasol:project-keeper-maven-plugin:2.9.7 to 2.9.9
  • Updated org.apache.maven.plugins:maven-failsafe-plugin:3.0.0 to 3.1.2
  • Updated org.apache.maven.plugins:maven-gpg-plugin:3.0.1 to 3.1.0
  • Updated org.apache.maven.plugins:maven-surefire-plugin:3.0.0 to 3.1.2
  • Updated org.basepom.maven:duplicate-finder-maven-plugin:1.5.1 to 2.0.1
  • Updated org.codehaus.mojo:flatten-maven-plugin:1.4.1 to 1.5.0
  • Updated org.codehaus.mojo:versions-maven-plugin:2.15.0 to 2.16.0
  • Updated org.jacoco:jacoco-maven-plugin:0.8.9 to 0.8.10
spark-connector-common-java - 1.1.1: Refactored `ExasolOptions` class to be `Serializable`.

Published by morazow over 1 year ago

Summary

Update the ExasolOptions to be serializable since Spark 3.3 with Scala 2.12 version requires the class to implement Serializable interface.

Features

  • #16: Refactored ExasolOptions class to be serializable
spark-connector-common-java - 1.1.0: Added additional user parameters

Published by morazow over 1 year ago

Summary

This release supports additional user provided parameters.

Features

  • #14: Added additional user parameters

Dependency Updates

Compile Dependency Updates

  • Added com.exasol:error-reporting-java8:1.0.1
  • Added com.exasol:exasol-jdbc:7.1.20
  • Added com.exasol:sql-statement-builder-java8:4.5.4

Test Dependency Updates

  • Added com.exasol:exasol-testcontainers:6.6.0
  • Added com.exasol:hamcrest-resultset-matcher:1.6.0
  • Added com.exasol:java-util-logging-testing:2.0.3
  • Added com.exasol:test-db-builder-java:3.4.2
  • Added com.fasterxml.jackson.core:jackson-core:2.15.2
  • Added nl.jqno.equalsverifier:equalsverifier:3.14.3
  • Added org.hamcrest:hamcrest:2.2
  • Added org.junit.jupiter:junit-jupiter-api:5.9.3
  • Added org.junit.jupiter:junit-jupiter:5.9.3
  • Added org.mockito:mockito-core:5.4.0
  • Added org.mockito:mockito-junit-jupiter:5.4.0
  • Added org.testcontainers:junit-jupiter:1.18.3

Plugin Dependency Updates

  • Added com.exasol:error-code-crawler-maven-plugin:1.2.3
  • Added com.exasol:project-keeper-maven-plugin:2.9.7
  • Added io.github.zlika:reproducible-build-maven-plugin:0.16
  • Added org.apache.maven.plugins:maven-clean-plugin:2.5
  • Added org.apache.maven.plugins:maven-compiler-plugin:3.11.0
  • Added org.apache.maven.plugins:maven-deploy-plugin:3.1.1
  • Added org.apache.maven.plugins:maven-enforcer-plugin:3.3.0
  • Added org.apache.maven.plugins:maven-failsafe-plugin:3.0.0
  • Added org.apache.maven.plugins:maven-gpg-plugin:3.0.1
  • Added org.apache.maven.plugins:maven-install-plugin:2.4
  • Added org.apache.maven.plugins:maven-jar-plugin:2.4
  • Added org.apache.maven.plugins:maven-javadoc-plugin:3.5.0
  • Added org.apache.maven.plugins:maven-resources-plugin:2.6
  • Added org.apache.maven.plugins:maven-site-plugin:3.3
  • Added org.apache.maven.plugins:maven-source-plugin:3.2.1
  • Added org.apache.maven.plugins:maven-surefire-plugin:3.0.0
  • Added org.basepom.maven:duplicate-finder-maven-plugin:1.5.1
  • Added org.codehaus.mojo:flatten-maven-plugin:1.4.1
  • Added org.codehaus.mojo:versions-maven-plugin:2.15.0
  • Added org.jacoco:jacoco-maven-plugin:0.8.9
  • Added org.sonarsource.scanner.maven:sonar-maven-plugin:3.9.1.2184
  • Added org.sonatype.ossindex.maven:ossindex-maven-plugin:3.2.0
  • Added org.sonatype.plugins:nexus-staging-maven-plugin:1.6.13
spark-connector-common-java - 1.0.1: Fixed Dependency Scope

Published by morazow over 1 year ago

Summary

In this release we changed the scope of Spark dependency from compile to provided. We indented to use provided scope so that users of dependency could use their own version of Spark.

Bugs

  • #12: Fixed Dependency Scope

Dependency Updates

Compile Dependency Updates

  • Added com.exasol:error-reporting-java8:1.0.1
  • Added com.exasol:exasol-jdbc:7.1.20
  • Added com.exasol:sql-statement-builder-java8:4.5.4

Test Dependency Updates

  • Added com.exasol:exasol-testcontainers:6.6.0
  • Added com.exasol:hamcrest-resultset-matcher:1.6.0
  • Added com.exasol:java-util-logging-testing:2.0.3
  • Added com.exasol:test-db-builder-java:3.4.2
  • Added com.fasterxml.jackson.core:jackson-core:2.15.2
  • Added nl.jqno.equalsverifier:equalsverifier:3.14.2
  • Added org.hamcrest:hamcrest:2.2
  • Added org.junit.jupiter:junit-jupiter-api:5.9.3
  • Added org.junit.jupiter:junit-jupiter:5.9.3
  • Added org.mockito:mockito-core:5.3.1
  • Added org.mockito:mockito-junit-jupiter:5.3.1
  • Added org.testcontainers:junit-jupiter:1.18.3

Plugin Dependency Updates

  • Added com.exasol:error-code-crawler-maven-plugin:1.2.3
  • Added com.exasol:project-keeper-maven-plugin:2.9.7
  • Added io.github.zlika:reproducible-build-maven-plugin:0.16
  • Added org.apache.maven.plugins:maven-clean-plugin:2.5
  • Added org.apache.maven.plugins:maven-compiler-plugin:3.11.0
  • Added org.apache.maven.plugins:maven-deploy-plugin:3.1.1
  • Added org.apache.maven.plugins:maven-enforcer-plugin:3.3.0
  • Added org.apache.maven.plugins:maven-failsafe-plugin:3.0.0
  • Added org.apache.maven.plugins:maven-gpg-plugin:3.0.1
  • Added org.apache.maven.plugins:maven-install-plugin:2.4
  • Added org.apache.maven.plugins:maven-jar-plugin:2.4
  • Added org.apache.maven.plugins:maven-javadoc-plugin:3.5.0
  • Added org.apache.maven.plugins:maven-resources-plugin:2.6
  • Added org.apache.maven.plugins:maven-site-plugin:3.3
  • Added org.apache.maven.plugins:maven-source-plugin:3.2.1
  • Added org.apache.maven.plugins:maven-surefire-plugin:3.0.0
  • Added org.basepom.maven:duplicate-finder-maven-plugin:1.5.1
  • Added org.codehaus.mojo:flatten-maven-plugin:1.4.1
  • Added org.codehaus.mojo:versions-maven-plugin:2.15.0
  • Added org.jacoco:jacoco-maven-plugin:0.8.9
  • Added org.sonarsource.scanner.maven:sonar-maven-plugin:3.9.1.2184
  • Added org.sonatype.ossindex.maven:ossindex-maven-plugin:3.2.0
  • Added org.sonatype.plugins:nexus-staging-maven-plugin:1.6.13
spark-connector-common-java - 1.0.0: Initial Release

Published by morazow over 1 year ago

Summary

This is a initial release of the common library that provides helper classes for Exasol Spark based connectors.

Features

  • #1: Added Exasol data types to the Spark schema conversion
  • #2: Added column description helper class
  • #4: Updated developer guide
  • #6: Added import query generator interface
  • #7: Added export query generator interface
  • #9: Moved options class from Spark connector

Dependency Updates

Compile Dependency Updates

  • Added com.exasol:error-reporting-java8:1.0.1
  • Added com.exasol:exasol-jdbc:7.1.20
  • Added com.exasol:sql-statement-builder-java8:4.5.4
  • Added org.apache.spark:spark-sql_2.13:3.4.0
  • Added org.scala-lang:scala-library:2.13.11

Test Dependency Updates

  • Added com.exasol:exasol-testcontainers:6.6.0
  • Added com.exasol:hamcrest-resultset-matcher:1.6.0
  • Added com.exasol:java-util-logging-testing:2.0.3
  • Added com.exasol:test-db-builder-java:3.4.2
  • Added com.fasterxml.jackson.core:jackson-core:2.15.2
  • Added nl.jqno.equalsverifier:equalsverifier:3.14.2
  • Added org.hamcrest:hamcrest:2.2
  • Added org.junit.jupiter:junit-jupiter-api:5.9.3
  • Added org.junit.jupiter:junit-jupiter:5.9.3
  • Added org.mockito:mockito-core:5.3.1
  • Added org.mockito:mockito-junit-jupiter:5.3.1
  • Added org.testcontainers:junit-jupiter:1.18.3

Plugin Dependency Updates

  • Added com.exasol:error-code-crawler-maven-plugin:1.2.3
  • Added com.exasol:project-keeper-maven-plugin:2.9.7
  • Added io.github.zlika:reproducible-build-maven-plugin:0.16
  • Added org.apache.maven.plugins:maven-clean-plugin:2.5
  • Added org.apache.maven.plugins:maven-compiler-plugin:3.11.0
  • Added org.apache.maven.plugins:maven-deploy-plugin:3.1.1
  • Added org.apache.maven.plugins:maven-enforcer-plugin:3.3.0
  • Added org.apache.maven.plugins:maven-failsafe-plugin:3.0.0
  • Added org.apache.maven.plugins:maven-gpg-plugin:3.0.1
  • Added org.apache.maven.plugins:maven-install-plugin:2.4
  • Added org.apache.maven.plugins:maven-jar-plugin:2.4
  • Added org.apache.maven.plugins:maven-javadoc-plugin:3.5.0
  • Added org.apache.maven.plugins:maven-resources-plugin:2.6
  • Added org.apache.maven.plugins:maven-site-plugin:3.3
  • Added org.apache.maven.plugins:maven-source-plugin:3.2.1
  • Added org.apache.maven.plugins:maven-surefire-plugin:3.0.0
  • Added org.basepom.maven:duplicate-finder-maven-plugin:1.5.1
  • Added org.codehaus.mojo:flatten-maven-plugin:1.4.1
  • Added org.codehaus.mojo:versions-maven-plugin:2.15.0
  • Added org.jacoco:jacoco-maven-plugin:0.8.9
  • Added org.sonarsource.scanner.maven:sonar-maven-plugin:3.9.1.2184
  • Added org.sonatype.ossindex.maven:ossindex-maven-plugin:3.2.0
  • Added org.sonatype.plugins:nexus-staging-maven-plugin:1.6.13
Package Rankings
Top 42.71% on Repo1.maven.org
Badges
Extracted from project README
Build Status Maven Central โ€“ spark-connector-common-java Quality Gate Status Security Rating Reliability Rating Maintainability Rating Technical Debt Code Smells Coverage Duplicated Lines (%) Lines of Code
Related Projects