kamu-cli

[0.194.0] - 2024-08-13

Changed

• Change mode argument for DatasetEnvVarsConfig to enabled: Option<bool>

Added

• New Reset flow in GQL Api which can be triggered manually for Root and Derivative datasets
• Private Datasets, preparation work:
  • Added in-mem implementation of ReBAC repository
  • Added in-mem implementation of DatasetEntryRepository

[0.193.1] - 2024-08-09

Fixed

• Panic for EXECUTE_TRANSFORM flow without dataset env vars enabled feature

[0.193.0] - 2024-08-07

Added

• kamu add command accepts optional --name argument to add a snapshot under a different name

[0.192.0] - 2024-08-07

Added

• kamu --no-color to disable color output in the terminal.

Changed

• New recursive flag for CompactionConditionFull input to trigger
  Hard compaction with keep metadata only mode for each derived dataset
• E2E: Reorganized work with tests that call kamu-cli:
  • Added kamu-cli-puppet crate to allow kamu-cli to be run as a separate process from tests
  • Removed past kamu-cli wrapper that ran in-process.
  • Some of kamu-cli tests that are inherently E2E are moved and adapted to E2E scope (in-mem area)
  • For convenience, the test run macros are now procedural
  • Various Windows-related tweaks & fixes

Fixed

• Return RootDatasetCompacted error for manual triggered EXECUTE_TRANSFROM flows
• Using new Spark image that fixes serialization errors when working with large GIS datasets
• Fixed container runtime for systems using SELinux

[0.191.5] - 2024-07-30

Fixed

• Ingest flow panic with database api mode

[0.191.4] - 2024-07-22

Fixed

• Parsing passwords includes specific symbols in database common crate

[0.191.3] - 2024-07-22

Fixed

• Script for api server database migration issue with passwords includes
  specific symbols

[0.191.2] - 2024-07-18

Fixed

• Panic for DatasetEnvVars API with wrong configuration
• Moved DATASET_ENV_VAR_ENCRYPTION_KEYfrom env to config

[0.191.1] - 2024-07-16

Fixed

• opendatafabric crate was not compiling without sqlx feature

[0.191.0] - 2024-07-16

Fixed

• Obscure error during push duplicate dataset with different aliases
• Get Data Panel: fixed base_url_rest calculation in case the API server is started on a random port
• Minor corrections to references in generated code documentation

Changed

• Upgraded rustc version and some dependencies
• E2E: unblocked parallel run for tests

[0.190.1] - 2024-07-10

Fixed

• DatasetEnvVars inmem deleting

[0.190.0] - 2024-07-09

Added

• New repository DatasetEnvVars to work with dataset secrets
• Now is possible to set new DatasetEnvVars configuration to storage
  and manage it via GQL api
• New Gql APIs to manage dataset env vars
  • listEnvVariables to fetch list of env vars by dataset
  • exposedValue to get secret value of env var by id
  • saveEnvVariable to store new dataset env var
  • deleteEnvVariable to delete dataset env var
  • modifyEnvVariable to modify dataset env var

[0.189.7] - 2024-07-04

Added

• Added Kamu access token E2E test
• SmTP: added E2E test group to cover the pushing and pulling of datasets

Changed

• Wrapping only necessary, not all HTTP requests in a transaction
• Respect the --quiet option for:
  • kamu add
  • kamu ingest
  • kamu push

Fixed

• Fixed SmTP working together with transactions

[0.189.6] - 2024-07-3

Fixed

• GQL API regression where unparsable SQL was ending up in internal error
• REST API /query endpoint will return 400 Bad Request in case of unparsable SQL
• Bug fixed in database IAM token authentication method (redundant session token request)

[0.189.4] - 2024-07-02

Fixed

• GQL access token list pagination

[0.189.3] - 2024-07-02

Fixed

• SQLX images now include scripts and programs necessary to fetch database credentials from AWS secrets manager

[0.189.2] - 2024-07-01

Fixed

• AWS secret stores both user name and password, so database username should be a secret too.

[0.189.1] - 2024-06-28

Fixed

• Modify revoke access token GQL response according to design

[0.189.0] - 2024-06-28

Added

• Support multiple methods to access database:
  • via raw password
  • via password stored as AWS secret
  • via generated AWS IAM authentication tokens
• Support periodic database password rotation with configurable period