kamu-cli

New generation decentralized data lake and a streaming data pipeline

OTHER License

Downloads
1.3K
Stars
277
Committers
8

Bot releases are visible (Hide)

kamu-cli - Release v0.188.6

Published by github-actions[bot] 4 months ago

[0.188.6] - 2024-06-27

Fixed

  • Added missed field to create access token result API
kamu-cli - Release v0.188.5

Published by github-actions[bot] 4 months ago

[0.188.5] - 2024-06-26

Added

  • kamu system api-server: Added the option of overriding the base URL in the API with --external-address.
    Can be handy when launching inside a container
kamu-cli - Release v0.188.4

Published by github-actions[bot] 4 months ago

[0.188.4] - 2024-06-25

Changed

  • Renamed all places compacting -> compacting
kamu-cli - Release v0.188.3

Published by github-actions[bot] 4 months ago

[0.188.3] - 2024-06-24

Fixed

  • Fixed support of ingestion via file upload in kamu ui mode
    and kamu system api-server mode with custom HTTP port
  • Fixed launching kamu ui mode (related to transactions management)
kamu-cli - Release v0.188.2

Published by github-actions[bot] 4 months ago

[0.188.2] - 2024-06-20

Added

  • Added an E2E test group for REST API

Changed

  • MySQL E2E tests are turned off
  • The <owner/dataset>/tail REST API endpoint will:
    • return 404 Not Found on not found datasets
    • return 202 No Content on empty datasets

Fixed

  • Stabilized query handling in case of database usage; affected:
    • The <owner/dataset>/tail REST API
    • The /query REST API
    • kamu system tail command
    • kamu sql command
  • Fixed memory leak when working with DataFusion
kamu-cli - Release v0.188.1

Published by github-actions[bot] 4 months ago

[0.188.1] - 2024-06-17

Changed

  • The /query REST API endpoint will:
    • return 404 Not Found on not found datasets
    • return 400 Bad Request on invalid SQL
    • return 422 Unprocessable Content on unrecognized request body fields
kamu-cli - Release v0.188.0

Published by github-actions[bot] 4 months ago

kamu-cli - Release v0.187.0

Published by github-actions[bot] 4 months ago

kamu-cli - Release v0.186.0

Published by github-actions[bot] 4 months ago

kamu-cli - Release v0.185.1

Published by github-actions[bot] 4 months ago

[0.185.1] - 2024-06-07

Fixed

  • Fixed support of --force mode for pull/push actions using Smart Transfer Protocol
kamu-cli - Release v0.185.0

Published by github-actions[bot] 4 months ago

[0.185.0] - 2024-06-06

Added

  • New --reset-derivatives-on-diverged-input flag to kamu pull command, which will trigger
    compaction for derived dataset if transformation fails due to root dataset compaction and retry transformation
  • Initial support for ingestion via file uploads, with local FS and S3-based storage for temporary files

Changed

  • AddPushSource event may omit specifying a schema. In this case, the very first push ingestion invokation
    would try to make a best-effort auto-inferrence of the data schema.

Fixed

  • Fixed issue with smart protocol transfer operations upon empty datasets
kamu-cli - Release v0.184.0

Published by github-actions[bot] 5 months ago

kamu-cli - Release v0.183.0

Published by github-actions[bot] 5 months ago

[0.183.0] - 2024-05-22

Added

  • New keep_metadata_only flag to HardCompacting flow. Also extended FlowState with ConfigSnapshot
    and possibility to pass configuration during triggering a flow

Fixed

  • Added support of --all flag to the kamu delete command
  • Made recursive deletion dataset with provided % pattern

Changed

  • HardCompacting configuration now is one of Full or KeepMetadataOnly variants. In case of
    KeepMetadataOnly variant required to provide recursive value which will trigger downstream
    dependecnies compacting
kamu-cli - Release v0.182.0

Published by github-actions[bot] 5 months ago

[0.182.0] - 2024-05-20

Added

  • Loading database components relying on CLI config

Fixed

  • Panic when creating a workspace with an existing config
kamu-cli - Release v0.181.2

Published by github-actions[bot] 5 months ago

[0.181.2] - 2024-05-20

Fixed

  • kamu login --check supports searching both by frontend and backend URL
kamu-cli - Release v0.181.1

Published by github-actions[bot] 5 months ago

kamu-cli - Release v0.181.0

Published by github-actions[bot] 5 months ago

[0.181.0] - 2024-05-14

Added

  • Introduced MQTT protocol support (see FetchStepMqtt and the new mqtt example)
  • The kamu system compact command now accepts the --keep-metadata-only flag, which performs hard
    compaction of dataset(root or derived) without retaining AddData or ExecuteTransform blocks

Fixed

  • Panic while performing data ingesting in the derived datasets
kamu-cli - Release v0.180.0

Published by github-actions[bot] 5 months ago

[0.180.0] - 2024-05-08

Added

  • GraphQL account flows endpoints:
    • List of flows by account(including filters byDatasetName, byFlowType, byStatus, byInitiator)
    • Pause all flows by account
    • Resume all flows by account

Changed

  • Correct JWT config creation for kamu-node

Fixed

  • kamu repo alias rm command regression crash. Changed accepted type and covered by integration test
kamu-cli - Release v0.179.1

Published by github-actions[bot] 5 months ago

[0.179.1] - 2024-05-07

Changed

  • Adding derived traits needed for kamu-node
kamu-cli - Release v0.179.0

Published by github-actions[bot] 6 months ago

[0.179.0] - 2024-05-06

Changed

  • Refactoring of authorization configuration data: separation into configuration models and logic for loading them from environment variables