kestra

Infinitely scalable, event-driven, language-agnostic orchestration and scheduling platform to manage millions of workflows declaratively in code.

APACHE-2.0 License

Downloads
228.4K
Stars
7.2K
View Code on GitHub Visit Website View on X
Ecosystems: Java

Bot releases are visible (Hide)

kestra - v0.17.2

Published by github-actions[bot] 4 months ago

Bug Fixes

  • ui: amended output preview for sqs trigger messages for ion files (Milos Paunovic)
  • ui: namespace files calls were not including tenant (brian.mulier)

Chores

  • ui: showing ee tooltip on hover only once, then, just on click (#3944) (Miloš Paunović)
  • ui: showing ee tooltip only on click (#3951) (Miloš Paunović)
  • upgrade to version 'v0.17.2' (YannC)
kestra - v0.17.1

Published by github-actions[bot] 5 months ago

Features

Bug Fixes

  • core: UploadFiles now handle subfolders (YannC)
  • core: remove @NotEmpty (YannC)
  • ui: flow default inputs are now properly populated (#3934) (Miloš Paunović)
  • ui: null-safe guided tour access in TriggerFlow.vue (brian.mulier)
  • ui: dont count flow in tutorial namespace (YannC)
  • ui: added safety checks for all tour related calls (#3938) (Miloš Paunović)
  • core: Now accept an extension for the file input (YannC)
  • ui: avoid 404 with autocomplete when flow does not exist (YannC)
  • ui: prevent the need of loading all flows for Flow tab to be displayed in editor (brian.mulier)

Chores

  • upgrade to version 0.17.1 (YannC)
kestra - v0.16.9

Published by github-actions[bot] 5 months ago

Features

Bug Fixes

  • handle namespace variable in eval (YannC)

Chores

  • upgrade to version 0.16.9 (YannC)
kestra - v0.15.16

Published by github-actions[bot] 5 months ago

Bug Fixes

  • handle namespace variable in eval (YannC)

Chores

  • upgrade to version 0.15.16 (YannC)
kestra - v0.17.0

Published by github-actions[bot] 5 months ago

Features

Bug Fixes

Documentation

  • add Pebble expressions to the main UI documentation for a quick reference (Anna Geller)
  • Resume task (Anna Geller)

Code Refactoring

Builds

Chores

Commits

  • f5586d2: closes https://github.com/kestra-io/kestra/issues/3670 (Anna Geller)
  • a72e391: feat(core, webserver): alias improvements (Loïc Mathieu) #3740
  • 9e5a605: fix(core, ui): display alias doc in the editor (Loïc Mathieu) #3745
  • 17ccfcf: feat(core, script): rename DockerTaskRunner to Docker and ProcessTaskRunner to Process (Loïc Mathieu) #3743
  • 513e69d: fix(ui); remove lang settings from date/time section (YannC)
  • 7f6881d: WIP feat(core): add new stop method WorkerJobLifecycle (Florian Hussonnois) #3767
  • d93761e: fix(core, webserver): file upload (Loïc Mathieu) #3429
  • f6f5011: Merge branch 'develop' of https://github.com/kestra-io/kestra into develop (Anna Geller)

Non-breaking changes related to renaming

Many plugins have been renamed for consistency and extensibility. We’ve implemented aliases for backward compatibility so that you don't need to update those names immediately. Everything will continue to work seamlessly, and you can take as much time as needed to rename those tasks and triggers.

Here are the key changes:

  • taskDefaults are now pluginDefaults to reflect the fact that you can set default values for all plugins, not just tasks.
  • HTTP tasks are now part of the core plugin rather than the file-system (fs) plugin.
  • All core plugins have been renamed, e.g. io.kestra.core.models.triggers.types.Schedule is now io.kestra.plugin.core.trigger.Schedule. Again, this is a non-breaking change as we use aliases — don't worry when you see warnings in the UI. Those warnings are here to spread the message about renamed tasks and triggers, but you can take as much time as you need to rename them.
  • Serialization tasks have been renamed from Readers and Writers to explicit conversion tasks e.g. CsvReader → CsvToIon and CsvWriter → IonToCsv.
  • Redis plugins have been renamed to make them easier to extend and maintain. For example, io.kestra.plugin.redis.TriggerList is now io.kestra.plugin.redis.list.Trigger.

For more details about all these changes, check the Renamed Plugins Migration Guide.

Breaking Changes

Task Runner names have been shortened

The task runner classes are now shorter. For example, io.kestra.plugin.aws.runner.AwsBatchTaskRunner is now io.kestra.plugin.aws.runner.Batch. Check the task runner documentation for the full list of updated names.

Note that in contrast to the renaming mentioned in the previous section, we've renamed them directly (without using aliases) given it's a beta feature.

New build process for custom plugins

Kestra 0.17.0 uses a new mechanism to discover and load plugins. Plugins are now discovered and loaded using the standard Java Service Loader rather than Micronaut-specific Bean introspection. If you use custom plugins, follow the Migration Guide to make the necessary adjustments.

Subflow default values have changed

The wait and transmitFailed boolean properties of the Subflow task are now set to true by default. This means that the default behavior of the Subflow task is now waiting for the subflow execution to finish and transmitting the failed status to the parent flow's Subflow task runs. If you want to keep the old default behavior, make sure to add the following to your pluginDefaults:

pluginDefaults:
  - type: io.kestra.core.tasks.flows.Subflow
    values:
      wait: false
      transmitFailed: false

Change in the JSON objects serialization strategy

We previously serialized JSON objects with a NON_DEFAULT strategy to save space (in the database) and optimize network bandwidth.

We changed that behavior so that all properties that are not null will now be included in the serialized JSON document. This fixes several limitations and lets us know when a default is purposely set. This also means that empty lists and maps are now serialized as empty objects (rather than not being serialized at all).

kestra - v0.16.8

Published by github-actions[bot] 5 months ago

Chores

kestra - v0.16.7

Published by github-actions[bot] 5 months ago

Code Refactoring

  • core: don't expose multiple entry on collector service (Ludovic DEHON)

Chores

  • upgrade to version 0.16.7 (YannC)
kestra - v0.15.15

Published by github-actions[bot] 5 months ago

Code Refactoring

  • core: don't expose multiple entry on collector service (Ludovic DEHON)

Chores

  • upgrade to version 0.15.15 (YannC)
kestra - v0.16.6

Published by github-actions[bot] 6 months ago

Bug Fixes

Chores

kestra - v0.16.5

Published by github-actions[bot] 6 months ago

Features

  • script: move plugin-script library to Kestra itself (Loïc Mathieu)

Bug Fixes

  • ui: use index instead of title for v-for key (YannC)
  • core: working directory are not passing the tenantId to child tasks (Ludovic DEHON)
  • core: fix DeduplicateItems for item containing Instant (#3615) (Florian Hussonnois)
  • core: task runner can now transform relative to absolute paths (based on wdir) + changed ProcessTaskRunner wdir & outputDir var type (brian.mulier)
  • core: type-safe TaskRunner.toAbsolutePath (brian.mulier)
  • script: add missing AbstractExecScript task (Loïc Mathieu)
  • sript: remove the annotation processor as it's only on 0.17 (Loïc Mathieu)

Chores

kestra - v0.15.14

Published by github-actions[bot] 6 months ago

Bug Fixes

  • webserver: prevent non-webserver from crashing due to lacking BasicAuthService (brian.mulier)

Chores

kestra - v0.16.4

Published by github-actions[bot] 6 months ago

Chores

Commits

  • eb489bc: Revert "chore: upgrade to Micronaut 4.3.8" (Loïc Mathieu)
kestra - v0.16.3

Published by github-actions[bot] 6 months ago

Bug Fixes

  • core/jdbc: add missing sort mapping for ServiceInstanceRepositoryInterface (Florian Hussonnois)

Chores

kestra - v0.15.13

Published by github-actions[bot] 6 months ago

Bug Fixes

Chores

  • upgrade to version 0.15.13 (YannC)
kestra - v0.16.2

Published by github-actions[bot] 6 months ago

Bug Fixes

  • core: VariableRenderer should expose alternativeRender (Florian Hussonnois)
  • tests: add real launch to outputDirDisabled test for task runners (brian.mulier)
  • ui: prevent editor shrink on loading task runner doc (brian.mulier)
  • ui: Gantt clicks are working again (brian.mulier)
  • ui: flow full revision is truncated (Ludovic DEHON)
  • cli: API commands work against a pre-micronaut-upgrade server (brian.mulier)
  • core: handle secret in trigger (Ludovic DEHON)
  • scheduler: better handling of locked triggers (#3603) (YannC)

Chores

Commits

  • core: mandate that both key and value are present for labels (Loïc Mathieu)
kestra - v0.15.12

Published by github-actions[bot] 6 months ago

Bug Fixes

  • scheduler: better handling of locked triggers (#3603) (YannC)

Continuous Integration

  • set plugin version via a variable to allow easily changing it (Loïc Mathieu)

Chores

  • upgrade to version 0.15.12 (YannC)
kestra - v0.16.1

Published by github-actions[bot] 6 months ago

Features

  • ui: set plugins menu back in the UI (#3558) (YannC)
  • ui: click anywhere on the row to open logs of a task in Gantt vue (YannC)

Bug Fixes

  • downgrade Micronaut (Loïc Mathieu)
  • validate: restore ability to run validate command without any configuration (brian.mulier)
  • ui: use new Monaco API for decorations to prevent editor from disappearing (brian.mulier)

Chores

  • version: update to version 'v0.16.1' (YannC)
kestra - v0.16.0

Published by github-actions[bot] 6 months ago

Features

Bug Fixes

  • ui: lint issue (Loïc Mathieu)
  • ui: lint issue (Loïc Mathieu)
  • ui: fix labels filter by route (#3189) #3189 (yuri)
  • ui: missing check permission to display flow CREATE and EXECUTE button #3197 (Loïc Mathieu)
  • controller: fix 404 issue when flow of a trigger has been deleted (#3209) #3209 (YannC)
  • ui: change editor width storage key (YannC)
  • core: replace deprecated icons (Ludovic DEHON)
  • core: DocumentationGeneratorTest.ech() test assertion (Loïc Mathieu)
  • core: change link to flow overview on dependencies (Ludovic DEHON)
  • quickwins (#3215) #3215 (YannC)
  • jdbc: make the flow listener tolerant of plugin loader issue #3205 (Loïc Mathieu)
  • ui: make dependencies expand more clear (#3222) #3222 (YannC)
  • core: validate task default (#3224) #3224 (YannC)
  • controller: return 404 when flow not found in follow API (#3219) #3219 (YannC)
  • ui: don't save settings on page load (Ludovic DEHON)
  • ui: manage panel for SuperAdmin without tenant (#3225) #3225 (YannC)
  • core: pebble render function must render boolean (#3218) #3231 (Florian Hussonnois)
  • core: take timezone into account for new schedule triggers (#3230) #3230 (YannC)
  • webserver: multi-cookies in a single header decoder #3229 (brian.mulier)
  • core: document the batch default value so it correctly appears in the doc #3233 (Loïc Mathieu)
  • ui: revision author is now fetched only once we know which revision to display to prevent inconsistencies (brian.mulier)
  • docs: add a docker version for front end development (Ludovic DEHON)
  • ui: feedtracker button are not aligned to right (Ludovic DEHON)
  • ui: better styling for el-select (Ludovic DEHON)
  • ui: invalid tooltip header color on white (Ludovic DEHON)
  • ui: blueprint layout & margin (Ludovic DEHON)
  • ui: reorder left menu (Ludovic DEHON)
  • wording of the security toast (Anna Geller)
  • ui: grayed-out triggers when disabled (in source or through API) in topology #3237 (brian.mulier)
  • webserver: rollback to http 1.1 (brian.mulier)
  • webserver: change cookie decoder to netty one (brian.mulier)
  • core: Avoid creating empty files when splitting (#3254) #3254 (YannC)
  • core: create dependency between forEachItem task and subflow (#3256) #3256 (YannC)
  • core: Pause task properly handled in restart #3257 (brian.mulier)
  • docs links (Anna Geller)
  • set timeout to sse and now display loading/error on UI (#3259) #3259 (YannC)
  • backfill link (Anna Geller)
  • ui: log on flow missed filters (Ludovic DEHON)
  • ui: add top margin in tabs components (YannC)
  • ui: ExecutionRoot marge issue (YannC)
  • core: ExecutionRunning use '|' and not '_' as separator #3268 (Loïc Mathieu)
  • core: null label value can crash the executor #3269 (Loïc Mathieu)
  • core: missing lombok annotation on new storage tasks (Ludovic DEHON)
  • webserver: override InputStream available method in NamespaceFileController.putNamespaceFile #3270 (brian.mulier)
  • ui: correct link to namespace (YannC)
  • ui: update originalFlow on save (YannC)
  • core: prevent flow validation from crashing (#3278) #3278 (brian-mulier-p)
  • build: no more force install for npm peer dependencies #3281 (brian.mulier)
  • ui: size of charts fix (Ludovic DEHON)
  • ui: don't display log filter on dashboard (Ludovic DEHON)
  • charts: force chart canvas to take the full width / height of its container (brian.mulier)
  • topology: fixed a bug where having a subflow with a trigger with same id than current flow would lead to wrong graph (brian.mulier)
  • graph: remove useless styling (brian.mulier)
  • topology: fixed some edge cases where graph uids were wrong (brian.mulier)
  • ui: remove outline from monaco editor to prevent small blue bars around it (brian.mulier)
  • ui: remove additional warnings #3198 (brian.mulier)
  • core: remove ScheduleBackfill, Condition & ScheduleCondition from defs #3308 (brian.mulier)
  • ui: display selected namespace in selector (YannC)
  • ui: Executions.vue lint (YannC)
  • ui: remove Axios' default URL to prevent duplicate context path in called URL #3310 (brian.mulier)
  • core: fix missing random number generator algorithm #3325 (Florian Hussonnois)
  • webserver: no longer decrypt secret inputs & outputs when doing an evaluate for an execution taskrun #3316 (brian.mulier)
  • core: prevent crashing if secret input is null #3316 (brian.mulier)
  • core: runContext decrypt method as public (brian.mulier)
  • ui: translate enable auth message (YannC)
  • ui: improve selected filter highlight (#3342) #3342 (yuri)
  • ui: only display select flow in home summary failed (YannC)
  • tests: add default image for AbstractScriptRunnerTest (brian.mulier)
  • core: warn on failed local flow parsing (#3349) #3349 (yuri)
  • core: use a different taskrun for each script runner test #3359 (Loïc Mathieu)
  • ui: boolean input label (YannC)
  • editor: editor won't fully shrink anymore #3358 (brian.mulier)
  • core: variable renderer handle properly raw tags when recursive rendering #3388 (brian.mulier)
  • core: add getName() to input to have soft deprecation (brian.mulier)
  • ui: prevent duplicate auto-completions (brian.mulier)
  • ui: remove absolute filter when switching to the relative one (#3341) #3341 (yuri)
  • core: remove incorrectly rendered icon on Mac (brian.mulier)
  • core: better script runners documentation generation (brian.mulier)
  • webserver: Triggers page crash when a trigger is deleted #3404 (Loïc Mathieu)
  • core: ensure all services are closed before ServiceLivenessManager #3407 (Florian Hussonnois)
  • core: MapUtils performance #3401 (Loïc Mathieu)
  • core: improve Execution.findChilds() #3401 (Loïc Mathieu)
  • core: fix stats webserver (#3408) #3416 (Florian Hussonnois)
  • core: fix race condition on ServiceLivenessManager #3417 (Florian Hussonnois)
  • core: properly handle deprecation for input's name property to prevent false warnings #3418 (brian.mulier)
  • core: fix NPE in ServiceLivenessManager #3420 (Florian Hussonnois)
  • core: skip directory and un-readable file on WorkingDirectory post action #3422 (Loïc Mathieu)
  • core: Correcting the EachParallel flow example #3426 (Loïc Mathieu)
  • core: ScriptService.labels should not add "/" to the prefix #3427 (Loïc Mathieu)
  • core: declare the FlowExecutor as a bean (#3389) #3389 (Loïc Mathieu)
  • webserver: ability to turn off basic authentication through configuration (brian.mulier)
  • ui: no more editor shrink due to localStorage value missing (brian.mulier)
  • ui: allow backfill with not required inputs (YannC)
  • webserver: set paused to success if not subtask (#3458) #3458 (YannC)
  • core: make RunContex.renderMap() null tolerant (Loïc Mathieu)
  • runner: change visibility of cache variables in ScriptRunner and use proper runContext in tests (brian.mulier)
  • ui: correct various margins (#3428) #3428 (yuri)
  • test: test does not pass during release (YannC)
  • core: prevent NPE on ScriptService.replaceInternalStorage (brian.mulier)
  • core: prevent NPE for empty input files (brian.mulier)
  • core: add runContext to additionalVars & env for ScriptRunners (brian.mulier)
  • core: runnerEnv & runnerAdditionalVars throw IllegalVariableException (brian.mulier)
  • core: render commands env and additional vars in ScriptRunner (brian.mulier)
  • tests: add test to ensure runner additional vars & env are rendered (brian.mulier)
  • webserver: basic auth filter should executore on the BLOCKING executor #3474 (Loïc Mathieu)
  • persist state for each service instance event #3488 (Florian Hussonnois)
  • core: allows only runnable task to be retried (YannC)
  • core: revert restricting the read function to the Worker for now #3495 (Loïc Mathieu)
  • ui: missing images (YannC)
  • ui: light theme welcome (YannC)
  • core: allow the read() function to read an URI #3494 (Loïc Mathieu)
  • welcome page wording (Anna Geller)
  • french translation (Anna Geller)
  • runner: output dir property as a guard #3499 (brian.mulier)
  • ui: change tutorial path (YannC)
  • ui: plugin pages improvements (YannC)
  • ui: headband plugin page (YannC)
  • ui: ForEachItem properly handled in Gantt, Logs & Topology #3504 (brian.mulier)
  • webserver: incorrect package for TriggerController (Loïc Mathieu)
  • core: allow task null to be founded for retry (#3505) #3505 (YannC)
  • ui: don't show attempt and originalDate for prior execution (YannC)
  • ui: template in settings don't crashed page (YannC)
  • ui: plugin page light theme (YannC)
  • webserver: plugin group can be null and Jackson cannot serialize null key #3513 (Loïc Mathieu)
  • core: add @NotNull to Purge.endDate (brian.mulier)
  • ui: remove various warnings (brian.mulier)
  • ui: Monaco no longer having duplicate auto-completion issue #3518 (brian.mulier)
  • ui: execution update is throttled to reduce browser load #3509 (brian.mulier)
  • ui: make ellipsis on taskId at the beginning for long ids + wider column (brian.mulier)
  • core: remove FlowLabelsCondition and deprecate FlowNamespaceCondition #3520 (Loïc Mathieu)
  • ui: chart issues (YannC)
  • core: remove incorrectly rendered icon on Mac (brian.mulier)
  • add links to read more and format tasks as table (Anna Geller)
  • ui: import Legend for ChartJS #3524 (brian.mulier)
  • tests: remove incorrectly rendered icon on Mac (brian.mulier)

Documentation

Tests

  • core: DocumentationGeneratorTest, deprecated message (YannC)

Chores

Commits

Breaking Changes

The only breaking change in this release is that we aligned all container labels. This means that if you filter any container resources by these labels, make sure to adjust them to match new labels.

Previous labels were:

  • flow.kestra.io/id
  • flow.kestra.io/namespace
  • task.kestra.io/id
  • execution.kestra.io/id
  • taskrun.kestra.io/id

New labels are:

  • kestra.io/namespace
  • kestra.io/flow-id
  • kestra.io/task-id
  • kestra.io/execution-id
  • kestra.io/taskrun-id
  • kestra.io/taskrun-attempt

GitHub issues that added these changes:

kestra - v0.15.11

Published by github-actions[bot] 7 months ago

Bug Fixes

  • core: variable renderer handle properly raw tags when recursive rendering (brian.mulier)
  • core: add getName() to input to have soft deprecation (brian.mulier)
  • webserver: Triggers page crash when a trigger is deleted (Loïc Mathieu)
  • core: MapUtils performance (Loïc Mathieu)
  • core: improve Execution.findChilds() (Loïc Mathieu)
  • core: fix stats webserver (#3408) (Florian Hussonnois)
  • core: properly handle deprecation for input's name property to prevent false warnings (brian.mulier)
  • core: skip directory and un-readable file on WorkingDirectory post action (Loïc Mathieu)
  • webserver: ability to turn off basic authentication through configuration (brian.mulier)
  • ui: no more editor shrink due to localStorage value missing (brian.mulier)
  • ui: allow backfill with not required inputs (YannC)
  • webserver: set paused to success if not subtask (#3458) (YannC)
  • test: test does not pass during release (YannC)

Chores

kestra - v0.15.10

Published by github-actions[bot] 7 months ago

Bug Fixes

Chores

Package Rankings
Top 22.7% on Repo1.maven.org
Top 11.19% on Pypi.org
Top 7.48% on Proxy.golang.org
Badges
Extracted from project README
Star the Repo