prefect

Improved Prefect Tutorial

Prefect's documentation has a new and improved tutorial. The tutorial focuses on the key elements and features of Prefect. You can find content related to more advanced features or less common use cases in the Guides section.

See the release notes for more details.

🚀 This release focuses on further improving the prefect deploy CLI command by removing the need to specify a flow entrypoint upfront! We've also made some other improvements and bug fixes.

See the release notes for details.

🚀 This release focuses on enhancing prefect deploy, allowing you to save and reuse deployment configurations, making redeployments quicker and more efficient! It also includes a few bug fixes.

See the release notes for details.

This release simplifies projects-based deployments, including the addition of more interactive CLI paths for a smoother deployment experience 🧈 . We also introduce a Cloud webhook CLI, as well as many more enhancements and bug fixes!

See the release notes for details.

This release improves the prefect deploy command, adds new project steps, squashes a swarm of bugs, and much more!

See the release notes for details.

This release restores the deployment tab in the UI, further improves CLI speed, adds support for local health checks on workers, and much more!

See the release notes for details.

This release brings upgrades that streamline your deployment experience! The prefect deploy command now offers interactive prompts for deployment names and work pool selections. 👥 We've also introduced a work pool creation wizard 🧙 to simplify the process, guiding you through essentials like basic work pool info, infrastructure type, and configuration.

Additional improvements include support for SQLAlchemy 2, and much more!

See the release notes for more details.

This release improves CLI performance, addresses orchestration race conditions, improves handling of terminal signals for workers, and more.

Check out the release notes additional enhancements, fixes, and details.

This release adds worker logs to the flow run page, improves handling of termination signals, and adds global default settings for flow and task run retries.

Check out the release notes for additional enhancements, fixes, and details.

This release relaxes flow run orchestration rules for improved behavior on infrastructure restart, fixes a bug with hanging CLI commands, and includes a few small improvements.

See the release notes for details

This release combines the previously separate flows and deployments UI pages into a single, holistic page that brings together information about flows and deployments, as well as recent and upcoming runs. You can now see the state of the most recent flow run for each flow and deployment, giving you a snapshot of the status of your workspace. In addition, you can now filter deployments by whether their schedule is active and the work pool to which flow runs are submitted. This release also introduces the new on_crashed hook for flows, allowing you to add client-side hooks that will be called when your flow crashes. This is useful for cases where you want to execute code without involving the Prefect API, and for custom handling on CRASHED terminal states. This callable hook will receive three arguments: flow, flow_run, and state.

Check out the release notes for more details.

This release focuses on enhancing the deployment experience and streamlining project setup. You can now deploy multiple flows simultaneously using the improved deployment.yaml file. This release also features better run restart behavior, ensuring smooth transitions in various situations. Additional improvements include support for recursive flow calls, concurrent runs of the same flow, and several UI and CLI refinements. We've also enriched our documentation with an informative tutorial on developing custom workers. This release incorporates a critical fix for logs, addressing occasional delays in sending them to the API.

Check out the release notes for more details.

This release includes some new features, such as a worker for each major cloud provider: a CloudRunWorker, ECSWorker, and AzureContainerWorker! 🎉 We're also releasing a new GitHub Action allowing you to automate the build process for deployments orchestrated by Prefect Cloud.

We've also included a number of enhancements, such as a widened flow run graph and Details tab on the Flow Runs page in the UI, a documentation refactor to provide more intuitive docs navigation, and much more!

Check out the release notes for more details.

This release further refines Prefect 2.10 with enhancements for project deployments and workers, fixes for flow run cancellation and the worker CLI, and more.

Check out the release notes for full details.

This release builds on 2.10 to further improve the experience of setting up and deploying from a prefect project. In particular, initializing a project with a recipe now starts an interactive CLI experience that guides you to a correct setup. This experience can be avoided for programmatic initialization by providing all required fields for the recipe via CLI. For more information, see the project documentation. We will continue to enhance the deployment experience as we receive feedback, so please keep it coming!

This release also includes a critical fix for Prefect logs that were sometimes delayed in being sent to the API.

Enhancements

• Rename __root_path__ to __development_base_path__ — https://github.com/PrefectHQ/prefect/pull/9136
• Include flow run and flow as related resources when emitting events via the events worker — https://github.com/PrefectHQ/prefect/pull/9129
• Cloud storage recipe improvements — https://github.com/PrefectHQ/prefect/pull/9145
• Use new sessions and transactions for each query during CancellationCleanup — https://github.com/PrefectHQ/prefect/pull/9124
• Stream git output during git_clone_project — https://github.com/PrefectHQ/prefect/pull/9149
• Update deployment defaults with project init — https://github.com/PrefectHQ/prefect/pull/9146
• Mock runtime via environment variable — https://github.com/PrefectHQ/prefect/pull/9156
• Wire up scheduling kwargs to deploy CLI — https://github.com/PrefectHQ/prefect/pull/9176
• Add deployment and flow filters to /artifacts/filter and /artifacts/latest/filter routes — https://github.com/PrefectHQ/prefect/pull/9089
• Add /artifacts/latest/count route — https://github.com/PrefectHQ/prefect/pull/9090
• add flow run to task run logging — https://github.com/PrefectHQ/prefect/pull/9170
• Add pragma statements automatically if sqlite — https://github.com/PrefectHQ/prefect/pull/9169
• Improved recipe initialization UX — https://github.com/PrefectHQ/prefect/pull/9158

Fixes

• Update prefect deploy to pull flow_name and entrypoint from deployment.yaml if specified — https://github.com/PrefectHQ/prefect/pull/9157
• Fix bug where non-zero status codes would be reported when deployed flow runs paused or failed — https://github.com/PrefectHQ/prefect/pull/9175
• Hide command when access token is provided and git_clone_project fails — https://github.com/PrefectHQ/prefect/pull/9150
• Fix bug where log worker only sent logs to API on flush rather than on an interval — https://github.com/PrefectHQ/prefect/pull/9180
• Fix apply artifact collection filter — https://github.com/PrefectHQ/prefect/pull/9153

Documentation

• Adds artifacts to api-ref — https://github.com/PrefectHQ/prefect/pull/9143
• Expands upon project step documentation — https://github.com/PrefectHQ/prefect/pull/9151
• small project doc fixes — https://github.com/PrefectHQ/prefect/pull/9161

Collections

• add prefect-spark-on-k8s-operator to integrations catalog list. — https://github.com/PrefectHQ/prefect/pull/9029

Contributors

• @tardunge made their first contribution in https://github.com/PrefectHQ/prefect/pull/9029

All changes: https://github.com/PrefectHQ/prefect/compare/2.10.2...2.10.3

Fixes a bug where deployments were not downloaded from remote storage blocks during flow runs.

See the release notes for details — don't forget to take a look at all the exciting 2.10 features.

Fixes an issue where recipes were not properly packaged within the Python build.

This release includes new features including workers, projects, variables, and versioned documentation alongside a slew of performance improvements and bug fixes.

Check out the (kind of long 🎉) release notes for details.

This release includes some new features such as the ability to track and manage data with artifacts, configure result storage keys, and expands the prefect.runtime module, along with other enhancements and fixes! 🎉

Check out the release notes for more details.

This release includes increased reliability for the Prefect engine, a new results tab in the UI, and improvements to the flow run graph.

Check out the release notes for all of the details!