prefect

Prefect is a workflow orchestration tool empowering developers to build, observe, and react to data pipelines

APACHE-2.0 License

Downloads
8.4M
Stars
14.5K
Committers
148

Bot releases are hidden (Show)

prefect - Release 2.11.2

Published by bunchesofdonald about 1 year ago

A lot of documentation updates, specifically around deployments, and ACI push work pools.

prefect - Release 2.11.1

Published by znicholasbrown about 1 year ago

This releases introduces the ability to override queue settings for individual flow runs and enables task runs to return Paused states. We've bolstered security by preventing accidental credential logging and fixed some UI issues related to work queues and flow run logs. Some new experimental features include a concurrency context manager and a rate_limit function.

See the release notes for more details.

prefect - Release 2.11.0

Published by zhen0 about 1 year ago

🚀 This release makes work pools and workers generally available. There are now work pools for every major infrastructure type. Work pools expose rich configuration of their infrastructure. Every work pool type has a base configuration with sensible defaults such that you can begin executing work with just a single command. The infrastructure configuration is fully customizable from the Prefect UI. Push work pools remain a beta feature.

📈 The release also adds flow summary graphs and stats to the flow page. Each flow page now includes graphs of it's recent flow runs, task runs, and (in prefect Cloud) related events, as well as summary statistics.

See the release notes for more details.

prefect - Release 2.10.21

Published by bunchesofdonald over 1 year ago

This release includes a number of exciting new features and improvements, including:

  • The Prefect Dashboard is now generally available.
  • Deploy deployments prefixed by flow name during prefect deploy.
  • Use environment variables in deployment steps.
  • Use prefect deploy with multiple deployments with the same name.
prefect - Release 2.10.20

Published by billpalombi over 1 year ago

Yesterday's 2.10.19 release introduced bugs that prevented UI form inputs from being rendered and parsed correctly. This release resolves those issues. It also drops Python 3.7 support. Prefect now requires Python 3.8 or later.

See the release notes for details.

prefect - Release 2.10.19

Published by serinamarie over 1 year ago

This release introduces a new Prefect dashboard as an experimental feature! The dashboard provides an overview of all Prefect activity, surfaces the urgent information, and provides the context to understand that information. Additionally, we've added support for service-specific credentials to the git_clone deployment step.

See the release notes for more details.

prefect - Release 2.10.18

Published by znicholasbrown over 1 year ago

This release introduces substantial enhancements to Docker image support during flow deployment. We've made the process of building, pushing, and pulling Docker images simpler, with our CLI now providing automatic detection and guidance for Docker-enabled work pools.

In addition, we're introducing event-based triggers for Prefect Cloud deployments and several improvements such as the ability to save updated deployment configurations and an install-policy option at worker start.

See the release notes for more details

prefect - Release 2.10.17

Published by bunchesofdonald over 1 year ago

Improved Prefect Tutorial

Prefect's documentation has a new and improved tutorial. The tutorial focuses on the key elements and features of Prefect. You can find content related to more advanced features or less common use cases in the Guides section.

See the release notes for more details.

prefect - 2.10.16

Published by desertaxle over 1 year ago

🚀 This release focuses on further improving the prefect deploy CLI command by removing the need to specify a flow entrypoint upfront! We've also made some other improvements and bug fixes.

See the release notes for details.

prefect - Release 2.10.15

Published by serinamarie over 1 year ago

🚀 This release focuses on enhancing prefect deploy, allowing you to save and reuse deployment configurations, making redeployments quicker and more efficient! It also includes a few bug fixes.

See the release notes for details.

prefect - Release 2.10.14

Published by serinamarie over 1 year ago

This release simplifies projects-based deployments, including the addition of more interactive CLI paths for a smoother deployment experience 🧈 . We also introduce a Cloud webhook CLI, as well as many more enhancements and bug fixes!

See the release notes for details.

prefect - Release 2.10.13

Published by desertaxle over 1 year ago

This release improves the prefect deploy command, adds new project steps, squashes a swarm of bugs, and much more!

See the release notes for details.

prefect - Release 2.10.12

Published by zanieb over 1 year ago

This release restores the deployment tab in the UI, further improves CLI speed, adds support for local health checks on workers, and much more!

See the release notes for details.

prefect - Release 2.10.11

Published by serinamarie over 1 year ago

This release brings upgrades that streamline your deployment experience! The prefect deploy command now offers interactive prompts for deployment names and work pool selections. 👥 We've also introduced a work pool creation wizard 🧙 to simplify the process, guiding you through essentials like basic work pool info, infrastructure type, and configuration.

Additional improvements include support for SQLAlchemy 2, and much more!

See the release notes for more details.

prefect - Release 2.10.10

Published by jakekaplan over 1 year ago

This release improves CLI performance, addresses orchestration race conditions, improves handling of terminal signals for workers, and more.

Check out the release notes additional enhancements, fixes, and details.

prefect - Release 2.10.9

Published by zanieb over 1 year ago

This release adds worker logs to the flow run page, improves handling of termination signals, and adds global default settings for flow and task run retries.

Check out the release notes for additional enhancements, fixes, and details.

prefect - Release 2.10.8

Published by zanieb over 1 year ago

This release relaxes flow run orchestration rules for improved behavior on infrastructure restart, fixes a bug with hanging CLI commands, and includes a few small improvements.

See the release notes for details

prefect - Release 2.10.7

Published by zhen0 over 1 year ago

This release combines the previously separate flows and deployments UI pages into a single, holistic page that brings together information about flows and deployments, as well as recent and upcoming runs. You can now see the state of the most recent flow run for each flow and deployment, giving you a snapshot of the status of your workspace. In addition, you can now filter deployments by whether their schedule is active and the work pool to which flow runs are submitted. This release also introduces the new on_crashed hook for flows, allowing you to add client-side hooks that will be called when your flow crashes. This is useful for cases where you want to execute code without involving the Prefect API, and for custom handling on CRASHED terminal states. This callable hook will receive three arguments: flow, flow_run, and state.

Check out the release notes for more details.

prefect - Release 2.10.6

Published by znicholasbrown over 1 year ago

This release focuses on enhancing the deployment experience and streamlining project setup. You can now deploy multiple flows simultaneously using the improved deployment.yaml file. This release also features better run restart behavior, ensuring smooth transitions in various situations. Additional improvements include support for recursive flow calls, concurrent runs of the same flow, and several UI and CLI refinements. We've also enriched our documentation with an informative tutorial on developing custom workers. This release incorporates a critical fix for logs, addressing occasional delays in sending them to the API.

Check out the release notes for more details.

prefect - Release 2.10.5

Published by serinamarie over 1 year ago

This release includes some new features, such as a worker for each major cloud provider: a CloudRunWorker, ECSWorker, and AzureContainerWorker! 🎉 We're also releasing a new GitHub Action allowing you to automate the build process for deployments orchestrated by Prefect Cloud.

We've also included a number of enhancements, such as a widened flow run graph and Details tab on the Flow Runs page in the UI, a documentation refactor to provide more intuitive docs navigation, and much more!

Check out the release notes for more details.