prefect

Prefect is a workflow orchestration tool empowering developers to build, observe, and react to data pipelines

APACHE-2.0 License

Downloads
8.4M
Stars
14.5K
Committers
148

Bot releases are visible (Hide)

prefect - Release 2.13.7

Published by aaazzam about 1 year ago

This release includes:

โš™๏ธ ๐Ÿฅณ Pydantic V2 Support

In #10946 we add support for Pydantic V2. In 2.13.5 we released experimental support for Pydantic V2, which made it technically co-installable via forced install. In this release we're enabling proper co-installation.

prefect - Release 2.13.6

Published by desertaxle about 1 year ago

This release includes:

๐Ÿ“ฆ Default result storage block
The new PREFECT_DEFAULT_RESULT_STORAGE_BLOCK setting allows users to set a default storage block on a work pool or via job variables for a deployment. It's now easier to swap result storage locations by updating the environment in the UI or your prefect.yaml file, eliminating the need to alter your flow source code.

๐Ÿงช Experimental enhanced cancellation
We're enhancing the reliability of flow run cancellation, which you can try out by enabling the PREFECT_EXPERIMENTAL_ENABLE_ENHANCED_CANCELLATION feature. When enabled, you can cancel flow runs where cancellation can fail, such as when your worker is offline.

See the release notes for details!

prefect - Release 2.13.5

Published by pleek91 about 1 year ago

This release introduces a few new features:

โšก You can now load and serve flows from a git repository! With the new flow.from_source method, you can specify a git repository and a path to a flow file in that repository. This method will return a flow object that can be run or served with flow.serve().

๐Ÿงช Experimental Pydantic 2 compatibility! We're working eagerly toward having prefect installable with either pydantic<2 or pydantic>2. As a first step toward compatibility, we've ensured that Prefect's use of pydantic is isolated from your use of pydantic in as many ways as possible.

See the release notes for details!

prefect - Release 2.13.4

Published by znicholasbrown about 1 year ago

Enhancements

Fixes

Documentation

prefect - Release 2.13.3

Published by serinamarie about 1 year ago

This release includes:

๐Ÿ› ๏ธ CLI Enhancement for Work Pool Configurations
Configure your work poolโ€™s base job template directly through CLI! This enhancement adds more flexibility in creating and updating the base job template of a work pool, providing better control and version management.

๐Ÿ‘€ Customizable Default Flow Runs View
Optimize your workflow with a tailored default view on your Flow Runs page! A locally stored setting allows a user-centric approach, ensuring your preferred view is a click away.

See the release notes for details!

prefect - Release 2.13.2

Published by desertaxle about 1 year ago

This release introduces several key features and improvements:

๐Ÿ”’ Server-side enforcement of deployment parameter schemas

๐Ÿš€ Enhanced deployment flexibility with pattern-based deploying

๐Ÿ› ๏ธ Various fixes, including Prefect variable resolution in the deployments section of prefect.yaml

๐Ÿ“š Documentation updates and ๐Ÿค new contributions from the community

For a detailed breakdown, check out the release notes!

prefect - Release 2.13.1

Published by zzstoatzz about 1 year ago

This release introduces several enhancements and fixes:

๐Ÿ“Š Option to "Hide subflow runs" on the flow runs page of the Prefect UI.
โœจ Multiple enhancements like run_count in prefect.runtime and deployment triggers via CLI.
๐Ÿ› ๏ธ Various fixes including DST handling in CronSchedule and mobile UI improvements.
๐Ÿ“š Documentation updates and ๐Ÿค new contributions from the community.

See the release notes for details!

prefect - Release 2.13.0

Published by bunchesofdonald about 1 year ago

This release introduces exciting new features, as well as many enhancements, guides, and fixes!

๐ŸŽ›๏ธ Global concurrency limits: Control task execution and system stability with Prefect's new global concurrency and rate limits.

๐Ÿšฆ Work pool and worker status: Work pools and workers can now communicate their status. Ready, Not Ready and Paused for work pools and Online and Offline for workers.

๐ŸŒŒ We deprecated references to orion in our codebase six months ago, in this release, we're removing those references.

๐Ÿ“š Documentation Updates: Updated deployment concept documentation, new guide for deploying Kubernetes to Azure AKS, along with updated screenshots and broken link fixes.

Check out the release notes for more in-depth information and get ready to dive into a more powerful and user-friendly Prefect!

prefect - Release 2.12.1

Published by billpalombi about 1 year ago

This release includes some important fixes and enhancements. In particular, it resolves an issue preventing the flow run graph from rendering correctly in some cases. Please see the release notes for details.

prefect - Release 2.12.0

Published by serinamarie about 1 year ago

This release introduces exciting new features, as well as many enhancements, guides, and fixes!

๐Ÿ”ฅ Introducing Flow.serve(): Deploying flows has never been this straightforward. Just add .serve() to your existing flows and you can now schedule or trigger runs via the Prefect UI and CLI. Deployment and execution are just a script away!

๐ŸŽจ UI Makeover: The Prefect UI has a fresh new look, with updates in both light and dark modes. Navigate through an interface that's both visually pleasing and more harmonious.

๐Ÿ”ง Enhancements Galore: From improved validation to JSON overrides in deployments and expanded Docker image support, this release has lots of under-the-hood improvements.

๐Ÿ‘ท Worker and Work Pool Settings: New settings allow more granular control over SQLAlchemy connection pool sizes and better formatting of GitLab and Bitbucket tokens, enhancing the deployment process.

๐Ÿž Fixes: Various bugs have been addressed, including race conditions in concurrent subflow runs, Prefect Cloud login issues, and more to make your Prefect experience smoother.

๐Ÿ“š Documentation Updates: New quickstart guides, detailed Kubernetes usage, and a more organized index make it easier for both newcomers and experienced users to find what they need.

๐Ÿ“ˆ Additional Stats and Insights: Get a snapshot of your flows' performance with new summary graphs and statistics on each flow page.

Check out the release notes for more in-depth information and get ready to dive into a more powerful and user-friendly Prefect!

prefect - Release 2.11.5

Published by desertaxle about 1 year ago

This release includes two new guides for moving data to and from cloud providers and running flows via Kubernetes along with many enhancements and fixes. Please see the release notes for details.

prefect - Release 2.11.4

Published by pleek91 about 1 year ago

This release includes a new guide for upgrading from agents to workers, as well as a brand new way to visualize flows without running them. Please see the release notes for details.

prefect - Release 2.11.3

Published by serinamarie about 1 year ago

This release includes enhanced support for environment variables in deployments, as well as a CLI enhancement and documentation updates. Please see the release notes for details.

prefect - Release 2.11.2

Published by bunchesofdonald about 1 year ago

A lot of documentation updates, specifically around deployments, and ACI push work pools.

prefect - Release 2.11.1

Published by znicholasbrown about 1 year ago

This releases introduces the ability to override queue settings for individual flow runs and enables task runs to return Paused states. We've bolstered security by preventing accidental credential logging and fixed some UI issues related to work queues and flow run logs. Some new experimental features include a concurrency context manager and a rate_limit function.

See the release notes for more details.

prefect - Release 2.11.0

Published by zhen0 about 1 year ago

๐Ÿš€ This release makes work pools and workers generally available. There are now work pools for every major infrastructure type. Work pools expose rich configuration of their infrastructure. Every work pool type has a base configuration with sensible defaults such that you can begin executing work with just a single command. The infrastructure configuration is fully customizable from the Prefect UI. Push work pools remain a beta feature.

๐Ÿ“ˆ The release also adds flow summary graphs and stats to the flow page. Each flow page now includes graphs of it's recent flow runs, task runs, and (in prefect Cloud) related events, as well as summary statistics.

See the release notes for more details.

prefect - Release 2.10.21

Published by bunchesofdonald over 1 year ago

This release includes a number of exciting new features and improvements, including:

  • The Prefect Dashboard is now generally available.
  • Deploy deployments prefixed by flow name during prefect deploy.
  • Use environment variables in deployment steps.
  • Use prefect deploy with multiple deployments with the same name.
prefect - Release 2.10.20

Published by billpalombi over 1 year ago

Yesterday's 2.10.19 release introduced bugs that prevented UI form inputs from being rendered and parsed correctly. This release resolves those issues. It also drops Python 3.7 support. Prefect now requires Python 3.8 or later.

See the release notes for details.

prefect - Release 2.10.19

Published by serinamarie over 1 year ago

This release introduces a new Prefect dashboard as an experimental feature! The dashboard provides an overview of all Prefect activity, surfaces the urgent information, and provides the context to understand that information. Additionally, we've added support for service-specific credentials to the git_clone deployment step.

See the release notes for more details.

prefect - Release 2.10.18

Published by znicholasbrown over 1 year ago

This release introduces substantial enhancements to Docker image support during flow deployment. We've made the process of building, pushing, and pulling Docker images simpler, with our CLI now providing automatic detection and guidance for Docker-enabled work pools.

In addition, we're introducing event-based triggers for Prefect Cloud deployments and several improvements such as the ability to save updated deployment configurations and an install-policy option at worker start.

See the release notes for more details