flyte

Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.

APACHE-2.0 License

Downloads
463.7K
Stars
4.9K
Committers
253
View Code on GitHub Visit Website View on X
Ecosystems: gRPC, Kubernetes, Python, Go

Bot releases are visible (Hide)

flyte - flytectl/v0.8.21 Latest Release

Published by flyte-bot 5 months ago

Changelog

  • 1384b32d6 Ensure token is refreshed on Unauthenticated (#5388)
  • 2f1f813de Skip flytectl upgrade tests (#5381)
flyte - flytectl/v0.8.20

Published by flyte-bot 5 months ago

Changelog

  • 11fbeca68 Fix flytectl demo start (#5370)
flyte - flytectl/v0.8.19

Published by flyte-bot 5 months ago

Changelog

  • b5d78aa97 #minor Documentation fix and refactoring in sandbox (#131)
  • 8db28dd3e #minor Revert "Adopt flyteidl's ordered variable map change" (#180)
  • 936a24ac6 #minor Updated Sandbox config, with automated data configuration (#440)
  • 2766c18b2 #minor feat: pagination support for get commands (#234)
  • 41e0a4006 #none Fix DCO make target (#139)
  • 5da69f57d #none add go mod tidy in flyteidl release workflow (#151)
  • 81471f18c #none fixed storage config in docs (#138)
  • d75142cc4 3 usability improvements -Named executions, improved connection handling and better logging (#349)
  • 2a25558b1 Absolute path for Source dir (#126)
  • dd4655d7a Add ContentMD5 to fast register upload request (#303)
  • 90e01a648 Add Slack button to README (#198)
  • 2d6595656 Add ability to recover executions (#149)
  • 3e4323a5e Add additional nil check (#156)
  • 3e9525f6b Add commands to fetch active and archived launchplans (#331)
  • e2ed56258 Add console endpoint config section and init arg (#361)
  • 26d976d92 Add default input default behavior check for scheduler workflow registration (#368)
  • 9deb2ecc8 Add deployment docs (#127)
  • d330473e2 Add extra host to start command (#369)
  • ab171cdef Add pflag binding and fix loading of config (#135)
  • aa1f211d2 Add prefetch functionality for paginator (#5310)
  • a64a4162e Add support dev cluster (#353)
  • d69f4b754 Add support for gate nodes (#399)
  • 89cb3742c Add upgrade command with some refactor (#152)
  • d7e062491 Added Create command (#17)
  • bb499a90c Added Github workflow for generating docs (#85)
  • 73e4aa375 Added HOMEDIR/.flyte to search path for config.yaml (#59)
  • a101cd6f5 Added Update Execution cli (#261)
  • a1442752b Added config init command (#123)
  • 6453fab47 Added arm support (#206)
  • 852d7abc3 Added boilerplate automation (#74)
  • 89f6e6f3d Added capability to relaunch an execution (#52)
  • 892456310 Added check before creating empty k8s config (#211)
  • 34d76146a Added cluster resource attribute support (#65)
  • c2c5649c8 Added command delete along with subcommand executions for terminating (#34)
  • 712fdf8b9 Added customizable fields during registration (#80)
  • b5f332a63 Added dco signoff preecommit (#89)
  • 676f0cf84 Added different repo for brew release (#46)
  • 3b49630cf Added docs for demo and updated docs for workflow execution config with more details (#316)
  • fc3c99e0f Added dryRun flag for printing docker command for demo and sandbox (#367)
  • 02cf19ed6 Added enableSchedule option on registration and linked missing docs (#324)
  • e6855b463 Added endpoint suffix to service user for pkce token saved in token cache (#264)
  • 39add711d Added env flag for sandbox start (#273)
  • fdd1b15a6 Added error data and abort data in get execution output (#79)
  • 8b1c8446f Added exec command in sandbox (#122)
  • 19ba5fd4f Added fast register functionality (#112)
  • 2d2c145d5 Added filters flag (#82)
  • 1a904e0b3 Added flag to pass in CAcerts (#245)
  • fe72730a5 Added flags for using local images in sandbox (#216)
  • 517beb9a8 Added flytectl config by env variable (#91)
  • 696065ce5 Added goreleaser dry run in build (#47)
  • 400d4b6c6 Added gpg sign commit for flyte-bot (#92)
  • 7a43a97c0 Added latest version check added (#111)
  • 0a23db336 Added launchplan update command and moved namedentity (#170)
  • 31ad383f4 Added minio port in sandbox (#203)
  • 002d176ae Added node execution data to show inputs and outputs (#136)
  • 0f708dd43 Added non zero return code on error and AlreadyExists as success condition (#71)
  • cfde70d50 Added option to update labels & description in project (#260)
  • d5c31339b Added port for postgres in sandbox lite (#308)
  • 07fccb1dc Added reading of archive files for registration to flyte (#31)
  • 6947a2afd Added reuseable workflow (#276)
  • c5ab11ae3 Added sandbox command (#86)
  • bd1d4e5ef Added script for checking diff of generated code (#229)
  • 5c7133784 Added separate release workflow for releasing the binary (#132)
  • 179da66ab Added source flags in sandbox (#99)
  • 0a2ddb244 Added support for arm64 in install.sh (#209)
  • 4d43aee9e Added support for execution queue attribute (#66)
  • 2762f9762 Added support for pyflyte serialize fast register (#248)
  • 26f139a33 Added support for tar.gz in register (#199)
  • 4bb967592 Added transparent Get call when fetching latest version of workflow objects (#73)
  • caa38e551 Added unit test for covarage (#83)
  • b11a9e8e6 Added unit test for docker (#110)
  • cf3ffa193 Added update for named entity (#54)
  • 06458f580 Added validation for scheduled workflow during registration (#215)
  • 3904146af Added version command (#41)
  • 03be16bde Added version flag in sandbox (#137)
  • 36c1e4f86 Added version support to workflow command (#64)
  • a94cbdd57 Added workflow flag for get launchplan (#287)
  • 3749e3f8f Adding changes for project level matchable attr api (#357)
  • 3da647f89 Adding flytectl.rst to index (#257)
  • c68c5c2f2 Adding open-source boilerplate (#1)
  • d04b1e22b Adding overriden filter for get workflow (#310)
  • 9bcf5cc91 Adding support for ArrayNode (#406)
  • 6cf6d1e04 Adding support for execution cluster label (#68)
  • 5f9a2fb16 Adding support for structured dataset and also for node outputs in details flag (#390)
  • 9b05df0ed Adding support for workflow execution config (#144)
  • 7c31c1e8f Adopt flyteidl's ordered variable map change (#158)
  • 5af33e330 Always use sha for sandbox image (#266)
  • a0561024f Archive and Update project command (#24)
  • 79e8fddf5 Auto rendering of JSON entities using path (#13)
  • 3fb50804f Autodoc generation for cobra commands (#29)
  • 790a96566 Bind 30080 to 30081 in the case of sandbox (#313)
  • dd369af38 Bind pflags to default variable fields && Remove short flags as they're not supported by pflags (#124)
  • 3a48b4a54 Bug fix in sandbix start (#161)
  • 50ee30745 Bug fix in sandbox start when sandbox exist (#145)
  • b55026e60 Bump github.com/containerd/containerd from 1.5.10 to 1.6.26 in /flytectl (#5307)
  • 8db990138 Bump github.com/docker/distribution in /flytectl (#5313)
  • 7b823971f Bump github.com/docker/docker in /flytectl (#5363)
  • 8d2b83b1e Bump github.com/opencontainers/image-spec from 1.0.1 to 1.0.2 (#217)
  • cb57beb00 Bump golang.org/x/net to v0.23.0 (#5333)
  • f05acc7ae Bump idna from 3.6 to 3.7 in /flytectl (#5315)
  • b36a1f322 Bump jinja2 from 3.1.3 to 3.1.4 in /flytectl (#5329)
  • c7d02dfdb Bumped up flyteidl to 0.19.2 (#94)
  • 29740e0b6 Bumped up idl to use insecureVerify flag for remote and fixed docs (#125)
  • c673d3b7d Bumped up the flyteidl version to fix create execution issue (#53)
  • 73d9cb7bc Bumping go version to 1.19 (#384)
  • fc2ac0a26 Change extra host to host-gateway (#380)
  • e3977b117 Changes to 'use' in cmd folder (#235)
  • dafa5d7f2 Changing the default log level which is used by sandbox (#129)
  • 35e67f6a9 Check kubeConfig before starting sandbox (#363)
  • b09214614 Compile command (#321)
  • ee25d67b7 Consistent language about 'git revision SHA1' (#414)
  • 68324ce51 Consuming device flow IDL (#350)
  • e5d11a886 Create executions in flytectl (#39)
  • c751289f0 Created separate rst files for every resource (noun) (#230)
  • 440ad3171 Demo fit and finish (#317)
  • 3414946e1 Devflow, boilerplate, improved code, formatting and bug fixes (#11)
  • 6e20a258f Do not bump version on docs or boilerplate update (#200)
  • ce0fd450c Do not upload codecoverage data from boilerplate (#478)
  • 083cdbd84 Doc updates (#398)
  • 62dfd3208 Documentation setup for FlyteCTL (#26)
  • 2cec59ba2 Editorial review (#256)
  • e2adac497 Expose buildkit port (#413)
  • 931c651f0 Expose webhook service (#323)
  • 2811f53f2 Feature/get workflow,Task,Domain,Project (#9)
  • 22c203bdd Feature/goreleaser (#27)
  • a9a45b357 Feature: update launchplan --archive to --deactivate (#449)
  • a4702fbcd Filtering on activation state of workflows (#305)
  • 3be778c2f Fix "Sandbox" typo on Demo page. (#346)
  • 92104a8fc Fix --clusterPool argument override (#360)
  • 0e3f2a862 Fix case for No string to no (#419)
  • a66e66995 Fix config init command fails if no flyte dir doesn't exist (#150)
  • d0333696b Fix docs contribution guide (#197)
  • b8770eec7 Fix docs for updating description using workflow-meta subcommand (#394)
  • 1fe32fa39 Fix flytectl sandbox crash on M1 macs due to json-iterate (#342)
  • 8dd8b05a8 Fix flytectlt tests (#5325)
  • b03e86de0 Fix get task resource attribute comment (#469)
  • 86e764778 Fix getAllExample (#320)
  • caf9bbc99 Fix goreleaser (#40)
  • 3e329adea Fix grammar test (#272)
  • dcc2c091d Fix panic in rendering LP input descriptions (#174)
  • d963c7aac Fix pod task fast registration template substitution (#184)
  • 2e49f752f Fix project status change on update for archived projects (#438)
  • 664a604de Fix self-upgrade (#437)
  • 09013f768 Fix small bug in rendering table (#14)
  • 2657b262a Fix struct generation in execution file (#434)
  • c5165962e Fix testutils.TearDownAndVerify #none (#424)
  • 95fcceaee Fix the error message for the update cmd (#411)
  • 8cad4ed85 Fix typos
  • 8362431a1 Fix: Check for git authentication when GITHUB_TOKEN exists (#463)
  • 7a6ba140c Fixed continueonError bug (#292)
  • f3f6765a3 Fixed create project (#277)
  • b58b748ac Fixed the non-zero return code issue in archive path (#194)
  • 51226d564 Fixed the version bug and also added force flag (#246)
  • 9cb07f9a1 Fixed validation logic for launch plan schedule registration (#280)
  • e569acbb6 Fixes in Flytectl (#109)
  • 9af534f35 Fixes the project name and workflow name in the flytectl documentation. (#339)
  • f59e5ae46 Fixup flytectl (#5309)
  • 61eb8f2c3 Flyte Add Enable/Disable Options for Agent Services (#420)
  • 3eb2ea3a3 Flytectl Doc fixes (#38)
  • 514375fb7 Flytectl get started updated (#58)
  • 69232033d Force go 1.19.10 in goreleaser (#415)
  • c17ee3bad GH workflow change - publish binary when tag is pushed (#5)
  • fb6eb2d3e Graphviz does not like hyphens #patch (#141)
  • ec7c344c9 Hide global flags by overriding usage template of cobra. (#430)
  • 24710f743 Hotfix register example (#172)
  • 409c01c24 Hotfix/config init validation (#250)
  • dda6460af Hydrate failure node (#456)
  • e8bffb618 Image migration to static resources (#294)
  • 49a11220f Implement Fast Register through PreSigned URL (#296)
  • 922a8b192 Implement PFlag Value interface for OutputFormat to allow pflag binding (#219)
  • d087f3552 Improve flytectl config init UX (#241)
  • b09e20653 Improve register example UX, Moved from argument to version flag. (#222)
  • 23228584a Include default MinIO credentials (#410)
  • 204d3eafb Include workflow execution creation as part of flytectl create workflow (#295)
  • 955392349 Increase sleep seconds when waiting for sandbox (#442)
  • 4367c0b0a Index is too verbose for the docs, fix it (#30)
  • 5e0c7ec54 Initial Commit (#3)
  • 646201bd9 Initial commit
  • 8a8bbc05b Integrate Bubbletea Pagination into get execution (#473)
  • f10384863 Launch Flyte cluster in the single binary mode (#306)
  • ef0e4352b Linked configurable options for flytectl config.yaml (#251)
  • b708356b8 Manually pull latest boilerplate (#427)
  • 661de8de4 Matchable resource support in flytectl for task resource attributes (#63)
  • 0e61f1354 Migrated github methods to githubutil (#268)
  • 58f2ab7ef Minor updates to Readme (#304)
  • 07f158df6 Misc cleanups to aesthetics (#441)
  • 262af6e26 Mocking github repo service and refactoring (#315)
  • 3199afa1b Modified latest version message (#283)
  • 8913631e7 Monodocs dev build (#448)
  • ebe66f254 New Demo image (#370)
  • 6a1e06b79 Node executions (#113)
  • f103e4111 Oauth support in flytectl (#49)
  • 5e967f714 Only pass literals to execution if they users provided values (#105)
  • 8b5696e24 OverwriteCache flag for creating/relaunching executions (#358)
  • 1cfb91555 Pass k8s account on LP Execution (#100)
  • 59340aee1 Passing security context only if its non empty (#300)
  • 1cf79c197 Point Tutorial Youtube video to the correct one (#167)
  • b8ee84f0d Print instruction after teardown (#403)
  • 4065cf711 Project domain attribute for workflow Execution config (#298)
  • ff172b928 Proposal for flytectl (#2)
  • 9a4e5fa39 Proposal update: Additional details on some commands & aux commands (#12)
  • a2c4dd314 Pygments style should default to material (#35)
  • 9e3af15dd Recognize windows arm as a valid OS+arch combination (#386)
  • a2f437fcd Redirect install.sh script (#204)
  • 69c6afa4a Refactor (#275)
  • 052316d88 Refactor get command (#84)
  • a0632f082 Refactored the fetcher interface to exclude cmdCtx (#61)
  • 48e15a666 Register file and Get executions functionality (#22)
  • d98708da2 Release a new version for each master merge (#96)
  • 71e61f18c Remove dependency on unsupported k8s.io/kubernetes library (#457)
  • 9aaba3e34 Remove duplicate register files (#288)
  • d9cdd21cb Remove flytekit image priming (#412)
  • a0a2fc278 Remove go as dependency of brew formula (#395)
  • 2fae848b6 Remove input output columns for list workflows (#157)
  • 123067949 Removed parent flags which are not required as of now (#107)
  • b69fc961f Removed storage config and updated boilerplate (#319)
  • 4199e65a3 Removing the ignore on start-node and minor bug fix (#176)
  • bc3df4dcf Rename flag in sandbox (#119)
  • 59860c47d Rename flytesnacks flag to sourcesPath (#116)
  • eaeb998c6 Render descriptions in flytectl (#154)
  • 49714a3cb Require a user ACK or --force flag for update commands #minor (#423)
  • f2d8560a6 Reset default filter in the task_test so that the unit tests can be run individually (#155)
  • 3ae90aa6f Respect project state in project.yaml file (#402)
  • efffd5772 Sandbox status & Bash completion (#115)
  • c6dff3f2b Schema support idl update (#182)
  • b62243b22 Share demo/sandbox status command logic (#364)
  • b484b2fcc Specify cluster pool when creating execution (#355)
  • 5b70d88e9 Start sandbox logic shared for demo/sandbox cmds #minor (#326)
  • 2c3ffc296 Support envs when creating execution (#408)
  • cbe889de8 Support new sandbox-bundled features (#381)
  • e2082c00b Supporting generic types through flytectl (#78)
  • 1d96987e8 Task details in table and using jsonpb to print data (#15)
  • 09f9d213f Teardown logic shared for demo/sandbox cmds (#329)
  • 325b1065e The rst file names are in upper case (#237)
  • c96ee7f18 Update --force in doc (#443)
  • a462dc0dc Update CONTRIBUTING.md (#118)
  • b3ae52064 Update FlyteCTL Contribution Guide (#183)
  • f9dbf79d3 Update Flyteidl to avoid having string literal when the value is a simple empty/nil string (#103)
  • a87e20be8 Update Flyteidl version (#114)
  • 2fd5e5682 Update Flyteidl version (#134)
  • c98c23c20 Update Flyteidl version (#160)
  • 249ee0475 Update Flyteidl version (#202)
  • bdf47b88b Update README.md (#192)
  • 44c55f63d Update admin endpoint to use port 30080 in config.yaml (#467)
  • 3d86194a7 Update code of conduct (#148)
  • 65dd7f1af Update dependencies for Flyte monorepo migration (#429)
  • 9feeb8e8a Update docs for flytectl update project (#458)
  • 9460d7155 Update documentation (#117)
  • cf69eafaa Update documentation (#128)
  • bb6225539 Update documentation (#133)
  • 5695606cf Update documentation (#142)
  • 0510aaa69 Update documentation (#146)
  • 5e453441e Update documentation (#159)
  • e3c8cafab Update documentation (#162)
  • 6a8bb243a Update documentation (#173)
  • f33a41d85 Update documentation (#175)
  • f8fff0e21 Update documentation (#196)
  • 3c0eaa219 Update documentation (#213)
  • 47ee1ef2e Update documentation (#220)
  • f4a7e1e3a Update documentation (#221)
  • 0f9eee813 Update documentation (#223)
  • 3064b009a Update documentation (#233)
  • cb3193a78 Update documentation (#239)
  • 04d2c5300 Update documentation (#247)
  • 6453ad849 Update documentation (#249)
  • 60b0f1c27 Update documentation (#253)
  • 1784a382b Update documentation (#263)
  • f72902eeb Update documentation (#270)
  • f2ad71956 Update documentation (#271)
  • 799216692 Update documentation (#282)
  • 39cb8f3e4 Update documentation (#286)
  • 3421735b7 Update documentation (#289)
  • 1f29a6732 Update documentation (#293)
  • e22bce68f Update documentation (#301)
  • 0a1850dd7 Update documentation (#307)
  • 3989ec817 Update documentation (#335)
  • 63d38bf08 Update documentation (#340)
  • 305adae20 Update flyteidl version (#333)
  • fce2910db Update flyteidl version (#336)
  • ae1f5c018 Update flyteidl version (#341)
  • ca54f09ea Update help string for 'update task-meta' and 'update launchplan-meta' (#445)
  • bbd546e11 Update launch plan archive help string (#343)
  • f24f3a683 Update proposal for create (#18)
  • 2d93fcfab Update sandbox default config in the docs (#243)
  • e3aaedb08 Update template formate in install script (#48)
  • cff5a3d9b Update typo nodID -> nodeID in execution.go, flytectl_get_execution.rst (#450)
  • c6644401a Update upgrade.go (#164)
  • e292dd98b Update workflow_execution_config (#401)
  • 65580deaf Updated Boilerplate Code (#57)
  • 580370235 Updated readthedocs configuration - moved to build.os (#425)
  • 3a07da0e4 Updated version of flyteidl and removed the pinned version (#90)
  • 37847d4ca Updates the local kubecontext with that of sandbox and switches to it (#255)
  • 249cd1016 Upgrade IDL version (#382)
  • b3c746f5a Upgrade setup-go (#5328)
  • f4ed59fff Use GetLatestRelease to list latest non-pre-release flytesnacks version #minor (#279)
  • 7c9cf48f9 Use proto file name to infer message type (#436)
  • a2954286e Using released IDL version for CACaert flag (#254)
  • 096e377e1 Using security context during registration (#328)
  • 7b0145f0d Using the new pflags which has --bind-default-var functionality (#70)
  • c6ef3e70b Visualize graphs on command line (#75)
  • d7f247b13 When preleases are allowed for demo sandbox, simply choose the latest release (#407)
  • 308ddc86a [Doc] Updated flytectl uprade command (#297)
  • 4752206a3 [Docs] Flytectl docs cleanup (#210)
  • fd190c592 [Housekeeping] Refactor flytectl flags (#212)
  • c1d273cb9 [WIP]Exclude generated file from unit test (#143)
  • 4dd5f3c27 [monorepo] Move flytectl gh workflows to monorepo (#5354)
  • ce15cf056 add --dryRun flag to flytectl subcommands (#163)
  • 06765aabc add flytectl docs redirects to monodocs (#454)
  • 81a087387 add mainnav icons (#72)
  • f727ff644 add monodocs build to ci in flytectl (#446)
  • d30de343a add monodocs index page in flytectl (#453)
  • 9322c069d add monodocs redirect banner (#452)
  • dec585d44 add port (#265)
  • 4d78b8e93 add the missing exports for demo (#330)
  • 1d2d0db4f add version to pflags (#232)
  • 2761a7200 added support for helm (#177)
  • a2ac19f64 algolia search (#130)
  • 6618d9ea4 bind sandbox port to host system (#165)
  • f079e1d93 bump containderd version (#262)
  • 651706b5a bump containerd (#290)
  • 5d691856f bump docker/distribution (#281)
  • 40e2b3844 bump docsearch version (#258)
  • 073c29d76 bump version containerd (#231)
  • 34ed4b0d7 correct the install command (#16)
  • cad9e39bf dark theme updates (#45)
  • 38aae27c4 downgrade python version (#87)
  • 6898a8e64 enable --force flag in flyte demo start (#432)
  • e93d16cfd fix algolia search (#179)
  • 6a00fb3f3 fix config in docs (#50)
  • d2ef7daf6 fix confusing doc for flytectl delete (#377)
  • 63582435e fix create project bug (#291)
  • f5473de47 fix dependencies (#455)
  • 5392ada02 fix gcp parameters... s3 -> google (#147)
  • 70c47ed0e fix panic when get with table output for resource w/o expected output (#168)
  • 0c1620267 fix: Correctly demultiplex sandbox Docker exec output (#214)
  • da9d46764 fix: doc-requirements.txt to reduce vulnerabilities (#240)
  • c7e543ae8 fix: doc-requirements.txt to reduce vulnerabilities (#334)
  • e38e7a0a6 fix: doc-requirements.txt to reduce vulnerabilities (#416)
  • ec3f38b2e fix: doc-requirements.txt to reduce vulnerabilities (#479)
  • e5e923f3d fix: revert sandbox lite image tag prefix to sha (#312)
  • 7f2214330 fix: use 'dns:///' instead of 'dns://' (#274)
  • 5ff3c6d6a fixes update message when the version is same (#322)
  • d32425d47 flyetcl version should ignore talking to admin if host is not configures (#318)
  • f0930de1f flytectl demo start should print nicely (#311)
  • 460920a6c flytectl docs (#28)
  • 6f9a2aa91 flytectl sandbox start --image xyz (#195)
  • 7f80f02ab force flag (#431)
  • ac2f7c870 hotfix fast register (#171)
  • 8774f00db initial contributing (#8)
  • b725a65b6 install latest flyteidl with monodocs build (#459)
  • 73aa8188c launch plan command added (#10)
  • 122d16287 new flytestd libe version added (#93)
  • ce18a96e5 refactor: remove redundant YAML packages (#387)
  • e0d728421 remove welcome bot from boilerplate (#337)
  • f35bb2edd rename upgrade workflow (#332)
  • ce7ddc1ff to flyteorg (#43)
  • 2a9a827ba update doc requirements with sphinx v4 (#153)
  • 6114a7cd6 update docs based on revamp RFC (#60)
  • 1468b6b49 update docs theme (#44)
  • 6f1622ffb update execution for state changes (#267)
  • 4a1ff5e04 update flytectl for new navbar (#259)
  • 727e95209 update launch_plan.go (#344)
  • 9c10cd1b2 update launch_plan.go (#354)
  • 007a4b1f6 update links for monodocs (#465)
  • de61bd019 use sphinx-design directives instead of sphinx-panels (#471)
  • 3b266d7bf youtube video embedding for flytectl with walkthrough (#166)
flyte - Flyte v1.12.0 milestone release

Published by flyte-bot 6 months ago

Flyte 1.12.0 Release Notes

Flyte 1.12.0 brings a host of new features, optimizations, and fixes, enhancing the platform's functionality and user experience. This release also welcomes several new contributors to the Flyte community. Below are the highlights of this release.

🚀 New Features & Improvements

  1. Admin & Core Enhancements

  2. Helm Charts & Manifests

  3. Documentation Improvements

  4. Performance & Bug Fixes

🔧 Housekeeping & Deprecations

  1. Deprecated Configuration

  2. Miscellaneous

🆕 New Contributors

Full Changelog

flyte - Flyte v1.12.0-b0 milestone release

Published by flyte-bot 6 months ago

Flyte v1.12.0-b0

What's Changed

New Contributors

flyte - Flyte v1.11.1-b1 milestone release

Published by flyte-bot 7 months ago

Flyte v1.11.1-b1

What's Changed

New Contributors

flyte - Flyte v1.11.1-b0 milestone release

Published by flyte-bot 7 months ago

Flyte v1.11.1-b0

flyte - Flyte v1.11.0 milestone release

Published by flyte-bot 8 months ago

Flyte v1.11.0 Release Notes

We're excited to announce the release of Flyte v1.11.0! This version brings a host of improvements, bug fixes, and new features designed to enhance your experience with Flyte. From operational enhancements to documentation updates, this release aims to make Flyte more robust, user-friendly, and feature-rich.

Highlights

  • Agents hit General Availability (GA): Agents, now in General Availability, are long-running, stateless services that facilitate asynchronous job launches on platforms like Databricks or Snowflake and enable external service calls. They are versatile, supporting implementations in any language through a protobuf interface, enhancing Flyte's flexibility and operational efficiency.
  • Improved Caching: Support for loading cached sublists with multiple data types has been introduced, eliminating issues related to cache retrieval across varied data formats.
  • Tracing and Observability: The introduction of opentelemetry BlobstoreClientTracer in flyteadmin enhances observability, allowing for better monitoring and troubleshooting.
  • Security Enhancements: Added securityContext configuration to Flyte-core charts, strengthening the security posture of Flyte deployments.
  • Documentation Overhaul: Continuous improvements and updates have been made to the documentation, fixing broken links and updating content for better clarity and usability.
  • Operational Improvements: This release introduces enhancements such as adding a service account for V1 Ray Jobs, caching console assets in a single binary, and conditional mounting of secrets to improve the operational efficiency of Flyte. Additionally, we are removing kustomize from our deployment process to simplify the configuration and management of Flyte instances, making it easier for users to maintain and streamline their deployment workflows.

Bug Fixes

  • Fixed Literal in Launchplan: Added fixed_literal to the launchplan template, addressing issues with hardcoded values in workflows.
  • Corrected Metadata and Resources: Fixes have been applied to correct IsParent metadata in ArrayNode eventing and to address invalid "resources" scope issues in deployment configurations.
  • Enhanced Stability and Performance: Numerous bug fixes have been implemented to address stability and performance issues, including fixes for data catalog errors, yaml comment errors in pod template examples, and more.

Documentation and Guides

  • Comprehensive Guides: New guides and documentation updates have been added, including a ChatGPT Agent Setup guide and an Airflow migration guide. Improvements in documentation for developing agents have been integrated into the broader enhancements for this release.
  • Updated Troubleshooting and Configuration Docs: New troubleshooting guides for spark task execution and updates to deployment configuration documents enhance the knowledge base for Flyte users.

Contributors

We extend our deepest gratitude to all the contributors who made this release possible. Special shoutouts to @neilisaur, @lowc1012, @MortalHappiness, @novahow, and @pryce-turner for making their first contributions!

For a full list of changes, enhancements, and bug fixes, visit our changelog.

Thank you for your continued support of Flyte. We look forward to hearing your feedback on this release!

flyte - Flyte v1.11.0-b1 milestone release

Published by flyte-bot 8 months ago

Flyte v1.11.0-b1

Second beta release for 1.11.0.

This includes a refresh of flyteconsole.

flyte - Flyte v1.11.0-b0 milestone release

Published by flyte-bot 8 months ago

Flyte v1.11.0-b0

Beta release to test new idl

flyte - Flyte v1.10.7 milestone release

Published by flyte-bot 8 months ago

Flyte 1.10.7 Release Notes

We're excited to share the release of Flyte 1.10.7, featuring a broad spectrum of updates, improvements, and bug fixes across the Flyte ecosystem. This release marks a pivotal shift in our development approach, notably with our adoption of buf for protobuf stub generation. This move optimizes our development workflow and discontinues the automatic creation of Java and C++ stubs, making it easier to adapt the generated code for other languages as needed. Additionally, we've upgraded to gRPC-gateway v2, aligning with the latest advancements and recommendations found in the v2 migration guide.

Our sincere gratitude goes to all contributors for their invaluable efforts towards this release.

Core Improvements and Bug Fixes

  • Improved error handling for transient secret sync issues, enhancing the robustness of secret management. [PR #4310]
  • Introduced Sphinx build for Monodocs, improving documentation generation and integration. [PR #4347]
  • Enhanced the Spark plugin by fixing the environment variable ValueFrom for pod templates, allowing for more dynamic configurations. [PR #4532]
  • Optimized fastcache behavior to not cache lookups on node skip, reducing unnecessary cache hits. [PR #4524]
  • Removed composition errors from branch nodes, streamlining execution paths. [PR #4528]
  • Added support for ignoring warnings related to AWS SageMaker imports, improving integration compatibility. [PR #4540]
  • Fixed a bug related to setting the service account from PodTemplate, ensuring correct service account usage. [PR #4536]
  • Addressed flaky tests in test_monitor, enhancing test reliability. [PR #4537]
  • Updated the boilerplate version and contribution guide, facilitating better community contributions. [PR #4541], [PR #4501]
  • Improved documentation build processes by manually creating version files and introducing a conda-lock file for consistent environment setup. [PR #4556], [PR #4553]
  • Enhanced array node evaluation frequency optimization by detecting subNode phase updates. [PR #4535]
  • Introduced support for failure nodes, allowing workflows to handle failures more gracefully. [PR #4308]
  • Made various updates to Go versions, plugin integrations, and GitHub workflows to enhance performance and developer experience. [PR #4534], [PR #4582], [PR #4589]
  • Addressed several bugs and made improvements in caching, metadata handling, and task execution, further stabilizing the Flyte platform. [PR #4594], [PR #4590], [PR #4607]
  • Streamlined development workflow with the transition to buf for generating protobuf stubs, ceasing the automatic generation of Java and C++ stubs.
  • Upgraded to grpc-gateway v2, optimizing API performance and compatibility.

Plugin and Integration Enhancements

  • Added new features and fixed bugs in the Spark plugin, Ray Autoscaler integration, and other areas, expanding Flyte's capabilities and integration ecosystem. [PR #4363]
  • Updated various dependencies and configurations, ensuring compatibility and security. [PR #4571], [PR #4643]
  • Improved the handling and documentation of plugin secrets management, making it easier for users to manage sensitive information. [PR #4732]

Documentation and Community

  • Updated community meeting cadence and contribution guidelines, fostering a more engaged and welcoming community. [PR #4699]
  • Enhanced documentation through various updates, including the introduction of a new architecture image for FlytePlugins and clarification of propeller scaling. [PR #4661], [PR #4741]

Full Changelog

New Contributors

flyte - Flyte v1.10.7-b4 milestone release

Published by flyte-bot 9 months ago

Flyte v1.10.7-b4 Release

Pre-release testing.

flyte - Flyte v1.10.7-b3 milestone release

Published by flyte-bot 9 months ago

Flyte v1.10.7-b3 Release

Pre-release testing.

flyte - Flyte v1.10.7-b2 milestone release

Published by flyte-bot 9 months ago

Flyte v1.10.7-b2 Release

Pre-release testing.

flyte - Flyte v1.10.7-b1 milestone release

Published by flyte-bot 9 months ago

Flyte v1.10.7-b1 Release

Pre-release testing.

flyte - Flyte v1.10.7-b0 milestone release

Published by flyte-bot 10 months ago

Flyte v1.10.7-b0 Release

Beta release.

flyte - Flyte v1.10.6 milestone release

Published by flyte-bot 11 months ago

Flyte 1.10.6 Release

Due to a mishap in the move to the monorepo, we ended up generating the git tags between 1.10.1 to 1.10.5, so in order to decrease the confusion we decided to skip those patch versions and go straight to the next available version.

We've shipped a ton of stuff in this patch release, here are some of the highlights.

GPU Accelerators

You'll be able to get more fine-grained in the use GPU Accelerators in your tasks. Here are some examples:

No preference of GPU accelerator to use:

@task(limits=Resources(gpu="1"))
def my_task() -> None:
    ...

Schedule on a specific GPU accelerator:

from flytekit.extras.accelerators import T4


@task(
    limits=Resources(gpu="1"),
    accelerator=T4,
)
def my_task() -> None:
    ...

Schedule on a Multi-instance GPU (MIG) accelerator with no preference of partition size:

from flytekit.extras.accelerators import A100


@task(
    limits=Resources(gpu="1"),
    accelerator=A100,
)
def my_task() -> None:
    ...

Schedule on a Multi-instance GPU (MIG) accelerator with a specific partition size:

from flytekit.extras.accelerators import A100


@task(
    limits=Resources(gpu="1"),
    accelerator=A100.partition_1g_5gb,
)
def my_task() -> None:
    ...

Schedule on an unpartitioned Multi-instance GPU (MIG) accelerator:

from flytekit.extras.accelerators import A100


@task(
    limits=Resources(gpu="1"),
    accelerator=A100.unpartitioned,
)
def my_task() -> None:
    ...

Improved support for Ray logs

https://github.com/flyteorg/flyte/pull/4266 opens the door for RayJob logs to be persisted.

In https://github.com/flyteorg/flyte/pull/4397 we added support for a link to a Ray dashboard to show up in the task card.

Updated grafana dashboards

We updated the official grafana dashboards in https://github.com/flyteorg/flyte/pull/4382.

Support for Azure AD

A new version of our stow fork added support for Azure AD in https://github.com/flyteorg/stow/pull/9.

Full changelog:

New Contributors

flyte - Flyte v1.10.6-b0 milestone release

Published by eapolinario 11 months ago

Flyte v1.10.6-b0 Release

Beta release.

flyte - Flyte v1.10.0 milestone release

Published by flyte-bot about 1 year ago

Flyte v1.10.0 Release

This release marks the move to the (monorepo](https://github.com/flyteorg/flyte/pull/4014). From now on the development of backend components is going to be done in the Flyte main repo.

Flyte Agents are also getting a major lift. They are not only more performant, but we're also announcing support for a variety of agents, including Airflow, Memverge, Snowflake, Databricks.

Programmatically consuming inputs and outputs using flyteremote became a lot easier with the introduction of code snippets directly in the UI. For example, notice the small blurbs below inputs and outputs in the side panel:

Usage snippet

You'll now be able to use offloaded types in eager workflows.

More ergonomic improvements to pyflyte, including the inclusion of a progress bar, the ability to activate launchplans, and the ability to interact with gate nodes in local executions.

And much more. Here's the exhaustive list of changes:

Flytekit

Flyteadmin

  • Fixed bug for incorrect name (#4175)
  • Add version control for ArrayNode eventing (#4165)
  • Update golang experimental dep (#4177)
  • Add Additional gRPC service handler hook (#4171)
  • Handle batched TaskExecutionEvent reasons (#615)
  • Lint flyteadmin/auth/handlers_test.go
  • #patch Update FromWorkflowModel API (#617)
  • add codespell: config, workflow and have typos fixed (#4054)
  • Handle batched TaskExecutionEvent reasons (#615)
  • Update FromWorkflowModel API (#617)
  • Update boilerplate version (#605)
  • Reduce a warning to info (#612)
  • Logout hook plugin (#611)
  • Expire flyte_idt cookie at logout (#610)
  • Use configured domain on expired cookies (#608)
  • Fix list named entities (#609)
  • Merge pull request from GHSA-r847-6w6h-r8g4
  • Update boilerplate version (#604)
  • Handle grpc error explicitly (#602)
  • Introduce pre redirect hook plugin during auth callback (#601)
  • Add default cluster pool assignments to config (#600)
  • Implement Sandbox notifications processor and publisher (#595)

Flytepropeller

  • [Extended Resources] GPU Accelerators (#4172)
  • [Monorepo] Enable proxy-authorization in admin client (#4189)
  • (monorepo--importing-flyteidl-452) Add version control for ArrayNode eventing (#4165)
  • Update golang experimental dep (#4177)
  • Moving from flytepropeller - Adding flags for ignore-retry-cause and default-max-attempts (#4153)
  • [Monorepo] Rename flyteidl (#4166)
  • Revert add supported task types for agent service by default for task types (#4162)
  • reverting to parallelism increases only on non-terminal phase updates (#624)
  • Add k8s events to task phase updates (#600)
  • Ray log links (#620)
  • Add supportTaskTypes for agentservice without write it in config twice. (#612)
  • Bump flytestdlib version (#619)
  • added check for invalid argument code on node event recording failure (#613)
  • start informerFactory by default. (#614)
  • bumped flyteplugins to v1.1.23 (#616)
  • fixing boilerplate (#617)
  • Supporting using arraynode as a subnode (#606)
  • fixing max parallelism (#611)
  • adding controller-runtime manager metrics handler to http endpoint (#607)
  • pulled latest boilerplate (#609)
  • Move caching to node executor for fast cache hits (#485)

Flyteplugins

  • Update the item only if it exists in the cache (#4117)
  • [Extended Resources] GPU Accelerators (#4172)
  • Implement Spark pod template overrides (#4183)
  • Support Evaluator in Kubeflow TensorFlow Training Operator (#4168)
  • Agent Get Pending Message (#4106)
  • Moving from flytepropeller - Adding flags for ignore-retry-cause and default-max-attempts (#4153)
  • change to tf job worker spec (#4169)
  • Return ResourceWrapper without pointer (#4115)
  • Revert add supported task types for agent service by default for task types (#4162)
  • Plugin changes for plumbing k8s events into TaskExecutionEvent (#406)
  • Fix flyteplugins lint errors
  • add codespell: config, workflow and have typos fixed (#4054)
  • Add supportTaskTypes for agentservice without write it in config twice. (#398)
  • Create a FileOutput reader if the agent produce file output (#391)
  • Bump flytestdlib version (#404)
  • feat: Dask add pod template support (#374)
  • Mark webapi task failure as retry limit exceeded (#392)
  • Make rendering template in agent client temporary (#395)
  • enable secrets in non-python k8s tasks (#401)
  • Rename agent chart (#4019)
  • Fix resources requests for AWS Batch plugin (#400)
  • Transition to Queue if the JobCondition is empty (#387)
  • Fix databricks plugin test Naming Error (#393)
  • Updating boilerplate to lock golangci-lint version (#394)
  • Fix double http in the Spark Driver UI Link (#389)
  • Render task template in the agent client (#384)

Flyteconsole

  • show correct details panel io (#820)
  • resume form should support all known types (#819)
  • optional list arg is causing ui launch form to white screen (#817)
  • breadcrumb dropdown render (#815)
  • switching projects doesn't respect domain value (#814)
  • invalid item in dropdown (#809)
  • flyte decks height (#813)

datacatalog

  • b5a958f Refactoring profile handler into entrypoints (#113)
flyte - Flyte v1.10.0-b0 milestone release

Published by flyte-bot about 1 year ago

Flyte 1.10.0-b0 beta release

The major change in this release is the monorepo. This is a beta release to test the new release process.

Package Rankings
Top 1.53% on Pypi.org
Top 1.55% on Proxy.golang.org
Badges
Extracted from project README
953358 37090125 7597118 27159 29843943 10830562 8888115 78108056 158892 18408237 2896568 1518524 37936015 27724763 16888709 27777173 452166 4748985 6562898 6239450 8805803 5032356 77798312 23062603 653394 5725707 8122852 10869815 3880645 3936213 26174213 9142716 5487021 1815175 46989299 2816689 19375241 6065051 70988 94349093 16090976 43610471 53313394 4967458 467927 248688 1330233 31255434 1472826 5026554 34587798 11799671 95110820 38207208 8200209 24364830 43587819 163899 36511035 22784654 1316881 1777447 1360529 104257 2538760 11970258 19733683 155087 1399455 21109744 49699333 1810591 80421934 3939659 9609986 12219405 98349643 16509490 6774758 18337807 322624 1168692 91385411 30621230 54334265 48736656 17165004 30375389 97543480 69013027 116700206 422486 54333860 7005765 4025771 48966647 77167782 23013825 31381038 4396228 6288302 23107192 121866694 7358951 33652917 6984748 488594 20173739 34498039 19853373 10376195 125105 1153481 37170063 2614101 4308533 10201242 11269256 61228633 13070236 8817639 17309187 26834658 5092599 57967031 67166843 1778407 51814063 3741621 12450632 35151789 13331724 119345186 1521126 73247359 50860453 6506810 55718143 65977800 6610300 84735036 85753828 101579322 26953709 105876962 25038146 88684372 99441958 1388071 58770001 20668349 100569684 17351764 6399428 25695302 18363301 4023015 3451399 25364490 50679871 7548823 7515359 31982395 62209650 1892175 200401 13770222 2380665 24739949 10430635 31911175 104152793 27818609 6486584 321459 35962310 91927689 726061 47872044 105229971 405480 1004789 82604841 480621 1335881 100597998 4830700 69161722 43336767 25391173 66388192 14992189 1175392 7475946 11796986 304786 24402505 1659415 86911142 11456773 7490199 10345184 29532638 14008978 9272376 1633460 3033592 19229049 36594527 8755869 6528449 790725 576968 36827492 133936 10438373 33272587 580328 1027207 16526627 10526540 5346764 22917741 40143026 77197126 300315 106815366 1568889 937967 114232404 14996868 93438190 1043051 21953442 16461847 64676594 1174730 20135478 151841 44368997 36989112 7144772 697033 2845540 4056828 1071153 5732047 471021 71284190 26265392 85021780 48512530 3275593 66853113 1834509 107893 1324225 1300022 244656 467294 71486 20280470 3533182 199429 1032633 1313087 521097 63936253 18519037 413772 11478411 6739793 83365562 6670894 86675 4748863 181308 1390277 1391982 3880001 770392 6178510 5111931 873434 16724 17330872 419419 1014 504507 8841470 901479 6400253 353644 12421077 809865 19378 1113245 101659 4730508 33036160 470810 7592392 94814 8147854 1005 17263167 2807589 1683714 6386887 615811 75184 469669 28523 10113228 5751464 2405410 5082160 11335612 23391642 1024762 7390781 49680 87524 866505 2611549 49961058 5655837 8320753 16513382 3807434 118945041 8232503 69170839 6388483 8296645 17337515 10090384 2302957 995707 25486791 5067549 53085803 62775347 25625597 282792 38894122 16698198 36490558 79913779 41898282 18567580 26092524
Related Projects
DetectDee

DetectDee: Hunt down social media accounts by username, email or phone across social networks.

29 Apr 2023 1,231
revive

🔥 ~6x faster, stricter, configurable, extensible, and beautiful drop-in replacement for golint

04 Jul 2017 4,775