optimus
Optimus is an easy-to-use, reliable, and performant workflow orchestrator for data transformation, data modeling, pipelines, and data quality management.
APACHE-2.0 License
Stars
743
Committers
23
Bot releases are visible (Hide)
optimus
- v0.3.5
Published by ravisuhag about 2 years ago
Changelog
- f7ebafa5 fix: Remove sensor poke failure event (#520)
optimus
- v0.3.4
Published by ravisuhag about 2 years ago
Changelog
- 6309c5cc fix: ignore deleted job when getting inferred dependencies (#517) (#518)
- c3c48af4 fix: use a single deployTimeout in optimus deploy cli (#515) (#516)
optimus
- v0.3.3
Published by ravisuhag about 2 years ago
Changelog
- e55c5683 fix:
job_end_eventtrigger set toall_success(#510) (#511)
optimus
- v0.3.1
Published by ravisuhag about 2 years ago
Changelog
- 11698cd2 fix: bug breaking deploy on resource manager failure (#500) (#508)
optimus
- v0.3.2
Published by ravisuhag about 2 years ago
Changelog
- fe3bb2ab fix: set depends on past value set by users in transformation task level (#488) (#509)
optimus
- v0.3.0
Published by ravisuhag about 2 years ago
Changelog
- 5b3896d refactor: change external optimus sensor task id similar with internal sensor task id (#491)
- 65af2ca fix: bug job deployment failed and cancelled not returning error (#485)
- 606b5d4 fix: bug unable to decode GetJobSpecificationsResponse for jobs with hook (#478)
- bc0a5eb fix: always load configs from env variables regardless filepath exist (#473)
- 878ddda fix: capture scheduler exception errors in Optimus notifications (#457)
- ea50e90 fix: bug external sensor created when internal sensor with same urn already resolved (#466)
- 80df76a fix: bug unable to deploy job without dependency mod (#459)
- b4c9bba feat: support optimus sensor (#438)
- aeda4bb fix: load config from env var (#447)
- bd5f932 fix: race condition on resource deploy (#448)
- 779ca46 feat: add Optimus dashboard (#439)
- e69feb9 feat: revamp config overriding (#431)
- 00de128 fix: pass context to plugin call (#402)
- 0aba386 refactor: GetJobSpecificationsResponse to also include project and namespace names (#436)
- 6a6835a refactor: persist job and resource dependency (#401)
- 3cf7239 feat: job monitoring (#395)
- 59aaefa fix: use go releaser token to push artifacts
- e82229d fix: use job_spec api to get schedule interval for sensors (#426)
- a418c90 fix: use right execution_dates to fetch airflow job runs for varying schedule intervals (#396)
- a976283 fix: increase send and receive size limit (#427)
- 05fd4c9 feat: provide api related to optimus sensor (#406)
- de15c74 fix: temporary fix to avoid failing of sensor fast in case of shedule run is not present
- 79fdefa feat: resource apply changes only if different (#351)
- 7b1198b fix: format name for read config through file (#403)
- 609b62d feat: async job deployment (#350)
- 36a5111 fix: use right execution_dates to fetch airflow job runs for varying schedule intervals (#396)
- bb61b05 fix: initialize cli colors (#361)
- 243f0c0 feat: improve telemetry for external system interactions (#393)
- 3b283db feat: expose telemetry address to plugin and propagate metadata downstream (#388)
- 3a4ea5e fix: server crash when accepting improper resource create request (#374)
- 453568a refactor: extension (#328)
- 54f0784 fix: add missing logs on job deployment and fix job refresh cli (#358)
- 6d63be3 refactor: merge refactoring changes to main (#373)
- 19ff6d6 refactor: split interfaces for backup and replay (#312)
- 85a7f47 refactor: command (#313)
- df0ca11 fix: resolve bug when refreshing jobs with cross project dependency (#349)
optimus
- v0.2.5
Published by ravisuhag over 2 years ago
Changelog
- 59aaefa fix: use go releaser token to push artifacts
- a418c90 fix: use right execution_dates to fetch airflow job runs for varying schedule intervals (#396)
optimus
- v0.2.4
Published by github-actions[bot] over 2 years ago
Changelog
- a976283 fix: increase send and receive size limit (#427)
optimus
- v0.2.3
Published by github-actions[bot] over 2 years ago
Changelog
- a976283 fix: increase send and receive size limit (#427)
optimus
- v0.2.2
Published by github-actions[bot] over 2 years ago
Changelog
- de15c74 fix: temporary fix to avoid failing of sensor fast in case of shedule run is not present
optimus
- v0.2.1
Published by github-actions[bot] over 2 years ago
Changelog
- dc5ab84 fix: fix to the earlier working goreleaser version for publishing artifacts in github (#354)
- dfc2b1d fix: sensor shouldn't fail in case optimus returns a non 200 response. (#353)
optimus
- v0.2.0
Published by github-actions[bot] over 2 years ago
Changelog
- 2ff2f8f fix: address synchronization issues in async deployment (#337)
- 5c1ff07 fix: bug when deleting secret (#339)
optimus
- v0.2.0-alpha.1
Published by github-actions[bot] over 2 years ago
Changelog
- 2ff2f8f fix: address synchronization issues in async deployment (#337)
- 5c1ff07 fix: bug when deleting secret (#339)
optimus
- v0.2.0-alpha
Published by github-actions[bot] over 2 years ago
Changelog
- 4d01e2f Feat register project namespace (#257)
- ed7e0b8 Merge Releases/v0.2.1 to main (#329)
- 437b481 Python tests ci pipeline (#279)
- c55f791 Revert "fix: sensor to use scheduled_time & all the window params (#211)" (#233)
- d7aeb33 Sensor merge and leverage job run api in sensor logic (#278)
- 2cebf72 avoid release branches and release from main branch itself (#334)
- 416c28f feat: #326, add pagerduty support (#327)
- f393b13 feat: API to fetch JobRuns for given date range (#201)
- 52f15fc feat: add job refresh (#227)
- fcc94d1 feat: add labels on job spec as tags in airflow dag (#156)
- 62bc51c feat: allow config for airflow specific (#290)
- 4bfeffe feat: bind config with cobra flags to override the conf (#274)
- da4aa74 feat: consume secrets from job config (#259)
- d4beca8 feat: init project & namespace (#256)
- 1273506 feat: make job deployment asynchronous (#296)
- be782eb feat: multi namespace deployment support (#210)
- 80ec40d fix: add Maybe for optional calls due to map order (#280)
- d0faf13 fix: avoid modifying the origional confs (#295)
- 1c8ecf4 fix: bug caused by survey requirement on job validate and job run
- 1c18f20 fix: bug on uncatched log and early deployment termination for empty spec on namespace (#276)
- 692d62b fix: fix missing secrets for register (#291)
- 14cd989 fix: goreleaser build (#270)
- e44256d fix: handle empty nameSpaces config to prevent infinite prompt loop (#242)
- d08a801 fix: improve logging for deployment (#273)
- 87c400e fix: logging for job and resource deployment (#241)
- 8f48ad6 fix: pass namespace spec that has secrets to DeployJobs process (#284)
- e97668a fix: pass project spec containing secrets to plugin (#289)
- f7e6657 fix: prerun client config load (#271)
- f12a263 fix: sensors to use schedule_time_of_dag, window_size, upstream_schedule (#239)
- 2c48c0e fix: update the grpc limits for the client side (#234)
- 608a0c8 fix: update the workflows to verify, publish-latest and release. (#303)
- de3a40d fix: use correct script to drop job_dependency on migration down (#298)
- f730089 fix: use global flag for the docs user (#229)
- 9dbfb93 fix: use of progress on version call (#243)
- 653f83c fix: when file config not exist return error (#262)
- a5349fe refactor: arrange imports in order of stdlib, third-party and optimus (#237)
- 21b96c2 refactor: break down server initialisation in different parts (#240)
- 7d19600 refactor: decouple postgres adapter from plugin service (#294)
- 429b8c8 refactor: divide deployment command function for better readability (#269)
- 8c7c4a0 refactor: enable gosec to check for security issues (#230)
- 9cecebf refactor: extract constant for commands (#209)
- 4d9227b refactor: fix errors reported by gosimple (#206)
- 287f7b8 refactor: fix errors reported for errors and naked-return (#208)
- e791078 refactor: fix gocritic diagnostic errors (#238)
- e793a41 refactor: fix linter for init and autofix gofumpt (#221)
- 8760bba refactor: fix some lint errors (#245)
- 9007ac0 refactor: move test to separate package (#207)
- f4a768d refactor: propagate context to downstream calls (#216)
- dc1f5ec refactor: remove airflow1 support (#213)
- 42508b8 refactor: remove github.com/pkg/errors as dependency (#283)
- 8cd1795 refactor: remove unused method receivers (#281)
- f67f5f9 refactor: remove unused params and enable strict check (#218)
- b16b622 refactor: run database migration only once for all integration tests (#217)
- eb9676a refactor: split config (#236)
- af266ee refactor: split run module in service and compiler (#244)
- 16dfb63 refactor: split runtime proto to smaller module proto (#231)
- 74d46c0 refactor: update job status command to use job run API (#255)
- 05f8953 refactor: use bot user to publish docs (#226)
- 182d6c8 refactor: use truncate tables in missing integration tests (#309)
- 4d46754 review: add review comments
optimus
- v0.1.2
Published by kushsharma over 2 years ago
Changelog
- dc3fcc5 Api to delete secret for project (#160)
- fcfddc6 Enable all linters, disable only the problamatic ones (#159)
- c07c545 Namespace name during saving secret is optional (#158)
- ed76281 feat : add external http sensor at optimus (#150)
- a8da326 feat: Split runtime in multiple files (#153)
- 76be7c4 feat: Use secrets in macros (#155)
- 008f5a8 feat: Use services in runtime instead of repo-factories (#149)
- 49a76e4 feat: add api to list secrets (#141)
- b5277d5 feat: add dagrun_timeout to airflow dag (#142)
- 500e3cd feat: create and update secrets through cli & api (#129)
- 01db921 feat:Print Basic Details of Image Version & Optimus Client & Server Versions (#143)
- 7c7fcda fix : maintain single optimus host variable across environment (#147)
- 431059b fix(optimus): fix issue related to newline of resources (#140)
- a2a0f91 fix: avoid unmarshall if external dependencies is null (#214)
- a759f84 fix: fix issues for staticcheck linter (#191)
- 3d6f277 fix: remove or rename unused params (#190)
- bfec874 fix: remove reference to make generate in release (#212)
- bcd7324 fix: set CrossTenantDependancySensor mode from default poke to reschedule (#145)
- ecccf4b fix: update the grpc limits for the client side (#234)
- 1ec74c3 refactor: Use optimus config struct instead of interface (#162)
- 9e7d04b refactor: change command for running test in makefile (#194)
- a993cf4 refactor: clean unused code and methods (#161)
- 9b7a598 refactor: fix errors reported by magic number lint (#199)
- d775eb1 refactor: fix issues reported by stylecheck and enable the linter (#193)
- 31b6c90 refactor: reduce the number of global vars (#195)
- 28e6062 refactor: refactor and cleanup for secrets management (#202)
- 8521ef1 refactor: remove deprecated package "github.com/pkg/errors" (#200)
optimus
- v0.1.1
Published by kushsharma over 2 years ago
Changelog
- dc3fcc5a Api to delete secret for project (#160)
- fcfddc6a Enable all linters, disable only the problamatic ones (#159)
- c07c5452 Namespace name during saving secret is optional (#158)
- ed76281d feat : add external http sensor at optimus (#150)
- a8da3263 feat: Split runtime in multiple files (#153)
- 76be7c4b feat: Use secrets in macros (#155)
- 008f5a8e feat: Use services in runtime instead of repo-factories (#149)
- 49a76e48 feat: add api to list secrets (#141)
- b5277d5c feat: add dagrun_timeout to airflow dag (#142)
- 500e3cdd feat: create and update secrets through cli & api (#129)
- 01db9214 feat:Print Basic Details of Image Version & Optimus Client & Server Versions (#143)
- 7c7fcda7 fix : maintain single optimus host variable across environment (#147)
- 431059b6 fix(optimus): fix issue related to newline of resources (#140)
- a2a0f91d fix: avoid unmarshall if external dependencies is null (#214)
- a759f840 fix: fix issues for staticcheck linter (#191)
- 3d6f2771 fix: remove or rename unused params (#190)
- bfec8741 fix: remove reference to make generate in release (#212)
- 2ce5ba4f fix: sensor to use scheduled_time & all the window params (#211)
- bcd7324b fix: set CrossTenantDependancySensor mode from default poke to reschedule (#145)
- 1ec74c35 refactor: Use optimus config struct instead of interface (#162)
- 9e7d04b2 refactor: change command for running test in makefile (#194)
- a993cf46 refactor: clean unused code and methods (#161)
- 9b7a5987 refactor: fix errors reported by magic number lint (#199)
- d775eb10 refactor: fix issues reported by stylecheck and enable the linter (#193)
- 31b6c90e refactor: reduce the number of global vars (#195)
- 28e60627 refactor: refactor and cleanup for secrets management (#202)
- 8521ef10 refactor: remove deprecated package "github.com/pkg/errors" (#200)
optimus
- v0.1.0
Published by kushsharma almost 3 years ago
Changelog
- 0a8d332 fix: add instance_type prefix in airflow lib (#136)
- dcad5af fix: make job run data backward compatible to old runs
- c36818b fix: use scheduled at instead of current time for empty jobrun data
optimus
- v0.0.5-rc.4
Published by kushsharma almost 3 years ago
Changelog
- 0a8d332 fix: add instance_type prefix in airflow lib (#136)
- dcad5af fix: make job run data backward compatible to old runs
- c36818b fix: use scheduled at instead of current time for empty jobrun data
optimus
- v0.0.5-rc.3
Published by kushsharma almost 3 years ago
Changelog
- c840243 fix: airflow2 api url path
- a32e35a fix: empty metadata during job creation panics the server (#135)
- 3a021be fix: rerunning an old job cause task and hook execution time to differ (#133)
- 93d12fa fix: unknown project dependency should not raise an error
- 22696aa refactor(cli): make project/namespace configs required in deploy cmd (#134)
optimus
- v0.0.5-rc.2
Published by kushsharma almost 3 years ago
Changelog
- e8b3363 feat(cli): add command grouping (#132)
- 02efc17 fix(cli): log formatting for optimus job render command
- 839e39f fix: serialize instance type to protobuf enum
- 94adc17 refactor: rename v1 to v1beta1 go package for proto api
Package Rankings
Top 5.98% on Proxy.golang.org
Badges
Extracted from project README
