optimus

Changelog

• fix: user name_template for goreleaser 1.19
• chore: update version of goreleaser for publish latest
• feat: differentiate pools for task, hook, sensors
• feat: sync job api
• feat : add job disable API
• fix: scheduler event logging for better monitoring debugging
• feat: refresh on resource update
• feat: immediate sensor to fail on non success when fetching the job run status
• feat: resource apply to sync resources with datastore
• fix : sla callback notification appropriate schedule time
• feat: add authentication with oauth
• feat: add support for using https to connect to optimus server
• fix: airflow client api
• fix: concurrent read write issue in metric map
• refactor: simplify optimus plugin
• (tag: v0.8.2) Revert "feat: simplify plugin proto
• (tag: v0.8.1) fix: SLA to be at DAG level
• feat: job spec name validation
• refactor: standardize metrics and add documentation
• feat: improve user experience replay
• feat: continually poll replay status
• feat: simplify plugin proto
• remove: catchup capability
• (tag: v0.8.0) Add monitoring role and update dashboard json model
• Feat : resource namespace change
• (tag: v0.7.3-rc.1) Feat: job namespace change
• feat: startup timeout for operator creation
• feat: publish missing metrics
• fix: cast grpc numbers to float64
• fix: upsert job run
• fix: return all validation errors on check job spec
• refactor: log placement
• feat: capability to create runs on replay
• fix: unable to delete upstreams if no longer upstream found issue
• fix: replay status runs ordering
• Fix: optimus job failure alerts
• fix: show wrapped error when calling method error
• fix: test unique label values using element match
• remove: catchup capability
• fix: XCom state logic
• refactor: remove unused libs
• refactor: remove old priority resolver
• fix: provide upload jobs with simple priority resolver
• fix: window with playground
• fix: duplicate tags label
• (tag: v0.7.1) fix: use simple priority resolver
• refactor: trace the upload to scheduler
• (tag: v0.7.0) fix: update job state query main
• fix: update kafka write for errors
• refactor: use no-op handler for no publisher
• feat: Publish job run events
• feat: job downstream deletion
• fix: add migration to cleanup old , data and remove delete cascade fr…
• refactor: error handling changes
• feat: improve check job specs
• (tag: v0.7.0-rc.1) fix: do not return error in case resource already exists
• fix: upload to scheduler async
• fix: disable depends_on_past for sensors and hooks
• fix: job scheduling configs not match
• refactor: propogate template errors as invalid argument
• refactor: reduce concurrency
• feat: publish job events
• Publish events extended
• fix: replay issues
• fix: debug log
• docs: update documentation to the latest 0.6 version
• feat: get replay status
• feat: get replay list
• fix: allow resources to be uploaded in batches
• fix: revert get window handler default version to 1
• chore: fix imports and proto commit
• feat: add replay
• fix: fix init container url
• fix: override depends_on_past's dag level value
• fix: remove snapshot mode in publish latest
• fix: fix build by using new version of salt
• refactor: update protos and remove notice

Changelog

• 04eb5484 fix: Remove job_start_event and job_end_event from airflow dag templates (#768)
• 3ec5e088 fix: handle external dependency manager errors (#764)

Changelog

• 4ab86f03 fix: replay manual job and timeout issue (#767)

Changelog

• 1dd694ec fix: fix depends_on_past issue for sensors (#763)

Changelog

• 70a84c30 fix: override depends_on_past's dag level value (#762)

Changelog

• 159d1ceb refactor: make resource create backward compatible (#754)

Changelog

• 964c6547 Fix: source entrypoint with custom shell (#751)
• 83ece95b fix: fix issues related to resource deploy (#749)

Changelog

• c42e0c9 feat: configurable endpoint for kubernetes pod executor (#740)
• d54792a feat: update echo sample plugin (#745)

Changelog

• ad3c691 fix: change xcom push to false as default to unblock deployment for now

Changelog

• 79842e0 feat: add result for monitoring on job run (#742)
• 82b0244 feat: change job version's default (#744)
• e2fade4 fix: avoid unnecessary upstream resolver process and improve server logs (#726)
• 9d64ab2 fix: fix readiness probes (#728)
• 8cd9535 fix: increase timeouts for long running operations (#738)
• 3a9efe9 fix: ingress issues for grpc and http dual connection (#741)
• eb38596 refactor: remove gorilla mux (#732)
• dd55572 refactor: simplify custom kubernetes pod operator (#730)
• c4cf585 refactor: simplify fetching of secrets for compilation (#735)
• 6d766d7 refactor: simplify job builders (#734)
• 55c568b refactor: use connection multiplexer for http and grpc server (#723)

Changelog

• fa5c8f8 fix: update deploy timeout to 60 minutes as in few situations it is crossing 30 minutes (#737)

Changelog

• 3e6f584e feat: yaml export for job and resource (#717)

Changelog

• 5f2c317 Fix: scheduler BC testing issues (#722)
• c2fce72 feat: add job and resource export to yaml (#716)
• cdfecee fix: add missing template functions (#724)
• 7572689 fix: cyclic deps for inferred and static (#721)
• cdcb2be fix: duplicated upstream issue & job BC unclear logs (#719)
• 34c9f36 fix: fix issues for resources and unresolved upstreams (#714)
• d34eaaf fix: handle parallel error relay , scheduler BC (#718)
• 396493b fix: temporary fix for double cyclic (#725)
• 21a0471 fix: update of external table, auto-detect schema when not provided (#720)

Changelog

• 56c8645 fix: upload all error msg (#709)

Changelog

• a6ff29b fix: handle deleted jobs in scheduler BC (#712)
• 4d71411 refactor: add upload all command for resources (#713)

Changelog

• a72d635 fix: upload to scheduler (#710)

Changelog

• e776fb4 feat: change optimus architecture to be more domain oriented (#679)
• 8d70686 fix (scheduler) : create asset subdir in run-input cmd & provide job_name environment variable to executors to maintain backward compatibility (#701)
• 52918d1 fix: bug in __lib.py due to mishandling response from handle_pod_overlap (#695)
• 63c8637 fix: capure upstream state in job provider repo get all (#704)
• f5a5e8c fix: only send sensor start event on first poke (#700)
• 2e77c97 fix: redesign issues (#707)
• 8af49e5 fix: remove deploy cmd (#705)
• 200b4e5 fix: sla_update_state_query (#706)
• fdbec95 refactor: move plugin models to sdk (#699)
• 5899045 refactor: remove gorm, use pgx for postgres (#696)
• af3ebee refactor: remove schedule and retry struct's json tag in store to avoid inconsistency (#697)
• 794803c refactor: remove secret type (#703)

Changelog

• f32d70c1 fix (job run-input) : create asset subdir (#702)

Changelog

• c0424ef3 fix: bug in __lib.py due to mishandling response from handle_pod_overlap (#693)