wfl

A Simple Way of Creating Job Workflows in Go running in Processes, Containers, Tasks, Pods, or Jobs

BSD-2-CLAUSE License

Stars
45
View Code on GitHub
Ecosystems: Go, Linux, Docker, macOS, Kubernetes

Bot releases are hidden (Show)

wfl - Latest Release

Published by dgruber 2 months ago

  • Image pull secrets for Kubernetes jobs
wfl -

Published by dgruber 3 months ago

  • Bump drmaa2os version v0.3.33
wfl -

Published by dgruber 9 months ago

  • Bump to drmaa2os version v0.3.32 due to runc / containerd vulnerabilities
  • Updated dependencies
wfl -

Published by dgruber 10 months ago

  • drmaa2os v0.3.31
  • remote context
wfl -

Published by dgruber about 1 year ago

  • drmaa2os 0.3.30 which solves some compilation problems with dependencies
wfl -

Published by dgruber about 1 year ago

  • WaitWithTimeout(duration) method for Jobs
  • Updated dependencies
  • Latest version of Google Batch Tracker
wfl -

Published by dgruber over 1 year ago

  • GPT / LLM support: TemplateP("prompt"), ErrorP("prompt"), OutputP("prompt")
  • OnErrorPanic() simplifies the code during development
  • More examples (GPUs on GKE for running Bark transformer NN; OpenAI with prompts)
wfl -

Published by dgruber over 1 year ago

  • Breaking change for ForAll(): There is now ForEach() which runs sequentially and ForAll() which executes functions in parallel.
  • Added OutputsForJobIDs() to collect all job outputs (if param is nil) or job outputs of the given job ID list.
  • Examples needs to be updated.
wfl -

Published by dgruber over 1 year ago

  • Bump to Google batch tracker version 0.1.1 supporting getting JobTemplates
  • Multiple machine learning examples
wfl -

Published by dgruber over 1 year ago

  • Job output for Kubernetes jobs fixed
wfl -

Published by dgruber over 1 year ago

  • Simple job Output() support for Docker, K8s, OS
wfl -

Published by dgruber over 1 year ago

  • Dependency updates
wfl -

Published by dgruber about 2 years ago

  • Google Batch
  • Cleanups / dependency updates
wfl -

Published by dgruber over 2 years ago

  • Bump DRMAA2OS version v0.3.21
wfl -

Published by dgruber over 2 years ago

updated dependencies

wfl -

Published by dgruber almost 3 years ago

  • Kubernetes job's env variables can be sourced from configmaps and secrets
wfl -

Published by dgruber over 3 years ago

  • Improved job array interface
wfl -

Published by dgruber over 3 years ago

  • Data staging for Kubernetes jobs
  • Updated Docker dependencies
wfl -

Published by dgruber over 3 years ago

  • added ListJobs() method to the workflow to list all jobs of the underlying DRMAA2 job session
wfl -

Published by dgruber almost 4 years ago

  • drmaa2os version 0.3.7 with improved filestaging support in job template for Kubernetes
  • ReapAll() calls DRMAA2 Reap() on all tasks to remove job objects from workload manager (like Kubernetes)
Package Rankings
Top 5.42% on Proxy.golang.org
Badges
Extracted from project README
CircleCI codecov