scipipe

Robust, flexible and resource-efficient pipelines using Go and the commandline

MIT License

Stars
1.1K
Committers
10

Bot releases are visible (Hide)

scipipe - v0.12.0: Important bugfix. Minor API change. Latest Release

Published by samuell about 3 years ago

This release contains an important bugfix, making sure that we properly handle all errors (#146).

It also contains a minor API change, that could affect custom components making use of the AtomizeIPs() method, which is now renamed to FinalizePaths().

scipipe - v0.11.2-rc4: Properly handle errors when finalizing paths

Published by samuell about 3 years ago

This release fixes a bug where some errors were not properly handled and reported on finalizing paths.

scipipe - v0.11.2-rc3: Fix wrong error message in concatenator component

Published by samuell about 3 years ago

This Release Candidate fixes an erroneous error message in the concatenator component, that might result in confusion when debugging.

scipipe - v0.11.2-rc2: Fix behavior in globber

Published by samuell about 3 years ago

This release fixes a behavior in the globber component, making sure that it waits for all its dependencies to arrive before globbing.

Try to fix #143: Fix problem with creating directories in concatenator

This is a pre-release, release candidate.

scipipe - v0.11.1: Fix error about potential TempDir clashes

Published by samuell about 3 years ago

This is a small bugfix release, fixing bug #142 about a potential collision between TempDir paths.

scipipe - v0.11.0: Better logging

Published by samuell about 3 years ago

This is a rather small release, which fixes issue #134 and improves logging, by making sure that more context information, such as process, task, workflow or file-IP name is included wherever applicable.

It increases more than the most minor part in the version since it contains some smaller breaking changes, in particular that the NewFileIP() constructor returns errors instead of failing the program locally (this is, as you might have guessed, part of the move towards logging errors in a place with more context available).

This is a small release fixing issue #135.

scipipe - v0.10.1: Fix #131: Don't panic on erroneous path trimming

Published by samuell over 3 years ago

  • Fixes #131
scipipe - v0.10.0: Bugfix: Basename modifier should not include parent dir part

Published by samuell over 3 years ago

This release fixes bug #130. Read more in the bug description for info about this. We are bumping to 0.10.0 as this is potentially a breaking change for workflows already using the basename modifier.

This release contains a bugfix for #125 which was recently introduced as part of the fix for #66. This release fixes #125 by allowing multiple occurances of the same port-type/port-name combo, but not the same port-name for different types.

scipipe - v0.9.13: Fix error in the error fix

Published by samuell over 3 years ago

This is a fix of the incorrectly fixed error in #54 . See Release v0.9.12 for more info on what is new.

scipipe - v0.9.12: Somewhat important bugfixes

Published by samuell over 3 years ago

This release contains a number of somewhat important bugfixes, for stability and robustness of workflows:

  • #54: Properly fail when some outputs are missing, instead of silently passing on references to those.
  • #66: Showing an intelligible warning about when the same port name is used for multiple ports (in/out/params) in the same process.
  • #117: Automatically create any parent directories when plotting the workflow graph.
  • #119: Add a component for selecting / filtering IPs, based on a custom Go function, which can access all the data of the IP.
  • #120: Properly handle references to parent directories in out-paths (e.g. ../../somedir/somefile.txt).
scipipe - v0.9.11: Make channel buffert size configurable via environment variable

Published by samuell over 3 years ago

This is a small release, fixing issue #111 (Make channel buffert size configurable via environment variable).

This is documented here.

scipipe - v0.9.10: Implement dirname modifier for paths

Published by samuell about 4 years ago

This release includes implementation of the dirname modifier (see info about modifiers here).

Kudos to @szliao for this contribution!

scipipe - v0.9.9: Support GroupByTag in concatenator and fix newline bug

Published by samuell about 4 years ago

This is a small release containing one new enhancement, and a bug fix, both in the Concatenator component:

  • It implements #109, adding a new "GroupByTag" feature, to enable separating output based on a tag in IPs.
  • It fixes #108 so that concatenator does not swallow newlines.
scipipe - v0.9.8: Bugfix - Enable workflows with a single process

Published by samuell about 4 years ago

This release mainly fixes issue #71 , where a workflow could not run if it contained just a single process.

Many thanks to @kerkomen for contributing the fix!

scipipe - v0.9.7: Bugfixes - Apply path modifiers for all port-placeholders etc

Published by samuell about 4 years ago

This is a bug fix release, fixing a number of bugs: #93, #104, #105, #106

The biggest change is that path modifiers such as basename and %.ext for trimming file name extensions, are now available for all placeholders in the main command as well as in the SetOut() function.

The available modifiers are now documented here in the docs: Available path modifiers

It also now has support for go modules (a simple change, as scipipe has zero dependencies :)).

Thanks to @dwmunster for some contributions, and @jonalv for providing input leading to discovering most of, the fixes in this release.

scipipe - v0.9.6: Important bugfix in substream component and more

Published by samuell about 5 years ago

This release:

  • Fixes #78 as reported by @JakeHagen via PR #91 submitted by @rbisewski
  • Fixed a typo in the logging, via PR #90 submitted by @JakeHagen
  • Hashes substream IP paths for the temp directory, via PR #89 submitted by @dwmunster

With these fixes, the DNA Cancer Analysis demo from the SciPipe paper, which was broken, does now work again!

Many thanks for the contribution guys - it's so much appreacated! 🙌

scipipe - v0.9.5: Important bugfix in MapToTags component etc

Published by samuell over 5 years ago

This is an bugfix release:

Again, big thanks go to @dwmunster for contributing these fixes and improvements!