quaff

A data pipeline helper written in node to convert a folder of JS/ArchieML/JSON/YAML/CSV/TSV files into usable data.

MIT License

Downloads
1.6K
Stars
46

Bot releases are visible (Hide)

quaff - Latest Release

Published by rdmurphy over 3 years ago

  • Prep for release 5925048
  • Fine let's do it de68f0b
  • Accidential commit d1ce38f
  • Formatted 9ce2d2f
  • Migrate to TypeScript 6186189
  • jsconfig.json formatting b5351ca
  • Fix type stuff 222c361
  • Tweak README and CHANGELOG to note new pure ESM interface b1cabd9
  • Some cleanup 846d97b
  • Add support for .cjs and .mjs extensions c789115
  • @ts-ignore the dynamic import so TS quiets down 53287d5
  • TypeScript is wrong, this can be a URL 2e8392e
  • Use pathToFileURL to correct Windows error e2102fe
  • Oops b5b7086
  • Update CI GitHub Action, move back to c8 0e9ea14
  • Prep for move to ESM only c84a3f1
  • Bump np 4a6ea99
  • npm audit fix da5614e
  • Bump prettier from 2.3.0 to 2.3.1 08e1b82
  • Bump prettier from 2.2.1 to 2.3.0 6924281
  • Upgrade to GitHub-native Dependabot 3523bb4
  • Bump @types/node from 14.14.37 to 14.14.39 7b30f2b
  • Bump js-yaml from 4.0.0 to 4.1.0 19acc58
  • Bump @types/node from 14.14.36 to 14.14.37 9640af0
  • Bump @types/node from 14.14.35 to 14.14.36 5a0030f
  • Break out quaffFile from the main quaff function 02cfe89
  • Move to lockfileVersion: 2 0fba0fb
  • Bump @types/node from 14.14.34 to 14.14.35 320c908
  • Bump @types/node from 14.14.33 to 14.14.34 c3b59dc
  • Bump @types/node from 14.14.32 to 14.14.33 06b72ba
  • Bump @types/node from 14.14.31 to 14.14.32 67bb137
  • Bump dset from 3.0.0 to 3.1.0 41a7876
  • Bump @types/node from 14.14.30 to 14.14.31 48f36a8
  • Bump @types/node from 14.14.28 to 14.14.30 ea61b14
  • Bump @types/node from 14.14.27 to 14.14.28 0003f45
  • Bump @types/node from 14.14.25 to 14.14.27 d437cd1
  • Bump np from 7.3.0 to 7.4.0 b03f6fa
  • Bump np from 7.2.0 to 7.3.0 7e4007f
  • Bump @types/node from 14.14.22 to 14.14.25 70fb6d9
  • yaml.safeLoad -> yaml.load (now always safe) ea93d70
  • Bump js-yaml from 3.14.1 to 4.0.0 498e032
  • Bump parse-json from 5.1.0 to 5.2.0 061fda7
  • dset 3.0.0 is now a named export 346ae12
  • Bump dset from 2.1.0 to 3.0.0 15ebd21
  • Bump dset from 2.0.1 to 2.1.0 65d9f49
  • Bump @types/node from 14.14.21 to 14.14.22 e4835a2
  • Bump @types/node from 14.14.20 to 14.14.21 29400fe
  • Bump @types/node from 14.14.19 to 14.14.20 1aaaf28
  • Bump @types/node from 14.14.17 to 14.14.19 c6439c7
  • Bump np from 7.1.0 to 7.2.0 59bd988
  • Bump @types/node from 14.14.16 to 14.14.17 6135793
  • Bump np from 7.0.0 to 7.1.0 660299a
  • Bump @types/node from 14.14.14 to 14.14.16 9cbd840
  • Bump @types/node from 14.14.13 to 14.14.14 dc76ef7
  • Bump @types/node from 14.14.12 to 14.14.13 fafd00e
  • Bump @types/node from 14.14.11 to 14.14.12 7cc0ffc
  • [Security] Bump ini from 1.3.5 to 1.3.7 ad71abf
  • Bump @types/node from 14.14.10 to 14.14.11 e387c8d
  • Bump js-yaml from 3.14.0 to 3.14.1 7841127
  • Bump uvu from 0.5.0 to 0.5.1 e05a4f0
  • Bump prettier from 2.2.0 to 2.2.1 d67e5c5
  • Bump uvu from 0.4.1 to 0.5.0 0301db1
  • Bump @types/node from 14.14.9 to 14.14.10 a7dc3cc
  • Bump @types/node from 14.14.8 to 14.14.9 8c6c1e5
  • Bump prettier from 2.1.2 to 2.2.0 6da9f33
  • Bump @types/node from 14.14.7 to 14.14.8 25cbdc5
  • Bump @types/node from 14.14.6 to 14.14.7 7f52987
  • Bump uvu from 0.4.0 to 0.4.1 c66e5ec
  • Bump np from 6.5.0 to 7.0.0 8d07ee5
  • Bump uvu from 0.3.5 to 0.4.0 0398174
  • Bump uvu from 0.3.4 to 0.3.5 d4dc1dc
  • Bump @types/node from 14.14.5 to 14.14.6 6fda573
  • Bump @types/node from 14.14.2 to 14.14.5 78434b4
  • Add export map 0bf07a8
  • Bump @types/node from 14.11.11 to 14.14.2 f1fd39b
  • Bump @types/node from 14.11.10 to 14.11.11 334bfb4
  • Bump @types/node from 14.11.8 to 14.11.10 882ce93
  • Bump @types/node from 14.11.5 to 14.11.8 fc2c19f
  • Bump @types/node from 14.11.2 to 14.11.5 8729884
  • Bump uvu from 0.3.3 to 0.3.4 174b44a
  • Bump @types/node from 14.11.1 to 14.11.2 c6de69d
  • Bump @types/node from 14.10.3 to 14.11.1 a9f8daa
  • Bump @types/node from 14.10.2 to 14.10.3 ffe2d6d
  • Bump @types/node from 14.10.1 to 14.10.2 b66b598
  • Bump prettier from 2.1.1 to 2.1.2 74821f2
  • Bump @types/node from 14.10.0 to 14.10.1 81917d5
  • Bump @types/node from 14.6.4 to 14.10.0 fa89836
  • Bump @types/node from 14.6.3 to 14.6.4 750e37d
  • Bump @types/node from 14.6.2 to 14.6.3 250dd21
  • Bump np from 6.4.0 to 6.5.0 46a46f7
  • Bump @types/node from 14.6.1 to 14.6.2 49ec9f8
  • Add missing quotes addded with parse-json update a25606f
  • Bump parse-json from 5.0.1 to 5.1.0 54ed4c9
  • Totalist now has a named import fc837dd
  • Bump totalist from 1.1.0 to 2.0.0 f5e1c6b
  • Bump @types/node from 14.6.0 to 14.6.1 b189231
  • Bump prettier from 2.1.0 to 2.1.1 1c87624
  • Bump prettier from 2.0.5 to 2.1.0 323cd03
  • Bump d3-dsv from 1.2.0 to 2.0.0 9bbfae5
  • Bump @types/node from 14.0.27 to 14.6.0 b09d521
  • Bump uvu from 0.3.2 to 0.3.3 ac82a06
  • Bump np from 6.3.2 to 6.4.0 356dc9c
  • Bump uvu from 0.3.1 to 0.3.2 6185cdd
  • Bump uvu from 0.3.0 to 0.3.1 6b18ffc
  • Bump @types/node from 14.0.26 to 14.0.27 171536b
  • Bump @types/node from 14.0.25 to 14.0.26 9f4af06
  • Bump parse-json from 5.0.0 to 5.0.1 cd79989
  • Bump @types/node from 14.0.24 to 14.0.25 7408b52
  • Bump @types/node from 14.0.23 to 14.0.24 1c008a6
  • Bump uvu from 0.2.3 to 0.3.0 0a8adc1
  • Bump uvu from 0.2.2 to 0.2.3 f877594

https://github.com/rdmurphy/quaff/compare/4.2.0...5.0.0

quaff -

Published by rdmurphy over 4 years ago

Added

  • quaff will now throw an error when more than one input file attempts to use the same output key. This is caused by having multiple files in a directory with the same name but different extensions.
  • When a .yaml or .yml file fails to parse the thrown error will now include the file path.
  • We are now testing quaff in Mac OS and Windows thanks to GitHub Actions. Don't expect that'll ever be an issue good to know for sure.

Changed

  • tiny-glob has been replaced with totalist, which makes quaff a little faster at iterating through files.
  • All tests have been moved to uvu.
quaff -

Published by rdmurphy over 5 years ago

Added

  • Added TypeScript definition file.

Changed

  • Some housekeeping in index.js, but no functional changes.
quaff -

Published by rdmurphy over 5 years ago

Added

  • Support for ArchieML files. These are processed when they are found with the .aml extension.
  • Support for JavaScript files. This includes any JavaScript file that provides a default export (module.exports = ...). JavaScript files that export functions, including async functions, are also supported! This makes it possible for quaff to load data that's fetched from an API. Load GraphQL and go to town! Do some extra-preprocessing!

Changed

  • quaff now returns a Promise to enable async resolution of JavaScript files.
  • Moves testing to nyc.
  • Now requires Node.js 8 or later.
quaff - Support for JavaScript files, async processing

Published by rdmurphy almost 6 years ago

Doing a tiny prerelease to assess interest! This adds support for the following:

  • quaff now returns a Promise, which means it expects to be used in an async environment.
  • New file type! quaff now supports .js files. This means any JavaScript file with a default export (module.exports = ...) is supported. This includes JavaScript files that export functions, including async functions! What does this enable? Anything you can do in a JavaScript file. Hit an API! Pull in some GraphQL! Do some crazy pre-processing!
  • General clean up of test hooks - moves to nyc from old raw istanbul calls.

Installation with the next tag via npm:

npm install -D quaff@next
quaff - Added support for Node 0.10.0

Published by rdmurphy almost 6 years ago

quaff - Move to tiny-glob

Published by rdmurphy almost 6 years ago

Updates some development dependencies, and moves to tiny-glob from fast-glob, which significantly makes the install size smaller.

quaff - Dependency updates and better JSON errors

Published by rdmurphy about 6 years ago

Along with general clean up of the codebase and updates to the dependencies, this moves to using parse-json instead of JSON.parse in order to provide better errors in the event something is wrong with a provided JSON file.

quaff - CSV/TSV support

Published by rdmurphy almost 9 years ago

Decided that adding csv and tsv support made sense. 🎉

Package Rankings
Top 4.37% on Npmjs.org