php-etl

A small etl coded in php, to extract/transform/load

MIT License

Downloads
5.6K
Stars
8
Committers
5
php-etl - v1.1.2 Latest Release

Published by oliverde8 9 months ago

🔧 Fix - Usage of the AbstractFactory for operation without overriding configureValidator causing errors.

php-etl - v1.1.1

Published by oliverde8 10 months ago

  • Deprecation - Dropped support for php 7.4 and 8.0. Both are in end of life.
  • 🔧 Fix - Deprecation issues with the Csv extractor.
  • 🔧 Fix - Add missing tests to Csv extractor.
  • 🔧 Fix - Unit test not running for ChainSplitOperation.
php-etl - v1.1.0

Published by oliverde8 10 months ago

  • 🌟 Docs & Docs & Docs, lots of new & better documentation
  • 🌟 Feature #4 - Added Support to the ChainBuilder for the Split operation
  • 🌟 Feature #4 - new Merge operation that works like split but merges back the result of each branch for nex operations.
  • 🌟 Feature #9 - Added ne Filter operation to filter data.
  • 🌟 Feature #17 - Add new complex item MixItem. This allows operations to return more than one type of item.
  • 🌟 Feature #18 - Add new Item FileExtractedItem. Operations extracting data from files should send this item once all the data has been extracted.
  • 🌟 Feature #19 - Add new Item FileLoadedItem. Operations loading data into files should send this item once all the data has been written.
  • 🌟 Feature #4 - Add new split item operation
  • 🌟 Feature #11 - Add a Http client operation using symfony http client.
  • 🌟 Feature #24 - Added support for Asynchronous Items. The Processor will then wait for the item to finish before transferring it to the next operation.
php-etl - v1.1.0-alpha2

Published by oliverde8 about 1 year ago

  • 🌟 New Factories to simplify integration of the etl in Symfony & Magento.
  • 🌟 #28 - Allow importing and exporting files to external file systems
  • 🌟 Docs & Docs on using the new factories as well as documentation that explains "contextualized" executions.
php-etl - v1.1.0-alpha1

Published by oliverde8 over 1 year ago

  • 🌟 Docs & Docs & Docs, lots of new & better documentation
  • 🌟 Feature #4 - Added Support to the ChainBuilder for the Split operation
  • 🌟 Feature #4 - new Merge operation that works like split but merges back the result of each branch for nex operations.
  • 🌟 Feature #9 - Added ne Filter operation to filter data.
  • 🌟 Feature #17 - Add new complex item MixItem. This allows operations to return more than one type of item.
  • 🌟 Feature #18 - Add new Item FileExtractedItem. Operations extracting data from files should send this item once all the data has been extracted.
  • 🌟 Feature #19 - Add new Item FileLoadedItem. Operations loading data into files should send this item once all the data has been written.
  • 🌟 Feature #4 - Add new split item operation
  • 🌟 Feature #11 - Add a Http client operation using symfony http client.
  • 🌟 Feature #24 - Added support for Asynchronous Items. The Processor will then wait for the item to finish before transferring it to the next operation.
php-etl - Version 1.0.2

Published by oliverde8 almost 2 years ago

  • 🔧 Fix - Context not being finalized when there is an exception.
php-etl - Version 1.0.1

Published by oliverde8 over 2 years ago

  • 🔧 Fix - File writers not using the file abstraction.
php-etl - Version 1.0.0

Published by oliverde8 almost 3 years ago

  • 🎊 🎉 First stable release 🎉 🎊
  • 🌟 Added support for symfony 6
  • 🌟 Added better handling of 'execution' files to use as input files or as output files. (See Symfony Bundle)
  • 🌟 Improve method resolution for chain operations to use types instead of arbitrary names. processData can be names anything now as long as it typed properly
  • 🔧 Improve the global quality of the code by having typed methods.

-❗ This will break any of your existing chain declarations:

  • If you are using the symfony bundle only your custom operations will break (not factories). The context is now an object.
  • If not the definition of chains remains un changed but both the ChainBuilder and ChainProcessor has changed.
php-etl - Version 0.4.0

Published by oliverde8 about 3 years ago

  • ✔️ Added support for symfony 5
php-etl - Version 0.3.0

Published by oliverde8 almost 5 years ago

Multiple new features :

  • ✔️ Added support for symfony 4
php-etl - Version 0.2.0

Published by oliverde8 over 6 years ago

Multiple new features :

  • ✔️ Added a chainBuilder this allow building chanins from descriptions (such as yaml files)
  • ✔️ Added the Symfony Expression Langauge to the RuleEngine

Some Feature were deprecated

  • ❗ The condition rule were deprecated in favor of the Symfony Expression Language.
php-etl - Version 0.1.0

Published by oliverde8 over 6 years ago

Multiple new features :

  • ✅ Added possibility to have nested columns when using the RuleTransformer
  • ✅ Added possibility to have dynamic columns when using the RuleTransformer

This shouldn't break any existing usages,, but as it is quite a major change in the way rules are executed this is considered as a new minor release instead of just a patch.

php-etl - Version 0.0.3

Published by oliverde8 over 6 years ago

  • Added some unit tests
  • Added a crude error support, allows to have understand in which ETL operation the error happened. (Hopefully)

Sorry for the double releases, had forgot to push some changes from the weekend.

php-etl - Version v0.0.2

Published by oliverde8 over 6 years ago

  • Added support for php 5.6 & 7.0
php-etl - Version v0.0.1

Published by oliverde8 over 6 years ago

Package Rankings
Top 12.95% on Packagist.org
Badges
Extracted from project README
Scrutinizer Code Quality Code Coverage Donate