hamilton

What's Changed

• Adds bytewax example to feature engineering example by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/458
• Remove unneeded debug statement spark by @elijahbenizzy in https://github.com/DAGWorks-Inc/hamilton/pull/477

Full Changelog: https://github.com/DAGWorks-Inc/hamilton/compare/sf-hamilton-1.34.0...sf-hamilton-1.34.1

What's Changed

• Fixed type hints for parameterize_sources() by @zilto in https://github.com/DAGWorks-Inc/hamilton/pull/460
• Added DataLoader and DataSaver for XGBoost models using JSON by @zilto in https://github.com/DAGWorks-Inc/hamilton/pull/459
• Feat: added notebook to the scikit-learn example by @flaviassantos in https://github.com/DAGWorks-Inc/hamilton/pull/463
• Changes docs to build from furo main by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/464
• Bump version to 1.34.0 by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/465

Full Changelog: https://github.com/DAGWorks-Inc/hamilton/compare/sf-hamilton-1.33.1...sf-hamilton-1.34.0

What's Changed

• Removes requests from dataflow by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/453
• Bumps version to 1.33.1 by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/454
• Updates docs for using with ETL system by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/455

Full Changelog: https://github.com/DAGWorks-Inc/hamilton/compare/sf-hamilton-1.33.0...sf-hamilton-1.33.1

What's Changed

• Add jupyter notebook version of caching_nodes example by @alti-tude in https://github.com/DAGWorks-Inc/hamilton/pull/444
• Adds input validation to materialize execution path by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/445
• Feat/ml time series by @flaviassantos in https://github.com/DAGWorks-Inc/hamilton/pull/446
• Polars JSON Read Writer, Unit Test, Materilization. by @swapdewalkar in https://github.com/DAGWorks-Inc/hamilton/pull/440
• 420 polars avro reader writer by @kokobhara in https://github.com/DAGWorks-Inc/hamilton/pull/447
• Bumps version to 1.33.0 by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/451

New Contributors

• @alti-tude made their first contribution in https://github.com/DAGWorks-Inc/hamilton/pull/444
• @kokobhara made their first contribution in https://github.com/DAGWorks-Inc/hamilton/pull/447

Full Changelog: https://github.com/DAGWorks-Inc/hamilton/compare/sf-hamilton-1.32.0...sf-hamilton-1.33.0

What's Changed

• Adds Flavia to special mentions by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/424
• Fixes inconsistency in new builder API by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/430
• Feat/pandas reader parquet by @flaviassantos in https://github.com/DAGWorks-Inc/hamilton/pull/429
• Garbage collection/memory optimization by @elijahbenizzy in https://github.com/DAGWorks-Inc/hamilton/pull/374
• Improves data loader experience by allowing non-source/value kwargs by @elijahbenizzy in https://github.com/DAGWorks-Inc/hamilton/pull/434
• Polars parquet #417 by @swapdewalkar in https://github.com/DAGWorks-Inc/hamilton/pull/425
• Fixes whitespace for examples/polars/materialization/my_script.py by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/435
• Fixes polars parquet example by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/436
• Polars Feather/IPC reader and writer by @somaiyamansi in https://github.com/DAGWorks-Inc/hamilton/pull/437
• Enables the materializers to depend on functions & driver variables by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/431
• Jupyter notebook can autocomplete materializers by @elijahbenizzy in https://github.com/DAGWorks-Inc/hamilton/pull/438
• Bumps version from 1.31.0 to 1.32.0 by @elijahbenizzy in https://github.com/DAGWorks-Inc/hamilton/pull/442

New Contributors

• @swapdewalkar made their first contribution in https://github.com/DAGWorks-Inc/hamilton/pull/425
• @somaiyamansi made their first contribution in https://github.com/DAGWorks-Inc/hamilton/pull/437

Full Changelog: https://github.com/DAGWorks-Inc/hamilton/compare/sf-hamilton-1.31.0...sf-hamilton-1.32.0

What's Changed

• Pandas Feather Reader and Writer Class by @JoJo10Smith in https://github.com/DAGWorks-Inc/hamilton/pull/385
• Update README.md by @elijahbenizzy in https://github.com/DAGWorks-Inc/hamilton/pull/393
• Adds Hamilton svgs for hub by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/394
• Improves wording in Hamilton hub by @elijahbenizzy in https://github.com/DAGWorks-Inc/hamilton/pull/395
• Docs fixes by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/396
• Docs link fixes by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/397
• Adds collapse to the code-block for source code in the hub by @elijahbenizzy in https://github.com/DAGWorks-Inc/hamilton/pull/399
• Trigger hub build conditionally by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/400
• Trigger hub build conditionally by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/401
• Fixes typo in skrawcz author.md by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/402
• Adds hub social card by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/403
• Update PULL_REQUEST_TEMPLATE.md by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/405
• Fix list formatting in README by @Scorpil in https://github.com/DAGWorks-Inc/hamilton/pull/411
• feat(notebook): add Jupyter Notebook for Prefect example by @flaviassantos in https://github.com/DAGWorks-Inc/hamilton/pull/419
• Bumps version to 1.31.0 by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/422

New Contributors

• @Scorpil made their first contribution in https://github.com/DAGWorks-Inc/hamilton/pull/411
• @flaviassantos made their first contribution in https://github.com/DAGWorks-Inc/hamilton/pull/419

Full Changelog: https://github.com/DAGWorks-Inc/hamilton/compare/sf-hamilton-1.30.1...sf-hamilton-1.31.0

What's Changed

• Adds scaffolding for user_contrib by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/350
• Adds Hamilton logo to repo by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/386
• Attempt 1 to fix alternate PR template by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/387
• Bumps version to 1.30.1 by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/392

New Contributors

• @wentao-lu made their first contribution in https://github.com/DAGWorks-Inc/hamilton/pull/391

Full Changelog: https://github.com/DAGWorks-Inc/hamilton/compare/sf-hamilton-1.30.0...sf-hamilton-1.30.1

Note this will not be pushed until 1.30.2:

• Correct the name and type annotation for default_validator_candidates by @wentao-lu in https://github.com/DAGWorks-Inc/hamilton/pull/391

What's Changed

• Add bryangalindo to contributors by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/364
• Adds Ray Jupyter Notebook example for run.py by @bryangalindo in https://github.com/DAGWorks-Inc/hamilton/pull/363
• Adds polars df to csv plugin unit test by @bryangalindo in https://github.com/DAGWorks-Inc/hamilton/pull/366
• Updates pandas unit tests for standardization by @bryangalindo in https://github.com/DAGWorks-Inc/hamilton/pull/365
• Pandas XML Reader and Writer Class by @JoJo10Smith in https://github.com/DAGWorks-Inc/hamilton/pull/356
• Adds JoJo10Smith to contributors by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/367
• Update main.md in docs by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/368
• Adding HTML Read and Write functionality by @JoJo10Smith in https://github.com/DAGWorks-Inc/hamilton/pull/370
• Adding code to remove the table named test in the script and notebook… by @JoJo10Smith in https://github.com/DAGWorks-Inc/hamilton/pull/379
• Adding initial commit for Pandas Stata Read and Write by @JoJo10Smith in https://github.com/DAGWorks-Inc/hamilton/pull/378
• Adds lxml to requirements for pandas materializer examples by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/381
• Bumps version to 1.30.0 by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/382

New Contributors

• @JoJo10Smith made their first contribution in https://github.com/DAGWorks-Inc/hamilton/pull/356

Full Changelog: https://github.com/DAGWorks-Inc/hamilton/compare/sf-hamilton-1.29.0...sf-hamilton-1.30.0

What's Changed

• Updates stale Dask graph visualization by @bryangalindo in https://github.com/DAGWorks-Inc/hamilton/pull/339
• Updates stale Polars graph visualization by @bryangalindo in https://github.com/DAGWorks-Inc/hamilton/pull/336
• Adds Polars Jupyter Notebook example for e.g., data scientists by @bryangalindo in https://github.com/DAGWorks-Inc/hamilton/pull/335
• Adds Dask Jupyter Notebook example for e.g., data scientists by @bryangalindo in https://github.com/DAGWorks-Inc/hamilton/pull/337
• Adds Pandas JSON data loaders by @bryangalindo in https://github.com/DAGWorks-Inc/hamilton/pull/346
• Create docusaurus-gh-pages.yml by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/349
• Updates stale async graph visualization by @bryangalindo in https://github.com/DAGWorks-Inc/hamilton/pull/348
• Update README.md by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/351
• Adds Pandas DF JSON materializer by @bryangalindo in https://github.com/DAGWorks-Inc/hamilton/pull/347
• Adds Pandas DF SQL reader and writer by @bryangalindo in https://github.com/DAGWorks-Inc/hamilton/pull/353
• Adds plugins_test README by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/359
• Updates stale readme graph visualization by @bryangalindo in https://github.com/DAGWorks-Inc/hamilton/pull/360
• Bumps verison to 1.29.0 by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/361

Full Changelog: https://github.com/DAGWorks-Inc/hamilton/compare/sf-hamilton-1.28.0...sf-hamilton-1.29.0

What's Changed

• Adds note on purging conda build files by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/324
• Implements example to use for write-once-run-everywhere blog post by @elijahbenizzy in https://github.com/DAGWorks-Inc/hamilton/pull/317
• [Feedback requested] Add world of warcraft example for pandas and spark by @roelbertens in https://github.com/DAGWorks-Inc/hamilton/pull/309
• Fixes error message if no combine is passed to materializer by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/326
• Created a RAG example by @zilto in https://github.com/DAGWorks-Inc/hamilton/pull/325
• WIP - Response to Issue #292: Pandas Pickle data reader and writer by @benhhack in https://github.com/DAGWorks-Inc/hamilton/pull/303
• Fixes broken unit test for materializers by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/327
• Add to contributors by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/328
• Updates doc strings to use imperative writing style by @bryangalindo in https://github.com/DAGWorks-Inc/hamilton/pull/329
• Bumps version to 1.28.0 by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/338

New Contributors

• @roelbertens made their first contribution in https://github.com/DAGWorks-Inc/hamilton/pull/309
• @benhhack made their first contribution in https://github.com/DAGWorks-Inc/hamilton/pull/303
• @bryangalindo made their first contribution in https://github.com/DAGWorks-Inc/hamilton/pull/329

Full Changelog: https://github.com/DAGWorks-Inc/hamilton/compare/sf-hamilton-1.27.4...sf-hamilton-1.28.0

What's Changed

• Fixes polars type annotations to work for python 3.8 by @elijahbenizzy in https://github.com/DAGWorks-Inc/hamilton/pull/319
• Add viz defaults by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/321
• Bumps version to 1.27.4 by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/323

Full Changelog: https://github.com/DAGWorks-Inc/hamilton/compare/sf-hamilton-1.27.3...sf-hamilton-1.27.4

What's Changed

• Updates docs banner to point to FeatureStoreSummit by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/305
• Minor tweaks by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/302
• Adds DBT + Hamilton talk to docs by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/306
• Handles overrides in a cleaner way by @elijahbenizzy in https://github.com/DAGWorks-Inc/hamilton/pull/313
• Bumps sf-hamilton version from 1.27.2 to 1.27.3 by @elijahbenizzy in https://github.com/DAGWorks-Inc/hamilton/pull/314

Full Changelog: https://github.com/DAGWorks-Inc/hamilton/compare/sf-hamilton-1.27.2...sf-hamilton-1.27.3

What's Changed

• Fixes bug in which Collect[] couldn't take inputs not from the subdag by @elijahbenizzy in https://github.com/DAGWorks-Inc/hamilton/pull/299

Full Changelog: https://github.com/DAGWorks-Inc/hamilton/compare/sf-hamilton-1.27.1...sf-hamilton-1.27.2

What's Changed

• Clarifies wording in the README by @elijahbenizzy in https://github.com/DAGWorks-Inc/hamilton/pull/294
• Gate polars type version by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/296
• Bumps version to 1.27.1 by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/297

Full Changelog: https://github.com/DAGWorks-Inc/hamilton/compare/sf-hamilton-1.27.0...sf-hamilton-1.27.1

What's Changed

• Update use-for-feature-engineering.rst by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/285
• Full spark integration by @elijahbenizzy in https://github.com/DAGWorks-Inc/hamilton/pull/249
• Update customizing-execution.rst by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/287
• Update customizing-execution.rst by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/288
• Updates DBT example data_loader by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/289
• Updates dbt example image by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/290
• Moves scaling out of experimental by @elijahbenizzy in https://github.com/DAGWorks-Inc/hamilton/pull/286
• Fixes SparkSession import by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/291

Full Changelog: https://github.com/DAGWorks-Inc/hamilton/compare/sf-hamilton-1.26.5...sf-hamilton-1.27.0

What's Changed

• Executor minor fixes by @elijahbenizzy in https://github.com/DAGWorks-Inc/hamilton/pull/279
• Add spark pdf summarizer example by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/268
• Adds missing image to spark PDF summarizer example by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/280
• Adds CSV materializers for polars + fix by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/281
• Bumps version to 1.26.5 by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/282

Full Changelog: https://github.com/DAGWorks-Inc/hamilton/compare/sf-hamilton-1.26.3...sf-hamilton-1.26.5

What's Changed

• Updates DBT example by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/276
• Adds back in visualizations for parallelism that were lost in merge by @elijahbenizzy in https://github.com/DAGWorks-Inc/hamilton/pull/277

Full Changelog: https://github.com/DAGWorks-Inc/hamilton/compare/sf-hamilton-1.26.2...sf-hamilton-1.26.3

What's Changed

• Adds open telemetry to roadmap by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/271
• Adjusts docs banner by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/272
• Fixes up docs wording around pdf summarizer by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/273
• Miscellaneous/usability fixes by @elijahbenizzy in https://github.com/DAGWorks-Inc/hamilton/pull/270
• Fix to parameterize() docs by @zilto in https://github.com/DAGWorks-Inc/hamilton/pull/275
• Bumps sf-hamilton from 1.26.1 to 1.26.2 by @elijahbenizzy in https://github.com/DAGWorks-Inc/hamilton/pull/274

Full Changelog: https://github.com/DAGWorks-Inc/hamilton/compare/sf-hamilton-1.26.1...sf-hamilton-1.26.2

What's Changed

• Adds notes on docker compose by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/262
• Added jupyter notebook version of scikit-learn example by @AnupJoseph in https://github.com/DAGWorks-Inc/hamilton/pull/263
• Adds DAGWorks comments to PDF summarizer by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/265
• Add @AnupJoseph by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/267
• Adds marqo vector db to LLM stack example by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/266
• Materialization improvements by @elijahbenizzy in https://github.com/DAGWorks-Inc/hamilton/pull/264
• Bumps version from 1.26.0 to 1.26.1 by @elijahbenizzy in https://github.com/DAGWorks-Inc/hamilton/pull/269

Full Changelog: https://github.com/DAGWorks-Inc/hamilton/compare/sf-hamilton-1-26-0...sf-hamilton-1.26.1

What's Changed

• Adds Stephen Bias to special mentions by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/256
• Adds google collab gdrive mounting instructions to HW by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/257
• Fixes up PDF summarizer example by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/258
• dynamic task spawning + grouped execution by @elijahbenizzy in https://github.com/DAGWorks-Inc/hamilton/pull/220
• Added jupyter-notebook version of the numpy example by @AnupJoseph in https://github.com/DAGWorks-Inc/hamilton/pull/259
• Minor materialization fixes by @elijahbenizzy in https://github.com/DAGWorks-Inc/hamilton/pull/260

New Contributors

• @AnupJoseph made their first contribution in https://github.com/DAGWorks-Inc/hamilton/pull/259

Full Changelog: https://github.com/DAGWorks-Inc/hamilton/compare/sf-hamilton-1.25.0...sf-hamilton-1-26-0