hamilton

What's Changed

• Adds fine tuning contrib example by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/667
• Fixes typos in fine-tuning contrib README by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/671
• Adds comparisons to langchain by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/672
• Adds simple RAG example to contrib by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/673
• Contrib/conversational rag by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/674
• contrib: OpenAI code generation by @zilto in https://github.com/DAGWorks-Inc/hamilton/pull/675
• Adds GraphConstructionHook by @elijahbenizzy in https://github.com/DAGWorks-Inc/hamilton/pull/670
• Truncates inputs logged when a node errors by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/677
• type annotations edited to fix linting issue by @zilto in https://github.com/DAGWorks-Inc/hamilton/pull/648
• Adds bypass_validation for visualize_execution by @elijahbenizzy in https://github.com/DAGWorks-Inc/hamilton/pull/676
• Fixes all local file loader metadata to have a uniform shape by @elijahbenizzy in https://github.com/DAGWorks-Inc/hamilton/pull/662
• Contrib/eval grader by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/679
• Add experiment UI and plugin by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/680

Full Changelog: https://github.com/DAGWorks-Inc/hamilton/compare/sf-hamilton-1.47.0...sf-hamilton-1.48.9

What's Changed

• Updates pdf summarizer to use new openAI API by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/660
• Custom visualization styling by @zilto in https://github.com/DAGWorks-Inc/hamilton/pull/663
• Fix: added to legend examples/styling-visualization by @zilto in https://github.com/DAGWorks-Inc/hamilton/pull/665
• Docs: updated node page by @zilto in https://github.com/DAGWorks-Inc/hamilton/pull/659
• Bumps version to 1.47.0 by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/668

Full Changelog: https://github.com/DAGWorks-Inc/hamilton/compare/sf-hamilton-1.46.0...sf-hamilton-1.47.0

What's Changed

• Docs/streamlit integration by @zilto in https://github.com/DAGWorks-Inc/hamilton/pull/643
• FastAPI integration page by @zilto in https://github.com/DAGWorks-Inc/hamilton/pull/645
• DDOG Integration by @elijahbenizzy in https://github.com/DAGWorks-Inc/hamilton/pull/644
• Add to talks by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/647
• export_json method in Driver. by @alechewitt in https://github.com/DAGWorks-Inc/hamilton/pull/635
• Updates learning resources by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/651
• Fix flakey unit test by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/653
• Infer visualization format from output path by @zilto in https://github.com/DAGWorks-Inc/hamilton/pull/649
• Bumps version to 1.46.0 by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/655

New Contributors

• @alechewitt made their first contribution in https://github.com/DAGWorks-Inc/hamilton/pull/635

Full Changelog: https://github.com/DAGWorks-Inc/hamilton/compare/sf-hamilton-1.45.0...sf-hamilton-1.46.0

What's Changed

• updated Welcome Page by @zilto in https://github.com/DAGWorks-Inc/hamilton/pull/627
• Massages wording on why hamilton in docs by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/634
• Fixes schema viz so it doesn't drop duplicates by @elijahbenizzy in https://github.com/DAGWorks-Inc/hamilton/pull/638
• Lifecycle validators by @elijahbenizzy in https://github.com/DAGWorks-Inc/hamilton/pull/633
• Adds TQDM adapter to show progress by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/632
• Bumps version from 1.44.0 to 1.45.0 by @elijahbenizzy in https://github.com/DAGWorks-Inc/hamilton/pull/640
• Fixes bad merge in TQDM by @elijahbenizzy in https://github.com/DAGWorks-Inc/hamilton/pull/641

Full Changelog: https://github.com/DAGWorks-Inc/hamilton/compare/sf-hamilton-1.44.0...sf-hamilton-1.45.0

What's Changed

• refactor docs; minimal content change by @zilto in https://github.com/DAGWorks-Inc/hamilton/pull/621
• Fixes docs typo by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/626
• Feature/620 by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/622
• Bumps version to 1.44.0 by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/628

Full Changelog: https://github.com/DAGWorks-Inc/hamilton/compare/sf-hamilton-1.43.1...sf-hamilton-1.44.0

What's Changed

• Bumping node to version 20 by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/616
• Moves automatic registration from h_spark to spark_extensions by @elijahbenizzy in https://github.com/DAGWorks-Inc/hamilton/pull/618

Full Changelog: https://github.com/DAGWorks-Inc/hamilton/compare/sf-hamilton-1.43.0...sf-hamilton-1.43.1

What's Changed

• Adds bytesIO/bytes input for to.file by @elijahbenizzy in https://github.com/DAGWorks-Inc/hamilton/pull/610
• Adds pickle to caching adapter by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/612
• Bumps version to 1.43.0 by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/614

Full Changelog: https://github.com/DAGWorks-Inc/hamilton/compare/sf-hamilton-1.42.0...sf-hamilton-1.43.0

What's Changed

• small docs fixes by @roelbertens in https://github.com/DAGWorks-Inc/hamilton/pull/600
• Add missing import to fix test by @roelbertens in https://github.com/DAGWorks-Inc/hamilton/pull/601
• Fixes doc example in h_pandera.check_output by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/602
• Fix missing whitespace by @roelbertens in https://github.com/DAGWorks-Inc/hamilton/pull/603
• Lifecycle customization by @elijahbenizzy in https://github.com/DAGWorks-Inc/hamilton/pull/592
• Schema management for dataset-types by @elijahbenizzy in https://github.com/DAGWorks-Inc/hamilton/pull/607
• Bumps version from 1.41.0 to 1.42.0 by @elijahbenizzy in https://github.com/DAGWorks-Inc/hamilton/pull/609

Full Changelog: https://github.com/DAGWorks-Inc/hamilton/compare/sf-hamilton-1.41.0...sf-hamilton-1.42.0

What's Changed

• Exposes ray init functionality by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/597
• Extends Pandera validator to handle more DF types by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/596
• Bump version by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/598

Full Changelog: https://github.com/DAGWorks-Inc/hamilton/compare/sf-hamilton-1.40.1...sf-hamilton-1.41.0

What's Changed

• Image captioning/generation by @elijahbenizzy in https://github.com/DAGWorks-Inc/hamilton/pull/578
• Do not fail default NaN validation on empty series by @elshize in https://github.com/DAGWorks-Inc/hamilton/pull/593
• Bumps version to 1.40.1 by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/595

Full Changelog: https://github.com/DAGWorks-Inc/hamilton/compare/sf-hamilton-1.40.0...sf-hamilton-1.40.1

What's Changed

• Tweaks error message to make it harder to miss by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/579
• Fix hub docs by @elijahbenizzy in https://github.com/DAGWorks-Inc/hamilton/pull/580
• Update examples/README.md by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/584
• Update README.md to link to hub by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/581
• Fixes PR link on hub instructions by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/585
• Adds latest talk links by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/588
• Contrib/translate to hamilton by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/583
• Adds examples showing printing of inputs with node error by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/587
• Bump versions by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/590

Full Changelog: https://github.com/DAGWorks-Inc/hamilton/compare/sf-hamilton-1.39.1...sf-hamilton-1.40.0

What's Changed

• Adding a question to ask about notices for contributed code by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/561
• Updates docs banner to point to PyData Global by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/562
• Adds posthog capture to hub by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/563
• Fixes dagworks hub contrib docs by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/566
• Adds video on how to use Hamilton hub by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/567
• Hub init by @elijahbenizzy in https://github.com/DAGWorks-Inc/hamilton/pull/564
• Updates pre-commit hooks by @elijahbenizzy in https://github.com/DAGWorks-Inc/hamilton/pull/568
• Fixes parallel case with empty list by @elijahbenizzy in https://github.com/DAGWorks-Inc/hamilton/pull/569
• Adds s3_parallel_dataframe_load example by @elijahbenizzy in https://github.com/DAGWorks-Inc/hamilton/pull/570
• Misc fixes/improvements by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/573
• Contrib/customize embeddings by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/574
• Bumps contrib version to 0.0.5 by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/576
• Bumps version 1.39.1 by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/577

Full Changelog: https://github.com/DAGWorks-Inc/hamilton/compare/sf-hamilton-1.39.0...sf-hamilton-1.39.1

What's Changed

• Fix executor hub code by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/553
• Adds comment on how to display graph by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/555
• Fixes Annotated use as input type. Fixes #554 by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/557
• Multiple Usability Improvements by @elijahbenizzy in https://github.com/DAGWorks-Inc/hamilton/pull/545
• Errors out when calling create_temporary_module with functions that by @elijahbenizzy in https://github.com/DAGWorks-Inc/hamilton/pull/558
• Bumps version from 1.38.1 to 1.39.0 by @elijahbenizzy in https://github.com/DAGWorks-Inc/hamilton/pull/560

Full Changelog: https://github.com/DAGWorks-Inc/hamilton/compare/sf-hamilton-1.38.1...sf-hamilton-1.39.0

What's Changed

• added Plotly materialization example by @zilto in https://github.com/DAGWorks-Inc/hamilton/pull/544
• Changes type annotation on DB connection to Any by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/543
• Update README.md by @elijahbenizzy in https://github.com/DAGWorks-Inc/hamilton/pull/541
• example added example for contrib dataflows by @zilto in https://github.com/DAGWorks-Inc/hamilton/pull/539
• Adds air-quality-analysis to contrib by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/546
• Fix version check script by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/547
• Contrib/dw text summarization by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/548
• Adds pointer to llm_name for contrib example by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/549
• Fixes hub page header by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/550
• Catches dataflow errors when dealing with official packages by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/551
• Bumps version to 1.38.1 by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/552

Full Changelog: https://github.com/DAGWorks-Inc/hamilton/compare/sf-hamilton-1.38.0...sf-hamilton-1.38.1

What's Changed

• Hub improvements by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/522
• added Plotly materializer by @zilto in https://github.com/DAGWorks-Inc/hamilton/pull/496
• contrib added webscraper contrib by @zilto in https://github.com/DAGWorks-Inc/hamilton/pull/524
• added lancedb contrib by @zilto in https://github.com/DAGWorks-Inc/hamilton/pull/527
• added Matplotlib data saver by @zilto in https://github.com/DAGWorks-Inc/hamilton/pull/526
• Moves Official to DAGWorks for contrib/hub by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/528
• Fixes hub build CI step by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/529
• Adjusts hub wording and initial post by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/530
• Exposes new viz kwargs through to display_all_functions by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/525
• Updates furo install to fork by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/531
• Try updating base url for canonical links by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/532
• Allows for dynamic registration of materializer types by @elijahbenizzy in https://github.com/DAGWorks-Inc/hamilton/pull/523
• Fixed typo: import dataflow -> import dataflows by @zilto in https://github.com/DAGWorks-Inc/hamilton/pull/535
• updated dag viz for contribs by @zilto in https://github.com/DAGWorks-Inc/hamilton/pull/534
• Contrib: update to LanceDB contrib by @zilto in https://github.com/DAGWorks-Inc/hamilton/pull/533
• Supports "Any" in loader types by @elijahbenizzy in https://github.com/DAGWorks-Inc/hamilton/pull/536
• Bump version by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/537

Full Changelog: https://github.com/DAGWorks-Inc/hamilton/compare/sf-hamilton-1.37.1...sf-hamilton-1.38.0

What's Changed

• Fixes to the DAG path visualizations by @zilto in https://github.com/DAGWorks-Inc/hamilton/pull/518
• Bumps version to 1.37.1 by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/519

Full Changelog: https://github.com/DAGWorks-Inc/hamilton/compare/sf-hamilton-1.37.0...sf-hamilton-1.37.1

What's Changed

• Fixes Pandas plugins errors and warnings for 2.0 by @zilto in https://github.com/DAGWorks-Inc/hamilton/pull/511
• Adding an Pandas ORC Reader and Writer class by @JoJo10Smith in https://github.com/DAGWorks-Inc/hamilton/pull/509
• Decoupling io from materialization blog post by @elijahbenizzy in https://github.com/DAGWorks-Inc/hamilton/pull/483
• Adds basic README/updates requirements for 'decoupling IO' blog post by @elijahbenizzy in https://github.com/DAGWorks-Inc/hamilton/pull/514
• Feature Improved DAG visualization by @zilto in https://github.com/DAGWorks-Inc/hamilton/pull/512
• Updates integration tests to run on python3.12 by @elijahbenizzy in https://github.com/DAGWorks-Inc/hamilton/pull/513
• fixed type to string for Python <=3.9 by @zilto in https://github.com/DAGWorks-Inc/hamilton/pull/516
• Fix the displayed type for input node. by @zilto in https://github.com/DAGWorks-Inc/hamilton/pull/517
• Bumps version to 1.37.0 by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/515

Full Changelog: https://github.com/DAGWorks-Inc/hamilton/compare/sf-hamilton-1.36.0...sf-hamilton-1.37.0

What's Changed

• added nixtla statsforecast contrib by @zilto in https://github.com/DAGWorks-Inc/hamilton/pull/492
• Adds Algolia search to hub by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/500
• Places search bar on left side on hub by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/501
• added mlforecast contrib by @zilto in https://github.com/DAGWorks-Inc/hamilton/pull/498
• Fix: Clean XGBoost + Optuna contrib notebook state by @zilto in https://github.com/DAGWorks-Inc/hamilton/pull/503
• Extractors/from_.xyz by @elijahbenizzy in https://github.com/DAGWorks-Inc/hamilton/pull/468
• Misc materializer improvements by @elijahbenizzy in https://github.com/DAGWorks-Inc/hamilton/pull/502
• Adds validation methods to the driver by @elijahbenizzy in https://github.com/DAGWorks-Inc/hamilton/pull/493
• Bumps sf-hamilton from 1.35.1 to 1.36.0 by @elijahbenizzy in https://github.com/DAGWorks-Inc/hamilton/pull/507

Full Changelog: https://github.com/DAGWorks-Inc/hamilton/compare/sf-hamilton-1.35.1...sf-hamilton-1.36.0

What's Changed

• Fixes data loader/data saver documentation by @elijahbenizzy in https://github.com/DAGWorks-Inc/hamilton/pull/494
• Fixed run_dask.png image in pandera data quality example by @subhamc1 in https://github.com/DAGWorks-Inc/hamilton/pull/486
• Fixed all images in the examples/data_quality/simple folder by @subhamc1 in https://github.com/DAGWorks-Inc/hamilton/pull/490
• Fixed run_ray.png image in pandera data quality example by @subhamc1 in https://github.com/DAGWorks-Inc/hamilton/pull/489
• Fixed run.png image in pandera data quality example by @subhamc1 in https://github.com/DAGWorks-Inc/hamilton/pull/488
• Fixed run_spark.png image in pandera data quality example by @subhamc1 in https://github.com/DAGWorks-Inc/hamilton/pull/487
• Adding Pandas CSV Reader and Writer class by @JoJo10Smith in https://github.com/DAGWorks-Inc/hamilton/pull/480
• Fixes Pandas CSV Reader Writer names by @skrawcz in https://github.com/DAGWorks-Inc/hamilton/pull/497
• Clean requirements by @elijahbenizzy in https://github.com/DAGWorks-Inc/hamilton/pull/499

Full Changelog: https://github.com/DAGWorks-Inc/hamilton/compare/sf-hamilton-1.35.0...sf-hamilton-1.35.1

What's Changed

• Adds pandera type-hint validation by @elijahbenizzy in https://github.com/DAGWorks-Inc/hamilton/pull/475
• @pipe decorator by @elijahbenizzy in https://github.com/DAGWorks-Inc/hamilton/pull/398
• added data loader and saver for LightGBM by @zilto in https://github.com/DAGWorks-Inc/hamilton/pull/462
• remove exception handling for xgboost by @zilto in https://github.com/DAGWorks-Inc/hamilton/pull/478
• Added Numpy .npysaver/loader by @zilto in https://github.com/DAGWorks-Inc/hamilton/pull/476
• Contrib: added xgboost-optuna contrib by @zilto in https://github.com/DAGWorks-Inc/hamilton/pull/479
• Fixed scikit_transformer image in the scikit-learn example by @subhamc1 in https://github.com/DAGWorks-Inc/hamilton/pull/482
• add sklearn plot saver by @VPraharsha03 in https://github.com/DAGWorks-Inc/hamilton/pull/467
• Writeup on garbage collection + hamilton by @elijahbenizzy in https://github.com/DAGWorks-Inc/hamilton/pull/481
• Bumps hamilton version to 1.35.0 by @elijahbenizzy in https://github.com/DAGWorks-Inc/hamilton/pull/491

New Contributors

• @subhamc1 made their first contribution in https://github.com/DAGWorks-Inc/hamilton/pull/482
• @VPraharsha03 made their first contribution in https://github.com/DAGWorks-Inc/hamilton/pull/467

Full Changelog: https://github.com/DAGWorks-Inc/hamilton/compare/sf-hamilton-1.34.1...sf-hamilton-1.35.0