autolabel

What's Changed

• Fix example selector with non string inputs by @rajasbansal in https://github.com/refuel-ai/autolabel/pull/558
• Change label to null label on output not followed by @rajasbansal in https://github.com/refuel-ai/autolabel/pull/559
• Increase pool size and record prompts after labeling by @rajasbansal in https://github.com/refuel-ai/autolabel/pull/549
• Support disable quoting while reading .csv files by @mkchaitanya03 in https://github.com/refuel-ai/autolabel/pull/563
• Support full named-entity level metrics by @mkchaitanya03 in https://github.com/refuel-ai/autolabel/pull/562
• Add an attribute extraction task by @rajasbansal in https://github.com/refuel-ai/autolabel/pull/566
• Add support for Redis Cache by @yadavsahil197 in https://github.com/refuel-ai/autolabel/pull/570
• Better support for classification tasks with large number of label classes by @iomap in https://github.com/refuel-ai/autolabel/pull/561
• Allow confidence computation per attribute and setting label columns by @rajasbansal in https://github.com/refuel-ai/autolabel/pull/572
• Change embedding model attribute's name in vector store wrapper by @mkchaitanya03 in https://github.com/refuel-ai/autolabel/pull/580
• Expanding benchmark by @DhruvaBansal00 in https://github.com/refuel-ai/autolabel/pull/584
• Allow additional properties by @Abhinav-Naikawadi in https://github.com/refuel-ai/autolabel/pull/585
• add documentation for using label_selection on large classification tasks by @iomap in https://github.com/refuel-ai/autolabel/pull/586
• Anthropic bugfix - upgrading sdk, tokenizer usage by @DhruvaBansal00 in https://github.com/refuel-ai/autolabel/pull/597
• Bug fixes and add documentation for attribute extraction by @rajasbansal in https://github.com/refuel-ai/autolabel/pull/596
• Refuel LLM integration with autolabel by @rajasbansal in https://github.com/refuel-ai/autolabel/pull/595
• add initialize to cache by @rajasbansal in https://github.com/refuel-ai/autolabel/pull/598
• bump version for release by @rajasbansal in https://github.com/refuel-ai/autolabel/pull/601

New Contributors

• @mkchaitanya03 made their first contribution in https://github.com/refuel-ai/autolabel/pull/563

Full Changelog: https://github.com/refuel-ai/autolabel/compare/v0.0.15...v0.0.16

What's Changed

• Fix AUROC Bug and allow custom Example Selectors by @rajasbansal in https://github.com/refuel-ai/autolabel/pull/531
• Setting skip keys as true for hashing non basic types by @rajasbansal in https://github.com/refuel-ai/autolabel/pull/532
• Make task management optional by @rajasbansal in https://github.com/refuel-ai/autolabel/pull/535
• Update example notebooks with the new agent changes by @nihit in https://github.com/refuel-ai/autolabel/pull/536
• optionalize evaluation and console progress printing by @nihit in https://github.com/refuel-ai/autolabel/pull/537
• typo in getting started docs by @guptav96 in https://github.com/refuel-ai/autolabel/pull/538
• Transforms: Send only specified output columns in transformed row by @yadavsahil197 in https://github.com/refuel-ai/autolabel/pull/539
• Synthetic Data Generation With LLMs by @Tyrest in https://github.com/refuel-ai/autolabel/pull/500
• Add annotations column in output dataframe by @Abhinav-Naikawadi in https://github.com/refuel-ai/autolabel/pull/541
• Transforms: Add error handling by @yadavsahil197 in https://github.com/refuel-ai/autolabel/pull/540
• Fix error message on openai key not set by @rajasbansal in https://github.com/refuel-ai/autolabel/pull/543
• added ocr image transform by @Tyrest in https://github.com/refuel-ai/autolabel/pull/515
• fix bugs for kill signal and indexing by @Tyrest in https://github.com/refuel-ai/autolabel/pull/545
• added docs for synthetic datasets and progress by @Tyrest in https://github.com/refuel-ai/autolabel/pull/544
• fix some outdated examples in the documentation by @nihit in https://github.com/refuel-ai/autolabel/pull/548
• Add support for Serp Api Transform by @yadavsahil197 in https://github.com/refuel-ai/autolabel/pull/547
• Update name of db with the new release by @rajasbansal in https://github.com/refuel-ai/autolabel/pull/551
• bump version for release by @nihit in https://github.com/refuel-ai/autolabel/pull/557

New Contributors

• @guptav96 made their first contribution in https://github.com/refuel-ai/autolabel/pull/538

Full Changelog: https://github.com/refuel-ai/autolabel/compare/v0.0.14...v0.0.15

What's Changed

• Allow label column to be null for running autolabel by @rajasbansal in https://github.com/refuel-ai/autolabel/pull/485
• Bump version to 0.0.10 by @rajasbansal in https://github.com/refuel-ai/autolabel/pull/488
• Autolabel config cli by @Tyrest in https://github.com/refuel-ai/autolabel/pull/463
• cli file name bugfix by @Tyrest in https://github.com/refuel-ai/autolabel/pull/493
• added logit bias for huggingface by @Tyrest in https://github.com/refuel-ai/autolabel/pull/495
• Added configurable log level to the CLI by @Tyrest in https://github.com/refuel-ai/autolabel/pull/497
• CLI Logit Bias and Model Params Fix by @Tyrest in https://github.com/refuel-ai/autolabel/pull/498
• Output object instead of dataframe to handle sorting and filtering by @rajasbansal in https://github.com/refuel-ai/autolabel/pull/482
• Add transform base class with a very simple agent.transform by @rajasbansal in https://github.com/refuel-ai/autolabel/pull/496
• added CLI documentation by @Tyrest in https://github.com/refuel-ai/autolabel/pull/494
• added links to the CLI documentation by @Tyrest in https://github.com/refuel-ai/autolabel/pull/505
• updated cli to reflect the transform change by @Tyrest in https://github.com/refuel-ai/autolabel/pull/504
• Accept config in LabelingAgent by @rajasbansal in https://github.com/refuel-ai/autolabel/pull/501
• Add support for Webpage Transform by @yadavsahil197 in https://github.com/refuel-ai/autolabel/pull/507
• added pdf transform and tests by @Tyrest in https://github.com/refuel-ai/autolabel/pull/502
• Support custom llm by @Sardhendu in https://github.com/refuel-ai/autolabel/pull/503
• Add cache for transforms and unpin sqlite by @rajasbansal in https://github.com/refuel-ai/autolabel/pull/508
• fixes to cli documentation like lists and others by @Tyrest in https://github.com/refuel-ai/autolabel/pull/514
• remove data loader directory (unused) by @rajasbansal in https://github.com/refuel-ai/autolabel/pull/512
• Update docs and add an example webpage transform notebook by @rajasbansal in https://github.com/refuel-ai/autolabel/pull/517
• added pdf transform documentation by @Tyrest in https://github.com/refuel-ai/autolabel/pull/519
• Allow running transforms in Jupyter Notebook using nest_asyncio by @rajasbansal in https://github.com/refuel-ai/autolabel/pull/520
• Add docs for webpage transform by @rajasbansal in https://github.com/refuel-ai/autolabel/pull/521
• version bump by @nihit in https://github.com/refuel-ai/autolabel/pull/522
• Bump version and fix dependency issue by @rajasbansal in https://github.com/refuel-ai/autolabel/pull/524
• edited pdf transform documentation for consistency by @Tyrest in https://github.com/refuel-ai/autolabel/pull/523
• upgrade bs4 version by @nihit in https://github.com/refuel-ai/autolabel/pull/525
• bump version by @nihit in https://github.com/refuel-ai/autolabel/pull/526
• Update docs for Autolabel Dataset by @rajasbansal in https://github.com/refuel-ai/autolabel/pull/527
• Add optional vector store params to autolabel config by @Abhinav-Naikawadi in https://github.com/refuel-ai/autolabel/pull/528
• fix config type error in AutolabelDataset initialization by @nihit in https://github.com/refuel-ai/autolabel/pull/530

Full Changelog: https://github.com/refuel-ai/autolabel/compare/v0.0.9...v0.0.14

What's Changed

• Allow label column to be null for running autolabel by @rajasbansal in https://github.com/refuel-ai/autolabel/pull/485
• Bump version to 0.0.10 by @rajasbansal in https://github.com/refuel-ai/autolabel/pull/488
• Autolabel config cli by @Tyrest in https://github.com/refuel-ai/autolabel/pull/463
• cli file name bugfix by @Tyrest in https://github.com/refuel-ai/autolabel/pull/493
• added logit bias for huggingface by @Tyrest in https://github.com/refuel-ai/autolabel/pull/495
• Added configurable log level to the CLI by @Tyrest in https://github.com/refuel-ai/autolabel/pull/497
• CLI Logit Bias and Model Params Fix by @Tyrest in https://github.com/refuel-ai/autolabel/pull/498
• Output object instead of dataframe to handle sorting and filtering by @rajasbansal in https://github.com/refuel-ai/autolabel/pull/482
• Add transform base class with a very simple agent.transform by @rajasbansal in https://github.com/refuel-ai/autolabel/pull/496
• added CLI documentation by @Tyrest in https://github.com/refuel-ai/autolabel/pull/494
• added links to the CLI documentation by @Tyrest in https://github.com/refuel-ai/autolabel/pull/505
• updated cli to reflect the transform change by @Tyrest in https://github.com/refuel-ai/autolabel/pull/504
• Accept config in LabelingAgent by @rajasbansal in https://github.com/refuel-ai/autolabel/pull/501
• Add support for Webpage Transform by @yadavsahil197 in https://github.com/refuel-ai/autolabel/pull/507
• added pdf transform and tests by @Tyrest in https://github.com/refuel-ai/autolabel/pull/502
• Support custom llm by @Sardhendu in https://github.com/refuel-ai/autolabel/pull/503
• Add cache for transforms and unpin sqlite by @rajasbansal in https://github.com/refuel-ai/autolabel/pull/508
• fixes to cli documentation like lists and others by @Tyrest in https://github.com/refuel-ai/autolabel/pull/514
• remove data loader directory (unused) by @rajasbansal in https://github.com/refuel-ai/autolabel/pull/512
• Update docs and add an example webpage transform notebook by @rajasbansal in https://github.com/refuel-ai/autolabel/pull/517
• added pdf transform documentation by @Tyrest in https://github.com/refuel-ai/autolabel/pull/519
• Allow running transforms in Jupyter Notebook using nest_asyncio by @rajasbansal in https://github.com/refuel-ai/autolabel/pull/520
• Add docs for webpage transform by @rajasbansal in https://github.com/refuel-ai/autolabel/pull/521
• version bump by @nihit in https://github.com/refuel-ai/autolabel/pull/522
• Bump version and fix dependency issue by @rajasbansal in https://github.com/refuel-ai/autolabel/pull/524
• edited pdf transform documentation for consistency by @Tyrest in https://github.com/refuel-ai/autolabel/pull/523
• upgrade bs4 version by @nihit in https://github.com/refuel-ai/autolabel/pull/525
• bump version by @nihit in https://github.com/refuel-ai/autolabel/pull/526

Full Changelog: https://github.com/refuel-ai/autolabel/compare/v0.0.10...v0.0.13

What's Changed

• add multilabel classification to validation by @Tyrest in https://github.com/refuel-ai/autolabel/pull/445
• consolidate compute f1 to single function in utils by @Tyrest in https://github.com/refuel-ai/autolabel/pull/453
• cache embeddings in vector store by @Tyrest in https://github.com/refuel-ai/autolabel/pull/457
• Add llm explanation to output dataframe by @rajasbansal in https://github.com/refuel-ai/autolabel/pull/462
• Rmv chunk size by @Sardhendu in https://github.com/refuel-ai/autolabel/pull/459
• added output cost calculation to PaLM get_cost by @Tyrest in https://github.com/refuel-ai/autolabel/pull/470
• Fix metric calculation for unlabeled datapoints by @rajasbansal in https://github.com/refuel-ai/autolabel/pull/468
• fixed adding cache argument to certain algorithms by @Tyrest in https://github.com/refuel-ai/autolabel/pull/471
• Added causal LM support by @Tyrest in https://github.com/refuel-ai/autolabel/pull/472
• added causal lm documentation by @Tyrest in https://github.com/refuel-ai/autolabel/pull/477
• Bubble up errors and clean up error creation by @rajasbansal in https://github.com/refuel-ai/autolabel/pull/475
• Metric calculation as a separate class by @rajasbansal in https://github.com/refuel-ai/autolabel/pull/480
• version bump + clean build artifacts by @nihit in https://github.com/refuel-ai/autolabel/pull/483

Full Changelog: https://github.com/refuel-ai/autolabel/compare/v0.0.8...v0.0.9

What's Changed

• Fix 178: Add data type checking and validation while performing agent plan action by @Sardhendu in https://github.com/refuel-ai/autolabel/pull/428
• Support example selection using label diversity by random and by semantic similarity by @Abhinav-Naikawadi in https://github.com/refuel-ai/autolabel/pull/436
• rmv duplicate and add adjustments to ledger config by @Sardhendu in https://github.com/refuel-ai/autolabel/pull/437
• Correcting name of 16k context model for OpenAI LLM docs by @rishabh-bhargava in https://github.com/refuel-ai/autolabel/pull/439
• label diversity example selection docs by @Abhinav-Naikawadi in https://github.com/refuel-ai/autolabel/pull/438
• Format seed file path correctly by @Abhinav-Naikawadi in https://github.com/refuel-ai/autolabel/pull/442
• add support for older pinned gpt-3.5-turbo-0301 by @nihit in https://github.com/refuel-ai/autolabel/pull/444
• Dataset validation fix for explanation generation by @Abhinav-Naikawadi in https://github.com/refuel-ai/autolabel/pull/441
• Documentation updates for few-shot and LLMs by @nihit in https://github.com/refuel-ai/autolabel/pull/446
• added individual retrying for failed batches by @Tyrest in https://github.com/refuel-ai/autolabel/pull/443
• add chain_of_thought flag to the config schema by @nihit in https://github.com/refuel-ai/autolabel/pull/447
• Revise guidelines and examples for chain of thought by @nihit in https://github.com/refuel-ai/autolabel/pull/448
• tag sections in the civil comments notebooks by @nihit in https://github.com/refuel-ai/autolabel/pull/450

Full Changelog: https://github.com/refuel-ai/autolabel/compare/v0.0.7...v0.0.8

What's Changed

• added cohere support by @Tyrest in https://github.com/refuel-ai/autolabel/pull/419
• Autolabel embedding config docs by @Abhinav-Naikawadi in https://github.com/refuel-ai/autolabel/pull/416
• Add docs for cohere in llms.md by @Tyrest in https://github.com/refuel-ai/autolabel/pull/420
• Bump version: 0.0.6 -> 0.0.7 by @rishabh-bhargava in https://github.com/refuel-ai/autolabel/pull/426
• Multi label docs visibility on docs.refuel.ai by @rishabh-bhargava in https://github.com/refuel-ai/autolabel/pull/427
• Fix open api key error handling by @chirag-manwani in https://github.com/refuel-ai/autolabel/pull/423
• Cohere embeddings support by @Abhinav-Naikawadi in https://github.com/refuel-ai/autolabel/pull/432

New Contributors

• @chirag-manwani made their first contribution in https://github.com/refuel-ai/autolabel/pull/423

Full Changelog: https://github.com/refuel-ai/autolabel/compare/v0.0.6...v0.0.7

What's Changed

• Configs docs by @Abhinav-Naikawadi in https://github.com/refuel-ai/autolabel/pull/320
• change readme links for readability by @nihit in https://github.com/refuel-ai/autolabel/pull/322
• revamp tutorial in the docs website by @nihit in https://github.com/refuel-ai/autolabel/pull/326
• Bump version by @rishabh-bhargava in https://github.com/refuel-ai/autolabel/pull/327
• typeform link in readme by @nihit in https://github.com/refuel-ai/autolabel/pull/329
• update the image format in README by @nihit in https://github.com/refuel-ai/autolabel/pull/331
• merge assets and test/assets directories by @Abhinav-Naikawadi in https://github.com/refuel-ai/autolabel/pull/330
• Bump version: 0.0.2 -> 0.0.3 by @rishabh-bhargava in https://github.com/refuel-ai/autolabel/pull/332
• add link to form for confidence api key by @Abhinav-Naikawadi in https://github.com/refuel-ai/autolabel/pull/333
• Add remaining colab integrations, fix docs deprecated configs, and some example notebook cleanups by @Abhinav-Naikawadi in https://github.com/refuel-ai/autolabel/pull/335
• Chain of thought json parsing by @rajasbansal in https://github.com/refuel-ai/autolabel/pull/336
• Fix the labeled stats shown for labeled examples by @rajasbansal in https://github.com/refuel-ai/autolabel/pull/334
• put links next to section headers in docs site by @iomap in https://github.com/refuel-ai/autolabel/pull/337
• add support for new OpenAI models, update pricing by @nihit in https://github.com/refuel-ai/autolabel/pull/339
• Adding single quotes around pip install in CONTRIBUTING.md by @rishabh-bhargava in https://github.com/refuel-ai/autolabel/pull/341
• Bump version for chain of thought fixes by @Abhinav-Naikawadi in https://github.com/refuel-ai/autolabel/pull/338
• remove the -inf row with compute confidence by @Tyrest in https://github.com/refuel-ai/autolabel/pull/343
• add support for all gpt-3.5 and gpt-4 model versions by @nihit in https://github.com/refuel-ai/autolabel/pull/346
• added retry with tenacity for palm by @Tyrest in https://github.com/refuel-ai/autolabel/pull/347
• Adding a helpful video during set up for contributing by @rishabh-bhargava in https://github.com/refuel-ai/autolabel/pull/348
• Check if the LLM label is in the labels list by @Tyrest in https://github.com/refuel-ai/autolabel/pull/345
• update Makefile help output by @nihit in https://github.com/refuel-ai/autolabel/pull/353
• Moving returned items to dataset loader fields by @rajasbansal in https://github.com/refuel-ai/autolabel/pull/317
• Update get_data and add test case by @Sardhendu in https://github.com/refuel-ai/autolabel/pull/351
• Fixing a small typo in the confidence section of docs by @rishabh-bhargava in https://github.com/refuel-ai/autolabel/pull/358
• Update llms.md by @gruentee in https://github.com/refuel-ai/autolabel/pull/359
• Update llms.md by @eltociear in https://github.com/refuel-ai/autolabel/pull/360
• added custom progress bar for get data by @chiranthans23 in https://github.com/refuel-ai/autolabel/pull/361
• fix test failures by @nihit in https://github.com/refuel-ai/autolabel/pull/364
• Adding single quotes around pip install extras by @rishabh-bhargava in https://github.com/refuel-ai/autolabel/pull/363
• add pull request trigger to actions by @nihit in https://github.com/refuel-ai/autolabel/pull/365
• Adding default cpu support. Removing max tokens for huggingface warnings by @DhruvaBansal00 in https://github.com/refuel-ai/autolabel/pull/366
• Revamp civil comments example notebook and add Colab links by @nihit in https://github.com/refuel-ai/autolabel/pull/367
• added links for convenience to llms.md by @JTarakRam in https://github.com/refuel-ai/autolabel/pull/369
• Fix JSON config for starter task by @yadavsahil197 in https://github.com/refuel-ai/autolabel/pull/372
• Add mkdocs build dependencies to dev setup by @yadavsahil197 in https://github.com/refuel-ai/autolabel/pull/373
• Checks should run on PR commits and after push to main branch by @yadavsahil197 in https://github.com/refuel-ai/autolabel/pull/375
• Pin Langchain to a working version by @yadavsahil197 in https://github.com/refuel-ai/autolabel/pull/374
• added support for hugging face datasets by @Tyrest in https://github.com/refuel-ai/autolabel/pull/354
• version bump by @nihit in https://github.com/refuel-ai/autolabel/pull/376
• added small hugging face dataset section to docs by @Tyrest in https://github.com/refuel-ai/autolabel/pull/377
• added comma's to fix syntax errors in llms.md by @JTarakRam in https://github.com/refuel-ai/autolabel/pull/381
• Fix 196 by @Sardhendu in https://github.com/refuel-ai/autolabel/pull/384
• small fixes to config validation by @nihit in https://github.com/refuel-ai/autolabel/pull/386
• revamp roadmap section by @nihit in https://github.com/refuel-ai/autolabel/pull/402
• pin anthropic version to avoid breaking changes by @Tyrest in https://github.com/refuel-ai/autolabel/pull/407
• Support for multiple embedding providers (Huggingface, etc.) by @Abhinav-Naikawadi in https://github.com/refuel-ai/autolabel/pull/404
• Add multi label classification task by @Tyrest in https://github.com/refuel-ai/autolabel/pull/405
• Fix engine path by @turian in https://github.com/refuel-ai/autolabel/pull/414
• Add docs for multilabel classification by @Tyrest in https://github.com/refuel-ai/autolabel/pull/411
• added check for refuel api key in plan by @Tyrest in https://github.com/refuel-ai/autolabel/pull/344
• Black formatting checks to run on PR branch by @yadavsahil197 in https://github.com/refuel-ai/autolabel/pull/417
• Implemented logit bias by @Tyrest in https://github.com/refuel-ai/autolabel/pull/385
• Bump version: 0.0.5 -> 0.0.6 by @rishabh-bhargava in https://github.com/refuel-ai/autolabel/pull/418

New Contributors

• @gruentee made their first contribution in https://github.com/refuel-ai/autolabel/pull/359
• @eltociear made their first contribution in https://github.com/refuel-ai/autolabel/pull/360
• @chiranthans23 made their first contribution in https://github.com/refuel-ai/autolabel/pull/361
• @JTarakRam made their first contribution in https://github.com/refuel-ai/autolabel/pull/369
• @turian made their first contribution in https://github.com/refuel-ai/autolabel/pull/414

Full Changelog: https://github.com/refuel-ai/autolabel/commits/v0.0.6