fiddler-auditor

What's Changed

• Updating dependencies and Notebooks by @iterix in https://github.com/fiddler-labs/fiddler-auditor/pull/46
• Updated Quickstart by @iterix in https://github.com/fiddler-labs/fiddler-auditor/pull/47

Full Changelog: https://github.com/fiddler-labs/fiddler-auditor/compare/0.0.4...0.0.5

What's Changed

• Updating dependencies and Notebooks by @iterix in https://github.com/fiddler-labs/fiddler-auditor/pull/46

Full Changelog: https://github.com/fiddler-labs/fiddler-auditor/compare/0.0.4...0.0.5.rc0

What's Changed

• 🎆 Added ModelGrading, Toxicity and URLChecker by @iterix in https://github.com/fiddler-labs/fiddler-auditor/pull/41
• Issue#17 - Add Progress Bar to show progress on perturbations and scores by @jimilp7 in https://github.com/fiddler-labs/fiddler-auditor/pull/38
• Fix failing nightly by @iterix in https://github.com/fiddler-labs/fiddler-auditor/pull/40
• Fixing an issue with sentence construction by @iterix in https://github.com/fiddler-labs/fiddler-auditor/pull/44
• Updating notebooks by @iterix in https://github.com/fiddler-labs/fiddler-auditor/pull/45

New Contributors

• @jimilp7 made their first contribution in https://github.com/fiddler-labs/fiddler-auditor/pull/38

Full Changelog: https://github.com/fiddler-labs/fiddler-auditor/compare/0.0.3...0.0.4

What's Changed

• Issue#17 - Add Progress Bar to show progress on perturbations and scores by @jimilp7 in https://github.com/fiddler-labs/fiddler-auditor/pull/38
• Fix failing nightly by @iterix in https://github.com/fiddler-labs/fiddler-auditor/pull/40
• Adding ModelGrading, Toxicity and URLChecker by @iterix in https://github.com/fiddler-labs/fiddler-auditor/pull/41

New Contributors

• @jimilp7 made their first contribution in https://github.com/fiddler-labs/fiddler-auditor/pull/38

Full Changelog: https://github.com/fiddler-labs/fiddler-auditor/compare/0.0.3...0.0.4.rc0

What's Changed

• Contribution guide and checklist dependency management by @iterix in https://github.com/fiddler-labs/fiddler-auditor/pull/32
• bumping up version number by @iterix in https://github.com/fiddler-labs/fiddler-auditor/pull/34
• Updating workflows by @iterix in https://github.com/fiddler-labs/fiddler-auditor/pull/35
• Enabling manual trigger of tests by @iterix in https://github.com/fiddler-labs/fiddler-auditor/pull/36

Full Changelog: https://github.com/fiddler-labs/fiddler-auditor/compare/0.0.2...0.0.3

What's Changed

• Ability to define custom transformations
• Support for Azure OpenAI
• In-built Typo based perturbations

Prominent PRs

• Add support to Azure OpenAI by @tspthomas in https://github.com/fiddler-labs/fiddler-auditor/pull/21
• Overhauling perturbations to support custom perturbations by @iterix in https://github.com/fiddler-labs/fiddler-auditor/pull/26
• Add typo based perturbations by @lior-fiddler in https://github.com/fiddler-labs/fiddler-auditor/pull/22

New Contributors

• @tspthomas made their first contribution in https://github.com/fiddler-labs/fiddler-auditor/pull/21
• @SangamSwadiK made their first contribution in https://github.com/fiddler-labs/fiddler-auditor/pull/25
• @lior-fiddler made their first contribution in https://github.com/fiddler-labs/fiddler-auditor/pull/22

Full Changelog: https://github.com/fiddler-labs/fiddler-auditor/compare/0.0.1...0.0.2

First Release of Fiddler Auditor

This version supports

• Perturbation of prompts via paraphrasing
• Gathering responses and checking expected behavior
• Ability to add custom expected behavior
• Creation and saving of HTML report
• Langchain integration

• Support restricted to Python 3.10 and 3.11 due to upstream issues with langchain and typing_extensions (Link).
• Updates to image assets on Readme