deepeval
The LLM Evaluation Framework
APACHE-2.0 License
Downloads
172.4K
Stars
1.9K
Ecosystems:
Python
Bot releases are visible (Hide)
deepeval
- v0.20.6
Published by ColabDog about 1 year ago
What's Changed
- ensure telemetry hits your server by @ColabDog in https://github.com/confident-ai/deepeval/pull/202
Full Changelog: https://github.com/confident-ai/deepeval/compare/v0.20.5...v0.20.6
deepeval
- v0.20.5
Published by ColabDog about 1 year ago
What's Changed
- firewall check for telemetry by @ColabDog in https://github.com/confident-ai/deepeval/pull/200
- hotfix telemetry setup by @ColabDog in https://github.com/confident-ai/deepeval/pull/201
Full Changelog: https://github.com/confident-ai/deepeval/compare/v0.20.3...v0.20.5
deepeval
- v0.20.3
Published by ColabDog about 1 year ago
What's Changed
- clean quickstart by @ColabDog in https://github.com/confident-ai/deepeval/pull/166
- Hotfix.readme by @penguine-ip in https://github.com/confident-ai/deepeval/pull/168
- Freeze typer v by @ColabDog in https://github.com/confident-ai/deepeval/pull/169
- update quickstart by @ColabDog in https://github.com/confident-ai/deepeval/pull/170
- update sidebar by @ColabDog in https://github.com/confident-ai/deepeval/pull/171
- Fix sidebar by @ColabDog in https://github.com/confident-ai/deepeval/pull/172
- Additional error handling for network issues in __init__py by @donaldwasserman in https://github.com/confident-ai/deepeval/pull/177
- Feature/improve assert dx by @ColabDog in https://github.com/confident-ai/deepeval/pull/178
- make query mandatory by @penguine-ip in https://github.com/confident-ai/deepeval/pull/182
- Iimprove prompting flow for api key by @penguine-ip in https://github.com/confident-ai/deepeval/pull/185
- Force query and output by @ColabDog in https://github.com/confident-ai/deepeval/pull/188
- force context to be a list by @ColabDog in https://github.com/confident-ai/deepeval/pull/192
- update version by @ColabDog in https://github.com/confident-ai/deepeval/pull/195
- Features/llmmetric by @penguine-ip in https://github.com/confident-ai/deepeval/pull/197
- add telemetry and sentry by @ColabDog in https://github.com/confident-ai/deepeval/pull/198
- Feature/add configuration by @ColabDog in https://github.com/confident-ai/deepeval/pull/199
New Contributors
- @donaldwasserman made their first contribution in https://github.com/confident-ai/deepeval/pull/177
Full Changelog: https://github.com/confident-ai/deepeval/compare/v0.20.0...v0.20.3
deepeval
- v0.20.0
Published by ColabDog about 1 year ago
What's Changed
- Rename HOW_TO_CONTRIBUTE.md to CONTRIBUTING.md by @penguine-ip in https://github.com/confident-ai/deepeval/pull/164
- add image similarity metric by @ColabDog in https://github.com/confident-ai/deepeval/pull/162
- Feature/add image similarity by @ColabDog in https://github.com/confident-ai/deepeval/pull/165
Full Changelog: https://github.com/confident-ai/deepeval/compare/v0.19.0...v0.20.0
deepeval
- v0.19.0
Published by ColabDog about 1 year ago
What's Changed
- add guardrails integration by @ColabDog in https://github.com/confident-ai/deepeval/pull/158
- add github workflow results by @ColabDog in https://github.com/confident-ai/deepeval/pull/159
- Feature/add llm eval by @ColabDog in https://github.com/confident-ai/deepeval/pull/161
Full Changelog: https://github.com/confident-ai/deepeval/compare/v0.18.0...v0.19.0
deepeval
- v0.18.0
Published by ColabDog about 1 year ago
What's Changed
- Add new customer support example by @ColabDog in https://github.com/confident-ai/deepeval/pull/154
- Add example test case by @ColabDog in https://github.com/confident-ai/deepeval/pull/156
Full Changelog: https://github.com/confident-ai/deepeval/compare/v0.17.9...v0.18.0
deepeval
- v0.17.9
Published by ColabDog about 1 year ago
What's Changed
- fix the API and version by @ColabDog in https://github.com/confident-ai/deepeval/pull/153
Full Changelog: https://github.com/confident-ai/deepeval/compare/v0.17.8...v0.17.9
deepeval
- v0.17.8
Published by ColabDog about 1 year ago
What's Changed
- fix by @ColabDog in https://github.com/confident-ai/deepeval/pull/147
- add context to the API by @ColabDog in https://github.com/confident-ai/deepeval/pull/150
- Resolves #151 by @ColabDog in https://github.com/confident-ai/deepeval/pull/152
Full Changelog: https://github.com/confident-ai/deepeval/compare/v0.17.6...v0.17.8
deepeval
- v0.17.6
Published by ColabDog about 1 year ago
What's Changed
- adding length metric including test and documentation by @j-space-b in https://github.com/confident-ai/deepeval/pull/139
- add koala by @ColabDog in https://github.com/confident-ai/deepeval/pull/141
- Feature/update file name by @ColabDog in https://github.com/confident-ai/deepeval/pull/145
- add switch CLI by @ColabDog in https://github.com/confident-ai/deepeval/pull/146
Full Changelog: https://github.com/confident-ai/deepeval/compare/v0.17.5...v0.17.6
deepeval
- v0.17.5
Published by ColabDog about 1 year ago
What's Changed
- Hotfix/fix conceptual similarity threshold by @ColabDog in https://github.com/confident-ai/deepeval/pull/133
- Hotfix/fix quickstart example for query creation by @ColabDog in https://github.com/confident-ai/deepeval/pull/130
- remove test utils by @ColabDog in https://github.com/confident-ai/deepeval/pull/134
- fix yml by @ColabDog in https://github.com/confident-ai/deepeval/pull/135
- add docs on evaluatin glegal by @ColabDog in https://github.com/confident-ai/deepeval/pull/136
- update social card image by @ColabDog in https://github.com/confident-ai/deepeval/pull/137
- update ragas by @ColabDog in https://github.com/confident-ai/deepeval/pull/138
Full Changelog: https://github.com/confident-ai/deepeval/compare/v0.17.4...v0.17.5
deepeval
- v0.17.4
Published by ColabDog about 1 year ago
What's Changed
- Feature/cache pip dependencies by @ColabDog in https://github.com/confident-ai/deepeval/pull/128
- Hotfix/fix cli by @ColabDog in https://github.com/confident-ai/deepeval/pull/129
- FIx to Singleton class instantiation not considering arguments of the class
Full Changelog: https://github.com/confident-ai/deepeval/compare/v0.17.3...v0.17.4
deepeval
- v0.17.3
Published by ColabDog about 1 year ago
What's Changed
- Feature/add synthetic query generation by @ColabDog in https://github.com/confident-ai/deepeval/pull/1
- Feature/add synthetic query generation by @ColabDog in https://github.com/confident-ai/deepeval/pull/2
- fix evals by @ColabDog in https://github.com/confident-ai/deepeval/pull/3
- add docs by @ColabDog in https://github.com/confident-ai/deepeval/pull/4
- Feature/add docs by @ColabDog in https://github.com/confident-ai/deepeval/pull/5
- Feature/add pytest cases by @ColabDog in https://github.com/confident-ai/deepeval/pull/6
- add black by @ColabDog in https://github.com/confident-ai/deepeval/pull/7
- add pytest by @ColabDog in https://github.com/confident-ai/deepeval/pull/8
- Feature/add langchain integration by @ColabDog in https://github.com/confident-ai/deepeval/pull/10
- update to modal by @ColabDog in https://github.com/confident-ai/deepeval/pull/11
- fix langchain integration pipeline by @ColabDog in https://github.com/confident-ai/deepeval/pull/14
- update API by @ColabDog in https://github.com/confident-ai/deepeval/pull/15
- switch to callable metrics by @ColabDog in https://github.com/confident-ai/deepeval/pull/16
- add answer relevancy by @ColabDog in https://github.com/confident-ai/deepeval/pull/18
- check for ranking similarity by @ColabDog in https://github.com/confident-ai/deepeval/pull/19
- add dashboard by @ColabDog in https://github.com/confident-ai/deepeval/pull/20
- add support for dict objects by @ColabDog in https://github.com/confident-ai/deepeval/pull/21
- Jacky/twi 332 add overall metric by @ColabDog in https://github.com/confident-ai/deepeval/pull/23
- Jacky/twi 338 add alert score by @ColabDog in https://github.com/confident-ai/deepeval/pull/22
- Feature/add conceptual similarity by @ColabDog in https://github.com/confident-ai/deepeval/pull/24
- Feature/add overall score by @ColabDog in https://github.com/confident-ai/deepeval/pull/25
- Jacky/twi 332 add overall metric 2 by @ColabDog in https://github.com/confident-ai/deepeval/pull/27
- Jacky/twi 343 fix sending python events to server by @ColabDog in https://github.com/confident-ai/deepeval/pull/28
- Add assert non-toxic by @ColabDog in https://github.com/confident-ai/deepeval/pull/26
- Fix toxic classifier by @ColabDog in https://github.com/confident-ai/deepeval/pull/29
- Biasdetection by @j-space-b in https://github.com/confident-ai/deepeval/pull/31
- add length metric by @ColabDog in https://github.com/confident-ai/deepeval/pull/30
- update debias documentation by @ColabDog in https://github.com/confident-ai/deepeval/pull/32
- update the name by @ColabDog in https://github.com/confident-ai/deepeval/pull/34
- make tests run in matrix by @ColabDog in https://github.com/confident-ai/deepeval/pull/33
- Feature/create implementation by @ColabDog in https://github.com/confident-ai/deepeval/pull/35
- fix prod by @ColabDog in https://github.com/confident-ai/deepeval/pull/36
- Feature/add retry manager by @ColabDog in https://github.com/confident-ai/deepeval/pull/37
- update tests by @ColabDog in https://github.com/confident-ai/deepeval/pull/38
- Feature/fix evaluation by @ColabDog in https://github.com/confident-ai/deepeval/pull/40
- Feature/run evaluation by @ColabDog in https://github.com/confident-ai/deepeval/pull/39
- Hotfix/assert not working by @ColabDog in https://github.com/confident-ai/deepeval/pull/41
- add classifiers by @ColabDog in https://github.com/confident-ai/deepeval/pull/42
- ADd check for raising error by @ColabDog in https://github.com/confident-ai/deepeval/pull/43
- Feature/add success by @ColabDog in https://github.com/confident-ai/deepeval/pull/45
- Feature/fix error by @ColabDog in https://github.com/confident-ai/deepeval/pull/44
- Feature/rename input to query by @ColabDog in https://github.com/confident-ai/deepeval/pull/47
- Feature/improve question answering by @ColabDog in https://github.com/confident-ai/deepeval/pull/46
- Feature/add singleton metric by @ColabDog in https://github.com/confident-ai/deepeval/pull/48
- Add quickstart by @ColabDog in https://github.com/confident-ai/deepeval/pull/49
- Feature/make parameters available by @ColabDog in https://github.com/confident-ai/deepeval/pull/50
- add answer relevancy by @ColabDog in https://github.com/confident-ai/deepeval/pull/51
- add deepeval test by @ColabDog in https://github.com/confident-ai/deepeval/pull/52
- Add custom metric by @ColabDog in https://github.com/confident-ai/deepeval/pull/53
- Feature/fix custom metric by @ColabDog in https://github.com/confident-ai/deepeval/pull/54
- Feature/add posthog by @ColabDog in https://github.com/confident-ai/deepeval/pull/56
- Jacky/conf 356 add tests for answer relevancy by @ColabDog in https://github.com/confident-ai/deepeval/pull/55
- Hotfix/overall score tests by @ColabDog in https://github.com/confident-ai/deepeval/pull/58
- add etst by @ColabDog in https://github.com/confident-ai/deepeval/pull/57
- Feature/add cli by @ColabDog in https://github.com/confident-ai/deepeval/pull/59
- add readme by @ColabDog in https://github.com/confident-ai/deepeval/pull/60
- add file handler to key env by @ColabDog in https://github.com/confident-ai/deepeval/pull/61
- Add llamaidnex by @ColabDog in https://github.com/confident-ai/deepeval/pull/63
- Feaeture/improve get api key by @ColabDog in https://github.com/confident-ai/deepeval/pull/66
- update reqs by @ColabDog in https://github.com/confident-ai/deepeval/pull/69
- Feature/add test overall score by @ColabDog in https://github.com/confident-ai/deepeval/pull/73
- Fix overall score by @ColabDog in https://github.com/confident-ai/deepeval/pull/75
- Add gpt synthetic data by @penguine-ip in https://github.com/confident-ai/deepeval/pull/74
- Feature/log context by @ColabDog in https://github.com/confident-ai/deepeval/pull/77
- remove by @ColabDog in https://github.com/confident-ai/deepeval/pull/79
- Feature/fix quickstart by @ColabDog in https://github.com/confident-ai/deepeval/pull/81
- Hotfix/fix project name by @ColabDog in https://github.com/confident-ai/deepeval/pull/82
- Hotfix/incorrect issue by @ColabDog in https://github.com/confident-ai/deepeval/pull/85
- Fix conceptual similarity by @ColabDog in https://github.com/confident-ai/deepeval/pull/86
- Feature/improve writing unit tests by @ColabDog in https://github.com/confident-ai/deepeval/pull/90
- Feature/add spinner progress by @ColabDog in https://github.com/confident-ai/deepeval/pull/91
- Feature/add context back to textcase by @ColabDog in https://github.com/confident-ai/deepeval/pull/94
- update quickstart by @ColabDog in https://github.com/confident-ai/deepeval/pull/103
- Fix answer relevancy by @ColabDog in https://github.com/confident-ai/deepeval/pull/111
- make crossencoder default by @ColabDog in https://github.com/confident-ai/deepeval/pull/112
- Feature/add test run by @ColabDog in https://github.com/confident-ai/deepeval/pull/115
- Feature/add test run by @ColabDog in https://github.com/confident-ai/deepeval/pull/116
- update metric by @ColabDog in https://github.com/confident-ai/deepeval/pull/117
- Hotfix/zero score logs by @ColabDog in https://github.com/confident-ai/deepeval/pull/119
- Feature/add ragas by @ColabDog in https://github.com/confident-ai/deepeval/pull/121
- Hotfix/not running with no pytest by @ColabDog in https://github.com/confident-ai/deepeval/pull/124
- add multiple metrics by @ColabDog in https://github.com/confident-ai/deepeval/pull/123
- Hotfix/remove code by @ColabDog in https://github.com/confident-ai/deepeval/pull/125
- add chatbot test by @ColabDog in https://github.com/confident-ai/deepeval/pull/126
New Contributors
- @ColabDog made their first contribution in https://github.com/confident-ai/deepeval/pull/1
- @j-space-b made their first contribution in https://github.com/confident-ai/deepeval/pull/31
- @penguine-ip made their first contribution in https://github.com/confident-ai/deepeval/pull/74
Full Changelog: https://github.com/confident-ai/deepeval/commits/v0.17.3
Package Rankings
Top 6.75% on Proxy.golang.org
Top 9.35% on Pypi.org