evaluate

🤗 Evaluate: A library for easily evaluating machine learning models and datasets.

APACHE-2.0 License

Downloads
2.4M
Stars
1.8K
Committers
120
View Code on GitHub Visit Website
Ecosystems: Python

Commit Statistics

Past Year

All Time

Total Commits
52
904
Total Committers
31
128
Avg. Commits Per Committer
1.68
7.06
Bot Commits
0
0

Issue Statistics

Past Year

All Time

Total Pull Requests
60
116
Merged Pull Requests
20
43
Total Issues
81
175
Time to Close Issues
23 days
about 2 months
Package Rankings
Top 1.2% on Pypi.org
Top 6.0% on Proxy.golang.org
Top 36.99% on Anaconda.org
Top 24.4% on Conda-forge.org
Related Projects
autometrics-py

Easily add metrics to your code that actually help you spot and debug issues in production. Built...

20 Feb 2023 206
neurips-llm-efficiency-challenge

Starter pack for NeurIPS LLM Efficiency Challenge 2023.

11 Jul 2023 28
BIG-bench

Beyond the Imitation Game collaborative benchmark for measuring and extrapolating the capabilitie...

15 Jan 2021 2,833
ice-score

[EACL 2024] ICE-Score: Instructing Large Language Models to Evaluate Code

26 Apr 2023 67
lm-evaluation-harness

A framework for few-shot evaluation of language models.

28 Aug 2020 6,569
nlp-uncertainty-zoo

Model zoo for different kinds of uncertainty quantification methods used in Natural Language Proc...

17 Mar 2021 45
deepeval

The LLM Evaluation Framework

10 Aug 2023 1,929
metric-learn

Metric learning algorithms in Python

02 Nov 2013 1,383
evalify

Evaluate your biometric verification models literally in seconds.

15 Feb 2022 19
RAGTune

Tuning and Evaluation of RAG pipeline. (Automated optimization to be added soon)

04 Mar 2024 260
mmengine

OpenMMLab Foundational Library for Training Deep Learning Models

08 Feb 2022 1,093
torchmetrics

Torchmetrics - Machine learning metrics for distributed, scalable PyTorch applications.

22 Dec 2020 1,998
CASS-PROPEL

Complete evaluation of traditional "SK-learn like" machine learning models for post-operative com...

11 Sep 2023 4
EvalAI

Evaluating state of the art in AI

21 Oct 2016 1,699
review_object_detection_metrics

Object Detection Metrics. 14 object detection metrics: mean Average Precision (mAP), Average Reca...

11 Nov 2020 1,064