repobench

✨ RepoBench: Benchmarking Repository-Level Code Auto-Completion Systems - ICLR 2024

CC-BY-4.0 License

Stars
124
View Code on GitHub Visit Website
Ecosystems: Python

Statistics for this project are still being loaded, please check back later.

Related Projects
Transfer-Learning-Library

Transfer Learning Library for Domain Adaptation, Task Adaptation, and Domain Generalization

14 Feb 2020 3,356
dreambench_plus

12 Jun 2024 64
ceval

Official github repo for C-Eval, a Chinese evaluation suite for foundation models [NeurIPS 2023]

12 May 2023 1,507
automl_multimodal_benchmark

Repository for Multimodal AutoML Benchmark

12 Jul 2021 50
cleanrl

High-quality single file implementation of Deep Reinforcement Learning algorithms with research-f...

07 Jun 2019 5,379
ocl_survey

Code for "A Comprehensive Empirical Evaluation on Online Continual Learning" ICCVW 2023 VCL Workshop

25 Apr 2023 31
Bench2Drive

[NeurIPS 2024 Datasets and Benchmarks Track] Closed-Loop E2E-AD Benchmark Enhanced by World Model...

23 Apr 2024 1,240
SWE-bench

[ICLR 2024] SWE-Bench: Can Language Models Resolve Real-world Github Issues?

04 Oct 2023 1,819
FastChat

An open platform for training, serving, and evaluating large language models. Release repo for Vi...

19 Mar 2023 36,628
pretraining-with-human-feedback

Code accompanying the paper Pretraining Language Models with Human Preferences

20 Feb 2023 167
YAIB

🧪Yet Another ICU Benchmark: a holistic framework for the standardization of clinical prediction m...

15 Aug 2022 49
UltraTool

Planning, Creation, Usage: Benchmarking LLMs for Comprehensive Tool Utilization in Real-World Com...

25 Jan 2024 12
test

Measuring Massive Multitask Language Understanding | ICLR 2021

07 Sep 2020 1,165
mteb

MTEB: Massive Text Embedding Benchmark

05 Apr 2022 1,441
CodeGeeX2

CodeGeeX2: A More Powerful Multilingual Code Generation Model

23 Jul 2023 7,626