Library for experimenting with state-of-the-art evaluation metrics like UScore
GPL-3.0 License
Pip compatible CodeBLEU metric implementation available for linux/macos/win
Code for EMNLP 2023 industry track paper "Learning Multilingual Sentence Representations with Cro...
Code accompanying the paper Pretraining Language Models with Human Preferences
ACL2023 - AlignScore, a metric for factual consistency evaluation.
A python tool for evaluating the quality of sentence embeddings.
Hierarchical Sketch Induction for Paraphrase Generation (Hosking et al., ACL 2022)
Code for NAACL 2024 main conference paper "An Empirical Study of Consistency Regularization for E...
Basically SentEval with German language downstream tasks
Access a database of word frequencies, in various natural languages.
This is an open source project (formerly named Listen, Attend and Spell - PyTorch Implementation)...
Public release of the TransCoder research project https://arxiv.org/pdf/2006.03511.pdf
[EMNLP 2021] SimCSE: Simple Contrastive Learning of Sentence Embeddings https://arxiv.org/abs/210...
Metrics for evaluating Automated Audio Captioning systems, designed for PyTorch.
Implementation of Voicebox, new SOTA Text-to-speech network from MetaAI, in Pytorch
A lightweight evaluation suite tailored specifically for assessing Indic LLMs across a diverse ra...