AdaMix

This is the implementation of the paper AdaMix: Mixture-of-Adaptations for Parameter-efficient Model Tuning (https://arxiv.org/abs/2205.12410).

APACHE-2.0 License

Downloads
376
Stars
126
Committers
5
View Code on GitHub View on X
Ecosystems: VS Code Extension, Dart, Windows UI Library (WinUI), Windows, PyTorch, Playwright, TypeScript

Commit Statistics

Past Year

All Time

Total Commits
22
Total Committers
6
Avg. Commits Per Committer
3.67
Bot Commits
0

Issue Statistics

Past Year

All Time

Total Pull Requests
0
29
Merged Pull Requests
0
0
Total Issues
0
1
Time to Close Issues
N/A
N/A
Package Rankings
Top 16.66% on Pypi.org
Related Projects
fastseq

An efficient implementation of the popular sequence models for text generation, summarization, an...

15 Jul 2020 431
CodeBERT

CodeBERT

17 Jun 2020 2,192
JARVIS

JARVIS, a system to connect LLMs with ML community. Paper: https://arxiv.org/pdf/2303.17580.pdf

30 Mar 2023 23,583
MASS

MASS: Masked Sequence to Sequence Pre-training for Language Generation

27 May 2019 1,116
torchscale

Foundation Architecture for (M)LLMs

17 Nov 2022 3,006
MMdnn

MMdnn is a set of tools to help users inter-operate among different deep learning frameworks. E.g...

16 Aug 2017 5,792
MathOctopus

This repository contains resources for accessing the official benchmarks, codes, and checkpoints ...

25 Oct 2023 41
DialoGPT

Large-scale pretraining for dialogue

29 Aug 2019 2,353
Industrial-Foundation-Models

Dedicated to building industrial foundation models for universal data intelligence across industr...

22 Mar 2024 32
SpeechT5

Unified-Modal Speech-Text Pre-Training for Spoken Language Processing

08 Feb 2022 1,164
DeBERTa

The implementation of DeBERTa

08 Jun 2020 1,976
AI2BMD

AI-powered ab initio biomolecular dynamics simulation

10 Nov 2022 175
MoCapAct

A Multi-Task Dataset for Simulated Humanoid Control

07 Jun 2022 158
LoRA

Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"

18 Jun 2021 10,449
LLaVA-Med

Large Language-and-Vision Assistant for Biomedicine, built towards multimodal GPT-4 level capabil...

20 May 2023 1,483