LoRA

Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"

MIT License

Downloads
114.6K
Stars
10.4K
Committers
12
View Code on GitHub Visit Website View on X
Ecosystems: Windows, TypeScript, Windows UI Library (WinUI), Playwright, VS Code Extension, PyTorch

Bot releases are hidden (Show)

LoRA - DeBERTa LoRA checkpoints Latest Release

Published by edwardjhu about 3 years ago

LoRA checkpoints for DeBERTa XXL. Please see NLU/README.md for steps to reproduce our results.

LoRA - GPT-2 LoRA checkpoints

Published by edwardjhu about 3 years ago

LoRA checkpoints for GPT-2 medium and large. Please see NLG/README.md for steps to reproduce our results.

LoRA - RoBERTa large LoRA checkpoints

Published by edwardjhu about 3 years ago

LoRA checkpoints for RoBERTa large. Please see NLU/README.md for steps to reproduce our results.

LoRA - RoBERTa base LoRA checkpoints

Published by edwardjhu about 3 years ago

LoRA checkpoints for RoBERTa base. Please see NLU/README.md for steps to reproduce our results.

Package Rankings
Top 1.66% on Pypi.org
Related Projects
PromptCraft-Robotics

Community for applying LLMs to robotics and a robot simulator with ChatGPT integration

08 Feb 2023 1,852
OptiGuide

Large Language Models for Supply Chain Optimization

31 Jul 2023 306
mttl

Building modular LMs with parameter-efficient fine-tuning.

11 Jul 2022 76
MInference

To speed up Long-context LLMs' inference, approximate and dynamic sparse calculate the attention,...

22 May 2024 725
aici

AICI: Prompts as (Wasm) Programs

26 Sep 2023 1,916
DialoGPT

Large-scale pretraining for dialogue

29 Aug 2019 2,353
BiDR

Repo for WWW 2022 paper: Progressively Optimized Bi-Granular Document Representation for Scalable...

28 Feb 2022 15
Graphormer

Graphormer is a general-purpose deep learning backbone for molecular modeling.

27 May 2021 2,089
tf2-gnn

TensorFlow 2 library implementing Graph Neural Networks

25 Feb 2020 370
tutel

Tutel MoE: An Optimized Mixture-of-Experts Implementation

06 Aug 2021 716
CodeBERT

CodeBERT

17 Jun 2020 2,192
VRL3

06 Nov 2022 32
IRNet

An algorithm for cross-domain NL2SQL

01 Nov 2019 268
BioGPT

15 Aug 2022 4,292
torchscale

Foundation Architecture for (M)LLMs

17 Nov 2022 3,006