slowllama

Finetune llama2-70b and codellama on MacBook Air without quantization

MIT License

Stars
444
Committers
2
View Code on GitHub
Ecosystems: Llama

Commit Statistics

Past Year

All Time

Total Commits
36
76
Total Committers
2
2
Avg. Commits Per Committer
18.0
38.0
Bot Commits
0
0

Issue Statistics

Past Year

All Time

Total Pull Requests
4
6
Merged Pull Requests
4
6
Total Issues
8
9
Time to Close Issues
18 days
18 days
Related Projects
Alpaca-CoT

We unified the interfaces of instruction-tuning data (e.g., CoT data), multiple LLMs and paramete...

24 Mar 2023 2,597
llama2-webui

Run any Llama 2 locally with gradio UI on GPU or CPU from anywhere (Linux/Windows/Mac). Use `llam...

20 Jul 2023 1,960
PowerInfer

High-speed Large Language Model Serving on PCs with Consumer-grade GPUs

15 Dec 2023 7,913
airllm

AirLLM 70B inference with single 4GB GPU

12 Jun 2023 4,536
LLamaTuner

Easy and Efficient Finetuning LLMs. (Supported LLama, LLama2, LLama3, Qwen, Baichuan, GLM , Fal...

25 May 2023 568
llama-squad

Train Llama 2 & 3 on the SQuAD v2 task as an example of how to specialize a generalized (foundati...

29 Jul 2023 45
llama2.zig

Inference Llama 2 in one file of pure Zig

30 Jul 2023 145
llama2.go

LLaMA-2 in native Go

25 Jul 2023 193
distributed-llama

Tensor parallelism is all you need. Run LLMs on an AI cluster at home using any device. Distribut...

04 Dec 2023 1,418
xTuring

Build, customize and control you own LLMs. From data pre-processing to fine-tuning, xTuring provi...

19 Mar 2023 2,527
llama.go

llama.go is like llama.cpp in pure Golang!

19 Mar 2023 1,245
unsloth

Finetune Llama 3.2, Mistral, Phi & Gemma LLMs 2-5x faster with 80% less memory

29 Nov 2023 16,609
llm.f90

LLM inference in Fortran

03 Sep 2023 54
Chinese-Vicuna

Chinese-Vicuna: A Chinese Instruction-following LLaMA-based Model —— 一个中文低资源的llama+lora方案，结构参考alpaca

23 Mar 2023 4,144
xllm

🦖 X—LLM: Cutting Edge & Easy LLM Finetuning

10 Nov 2023 375