LLMCompiler

LLMCompiler: An LLM Compiler for Parallel Function Calling

MIT License

Stars
1.1K
Committers
4
View Code on GitHub Visit Website
Ecosystems: Llama

Commit Statistics

Past Year

All Time

Total Commits
34
34
Total Committers
4
4
Avg. Commits Per Committer
8.5
8.5
Bot Commits
0
0

Issue Statistics

Past Year

All Time

Total Pull Requests
16
16
Merged Pull Requests
16
16
Total Issues
6
6
Time to Close Issues
9 days
9 days
Related Projects
xtuner

An efficient, flexible and full-featured toolkit for fine-tuning LLM (InternLM2, Llama3, Phi3, Qw...

11 Jul 2023 3,820
inferflow

Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).

26 Dec 2023 235
LLM-Pruner

[NeurIPS 2023] LLM-Pruner: On the Structural Pruning of Large Language Models. Support Llama-3/3....

17 May 2023 840
pyllamacpp

Python bindings for llama.cpp

25 Apr 2023 62
PowerInfer

High-speed Large Language Model Serving on PCs with Consumer-grade GPUs

15 Dec 2023 7,913
LLM-Inference-Bench

LLM-Inference-Bench

29 Jul 2024 2
llama.cpp

LLM inference in C/C++

10 Mar 2023 55,160
BambooAI

A lightweight library that leverages Language Models (LLMs) to enable natural language interactio...

07 May 2023 439
LLaVA-MORE

LLaVA-MORE: Enhancing Visual Instruction Tuning with LLaMA 3.1

31 Jul 2024 82
query-llm

Query LLM with Chain-of-Tought

22 Jun 2024 3
llm.f90

LLM inference in Fortran

03 Sep 2023 54
llm-chain

`llm-chain` is a powerful rust crate for building chains in large language models allowing you to...

24 Mar 2023 1,322
vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

09 Feb 2023 28,039
lightllm

LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable fo...

22 Jul 2023 1,967
Llama-2-Open-Source-LLM-CPU-Inference

Running Llama 2 and other Open-Source LLMs on CPU Inference Locally for Document Q&A

06 Jul 2023 945