Llama Ecosystem

Llama is an open-source toolkit for training and fine-tuning large language models (LLMs). It provides tools for efficient model development, including data preprocessing, training scripts, and model evaluation. Suitable for research and production, Llama supports various architectures and scales to accommodate different hardware setups.

Created by
Meta AI
Released
February 24, 2023
Community Repos
1,449
Total GitHub Stars
95,898

winamp

Iconic media player

22 Sep 2024 9,033

musegpt

Local LLMs in your DAW!

14 Sep 2024 32

QodeAssist

QodeAssist is an AI-powered coding assistant plugin for Qt Creator

27 Aug 2024 28

grps_trtllm

【grps接入trtllm】通过接入TensorRT-LLM以及Tokenizers

21 Aug 2024 43

llama.cpp-ts

llama

27 Jul 2024 0

ollama-hpp

Modern, Header-only C++ bindings for the Ollama API

28 Apr 2024 38

godot-llm

LLM in Godot

26 Apr 2024 121

KuiperLLama

校招、秋招、春招、实习好项目,带你从零动手实现支持LLama的大模型推理框架。

25 Apr 2024 191

llama.node

Node

23 Apr 2024 5

PipeInfer

PipeInfer: Accelerating LLM Inference using Asynchronous Pipelined Speculation

09 Apr 2024 8

Lucys_Labyrinth

A game made for a school project, dedicated to my daughter

04 Apr 2024 26

wllama

WebAssembly binding for llama

13 Mar 2024 371

mentals-ai

Agents in Markdown syntax (loops, memory and tools included) 🍓

27 Feb 2024 344

godot-llama-cpp

Run large language models in Godot

08 Feb 2024 29

inferflow

Inferflow is an efficient and highly configurable inference engine for large language models (LLMs)

26 Dec 2023 235

PowerInfer

High-speed Large Language Model Serving on PCs with Consumer-grade GPUs

15 Dec 2023 7,913

distributed-llama

Tensor parallelism is all you need

04 Dec 2023 1,418

neural-speed

An innovative library for efficient LLM inference via low-bit quantization

20 Nov 2023 179

vit.cpp

Inference Vision Transformer (ViT) in plain C/C++ with ggml

02 Nov 2023 220

cortex.cpp

Drop-in, local AI alternative to the OpenAI stack

11 Sep 2023 1,887