Llama Ecosystem
Llama is an open-source toolkit for training and fine-tuning large language models (LLMs). It provides tools for efficient model development, including data preprocessing, training scripts, and model evaluation. Suitable for research and production, Llama supports various architectures and scales to accommodate different hardware setups.
Core Projects
MorePopular Projects
More
vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
LLaVA
[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond
Llama-Chinese
Llama中文社区，Llama3在线体验和微调模型已开放，实时汇总最新Llama3学习资料，已将所有代码更新适配Llama3，构建最好的中文Llama大模型，完全开源可商用
PaddleNLP
👑 Easy-to-use and powerful NLP and LLM library with 🤗 Awesome model zoo, supporting wide-range of NLP tasks from research to industrial applications, including 🗂Text Classification, 🔍 Neural Search, ❓ Question Answering, ℹ️ Information Extraction, 📄 Document Intelligence, 💌 Sentiment Analysis etc
xtuner
An efficient, flexible and full-featured toolkit for fine-tuning LLM (InternLM2, Llama3, Phi3, Qwen, Mistral,
Chinese-LLaMA-Alpaca
中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)
OpenLLM
Run any open-source LLMs, such as Llama 2, Mistral, as OpenAI compatible API endpoint, locally and in the cloud
Langchain-Chatchat
Langchain-Chatchat（原Langchain-ChatGLM）基于 Langchain 与 ChatGLM, Qwen 与 Llama 等语言模型的 RAG 与 Agent 应用 | Langchain-Chatchat (formerly langchain-ChatGLM), local knowledge based LLM (like ChatGLM, Qwen and Llama) RAG and Agent app with langchain
PowerInfer
High-speed Large Language Model Serving on PCs with Consumer-grade GPUs
llm-chain
`llm-chain` is a powerful rust crate for building chains in large language models allowing you to summarise text and complete complex tasks
Chinese-LLaMA-Alpaca-2
中文LLaMA-2 & Alpaca-2大模型二期项目 + 64K超长上下文模型 (Chinese LLaMA-2 & Alpaca-2 LLMs with 64K long context models)
Up and Coming Projects
More
swift-llm-chat-openai
Interact with OpenAI and OpenAI-compatible chat completion APIs in a simple and elegant way
llama-assistant
AI-powered assistant to help you with your daily tasks, powered by Llama 3
brainvat
This artificial intelligence library is designed to provide a more human and natural interaction with the user
smartplant
SmartPlant is a library that uses advanced AI to simplify plant care by providing detailed information and optimizing conditions for each plant, ensuring maximum growth and health
ollama-toolkit
The Ollama Toolkit is a collection of powerful tools designed to enhance your experience with the Ollama project, an open-source framework for deploying and scaling machine learning models
Cold_Email_Generator_Llama3.1
This project automates the generation of personalized cold emails by scraping job postings and matching them with a service company’s portfolio using AI
Hello-Happy-World
AI-powered automatic dataset creation from the web, Support for LoRA and SFT question generation!
open-strawberry
Building open version of OpenAI o1 via reasoning traces (Groq, ollama, Anthropic, Gemini, OpenAI, Azure supported) Demo: https://huggingface
Blaze-Server
Fast, minimalistic, multi-threaded, open source rest api server made in javascript
