llm-infer-bench | Python Ecosystem Directory

Statistics for this project are still being loaded, please check back later.

A lightweight library that leverages Language Models (LLMs) to enable natural language interactio...

Chat language model that can use tools and interpret the results

MiniCPM-Llama3-V 2.5: A GPT-4V Level Multimodal LLM on Your Phone

Xwin-LM: Powerful, Stable, and Reproducible LLM Alignment

Official repo for "Mini-Gemini: Mining the Potential of Multi-modality Vision Language Models"

The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.

LLM as a Chatbot Service

Speed Benchmarking 7B LLM on different gcloud VMs

4 bits quantization of LLaMA using GPTQ

Run any Large Language Model behind a unified API

SGLang is a structured generation language designed for large language models (LLMs). It makes yo...

20+ high-performance LLM implementations with recipes to pretrain, finetune and deploy at scale.

LLaMA: Open and Efficient Foundation Language Models