hosting-7B-llm-on-google-cloud

llm-infer-bench

qwen2-in-a-lambda

Deploying Qwen2 (or any other GGUF models) into AWS Lambda

LLM-As-Chatbot

LLM as a Chatbot Service

languagemodels

Explore large language models in 512MB of RAM

llm-api

Run any Large Language Model behind a unified API

MiniCPM-V

MiniCPM-Llama3-V 2.5: A GPT-4V Level Multimodal LLM on Your Phone

pyllama

LLaMA: Open and Efficient Foundation Language Models

neurips-llm-efficiency-challenge

Starter pack for NeurIPS LLM Efficiency Challenge 2023.

llm-llama-cpp

LLM plugin for running models using llama.cpp

go-ml-benchmarks

⏱ Benchmarks of machine learning inference for Go

docs

Access 14k+ open source AI models across 30+ tasks with the Bytez inference API ✨

llm-gpt4all

Plugin for LLM adding support for the GPT4All collection of models

FastChat

An open platform for training, serving, and evaluating large language models. Release repo for Vi...