llama.cpp

Ampere optimized llama.cpp

Stars
5
Committers
4
View Code on GitHub Visit Website
Ecosystems: Llama

Commit Statistics

Past Year

All Time

Total Commits
14
14
Total Committers
4
4
Avg. Commits Per Committer
3.5
3.5
Bot Commits
0
0

Issue Statistics

Past Year

All Time

Total Pull Requests
4
4
Merged Pull Requests
3
3
Total Issues
4
4
Time to Close Issues
N/A
N/A
Related Projects
inferflow

Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).

26 Dec 2023 235
Llama-2-Open-Source-LLM-CPU-Inference

Running Llama 2 and other Open-Source LLMs on CPU Inference Locally for Document Q&A

06 Jul 2023 945
llama.go

llama.go is like llama.cpp in pure Golang!

19 Mar 2023 1,245
Chinese-Llama-2-7b

开源社区第一个能下载、能运行的中文 LLaMA2 模型！

20 Jul 2023 2,225
neural-speed

An innovative library for efficient LLM inference via low-bit quantization

20 Nov 2023 179
llama2-webui

Run any Llama 2 locally with gradio UI on GPU or CPU from anywhere (Linux/Windows/Mac). Use `llam...

20 Jul 2023 1,960
Enhancing-LLM-with-Jenkins-Knowledge

🚀 this project aims to develop an app using an existing open-source LLM with data collected for d...

20 May 2024 10
llm-api

Run any Large Language Model behind a unified API

02 Apr 2023 159
open-llm-webui

This repository contains a web application designed to execute relatively compact, locally-operat...

17 May 2023 39
aikit

🏗️ Fine-tune, build, and deploy open-source LLMs easily!

20 Sep 2023 164
llm.f90

LLM inference in Fortran

03 Sep 2023 54
airllm

AirLLM 70B inference with single 4GB GPU

12 Jun 2023 4,536
llama-gpt

A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leav...

22 Jul 2023 10,740
llama3.java

Practical Llama 3 inference in Java

25 Apr 2024 360
ScaleLLM

A high-performance inference system for large language models, designed for production environments.

24 Jul 2023 289