vit.cpp

Inference Vision Transformer (ViT) in plain C/C++ with ggml

MIT License

Stars
220
Committers
4
View Code on GitHub
Ecosystems: Llama, C++, C

Commit Statistics

Past Year

All Time

Total Commits
105
105
Total Committers
4
4
Avg. Commits Per Committer
26.25
26.25
Bot Commits
0
0

Issue Statistics

Past Year

All Time

Total Pull Requests
7
7
Merged Pull Requests
5
5
Total Issues
11
11
Time to Close Issues
5 days
5 days
Package Rankings
Top 6.7% on Proxy.golang.org
Badges
Extracted from project README's
Star History Chart
Related Projects
rungpt

An open-source cloud-native of large multi-modal models (LMMs) serving framework.

04 Apr 2023 151
Chinese-Vicuna

Chinese-Vicuna: A Chinese Instruction-following LLaMA-based Model —— 一个中文低资源的llama+lora方案，结构参考alpaca

23 Mar 2023 4,144
ScaleLLM

A high-performance inference system for large language models, designed for production environments.

24 Jul 2023 289
inferflow

Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).

26 Dec 2023 235
airllm

AirLLM 70B inference with single 4GB GPU

12 Jun 2023 4,536
gguf_modeldb

A quick and optimized solution to manage llama based gguf quantized models, download gguf files, ...

07 Jan 2024 11
neural-speed

An innovative library for efficient LLM inference via low-bit quantization

20 Nov 2023 179
BambooAI

A lightweight library that leverages Language Models (LLMs) to enable natural language interactio...

07 May 2023 439
CASALIOY

♾️ toolkit for air-gapped LLMs on consumer-grade hardware

10 May 2023 229
slowllama

Finetune llama2-70b and codellama on MacBook Air without quantization

26 Aug 2023 444
OnnxStream

Lightweight inference library for ONNX files, written in C++. It can run Stable Diffusion XL 1.0 ...

14 Jul 2023 1,833
unsloth

Finetune Llama 3.2, Mistral, Phi & Gemma LLMs 2-5x faster with 80% less memory

29 Nov 2023 16,609
PowerInfer

High-speed Large Language Model Serving on PCs with Consumer-grade GPUs

15 Dec 2023 7,913
llama2-webui

Run any Llama 2 locally with gradio UI on GPU or CPU from anywhere (Linux/Windows/Mac). Use `llam...

20 Jul 2023 1,960
glai

glai - GGUF LLAMA AI - Package for simplified model handling and text generation with Llama model...

03 Jan 2024 3