ezlocalai

ezlocalai is an easy to set up local artificial intelligence server with OpenAI Style Endpoints.

MIT License

Downloads
201
Stars
72
Committers
4
View Code on GitHub View on X
Ecosystems: Llama, Cuda

Commit Statistics

Past Year

All Time

Total Commits
734
734
Total Committers
5
5
Avg. Commits Per Committer
146.8
146.8
Bot Commits
2
2

Issue Statistics

Past Year

All Time

Total Pull Requests
36
36
Merged Pull Requests
34
34
Total Issues
13
13
Time to Close Issues
8 days
8 days
Package Rankings
Top 37.58% on Pypi.org
Badges
Extracted from project README
GitHub Dockerhub
Related Projects
watsor

Object detection for video surveillance

20 Jun 2020 244
extending-jax

Extending JAX with custom C++ and CUDA code

07 Jan 2021 368
bmf

Cross-platform, customizable multimedia/video processing framework. With strong GPU acceleration...

15 Jul 2023 773
TensorFlow-object-detection-tutorial

The purpose of this tutorial is to learn how to install and prepare TensorFlow framework to train...

08 Nov 2018 151
ScaleLLM

A high-performance inference system for large language models, designed for production environments.

24 Jul 2023 289
whisper-onnx-python

A low-footprint GPU accelerated Speech to Text Python package for the Jetpack 5 era bolstered b...

24 Jun 2024 1
cccl

CUDA C++ Core Libraries

17 Sep 2020 743
https://github.com/neoheartbeats/neoheartbeats-kernel

An architecture for LLMs' continual-learning and long-term memories

26 Jul 2024 4
awesome-rust-list

This repository lists some awesome public Rust projects, Videos, Blogs and Jobs.

07 Aug 2022 34
vacancies_server

This is a server for vacancies generation using LLM (Saiga3)

03 May 2024 1
dl4j-nlp-cuda-example

A git repository containing an NLP example using DL4J (cuda) in Java

22 Oct 2019 3
https://github.com/jamjamjon/usls

A Rust library integrated with ONNXRuntime, providing a collection of Computer Vison and Vision-L...

29 Mar 2024 34
https://github.com/dancing-ui/uestc_vhm

使用yolov8、fast-reid、deepsort完成目标跟踪

10 Aug 2024 6
willow-inference-server

Open source, local, and self-hosted highly optimized language inference server supporting ASR/STT...

03 Feb 2023 375
EasyAI

Make your own AI easily !

19 Aug 2022 2