llm-mlc

LLM plugin for running models using MLC

APACHE-2.0 License

Downloads
193
Stars
176
View Code on GitHub View on X
Ecosystems: Python
Package Rankings
Top 38.47% on Pypi.org
Badges
Extracted from project README
PyPI Changelog Tests License
Related Projects
llm-gguf

Run models distributed as GGUF files using LLM

23 Jul 2024 21
llm-api

Run any Large Language Model behind a unified API

02 Apr 2023 159
pyllama

LLaMA: Open and Efficient Foundation Language Models

28 Feb 2023 2,805
llm-mistral

LLM plugin providing access to Mistral models using the Mistral API

15 Dec 2023 144
languagemodels

Explore large language models in 512MB of RAM

07 May 2023 1,154
llm

Access large language models from the command-line

01 Apr 2023 4,329
llm-mlx-llama

Run Llama 2 using MLX on macOS

06 Dec 2023 32
llm-replicate

LLM plugin for models hosted on Replicate

18 Jul 2023 57
llm-anyscale-endpoints

LLM plugin for models hosted by Anyscale Endpoints

23 Aug 2023 31
llm-llama-cpp

LLM plugin for running models using llama.cpp

25 Jul 2023 133
llm-openrouter

LLM plugin for models hosted by OpenRouter

20 Aug 2023 69
llm-cluster

LLM plugin for clustering embeddings

04 Sep 2023 61
llm-sentence-transformers

LLM plugin for embeddings using sentence-transformers

02 Sep 2023 40
llm-gpt4all

Plugin for LLM adding support for the GPT4All collection of models

09 Jul 2023 177
Xwin-LM

Xwin-LM: Powerful, Stable, and Reproducible LLM Alignment

11 Sep 2023 1,018