A simple, easy-to-use framework for HuggingFace and OpenAI text-generation models.
BSD-3-CLAUSE License
AirLLM 70B inference with single 4GB GPU
Instruction/chat prompts creation library for text generation LLMs. It supports local and Hugging...
telegram bot for self-hosted local inference of stable diffusion, text-to-speech and large langua...
LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable fo...
llama.cpp 🦙 LLM inference in TypeScript
Simple LLM library for JavaScript
Unofficial python bindings for the rust llm library. 🐍❤️🦀
An OpenAI-like LLaMA inference API
A lightweight library that leverages Language Models (LLMs) to enable natural language interactio...
Python bindings for llama.cpp
🦙 Integrating LLMs into structured NLP pipelines
LangChain & Prompt Engineering tutorials on Large Language Models (LLMs) such as ChatGPT with cus...
Query LLM with Chain-of-Tought
A simple, intuitive toolkit for quickly implementing LLM powered applications.
A RAG chatbot that answers both Eskwelabs bootcamp-specific queries and general bootcamp-related ...