Make GPT safe for production
MIT License
Instruction/chat prompts creation library for text generation LLMs. It supports local and Hugging...
The Typescript-first prompt engineering toolkit for working with chat based LLMs.
💬 Chatbot web app + HTTP and Websocket endpoints for LLM inference with the Petals client
A CLI-based Python script that interacts with a local LLM and is compatible with Ollama and LlamaCpp
Search for anything using the Google, DuckDuckGo, phind.com. Also containes AI models, can transc...
A simple, easy-to-use framework for HuggingFace and OpenAI text-generation models.
An OpenAI-like LLaMA inference API
Completion After Prompt Probability. Make your LLM make a choice
Run LLMs locally with as little friction as possible.
Interact with NanoGPT's API for pay-per-prompt interaction with AI models
Powering Agent Chains by Constraining LLM Outputs
The unofficial DSPy framework. Build LLM powered Agents and "Agentic workflows" based on the Stan...
AskIt: Unified programming interface for programming with LLMs (GPT-3.5, GPT-4, Gemini, Claude, C...
AskIt (for JavaScript/TypeScript): Unified programming interface for large language models (GPT-4...
Unofficial python bindings for the rust llm library. 🐍❤️🦀