Benchmark your local LLMs.
MIT License
Desktop AI Assistant powered by GPT-4, GPT-4 Vision, GPT-3.5, Gemini, Claude, Llama 3, DALL-E, La...
Rack API application for Llama.cpp
Train Llama 2 & 3 on the SQuAD v2 task as an example of how to specialize a generalized (foundati...
UI tool for fine-tuning and testing your own LoRA models base on LLaMA, GPT-J and more. One-click...
Foundation model benchmarking tool. Run any model on Amazon SageMaker and benchmark for performan...
LLM-powered code documentation generation
A lightweight library that leverages Language Models (LLMs) to enable natural language interactio...
An Automated AI-Powered Prompt Optimization Framework
The unofficial DSPy framework. Build LLM powered Agents and "Agentic workflows" based on the Stan...
WebAssembly binding for llama.cpp - Enabling in-browser LLM inference
LLM Benchmark for Throughput via Ollama (Local LLMs)
GPT-4 level function calling models for real-world tool using use cases
LLMCompiler: An LLM Compiler for Parallel Function Calling
Query LLM with Chain-of-Tought
Evaluate open-source language models on Agent, formatted output, command following, long text, mu...