benchllama - v0.2.6 Latest Release

Published by srikanth235 8 months ago

Fixed

Added missing modules

benchllama - v0.2.5

Published by srikanth235 8 months ago

Added

Added support for evaluating instruct models

benchllama - v0.2.4

Published by srikanth235 8 months ago

Added

Fixing clean command.
Updating README.md file.

benchllama - v0.2.2

Published by srikanth235 8 months ago

Added

Added support for no-eval flag so that other use cases aside auto-completion can be addressed.

benchllama - v0.2.1

Published by srikanth235 8 months ago

Added

Updated README.md file with usage instructions

benchllama - v0.2.0

Published by srikanth235 8 months ago

Added

Initial public release

Full Changelog: https://github.com/srikanth235/benchllama/commits/0.2.0

Package Rankings

Top 37.61% on Pypi.org

Related Projects

foundation-model-benchmarking-tool

Foundation model benchmarking tool. Run any model on Amazon SageMaker and benchmark for performan...

09 Jan 2024 77

ollama-benchmark

LLM Benchmark for Throughput via Ollama (Local LLMs)

18 Jan 2024 24

LLMCompiler

LLMCompiler: An LLM Compiler for Parallel Function Calling

06 Dec 2023 1,061

llm_server

Rack API application for Llama.cpp

15 Jun 2023 40

query-llm

Query LLM with Chain-of-Tought

22 Jun 2024 3

BambooAI

A lightweight library that leverages Language Models (LLMs) to enable natural language interactio...

07 May 2023 439

empower-functions

GPT-4 level function calling models for real-world tool using use cases

10 May 2024 204

py-gpt

Desktop AI Assistant powered by GPT-4, GPT-4 Vision, GPT-3.5, Gemini, Claude, Llama 3, DALL-E, La...

09 Apr 2023 547

Open-LLM-Benchmark

Evaluate open-source language models on Agent, formatted output, command following, long text, mu...

25 Apr 2024 1

Promptimizer

An Automated AI-Powered Prompt Optimization Framework

26 Jul 2024 134

wllama

WebAssembly binding for llama.cpp - Enabling in-browser LLM inference

13 Mar 2024 371

llama-squad

Train Llama 2 & 3 on the SQuAD v2 task as an example of how to specialize a generalized (foundati...

29 Jul 2023 45

doc-comments-ai

LLM-powered code documentation generation

17 Aug 2023 107

ax

The unofficial DSPy framework. Build LLM powered Agents and "Agentic workflows" based on the Stan...

23 Feb 2023 1,058

LLaMA-LoRA-Tuner

UI tool for fine-tuning and testing your own LoRA models base on LLaMA, GPT-J and more. One-click...

03 Apr 2023 438