llm_templates

Instruction/chat prompts creation library for text generation LLMs. It supports local and Hugging Face models.

MIT License

Downloads

607

Stars

14

Committers

View Code on GitHub

Ecosystems: Llama, Cohere

Bot releases are hidden (Show)

llm_templates - v0.1.12 Latest Release

Published by jpmanson 2 months ago

Added local support for Llama 3.1 model

llm_templates - v0.1.11

Published by jpmanson 2 months ago

Fixed typo in url in setup.py

llm_templates - v0.1.10

Published by jpmanson 4 months ago

Added Cohere and Phi3 templates

llm_templates - v0.1.9

Published by jpmanson 5 months ago

Added Llama3 chat format

llm_templates - v0.1.8

Published by jpmanson 7 months ago

Minor updates

llm_templates - v0.1.7

Published by jpmanson 8 months ago

Added Google Gemma support

llm_templates - v0.1.5

Published by jpmanson 8 months ago

Update

llm_templates - Release v0.1.2

Published by jpmanson 8 months ago

Support HuggingFace authentication token, for restricted models (like "meta-llama/Llama-2-7b-chat-hf")

llm_templates - Release v.0.1.1

Published by jpmanson 8 months ago

Fixes missing init.py

llm_templates - First release

Published by jpmanson 8 months ago

First release

Package Rankings

Top 37.38% on Pypi.org

Badges

Extracted from project README

Related Projects

Llama-Chinese

Llama中文社区，Llama3在线体验和微调模型已开放，实时汇总最新Llama3学习资料，已将所有代码更新适配Llama3，构建最好的中文Llama大模型，完全开源可商用

19 Jul 2023 12,154

CandyLLM

A simple, easy-to-use framework for HuggingFace and OpenAI text-generation models.

eskwelabs_chatbot

A RAG chatbot that answers both Eskwelabs bootcamp-specific queries and general bootcamp-related ...

llama-api

An OpenAI-like LLaMA inference API

20 Jul 2023 111

llama-server

LLaMA Server combines the power of LLaMA C++ with the beauty of Chatbot UI.

03 Apr 2023 111

llm.js

Simple LLM library for JavaScript

py-gpt

Desktop AI Assistant powered by GPT-4, GPT-4 Vision, GPT-3.5, Gemini, Claude, Llama 3, DALL-E, La...

09 Apr 2023 547

lightllm

LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable fo...

22 Jul 2023 1,967

spacy-llm

🦙 Integrating LLMs into structured NLP pipelines

16 Mar 2023 1,086

llm-rs-python

Unofficial python bindings for the rust llm library. 🐍❤️🦀

llama3

The official Meta Llama 3 GitHub site

15 Mar 2024 26,523

llama.cpp-ts

llama.cpp 🦙 LLM inference in TypeScript

chat.petals.dev

💬 Chatbot web app + HTTP and Websocket endpoints for LLM inference with the Petals client

28 Dec 2022 306

libre-chat

🦙 Free and Open Source Large Language Model (LLM) chatbot web UI and API. Self-hosted, offline ca...

26 Jul 2023 128

botality-ii

telegram bot for self-hosted local inference of stable diffusion, text-to-speech and large langua...