go-llmcache

🧠 Cache implementation for storing and retrieving results of language model (LLM) requests

MIT License

Stars
6
Committers
2
View Code on GitHub View on X
Ecosystems: Go

Bot releases are hidden (Show)

No releases found yet, please check back later.
Package Rankings
Top 16.01% on Proxy.golang.org
Badges
Extracted from project README
Go Reference
Related Projects
go-generics-cache

A key:value store/cache library written in Go generics. LRU, LFU, FIFO, MRU, Clock support.

16 Nov 2021 366
otter

A high performance lockless cache for Go. Many times faster than Ristretto and friends.

29 Aug 2023 1,091
golc

🚀 Building Go applications with LLMs through composability

08 Jun 2023 90
cache

LevelDB style LRU cache for Go, support non GC object.

21 Aug 2015 10