gguf_modeldb

A quick and optimized solution to manage llama based gguf quantized models, download gguf files, retreive messege formatting, add more models from hf repos and more. It's super easy to use and comes prepacked with best preconfigured open source models: dolphin phi-2 2.7b, mistral 7b v0.2, mixtral 8x7b v0.1, solar 10.7b and zephyr 3b

OTHER License

Downloads
402
Stars
11
Committers
2

Commit Statistics

Past Year

All Time

Total Commits
28
28
Total Committers
2
2
Avg. Commits Per Committer
14.0
14.0
Bot Commits
0
0

Issue Statistics

Past Year

All Time

Total Pull Requests
8
8
Merged Pull Requests
8
8
Total Issues
4
4
Time to Close Issues
about 1 hour
about 1 hour