Infero

An easy to use, high performant CUDA powered LLM inference library.

BSD-3-CLAUSE License

Stars
12
Committers
1
Infero - Infero Runtime Dependencies Latest Release

Published by jarroddavis68 5 months ago

The following CUDA & llama.cpp runtime DLLs must be present on your target device for Infero to function properly. Please ensure they are placed in the same directory as your Infero executable file.

Badges
Extracted from project README
Chat on Discord Twitter Follow
Related Projects