Pacha

"Pacha" TUI (Text User Interface) is a JavaScript application that utilizes the "blessed" library. It serves as a frontend for llama.cpp and provides a convenient and straightforward way to perform inference using local language models.

APACHE-2.0 License

Stars
33
Committers
2
Pacha - pacha v1.0.0 Latest Release

Published by mounta11n over 1 year ago

Ready to use frontend for llama.cpp

  • Text User Interface
  • Very fast, since llama.cpp runs in backend – this is just a frontend!
  • Save your inputs and outputs
  • Save personal notes about models and/or prompt-styles
  • A lot of prompt styles
  • Instruction, Chat or "Single-Turn" Mode
  • Color changing top bar, that indicates cpu usage
  • 'Stop'-Generation button

But, please be aware: This is still quite buggy, but I am working on it.

Badges
Extracted from project README
asciicast