Simple and modern webui for LLM models based LLaMA.
GPL-3.0 License
This is Fooocus from the world of Stable Difusion in the world of Text Generation, the same ease of use and the same convenience.
This is simple and modern Gradio webui for LLM models GGML format (.bin) or GGUF format (.gguf) based on LLaMA.
We can try this app online in very slow demo of 3.0.0 version:
You can use this webui in cloud service Colab:
>>> Portable one-click packege <<<
Step-by-step installation:
git clone https://github.com/ehristoforu/TensorLM-webui.git
cd TensorLM-webui
update_mode.bat
&& enter 1 and 2start.bat
Or download exe installer from this repo
Step-by-step installation:
git clone https://github.com/ehristoforu/TensorLM-webui.git
cd TensorLM-webui
python pip install -r requirements.txt
python webui.py
Step-by-step installation:
git clone https://github.com/ehristoforu/TensorLM-webui.git
cd TensorLM-webui
python pip install -r requirements.txt
python webui.py
In this app there is 23 default presets. Thanks, @mustvlad for system prompts!
You can create your custom presets, instruction in presets
folder (it is .md-file).
With this interface you don't need to scour the Internet looking for a compatible model; in the "Tabs" checkbox and in the "ModelGet" tab you can choose which model to download from our verified repository on HuggingFace.
Warning! Need Internet.
You can use OpenAI API in this UI (select "OpenAI" in Mode radio-button).
To enter your OpenAI key go to configure.txt
and input to openai_key
parameter
You can use MistralAI API (from HuggingFace) in this UI (select "MistralAI" in Mode radio-button) for free.
To use args:
python webui.py
to python webui.py [Your args]
, for ex. python webui.py --inbrowser
python webui.py
with args - python webui.py {Your args}
, for ex. python webui.py --inbrowser
--inbrowser --share --lowvram --debug --quiet
While there are no forks , perhaps you will be the first who can significantly improve this application!
@software{ehristoforu_TensorLM-webui_2024,
author = {ehristoforu},
month = apr,
title = {{TensorLM-webui}},
url = {https://github.com/ehristoforu/TensorLM-webui},
year = {2024}
}