This GitHub repository integrates Reflection Llama-3.1 70B, the world's top open-source large language model (LLM), in a Streamlit-based user interface. The LLM is trained using a new technique called Reflection-Tuning, which enables it to detect and correct mistakes in its own reasoning.
MIT License
Reflection Llama-3.1 70B
, the world's top open-source large language model (LLM), in a Streamlit-based user interface. The LLM is trained using a new technique called Reflection-Tuning, which enables it to detect and correct mistakes in its own reasoning.lib
: contains configuration and utility code files.images
: contains UI image.app.py
: main function that will run the Streamlit UI.lib/conifg.py
: contains functions to load our environment variables and get our api keys.lib/utils.py
: contains a function to setup our llm, accept user query and provide response.git clone https://github.com/NebeyouMusie/Reflection-70B-Chat.git
python -m venv venv
source venv/bin/activate
for Mac and venv/bin/activate
for Windowscd ./Reflection-70B-Chat
using your terminalpip install -r requirements.txt
OPENROUTER_API_KEY
in the example.env
file then change the file to .env
. You can get your OPENROUTER_API_KEY
from here.streamlit run app.py
output
).