Free AI Youtube Summarizer on your computer using mistral-instruct-v0.2, langchain and llama_index
Free AI Youtube Summarizer built with opensource LLM (mistral-instruct-v0.2), langchain and llama_index.
Max RAM required: 7 GB
If you're using mac or linux, download ollama and follow these Readme.md instructions to get up and running with your chosen open source large language models locally.
If you're using Windows, download the model via this account here, then adapt the code to use llamacpp
instead of ChatOllama
to reference the models path on your local computer. Follow these instructions here
After you've downloaded your chosen LLM, you can change the default model name:
chat_model = ChatOllama(
model="mistral",
)
To adapt the model's instructions, you can change the system_prompt
variable.
Run the notebook cells to download the youtube transcript and call the model to make a prediction.