demo-securing-llms-with-vault
Demo repo showing how to secure the training and storage of Large Language Models using HashiCorp Vault
Stars
2
Ecosystems:
Jupyter Notebook
Creating a custom model from Mistral
First pull the mistral model
ollama pull mistral:v0.2
Check the model has been downloaded
ollama list
You should see the mistral model in the list of models
NAME ID SIZE MODIFIED
mistral:v0.2 61e88e884507 4.1 GB 31 seconds ago