bistro
Opinionated GPT implementation and finetuning harness.
APACHE-2.0 License
Stars
5
Ecosystems:
Python
bistro
Opinionated GPT implementation and finetuning harness.
Installation
Cloning the repo:
git clone [email protected]:transmissions11/bistro.git
cd bistro
Installing dependencies:
pip install -r requirements.txt
Downloading and setting up a base model:
python lit_script.py download --repo_id lmsys/vicuna-7b-v1.5
python lit_script.py convert_hf_checkpoint --checkpoint_dir checkpoints/lmsys/vicuna-7b-v1.5 --dtype bfloat16
(Optional) Use Flash Attention 2 (only available in PyTorch 2.2)
pip uninstall -y torch torchvision torchaudio torchtext
pip install --pre torch --index-url https://download.pytorch.org/whl/nightly/cu121
See lit-gpt's setup guide for additional info.
Acknowledgements
Built on lit-gpt.