What's Changed

• Faster Training by @cloneofsimo in https://github.com/cloneofsimo/lora/pull/178
• v0.1.7 by @cloneofsimo in https://github.com/cloneofsimo/lora/pull/180

Full Changelog: https://github.com/cloneofsimo/lora/compare/v0.1.6...v0.1.7

What's Changed

• accept training filenames with capitalized extensions by @zeke in https://github.com/cloneofsimo/lora/pull/169
• Add inpainting support to pivotal tuning by @levi in https://github.com/cloneofsimo/lora/pull/152
• fix "local variable 'unet_path' referenced before assignment" by @arceus-jia in https://github.com/cloneofsimo/lora/pull/175
• LoRA Manager for managing multiple loras with different scaling parameters & tokens by @cloneofsimo in https://github.com/cloneofsimo/lora/pull/172
• v0.1.6 by @cloneofsimo in https://github.com/cloneofsimo/lora/pull/171

New Contributors

• @zeke made their first contribution in https://github.com/cloneofsimo/lora/pull/169
• @arceus-jia made their first contribution in https://github.com/cloneofsimo/lora/pull/175

Full Changelog: https://github.com/cloneofsimo/lora/compare/v0.1.5...v0.1.6

I've worked with team @replicate to improve this repo capable of various productions! Thank you so much!

What's Changed

• Support prefix text for blip captioning by @levi in https://github.com/cloneofsimo/lora/pull/166
• allow jpeg files in addition to jpg files by @anotherjesse in https://github.com/cloneofsimo/lora/pull/165
• v0.1.5 by @cloneofsimo in https://github.com/cloneofsimo/lora/pull/168

New Contributors

• @anotherjesse made their first contribution in https://github.com/cloneofsimo/lora/pull/165

Full Changelog: https://github.com/cloneofsimo/lora/compare/v0.1.4...v0.1.5

What's Changed

• Fix dates in readme by @levi in https://github.com/cloneofsimo/lora/pull/162
• v0.1.4 by @cloneofsimo in https://github.com/cloneofsimo/lora/pull/164

Now output CLIP alignment scores during lora tuning step, mitigated center-crop by default error, saves lora with extra argument name.

Full Changelog: https://github.com/cloneofsimo/lora/compare/v0.1.3...v0.1.4

What's Changed

• Include mediapipe package in requirements.txt by @levi in https://github.com/cloneofsimo/lora/pull/158
• Update web demo link by @hysts in https://github.com/cloneofsimo/lora/pull/157
• LoRA Join operation by @cloneofsimo in https://github.com/cloneofsimo/lora/pull/160
• v0.1.3 by @cloneofsimo in https://github.com/cloneofsimo/lora/pull/161

New Contributors

• @levi made their first contribution in https://github.com/cloneofsimo/lora/pull/158
• @hysts made their first contribution in https://github.com/cloneofsimo/lora/pull/157

Full Changelog: https://github.com/cloneofsimo/lora/compare/v0.1.2...v0.1.3

What's Changed

• Feature/ Better LoRA : Dropout, Conv2d by @cloneofsimo in https://github.com/cloneofsimo/lora/pull/133
• Remove useless model_id declaration in svd_distill by @wsxiaoys in https://github.com/cloneofsimo/lora/pull/136
• Avoid using python 3.9 feature ( |= for dict ) so cli_pt_to_safetenso… by @wsxiaoys in https://github.com/cloneofsimo/lora/pull/137
• Basic dataset pipelines by @cloneofsimo in https://github.com/cloneofsimo/lora/pull/139
• Update README.md by @JackLangerman in https://github.com/cloneofsimo/lora/pull/144
• SVD update with conv support + LoRA add, weight update following recent updates by @cloneofsimo in https://github.com/cloneofsimo/lora/pull/140
• v0.1.2 by @cloneofsimo in https://github.com/cloneofsimo/lora/pull/135

New Contributors

• @wsxiaoys made their first contribution in https://github.com/cloneofsimo/lora/pull/136
• @JackLangerman made their first contribution in https://github.com/cloneofsimo/lora/pull/144

Full Changelog: https://github.com/cloneofsimo/lora/compare/v0.1.1...v0.1.2

What's Changed

• Hotfixes/docs and minor adj by @cloneofsimo in https://github.com/cloneofsimo/lora/pull/122
• v0.1.1 by @cloneofsimo in https://github.com/cloneofsimo/lora/pull/130

Full Changelog: https://github.com/cloneofsimo/lora/compare/v0.1.0-alpha...v0.1.1

Better Pivotal Tuning, CLIP evaluation, SVD distillation!

Many tricks / features went into this release :

1. Extended Latent textual inversion
2. Pivotal tuning with stage-learning rate schedule
3. Norm-prior Bayesian learning
4. Mask conditioned score estimation (+ in-pipeline face detector)
5. Sub-1 denoising
6. CLIP score (text alignment score, image alignment score) evaluater
7. xformer support (not in lorpt CLI yet)
8. wandb logging
9. Better Caption dataset
10. Distilling fully trained model into LoRA : SVD distillation CLI

What's Changed

• fix(missing-var): h_flip by @oscarnevarezleal in https://github.com/cloneofsimo/lora/pull/86
• BetterPTI: Support pivotal tuning with multiword latent by @cloneofsimo in https://github.com/cloneofsimo/lora/pull/91
• Other Acceleration tricks by @cloneofsimo in https://github.com/cloneofsimo/lora/pull/93
• fix : save lora 16 precision by @cloneofsimo in https://github.com/cloneofsimo/lora/pull/97
• feat : svd distillation with CLI by @cloneofsimo in https://github.com/cloneofsimo/lora/pull/98
• Add xformers to training scripts by @hafriedlander in https://github.com/cloneofsimo/lora/pull/103
• Make safetensors properly optional, and support storing TI by @hafriedlander in https://github.com/cloneofsimo/lora/pull/101
• Feat/inversion pp by @cloneofsimo in https://github.com/cloneofsimo/lora/pull/104
• image transforms by @ethansmith2000 in https://github.com/cloneofsimo/lora/pull/115
• Feat/allsave by @cloneofsimo in https://github.com/cloneofsimo/lora/pull/119
• v 0.1.0 by @cloneofsimo in https://github.com/cloneofsimo/lora/pull/88

New Contributors

• @timh made their first contribution in https://github.com/cloneofsimo/lora/pull/11
• @AK391 made their first contribution in https://github.com/cloneofsimo/lora/pull/20
• @2kpr made their first contribution in https://github.com/cloneofsimo/lora/pull/25
• @DavidePaglieri made their first contribution in https://github.com/cloneofsimo/lora/pull/39
• @hdeezy made their first contribution in https://github.com/cloneofsimo/lora/pull/48
• @hafriedlander made their first contribution in https://github.com/cloneofsimo/lora/pull/73
• @milyiyo made their first contribution in https://github.com/cloneofsimo/lora/pull/75
• @laksjdjf made their first contribution in https://github.com/cloneofsimo/lora/pull/76
• @oscarnevarezleal made their first contribution in https://github.com/cloneofsimo/lora/pull/86
• @ethansmith2000 made their first contribution in https://github.com/cloneofsimo/lora/pull/115

Full Changelog: https://github.com/cloneofsimo/lora/commits/v0.1.0-alpha