Recent Releases of lora

lora - v0.1.7

What's Changed

  • Faster Training by @cloneofsimo in https://github.com/cloneofsimo/lora/pull/178
  • v0.1.7 by @cloneofsimo in https://github.com/cloneofsimo/lora/pull/180

Full Changelog: https://github.com/cloneofsimo/lora/compare/v0.1.6...v0.1.7

- Jupyter Notebook
Published by cloneofsimo about 3 years ago

lora - Release v0.1.6

What's Changed

  • accept training filenames with capitalized extensions by @zeke in https://github.com/cloneofsimo/lora/pull/169
  • Add inpainting support to pivotal tuning by @levi in https://github.com/cloneofsimo/lora/pull/152
  • fix "local variable 'unet_path' referenced before assignment" by @arceus-jia in https://github.com/cloneofsimo/lora/pull/175
  • LoRA Manager for managing multiple loras with different scaling parameters & tokens by @cloneofsimo in https://github.com/cloneofsimo/lora/pull/172
  • v0.1.6 by @cloneofsimo in https://github.com/cloneofsimo/lora/pull/171

New Contributors

  • @zeke made their first contribution in https://github.com/cloneofsimo/lora/pull/169
  • @arceus-jia made their first contribution in https://github.com/cloneofsimo/lora/pull/175

Full Changelog: https://github.com/cloneofsimo/lora/compare/v0.1.5...v0.1.6

I've worked with team @replicate to improve this repo capable of various productions! Thank you so much!

- Jupyter Notebook
Published by cloneofsimo about 3 years ago

lora - Release v0.1.5

What's Changed

  • Support prefix text for blip captioning by @levi in https://github.com/cloneofsimo/lora/pull/166
  • allow jpeg files in addition to jpg files by @anotherjesse in https://github.com/cloneofsimo/lora/pull/165
  • v0.1.5 by @cloneofsimo in https://github.com/cloneofsimo/lora/pull/168

New Contributors

  • @anotherjesse made their first contribution in https://github.com/cloneofsimo/lora/pull/165

Full Changelog: https://github.com/cloneofsimo/lora/compare/v0.1.4...v0.1.5

- Jupyter Notebook
Published by cloneofsimo about 3 years ago

lora - Release v0.1.4

What's Changed

  • Fix dates in readme by @levi in https://github.com/cloneofsimo/lora/pull/162
  • v0.1.4 by @cloneofsimo in https://github.com/cloneofsimo/lora/pull/164

Now output CLIP alignment scores during lora tuning step, mitigated center-crop by default error, saves lora with extra argument name.

Full Changelog: https://github.com/cloneofsimo/lora/compare/v0.1.3...v0.1.4

- Jupyter Notebook
Published by cloneofsimo about 3 years ago

lora - Release v0.1.3

What's Changed

  • Include mediapipe package in requirements.txt by @levi in https://github.com/cloneofsimo/lora/pull/158
  • Update web demo link by @hysts in https://github.com/cloneofsimo/lora/pull/157
  • LoRA Join operation by @cloneofsimo in https://github.com/cloneofsimo/lora/pull/160
  • v0.1.3 by @cloneofsimo in https://github.com/cloneofsimo/lora/pull/161

New Contributors

  • @levi made their first contribution in https://github.com/cloneofsimo/lora/pull/158
  • @hysts made their first contribution in https://github.com/cloneofsimo/lora/pull/157

Full Changelog: https://github.com/cloneofsimo/lora/compare/v0.1.2...v0.1.3

- Jupyter Notebook
Published by cloneofsimo about 3 years ago

lora - Release v0.1.2

What's Changed

  • Feature/ Better LoRA : Dropout, Conv2d by @cloneofsimo in https://github.com/cloneofsimo/lora/pull/133
  • Remove useless modelid declaration in svddistill by @wsxiaoys in https://github.com/cloneofsimo/lora/pull/136
  • Avoid using python 3.9 feature ( |= for dict ) so cliptto_safetenso… by @wsxiaoys in https://github.com/cloneofsimo/lora/pull/137
  • Basic dataset pipelines by @cloneofsimo in https://github.com/cloneofsimo/lora/pull/139
  • Update README.md by @JackLangerman in https://github.com/cloneofsimo/lora/pull/144
  • SVD update with conv support + LoRA add, weight update following recent updates by @cloneofsimo in https://github.com/cloneofsimo/lora/pull/140
  • v0.1.2 by @cloneofsimo in https://github.com/cloneofsimo/lora/pull/135

New Contributors

  • @wsxiaoys made their first contribution in https://github.com/cloneofsimo/lora/pull/136
  • @JackLangerman made their first contribution in https://github.com/cloneofsimo/lora/pull/144

Full Changelog: https://github.com/cloneofsimo/lora/compare/v0.1.1...v0.1.2

- Jupyter Notebook
Published by cloneofsimo about 3 years ago

lora - Release v0.1.1

What's Changed

  • Hotfixes/docs and minor adj by @cloneofsimo in https://github.com/cloneofsimo/lora/pull/122
  • v0.1.1 by @cloneofsimo in https://github.com/cloneofsimo/lora/pull/130

Full Changelog: https://github.com/cloneofsimo/lora/compare/v0.1.0-alpha...v0.1.1

- Jupyter Notebook
Published by cloneofsimo about 3 years ago

lora - Release v0.1.0

Better Pivotal Tuning, CLIP evaluation, SVD distillation!

image

Many tricks / features went into this release :

  1. Extended Latent textual inversion
  2. Pivotal tuning with stage-learning rate schedule
  3. Norm-prior Bayesian learning
  4. Mask conditioned score estimation (+ in-pipeline face detector)
  5. Sub-1 denoising
  6. CLIP score (text alignment score, image alignment score) evaluater
  7. xformer support (not in lorpt CLI yet)
  8. wandb logging
  9. Better Caption dataset
  10. Distilling fully trained model into LoRA : SVD distillation CLI

What's Changed

  • fix(missing-var): h_flip by @oscarnevarezleal in https://github.com/cloneofsimo/lora/pull/86
  • BetterPTI: Support pivotal tuning with multiword latent by @cloneofsimo in https://github.com/cloneofsimo/lora/pull/91
  • Other Acceleration tricks by @cloneofsimo in https://github.com/cloneofsimo/lora/pull/93
  • fix : save lora 16 precision by @cloneofsimo in https://github.com/cloneofsimo/lora/pull/97
  • feat : svd distillation with CLI by @cloneofsimo in https://github.com/cloneofsimo/lora/pull/98
  • Add xformers to training scripts by @hafriedlander in https://github.com/cloneofsimo/lora/pull/103
  • Make safetensors properly optional, and support storing TI by @hafriedlander in https://github.com/cloneofsimo/lora/pull/101
  • Feat/inversion pp by @cloneofsimo in https://github.com/cloneofsimo/lora/pull/104
  • image transforms by @ethansmith2000 in https://github.com/cloneofsimo/lora/pull/115
  • Feat/allsave by @cloneofsimo in https://github.com/cloneofsimo/lora/pull/119
  • v 0.1.0 by @cloneofsimo in https://github.com/cloneofsimo/lora/pull/88

New Contributors

  • @timh made their first contribution in https://github.com/cloneofsimo/lora/pull/11
  • @AK391 made their first contribution in https://github.com/cloneofsimo/lora/pull/20
  • @2kpr made their first contribution in https://github.com/cloneofsimo/lora/pull/25
  • @DavidePaglieri made their first contribution in https://github.com/cloneofsimo/lora/pull/39
  • @hdeezy made their first contribution in https://github.com/cloneofsimo/lora/pull/48
  • @hafriedlander made their first contribution in https://github.com/cloneofsimo/lora/pull/73
  • @milyiyo made their first contribution in https://github.com/cloneofsimo/lora/pull/75
  • @laksjdjf made their first contribution in https://github.com/cloneofsimo/lora/pull/76
  • @oscarnevarezleal made their first contribution in https://github.com/cloneofsimo/lora/pull/86
  • @ethansmith2000 made their first contribution in https://github.com/cloneofsimo/lora/pull/115

Full Changelog: https://github.com/cloneofsimo/lora/commits/v0.1.0-alpha

- Jupyter Notebook
Published by cloneofsimo about 3 years ago