Updated 6 months ago

mlora-cli • Rank 11.3 • Science 64%

An Efficient "Factory" to Build Multiple LoRA Adapters

Updated 6 months ago

sorsa • Rank 6.2 • Science 54%

SORSA: Singular Values and Orthonormal Regularized Singular Vectors Adaptation of Large Language Models

Updated 6 months ago

lotr • Rank 3.4 • Science 54%

Low Tensor Rank adaptation of large language models

Updated 6 months ago

finetuned-qlora-falcon7b-medical • Rank 6.3 • Science 44%

Finetuning of Falcon-7B LLM using QLoRA on Mental Health Conversational Dataset

Updated 6 months ago

relora • Rank 6.1 • Science 26%

Official code for ReLoRA from the paper Stack More Layers Differently: High-Rank Training Through Low-Rank Updates