Low Tensor Rank adaptation of large language models
APACHE-2.0 License
Published by daskol 9 months ago
Public release of LoTR, a novel approach for parameter-efficient fine-tuning of LLMs which represents a gradient update to parameters in a form of tensor decomposition.
arXiv:2402.01376
