\k{appa}-LoRA: Condition Numbers Reveal Which LoRA Matrices Worth Updating
Low-Rank Adaptation (LoRA) has become a widely adopted technique for efficient neural network fine-tuning, decomposing model updates into low-rank matrices. However, LoRA remains computationally costly because it updates all matrices uniformly, regardless of…
PRISM indexes and ranks — it never republishes. The full piece lives with its author on arxiv.org.
Read on arxiv.org