Live page · Day archive

PaLoRA: Paced Low-Rank Adaptation for Continual Learning

Read the original at HF Daily Papers

Summary

Researchers propose PaLoRA, a method that adjusts gradient scaling based on the effective rank of past updates to balance stability and plasticity in continual learning.

Carried by: HF Daily Papers. First seen: .