Read the original at HF Daily Papers
SpecMRL reorganizes the feature space using a parameter-derived spectral basis to improve prefix readout in Matryoshka Representation Learning. The method surpasses full-dimensional MRL using half the embedding dimensions.
Carried by: HF Daily Papers. First seen: .