Read the original at HF Daily Papers
Researchers introduce UltraBERT, an encoder that uses separate heads for different masking ratios to achieve state-of-the-art results on both classification and retrieval tasks.
Carried by: HF Daily Papers. First seen: .