A Conditional No-Hair Theorem for Transformers: How Language Models Forget Their Prompt

Summary

Researchers prove that autoregressive transformers forget prompts as generated text lengthens, with trained models decaying faster than untrained ones.

Carried by: arXiv, HF Daily Papers. First seen: 2026-10-20T05:30:18Z.