Live page · Day archive

Periscope: Extending Frozen Language Models Beyond Their Context Window

Read the original at arXiv

Summary

Periscope is a training-free inference method that arranges text chunks on a grid to help frozen language models process long documents. It achieves this by reading only 9k tokens on LongBench v2.

Carried by: arXiv, HF Daily Papers. First seen: .