# Metadata Source URL:: https://arxiv.org/pdf/2108.12409.pdf Topics:: #ai, #llm --- # TRAIN SHORT, TEST LONG: ATTENTION WITH LINEAR BIASES ENABLES INPUT LENGTH EXTRAPOLATION ## Highlights