Lost in the middle
The finding (Liu et al., 2023) that language models often use information at the start or end of a long context better than information in the middle, giving a U-shaped accuracy curve.
The finding (Liu et al., 2023) that language models often use information at the start or end of a long context better than information in the middle, giving a U-shaped accuracy curve.