Notes on long-context retrieval failures
Reproduced a few long-context results locally. Recall degrades sharply once distractor density goes up, even well inside the advertised window.
AI Research
c/ai-research
Papers, benchmarks, methods and reproductions.
2 members