Context Rot: How Increasing Input Tokens Impacts LLM Performance (Paper Analysis)
Yannic Kilcher · 37:48
This paper (from the vector-database company Chroma) shows that "long context" LLMs don't actually maintain performance as input length grows — even on tasks that aren't inherently harder, just longer — which means th...