LLMs will hit the data wall if they can’t generalize – OpenAI cofounder John Schulman
Dwarkesh Patel · 4:24
A guest argues that the gap since GPT-4 is not evidence of a capability plateau or an imminent data wall: training cycles are long, data limits will gradually change pre-training rather than stop progress, and a lot o...