Anthropic Head of Pretraining on Scaling Laws, Compute, and the Future of AI
Y Combinator · 64:04
Pre-training still drives most of the intelligence in frontier models: next-token prediction on internet-scale text plus more compute produces predictable gains, and Anthropic’s head of pre-training argues the hard pa...