Build Specialist LLMs Like It’s 2019 (Randall Balestriero)
Machine Learning Street Talk · 34:31
Randall Balestriero argues that for perception/classification tasks, LLM pre-training by next-token prediction often buys you nothing over a randomly initialized model trained from scratch — a 7B-parameter model train...