Deep Dive into LLMs like ChatGPT
Andrej Karpathy · 211:23
ChatGPT is a next-token predictor trained in three stages—pre-training on internet text, supervised fine-tuning on curated conversations, then reinforcement learning—and that pipeline, not a persistent mind, is what p...