Stanford CS25: Transformers United V6 I Serving Transformers: Lessons from the Trenches
Stanford Online · 82:31
Inference is where model weights become a product and a revenue stream, and Charles (Modal) surveys the full serving stack so engineers can turn training outputs into systems that hit latency, cost, and reliability go...