Lec 08. Architectures: Transformers
MIT OpenCourseWare · 74:35
Transformers are the current default architecture because they process data as tokens (vector-valued units), mix them with attention (global but sparse, data-dependent weights rather than a free \(n^2\) matrix), and i...