Is ChatGPT an N-gram model on steroids?
Machine Learning Street Talk · 32:58
Timothy Nguyen (Google DeepMind researcher, ex-mathematician, host of *The Cartesian Cafe*) presents his paper "Understanding Transformers via N-gram Statistics," which shows that on the TinyStories dataset a 150M-par...