TokenFormer: Rethinking Transformer Scaling with Tokenized Model Parameters (Paper Explained)
Yannic Kilcher · 28:22
Yannic Kilcher reviews TokenFormer (Max Planck Institute for Informatics, Google, Peking University). The paper replaces a Transformer's linear projections with attention over learnable "parameter tokens," so you can...