Energy-Based Transformers are Scalable Learners and Thinkers (Paper Review)
Yannic Kilcher · 47:51
Energy-Based Transformers (EBTs) combine energy-based modeling with transformer architectures to let models "think" at inference time by running iterative optimization (gradient descent on a learned energy function) i...