Simple Drop-in LoRA Conditioning on Attention Layers Will Improve Your Diffusion Model
Ernest Ryu · 3:07
This short talk (about 3 minutes) argues that diffusion U-Nets feed time and class information only into their residual blocks, not their attention blocks. Adding LoRA-based conditioning to the attention layers as a s...