Safety Alignment Should be Made More Than Just a Few Tokens Deep (Paper Explained)
Yannic Kilcher · 48:52
The paper "Safety Alignment Should Be Made More Than Just a Few Tokens Deep" (anonymous ICLR submission) argues that current LLM safety alignment is "shallow." It mostly changes the model's probabilities for the first...