Cascading Adversarial Bias from Injection to Distillation in Language Models

Google TechTalks · 38:13

Harsh's talk, based on work he did at Google, shows that an attacker who poisons only 0.25–0.5% of a teacher model's instruction-tuning data can plant a subtle bias that a distilled student model inherits and often am...

Read the full summary on tuber

Redirecting...