Cascading Adversarial Bias from Injection to Distillation in Language Models
Google TechTalks · 38:13
Harsh's talk, based on work he did at Google, shows that an attacker who poisons only 0.25–0.5% of a teacher model's instruction-tuning data can plant a subtle bias that a distilled student model inherits and often am...