Persistent Pre-Training Poisoning of LLMs
Google TechTalks · 33:10
Poisoning just 0.1% of an LLM's pre-training data can plant behaviours that are still there after standard safety and chat training (SFT and DPO). The talk tested four attacks. Making the model output gibberish when i...