Fine-Tuning Risk: 10 Examples Are Enough to Wipe All Safety Filters
Fatti validati
Qi et al. (Princeton University, arXiv:2310.03693). When a company fine-tunes an open-source or API model on its own data, a few manipulated examples are enough to disable all safety guardrails.
Spiegato in modo semplice
Tearing down the protective wall: Months of expensive safety work vanish if, while painting the living room, you accidentally take the front door off its hinges.
Rilevanza per la sicurezza e consiglio pratico
Companies must protect their internal training data as strictly as passwords.