Fine-tuning adapts a pretrained model to a domain using tailored data. It can also weaken safety behaviors, including when the data is benign, so domain performance alone is not enough to establish deployment readiness. section 4.4.1
For organization-specific fine-tuning, pair customization with safeguards:
- Validate and clean training data; assess risks of bias, poisoning, safety issues, and privacy violations. section 2.4.3
- Retest safety behavior after fine-tuning, even when the dataset is benign. section 2.4.3
Safety can erode during adaptation
Reported tests found that ten adversarial examples weakened GPT-3.5 Turbo’s guardrails; fine-tuning Llama-2 variants on benign medical, financial, or legal data also weakened safety behaviors. section 4.4.1



















































