PII scrubbing removes or masks personal information before data is reviewed, annotated, stored for training, or used to train a model. Training on personal identifiers can lead a model to reproduce them and creates data-processing liability. section 3.8
Scrub both direct identifiers and combinations that could identify someone:
- Structured identifiers include names, emails, phone numbers, national identifiers, account numbers, IP addresses, and device identifiers. Automated tools can detect these and replace them with typed placeholders. section 3.8
- Indirect identifiers can emerge from combinations such as age, job title, and employer. Automated detection may miss these; human review of a sample is needed. section 3.8
Scrubbing production logs
Before reviewers inspect exported query-and-response pairs, scrub the data. Microsoft Presidio can detect more than 20 entity types and replace them with placeholders such as [PERSON] and [EMAIL]. Then review at least 10% of examples for indirect identifiers and document the review. section 3.4.4 section 3.8

