Goal manipulation gradually shifts what an agent is trying to accomplish through adversarial influence across interactions. Agentic red teaming tests for this risk over time, not just with a single prompt. section 4.8.8
Test realistic attack paths that develop across sessions:
- Probe whether earlier interactions can shift policy interpretation or bypass controls that work in isolation. section 4.8.8
- Use PyRIT to orchestrate multi-turn attack conversations; single-prompt scanners alone do not test agents’ evolving context and goals. section 4.8.8
ClaimAssist
Carefully crafted sessions shifted the agent’s interpretation of policy documentation, while context from earlier interactions bypassed controls that worked in isolation. section 4.8.8
