Account takeover occurs when an attacker gains control of another person’s account or session. In a personalized assistant, a compromised customer session can let an attacker use ordinary prompts to consolidate information otherwise spread across pages and workflows. section 4.2.1
ClaimAssist profile extraction
With a customer session compromised, an attacker asks ClaimAssist to summarize policy details, recent claims, contact information, and reimbursement destinations. The assistant returns a dossier that could support identity theft or targeted phishing. section 4.2.1
Table 4.1 How each additional ClaimAssist feature increases the security risk
|
Version
|
Environment
|
Input
|
Model
|
Data
|
Ability to Act
|
Autonomy
|
|
V1: FAQ Bot
|
Yes
|
Yes
|
No
|
No
|
No
|
No
|
|
V2: FAQ Bot
running on an unvetted model
|
Yes
|
Yes
|
Yes
|
No
|
No
|
No
|
|
V3:
Personalized Assistant
|
Yes
|
Yes
|
Yes
|
Yes
|
No
|
No
|
|
V4:
Fine-tuned Assistant
|
Yes
|
Yes
|
Yes
|
Yes
|
No
|
No
|
|
V5:
Action-Enabled Assistant
|
Yes
|
Yes
|
Yes
|
Yes
|
Yes
|
No
|
|
V6: Agentic
Assistant
|
Yes
|
Yes
|
Yes
|
Yes
|
Yes
|
Yes
|
The risk ladder shows data risk appearing when ClaimAssist adds personalization, alongside environment, input, and model risks. section 4.2.1
