liveBook · Manning

Account takeover

As explained in AI Governance

Account takeover is an attack in which an attacker gains control of another person’s account or session.

Account takeover occurs when an attacker gains control of another person’s account or session. In a personalized assistant, a compromised customer session can let an attacker use ordinary prompts to consolidate information otherwise spread across pages and workflows. section 4.2.1

ClaimAssist profile extraction

With a customer session compromised, an attacker asks ClaimAssist to summarize policy details, recent claims, contact information, and reimbursement destinations. The assistant returns a dossier that could support identity theft or targeted phishing. section 4.2.1

Table 4.1 How each additional ClaimAssist feature increases the security risk
Version
Environment
Input
Model
Data
Ability to Act
Autonomy
V1: FAQ Bot
Yes
Yes
No
No
No
No
V2: FAQ Bot running on an unvetted model
Yes
Yes
Yes
No
No
No
V3: Personalized Assistant
Yes
Yes
Yes
Yes
No
No
V4: Fine-tuned Assistant
Yes
Yes
Yes
Yes
No
No
V5: Action-Enabled Assistant
Yes
Yes
Yes
Yes
Yes
No
V6: Agentic Assistant
Yes
Yes
Yes
Yes
Yes
Yes

The risk ladder shows data risk appearing when ClaimAssist adds personalization, alongside environment, input, and model risks. section 4.2.1

How AI Governance covers it

How deep it goes
Traces an attack from a compromised session and single-factor authentication to consolidated customer-data extraction.
Examples
Uses ClaimAssist to summarize policy details, recent claims, contact information, and reimbursement destinations.
What you can do after
Understand how a compromised session can turn ordinary prompts into a consolidated customer dossier.
How it connects
Connects account takeover to session compromise, single-factor authentication, data access, identity theft, and phishing.

Related concepts

This explainer was generated by Manning's knowledge graph from the text of AI Governance. The section links point to the parts of the book it draws on.