Human values are socially and ethically grounded preferences about acceptable goals, conduct, and outcomes. In AI alignment, they define part of what a system should do, alongside explicit policies and consistent personality traits. section 1.2 section 1.5
Treat human values as an alignment target rather than a direct software specification:
- Translate values into observable behavioral expectations, then use evaluation to measure whether the system follows them. section 1.0
- Separate foundational values from policy-based rules and personality-based communication styles. section 1.5
- Expect judgment and trade-offs: helpfulness, coherence, tone, and acceptable behavior may lack one deterministic answer. section 1.0 section 1.5
Helpful does not mean agreeable
A helpful assistant that agrees with users even when they are wrong can become sycophantic. Alignment must therefore distinguish desired helpfulness from behavior that violates broader human values. section 1.0
