A distributed representation encodes information through patterns of activity across multiple units, rather than storing it in isolated symbolic records. Coherent behavior emerges from interactions among units, not from assigning each one a fixed concept or function. section 5.2.4 section 5.5
This organization has several consequences:
- Partial loss need not eliminate a function, because activity and contribution are spread across a pattern. section 5.2.4 section 5.5
- Overlapping patterns for related experiences can support generalization to new situations with shared structure, without explicit transfer rules. section 5.2.4
- Distributed contribution does not mean every unit matters equally: some subnetworks can be sufficient for learning a task. section 5.2.4
Biological and artificial neural systems share this computational principle, but neural networks learn input regularities without necessarily constructing an explicit model of the world those inputs describe. section 5.5
