A structural score estimates a neuron's weight-based importance for width pruning. In a GLU, it combines normalized weight-range contributions from gate_proj, up_proj, and down_proj; activation-based importance is a separate component of the hybrid score. section 5.2
Compute the structural component in three stages:
- Measure each neuron's weight range as Max + |Min| in each projection matrix. section 5.2
- Sum the normalized contributions across all three projections to obtain a score per neuron. section 5.2
