Dynamic routing bias is a non-trainable per-expert adjustment added to router logits before top-k selection. Increasing an under-loaded expert’s bias makes it more likely to receive tokens, while decreasing overloaded experts’ relative advantage improves load balance. section 4.5
Figure 4.27 The complete forward pass of the DeepSeekMoE module, showing the three parallel data paths: the dense shared expert path, the sparse routed expert path with dynamic load balancing, and the residual connection.

The forward-pass diagram situates dynamic bias between router scoring and sparse expert dispatch, alongside shared experts and the residual connection. section 4.5
