A routed path is the sparse branch of a mixture-of-experts layer: it scores each token against routed experts, selects top-k specialists, and processes tokens only through those assignments. section 4.5
A practical routed path proceeds by:
- Computing router logits from flattened token representations and expert centroids, then adding a dynamic load-balancing bias. section 4.5
- Dispatching tokens with expert-specific indexing, combining expert outputs, and adding them to the shared path and residual input. section 4.5
Figure 4.27 The complete forward pass of the DeepSeekMoE module, showing the three parallel data paths: the dense shared expert path, the sparse routed expert path with dynamic load balancing, and the residual connection.

Trace the shared expert branch, sparse routed branch, and residual connection as parallel paths whose outputs are summed. section 4.5
