A shared path is the dense branch of a mixture-of-experts layer: every token passes through the same small set of generalist experts, applying common foundational knowledge consistently. section 4.5
In the DeepSeekMoE forward pass, the shared output runs alongside the sparse routed path and residual connection; the three outputs are summed as x + shared_out + routed_out. section 4.5
