#Inference Framework (1)

DeepInfer: The Inference Framework Behind DeepSeek's Production Serving

DeepSeek's open-sourced production inference engine: offline serving for DeepSeek-V4.1-Flash on NVIDIA SM100 and Ascend 950, with a C++ zero-overhead scheduler, attention DP/CP plus MoE EP with EPLB, DSpark confidence-scheduled speculative decoding, SWA bounded replay, batch-invariant and deterministic modes, and structured outputs under Apache-2.0.