Repository navigation

[None][feat] Extend Beam ModelingV2 inference and serving - #20952

Draft

Mgluhovskoi wants to merge 14 commits into

NVIDIA:mainfrom

Mgluhovskoi:feat/beam-inference-followup

Draft

[None][feat] Extend Beam ModelingV2 inference and serving#20952
Mgluhovskoi wants to merge 14 commits into
NVIDIA:mainfrom
Mgluhovskoi:feat/beam-inference-followup

Commits on Oct 16, 2026
- [None][feat] Add initial Beam component implementation
  Mgluhovskoi
  committed
  4380dff
Commits on Oct 18, 2026
- [None][feat] Add a Beam dense decoder-block component to ModelingV2
  Mgluhovskoi
  committed
  1e1caa1
- [None][feat] Add a Beam MoE router component to ModelingV2
  Mgluhovskoi
  committed
  5b66179
Commits on Oct 19, 2026
- [None][feat] Add a Beam MoE routed-expert component to ModelingV2
  Mgluhovskoi
  committed
  1b48e46
Commits on Oct 20, 2026
- [None][feat] Add a Beam MoE dispatch/combine component to ModelingV2
  Mgluhovskoi
  committed
  1fba916
- [None][feat] Add a Beam complete MoE and sparse decoder block to ModelingV2
  Mgluhovskoi
  committed
  7cf3acd
Commits on Oct 21, 2026
- [None][feat] Add a Beam six-layer prefill model to ModelingV2
  Mgluhovskoi
  committed
  245fb0b
- [None][feat] Add cached generation and prefix reuse for Beam
  Mgluhovskoi
  committed
  603bbb1
Commits on Oct 22, 2026
- [None][feat] Add Beam checkpoint loading and TP4 block execution
  Mgluhovskoi
  committed
  55f78a5
- [None][feat] Add Beam NVFP4 expert loading and TP4 execution
  Mgluhovskoi
  committed
  04b6235
Commits on Oct 23, 2026
- [None][feat] Add Beam full-model NVFP4 generation and serving
  Mgluhovskoi
  committed
  bfc864a
- [None][fix] Integrate main and document Beam TP4 serving
  Mgluhovskoi
  committed
  1f37805
Commits on Oct 24, 2026
- [None][fix] Harden Beam loading and serving validation
  Mgluhovskoi
  committed
  96ce0ec
Commits on Oct 25, 2026
- [None][feat] Add Beam DFlash2 speculative decoding
  Mgluhovskoi
  committed
  57fed07

Commits

Commits on Oct 16, 2026

Commits on Oct 18, 2026

Commits on Oct 19, 2026

Commits on Oct 20, 2026

Commits on Oct 21, 2026

Commits on Oct 22, 2026

Commits on Oct 23, 2026

Commits on Oct 24, 2026

Commits on Oct 25, 2026