Skip to content

Add managed vLLM with multi-node serving over direct and ring fabrics, and device setup - #125

Closed
nv-pgoode wants to merge 33 commits into
NVIDIA:developfrom
nv-pgoode:feat/managed-vllm-clustering
Closed

Add managed vLLM with multi-node serving over direct and ring fabrics, and device setup#125
nv-pgoode wants to merge 33 commits into
NVIDIA:developfrom
nv-pgoode:feat/managed-vllm-clustering

feat(vllm): switch runtimes by reactivating a kept environment

16c4584
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs