Skip to content

feat: add vLLM engine with on-request model switching - #181

Open
nvtushark wants to merge 41 commits into
NVIDIA:developfrom
nvtushark:vllm-engine-support
Open

nvtushark wants to merge 41 commits into
NVIDIA:developfrom
nvtushark:vllm-engine-support

fix(nvpair-engine-manager): delete vLLM models with hf cache rm

dfbbcfb
Select commit
Loading
Failed to load commit list.
Sign in for the full log view