Repository navigation

fix(pd_vllm): prefill request hygiene, ignore_eos support, usage in its own chunk - #55

Merged

mzmssg merged 2 commits into

tile-ai:mainfrom

WSEmma:fix/pd-vllm-inferx-fixes

Aug 5, 2026

Merged

fix(pd_vllm): prefill request hygiene, ignore_eos support, usage in its own chunk#55
mzmssg merged 2 commits into
tile-ai:mainfrom
WSEmma:fix/pd-vllm-inferx-fixes

Commits on Aug 5, 2026
- fix(pd_vllm): honor ignore_eos; usage in its own chunk; relax dependency pins
  
  CrimsonDump
  authored and
  Shuang Wu
  committed
  1b9b64f
- fix(pd_vllm): drop stream_options / max_completion_tokens from the prefill request
  Shuang Wu
  committed
  b74b018