Skip to content

perf(pd): overlap the decode-side KV inject copies across device pairs - #66

Closed
Oseltamivir wants to merge 1 commit into
tile-ai:mainfrom
SemiAnalysisAI:perf/pd-parallel-inject
Closed

perf(pd): overlap the decode-side KV inject copies across device pairs#66
Oseltamivir wants to merge 1 commit into
tile-ai:mainfrom
SemiAnalysisAI:perf/pd-parallel-inject

Commits

  1. Commits on Sep 23, 2026