Skip to content

[Engine] STRATA_PREFILL_CPU_SHARE_BATCH=1 (opt-in): the prompt's CPU share with --batch, for a read while no slot decodes; short reads -21% to -31% - #3382

Open
Vop3p wants to merge 1 commit into
Niko1221:mainfrom
Vop3p:prefill-cpu-share-batch
Open

[Engine] STRATA_PREFILL_CPU_SHARE_BATCH=1 (opt-in): the prompt's CPU share with --batch, for a read while no slot decodes; short reads -21% to -31%#3382
Vop3p wants to merge 1 commit into
Niko1221:mainfrom
Vop3p:prefill-cpu-share-batch

prefill: STRATA_PREFILL_CPU_SHARE_BATCH=1 (opt-in) gives the prompt p…

2b65710
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

2 warnings and 1 notice
check
succeeded Oct 20, 2026 in 5s