Skip to content

[https://nvbugs/6739116][fix] Reserve full-batch logits memory in KV cache estimation - #20817

Closed
trtllm-agent wants to merge 1 commit into
NVIDIA:release/1.3from
tensorrt-cicd:repair-bot-v2/nvbug-6739116-r39
Closed

trtllm-agent wants to merge 1 commit into
NVIDIA:release/1.3from
tensorrt-cicd:repair-bot-v2/nvbug-6739116-r39