2 Commits
Author SHA1 Message Date
ZhenchengLin 6376fda7a9 [Bugfix][Rust Frontend] Use server-reported prompt_tokens in vllm-bench (#59694) 2026-10-28 09:22:50 +08:00
31ec1c3aa1 [Bugfix][Rust Frontend] Stop vllm-bench chat latency at the last token (#59251)
Signed-off-by: zhenchenglin <zhl132@ucsd.edu>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Roy Wang <jasonailu87@gmail.com>
2026-10-01 02:04:19 +00:00