Skip to content
Back to pull request #2965

Kvrouter that will increase the kv-cache hits in case of multiple routing strategy #2426

Sign in to view logs

Kvrouter that will increase the kv-cache hits in case of multiple routing strategy

Kvrouter that will increase the kv-cache hits in case of multiple routing strategy #2426

build (cuda-trtllm)  /  backend_trtllm_cxx_tests

build (cuda-trtllm) / backend_trtllm_cxx_tests
succeeded Jan 31, 2025 in 1m 3s