-
Notifications
You must be signed in to change notification settings - Fork 27
All issues
Issue creation is restricted in this repository
Issues
is:issue state:open
is:issue state:open
Search results
The documented router install fails on any cluster without the Prometheus Operator
bugSomething isn't workingSomething isn't workingStatus: Open.#358 In llm-d/llm-d-async;The router recipe's base values do not fit an 8-vCPU node
documentationImprovements or additions to documentationImprovements or additions to documentationStatus: Open.#357 In llm-d/llm-d-async;llm-d's own model server overlays do not carry the
inference_poolpod labelbugSomething isn't workingSomething isn't workingStatus: Open.#356 In llm-d/llm-d-async;modelServerMonitorsilently no-ops when llm-d-async is in a different namespacebugSomething isn't workingSomething isn't workingStatus: Open.#355 In llm-d/llm-d-async;docs/guides/e2e-deploy.mdreferences llm-d paths that no longer existdocumentationImprovements or additions to documentationImprovements or additions to documentationStatus: Open.#354 In llm-d/llm-d-async;Redis quickstart payload in the llm-d async guide cannot be consumed
bugSomething isn't workingSomething isn't workingStatus: Open.#353 In llm-d/llm-d-async;[Metrics] Deadline Proximity histogram (time-to-deadline of queued items)
enhancementNew feature or requestNew feature or requestStatus: Open.[Metrics] Token Throughput counter (input + output tokens processed)
enhancementNew feature or requestNew feature or requestStatus: Open.[Feature]: Consider active requests and inflight tokens for saturation signal
enhancementNew feature or requestNew feature or requestStatus: Open.- Status: Open.
[Feature]: Throttle Worker Pool Workers by Gate Budget
enhancementNew feature or requestNew feature or requestStatus: Open.[Feature]: unify config across backends
enhancementNew feature or requestNew feature or requestStatus: Open.