Skip to content

Commit 22ade29

Browse files
cboettigclaude
andcommitted
vllm(nimbus): drop qwen logging back to INFO
DEBUG (added 2026-07-06 to chase inconsistent tool-call/reasoning behavior) is root-caused as upstream vLLM #43713 and not recurring, and its volume was drowning kubectl logs to ~1min of retrievable history. Staged only — not yet applied to the cluster. Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
1 parent 219f502 commit 22ade29

1 file changed

Lines changed: 7 additions & 5 deletions

File tree

vllm/nimbus/deploy-qwen.yaml

Lines changed: 7 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -47,12 +47,14 @@ spec:
4747
key: api-key
4848
- name: OMP_NUM_THREADS
4949
value: "4"
50-
# DEBUG-level logging on top of --enable-log-requests/--enable-log-outputs
51-
# (below) makes vLLM log actual prompt/output text, not just request
52-
# metadata. Temporary: added 2026-07-06 to debug reports of inconsistent
53-
# tool-call/reasoning behavior. Drop once root-caused.
50+
# Was DEBUG (added 2026-07-06 to chase inconsistent tool-call/reasoning
51+
# behavior, see qwen-deployment-notes.md) — that bug is root-caused
52+
# (upstream vLLM #43713) and not recurring, and DEBUG volume was drowning
53+
# `kubectl logs` (only ~1min of history retrievable). Back to INFO.
54+
# --enable-log-requests/--enable-log-outputs (below) still give per-request
55+
# prompt/output visibility without the per-token op-priority spam.
5456
- name: VLLM_LOGGING_LEVEL
55-
value: DEBUG
57+
value: INFO
5658
# Belt-and-suspenders with --moe-backend marlin: the FlashInfer FP4 MoE path
5759
# crashes NVFP4 MoE on GB10/SM121 (FlashInfer #2776, cudaErrorIllegalAddress).
5860
# This checkpoint's mlp.experts are W4A16_NVFP4, so that path MUST be avoided.

0 commit comments

Comments
 (0)