Search results

Tensor parallel shared-memory RPC lacks worker acknowledgement and can corrupt commands

Status: Open.

#246 In GeeeekExplorer/nano-vllm;

· banfeb opened on Jun 25, 2026

Low inference speed in A100 PCIE GPU

Status: Open.

#245 In GeeeekExplorer/nano-vllm;

· thangld201 opened on Jun 20, 2026

Lightweight Go load-balancing proxy for nano-vllm

Status: Open.

#244 In GeeeekExplorer/nano-vllm;

· Sakalya opened on Jun 17, 2026

[Bug] may_append allocates new block one token too late, causing KV cache write to unallocated block

Status: Open.

#240 In GeeeekExplorer/nano-vllm;

· MrPaoBrother opened on Jun 8, 2026

📋 Documentation Enhancement Suggestion

Status: Open.

#230 In GeeeekExplorer/nano-vllm;

· croviatrust opened on May 12, 2026

[change] Int8 KV Cache + Async Pipeline + Head-major reordering for 22% Throughput Boost

Status: Open.

#228 In GeeeekExplorer/nano-vllm;

· naalo2 opened on May 8, 2026

Introducing Quantized Inference to Nano-vLLM - A Lightweight FP8 Runtime for Qwen Models

Status: Open.

#225 In GeeeekExplorer/nano-vllm;

· cuber726579 opened on May 7, 2026

[Discussion] As vLLM-Omni is also complex, I tried building a minimal version (~1k LOC) inspired by nano-vllm

Status: Open.

#221 In GeeeekExplorer/nano-vllm;

· Rising0321 opened on May 1, 2026

[Feature Request] Support weightless RMSNorm (for FlashNorm weight folding trick)

Status: Open.

#220 In GeeeekExplorer/nano-vllm;

· NilsGraf opened on Apr 29, 2026

[Discussion] Duplicate blocks for same-step prefix sharing

Status: Open.

#219 In GeeeekExplorer/nano-vllm;

· fishAndShrimp opened on Apr 28, 2026

Implement support for Qwen3.5

Status: Open.

#206 In GeeeekExplorer/nano-vllm;

· Wangbiao2 opened on Apr 20, 2026

CUDA graph replay can fail with block_tables shape mismatch

Status: Open.

#190 In GeeeekExplorer/nano-vllm;

· ilrewrite opened on Mar 24, 2026