forked from ggml-org/llama.cpp
-
-
Notifications
You must be signed in to change notification settings - Fork 411
Pull requests: TheTom/llama-cpp-turboquant
Author
Label
Projects
Milestones
Reviews
Assignee
Sort
Pull requests list
cuda: stream TurboQuant MoE experts from pinned host memory
CUDA
ggml
#364
opened Sep 7, 2026 by
jasstrong
Loading…
cuda: recover batched decode on AMD by keeping narrow weights off the GEMM
CUDA
ggml
#363
opened Sep 7, 2026 by
jasstrong
Loading…
Four fixes Qwen3.8-Flash-Next needs to work
examples
model
#362
opened Sep 7, 2026 by
jasstrong
Loading…
hip: add flash attention kernel A/B override
CUDA
ggml
#360
opened Sep 6, 2026 by
TheTom
Owner
Loading…
Block KV cache streaming: bound VRAM at long context via a shared CUDA phase arena
CUDA
documentation
Improvements or additions to documentation
examples
ggml
testing
#357
opened Sep 6, 2026 by
giveen
Loading…
hip: VEC flash-attn for D=512 (Gemma 4) on ROCm with quantized KV
ggml
Nvidia GPU
#156
opened May 24, 2026 by
cclecle
Loading…
vulkan: add TurboQuant KV cache support and optimized turbo mat-vec paths
ggml
Vulkan
#140
opened May 10, 2026 by
Fenix46
Loading…
fix(qwen35): support Qwen3.5:9B loading from Ollama GGUF
model
#135
opened May 8, 2026 by
Jordan-HS
Loading…
vendor: bump cpp-httplib to 0.43.2 (openssl 4.0.0 fix)
python
script
#121
opened May 4, 2026 by
TheTom
Owner
Loading…
1 of 3 tasks
HIP mixed TurboQuant vec FA on gfx900/gfx906
build
ggml
Nvidia GPU
#99
opened Apr 21, 2026 by
2bigO
Loading…
fix: HIP/ROCm compatibility — check cudaMemcpyToSymbol errors, guard …
ggml
Nvidia GPU
#41
opened Apr 1, 2026 by
terrysimons
•
Draft
ProTip!
What’s not been updated in a month: updated:<2026-08-09.