Skip to content

Pull requests: ggml-org/llama.cpp

New pull request New
419 Open 5,396 Closed
419 Open 5,396 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

sycl: use DNN in the first part of ggml_sycl_mul_mat_batched_sycl ggml changes relating to the ggml tensor library for machine learning SYCL https://en.wikipedia.org/wiki/SYCL - GPU programming language
#12972 opened Apr 16, 2025 by lslusarczyk • Draft
ggml: Re-enable CUDA graphs in presence of CONT and DUP nodes ggml changes relating to the ggml tensor library for machine learning Nvidia GPU Issues specific to Nvidia GPUs
#12970 opened Apr 16, 2025 by agray3 Loading…
1
Vulkan: Fix Deepseek V2 inference by making ggml_vk_op_supports_incontiguous(GGML_OP_RMS_NORM) return true ggml changes relating to the ggml tensor library for machine learning Vulkan Issues specific to the Vulkan backend
#12960 opened Apr 15, 2025 by stduhpf • Draft
1
3
Resolved half rope,multi-EOS issues in convert_hf_togguf.py for GLM4Z Model python python script changes
#12957 opened Apr 15, 2025 by piDack Loading…
23
rpc : add RPC_CMD_HELLO examples ggml changes relating to the ggml tensor library for machine learning
#12955 opened Apr 15, 2025 by rgerganov Loading…
2
graph : make FA compatible with MLA + add initial Metal kernels Apple Metal https://en.wikipedia.org/wiki/Metal_(API) ggml changes relating to the ggml tensor library for machine learning Nvidia GPU Issues specific to Nvidia GPUs testing Everything test related Vulkan Issues specific to the Vulkan backend
#12953 opened Apr 15, 2025 by ggerganov Loading…
1
main : Fix Ctrl+D/newline handling examples
#12951 opened Apr 15, 2025 by danielzgtg Loading…
1
4
rpc : do not wait for response when sending RPC_CMD_SET_TENSOR ggml changes relating to the ggml tensor library for machine learning
#12943 opened Apr 14, 2025 by rgerganov • Draft
4
set b = ub when b > ub with embedding examples server
#12940 opened Apr 14, 2025 by ahmedshakill Loading…
1
server : use std::move whenever possible examples server
#12936 opened Apr 14, 2025 by ngxson Loading…
12
vulkan: enable coopmat2 FA gqa and split_k optimizations more often ggml changes relating to the ggml tensor library for machine learning testing Everything test related Vulkan Issues specific to the Vulkan backend
#12931 opened Apr 13, 2025 by jeffbolznv Loading…
gguf-py : GGUF Editor GUI - Python + Qt python python script changes
#12930 opened Apr 13, 2025 by christopherthompson81 Loading…
27
llama-bench : Add --override-tensors arg examples
#12922 opened Apr 12, 2025 by 4onen Loading…
9
mtmd : add methods to access mtmd_image_tokens examples
#12906 opened Apr 11, 2025 by ngxson Loading…
14
Get CPU model in ggml_backend_cpu_device_context on FreeBSD ggml changes relating to the ggml tensor library for machine learning
#12902 opened Apr 11, 2025 by yurivict Loading…
4
server : (experimental) vision support via libmtmd examples server
#12898 opened Apr 11, 2025 by ngxson • Draft
6 tasks
11
cuda: fix compilation error (#12893) ggml changes relating to the ggml tensor library for machine learning Nvidia GPU Issues specific to Nvidia GPUs
#12894 opened Apr 11, 2025 by lizhenneng Loading…
llama-tts : input from stdin examples
#12890 opened Apr 11, 2025 by marcoStocchi Loading…
1
llama-bench: enhance benchmark with improved token throughput measurements examples
#12874 opened Apr 10, 2025 by thevishalagarwal Loading…
11
ggml : add SSE 4.2 and x64 base variant for CPUs without AVX ggml changes relating to the ggml tensor library for machine learning
#12871 opened Apr 10, 2025 by slaren Loading…
1
opencl: fix incorrect local_size index in profiling log ggml changes relating to the ggml tensor library for machine learning
#12868 opened Apr 10, 2025 by kimminsu38oo Loading…
CANN: Add support for async operator submission Ascend NPU issues specific to Ascend NPUs ggml changes relating to the ggml tensor library for machine learning
#12864 opened Apr 10, 2025 by hipudding Loading…
@hipudding
5
sycl : implementation of reordered Q4_0 MMVQ for Intel GPUs ggml changes relating to the ggml tensor library for machine learning SYCL https://en.wikipedia.org/wiki/SYCL - GPU programming language
#12858 opened Apr 10, 2025 by Alcpz Loading…
2 of 3 tasks
14
gguf-py: byteswapping improvements python python script changes
#12851 opened Apr 9, 2025 by AlekseiNikiforovIBM Loading…
1
metal : add memory pool for temp allocs Apple Metal https://en.wikipedia.org/wiki/Metal_(API) ggml changes relating to the ggml tensor library for machine learning
#12850 opened Apr 9, 2025 by ggerganov Loading…
9 tasks done
ProTip! no:milestone will show everything without a milestone.