安装ktransformers时报错，error: subprocess-exited-with-error #1459
Description
检查清单
- 1. 我已经搜索过相关问题，但未能获得预期的帮助
- 2. 该问题在最新版本中尚未修复
- 3. 请注意，如果您提交的BUG相关 issue 缺少对应环境信息和最小可复现示例，我们将难以复现和定位问题，降低获得反馈的可能性
- 4. 如果您提出的不是bug而是问题，请在讨论区发起讨论 https://github.com/kvcache-ai/ktransformers/discussions。否则该 issue 将被关闭
- 5. 为方便社区交流，我将使用中文/英文或附上中文/英文翻译（如使用其他语言）。未附带翻译的非中文/英语内容可能会被关闭
问题描述
安装ktransformers时报错。
复现步骤
(base) root@Frostia:~# cd ./ktransformers
(base) root@Frostia:~/ktransformers# ./install.sh
Selected backend: cuda
Installing python dependencies from requirements.txt
Ignoring cpufeature: markers 'sys_platform == "win32" or sys_platform == "Windows"' don't match your environment
Collecting fire (from -r requirements-local_chat.txt (line 1))
Using cached fire-0.7.0.tar.gz (87 kB)
Preparing metadata (setup.py) ... done
Collecting transformers==4.51.3 (from -r requirements-local_chat.txt (line 2))
Using cached transformers-4.51.3-py3-none-any.whl.metadata (38 kB)
Collecting numpy (from -r requirements-local_chat.txt (line 3))
Using cached numpy-2.3.2-cp313-cp313-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl.metadata (62 kB)
Collecting torch>=2.3.0 (from -r requirements-local_chat.txt (line 4))
Using cached torch-2.7.1-cp313-cp313-manylinux_2_28_x86_64.whl.metadata (29 kB)
Requirement already satisfied: packaging in /root/miniconda3/lib/python3.13/site-packages (from -r requirements-local_chat.txt (line 5)) (24.2)
Collecting protobuf (from -r requirements-local_chat.txt (line 7))
Using cached protobuf-6.31.1-cp39-abi3-manylinux2014_x86_64.whl.metadata (593 bytes)
Collecting tiktoken (from -r requirements-local_chat.txt (line 8))
Using cached tiktoken-0.9.0-cp313-cp313-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (6.7 kB)
Collecting blobfile (from -r requirements-local_chat.txt (line 9))
Using cached blobfile-3.0.0-py3-none-any.whl.metadata (15 kB)
Collecting filelock (from transformers==4.51.3->-r requirements-local_chat.txt (line 2))
Using cached filelock-3.18.0-py3-none-any.whl.metadata (2.9 kB)
Collecting huggingface-hub<1.0,>=0.30.0 (from transformers==4.51.3->-r requirements-local_chat.txt (line 2))
Using cached huggingface_hub-0.34.1-py3-none-any.whl.metadata (14 kB)
Collecting pyyaml>=5.1 (from transformers==4.51.3->-r requirements-local_chat.txt (line 2))
Using cached PyYAML-6.0.2-cp313-cp313-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (2.1 kB)
Collecting regex!=2019.12.17 (from transformers==4.51.3->-r requirements-local_chat.txt (line 2))
Using cached regex-2024.11.6-cp313-cp313-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (40 kB)
Requirement already satisfied: requests in /root/miniconda3/lib/python3.13/site-packages (from transformers==4.51.3->-r requirements-local_chat.txt (line 2)) (2.32.4)
Collecting tokenizers<0.22,>=0.21 (from transformers==4.51.3->-r requirements-local_chat.txt (line 2))
Using cached tokenizers-0.21.2-cp39-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (6.8 kB)
Collecting safetensors>=0.4.3 (from transformers==4.51.3->-r requirements-local_chat.txt (line 2))
Using cached safetensors-0.5.3-cp38-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (3.8 kB)
Requirement already satisfied: tqdm>=4.27 in /root/miniconda3/lib/python3.13/site-packages (from transformers==4.51.3->-r requirements-local_chat.txt (line 2)) (4.67.1)
Collecting fsspec>=2023.5.0 (from huggingface-hub<1.0,>=0.30.0->transformers==4.51.3->-r requirements-local_chat.txt (line 2))
Using cached fsspec-2025.7.0-py3-none-any.whl.metadata (12 kB)
Requirement already satisfied: typing-extensions>=3.7.4.3 in /root/miniconda3/lib/python3.13/site-packages (from huggingface-hub<1.0,>=0.30.0->transformers==4.51.3->-r requirements-local_chat.txt (line 2)) (4.12.2)
Collecting hf-xet<2.0.0,>=1.1.3 (from huggingface-hub<1.0,>=0.30.0->transformers==4.51.3->-r requirements-local_chat.txt (line 2))
Using cached hf_xet-1.1.5-cp37-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (879 bytes)
Collecting termcolor (from fire->-r requirements-local_chat.txt (line 1))
Using cached termcolor-3.1.0-py3-none-any.whl.metadata (6.4 kB)
Requirement already satisfied: setuptools in /root/miniconda3/lib/python3.13/site-packages (from torch>=2.3.0->-r requirements-local_chat.txt (line 4)) (78.1.1)
Collecting sympy>=1.13.3 (from torch>=2.3.0->-r requirements-local_chat.txt (line 4))
Using cached sympy-1.14.0-py3-none-any.whl.metadata (12 kB)
Collecting networkx (from torch>=2.3.0->-r requirements-local_chat.txt (line 4))
Using cached networkx-3.5-py3-none-any.whl.metadata (6.3 kB)
Collecting jinja2 (from torch>=2.3.0->-r requirements-local_chat.txt (line 4))
Using cached jinja2-3.1.6-py3-none-any.whl.metadata (2.9 kB)
Collecting nvidia-cuda-nvrtc-cu12==12.6.77 (from torch>=2.3.0->-r requirements-local_chat.txt (line 4))
Using cached nvidia_cuda_nvrtc_cu12-12.6.77-py3-none-manylinux2014_x86_64.whl.metadata (1.5 kB)
Collecting nvidia-cuda-runtime-cu12==12.6.77 (from torch>=2.3.0->-r requirements-local_chat.txt (line 4))
Using cached nvidia_cuda_runtime_cu12-12.6.77-py3-none-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.metadata (1.5 kB)
Collecting nvidia-cuda-cupti-cu12==12.6.80 (from torch>=2.3.0->-r requirements-local_chat.txt (line 4))
Using cached nvidia_cuda_cupti_cu12-12.6.80-py3-none-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.metadata (1.6 kB)
Collecting nvidia-cudnn-cu12==9.5.1.17 (from torch>=2.3.0->-r requirements-local_chat.txt (line 4))
Using cached nvidia_cudnn_cu12-9.5.1.17-py3-none-manylinux_2_28_x86_64.whl.metadata (1.6 kB)
Collecting nvidia-cublas-cu12==12.6.4.1 (from torch>=2.3.0->-r requirements-local_chat.txt (line 4))
Using cached nvidia_cublas_cu12-12.6.4.1-py3-none-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.metadata (1.5 kB)
Collecting nvidia-cufft-cu12==11.3.0.4 (from torch>=2.3.0->-r requirements-local_chat.txt (line 4))
Using cached nvidia_cufft_cu12-11.3.0.4-py3-none-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.metadata (1.5 kB)
Collecting nvidia-curand-cu12==10.3.7.77 (from torch>=2.3.0->-r requirements-local_chat.txt (line 4))
Using cached nvidia_curand_cu12-10.3.7.77-py3-none-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.metadata (1.5 kB)
Collecting nvidia-cusolver-cu12==11.7.1.2 (from torch>=2.3.0->-r requirements-local_chat.txt (line 4))
Using cached nvidia_cusolver_cu12-11.7.1.2-py3-none-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.metadata (1.6 kB)
Collecting nvidia-cusparse-cu12==12.5.4.2 (from torch>=2.3.0->-r requirements-local_chat.txt (line 4))
Using cached nvidia_cusparse_cu12-12.5.4.2-py3-none-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.metadata (1.6 kB)
Collecting nvidia-cusparselt-cu12==0.6.3 (from torch>=2.3.0->-r requirements-local_chat.txt (line 4))
Using cached nvidia_cusparselt_cu12-0.6.3-py3-none-manylinux2014_x86_64.whl.metadata (6.8 kB)
Collecting nvidia-nccl-cu12==2.26.2 (from torch>=2.3.0->-r requirements-local_chat.txt (line 4))
Using cached nvidia_nccl_cu12-2.26.2-py3-none-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.metadata (2.0 kB)
Collecting nvidia-nvtx-cu12==12.6.77 (from torch>=2.3.0->-r requirements-local_chat.txt (line 4))
Using cached nvidia_nvtx_cu12-12.6.77-py3-none-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.metadata (1.6 kB)
Collecting nvidia-nvjitlink-cu12==12.6.85 (from torch>=2.3.0->-r requirements-local_chat.txt (line 4))
Using cached nvidia_nvjitlink_cu12-12.6.85-py3-none-manylinux2010_x86_64.manylinux_2_12_x86_64.whl.metadata (1.5 kB)
Collecting nvidia-cufile-cu12==1.11.1.6 (from torch>=2.3.0->-r requirements-local_chat.txt (line 4))
Using cached nvidia_cufile_cu12-1.11.1.6-py3-none-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.metadata (1.5 kB)
Collecting triton==3.3.1 (from torch>=2.3.0->-r requirements-local_chat.txt (line 4))
Using cached triton-3.3.1-cp313-cp313-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl.metadata (1.5 kB)
Collecting pycryptodomex>=3.8 (from blobfile->-r requirements-local_chat.txt (line 9))
Using cached pycryptodomex-3.23.0-cp37-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (3.4 kB)
Requirement already satisfied: urllib3<3,>=1.25.3 in /root/miniconda3/lib/python3.13/site-packages (from blobfile->-r requirements-local_chat.txt (line 9)) (2.5.0)
Collecting lxml>=4.9 (from blobfile->-r requirements-local_chat.txt (line 9))
Using cached lxml-6.0.0-cp313-cp313-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl.metadata (6.6 kB)
Requirement already satisfied: charset_normalizer<4,>=2 in /root/miniconda3/lib/python3.13/site-packages (from requests->transformers==4.51.3->-r requirements-local_chat.txt (line 2)) (3.3.2)
Requirement already satisfied: idna<4,>=2.5 in /root/miniconda3/lib/python3.13/site-packages (from requests->transformers==4.51.3->-r requirements-local_chat.txt (line 2)) (3.7)
Requirement already satisfied: certifi>=2017.4.17 in /root/miniconda3/lib/python3.13/site-packages (from requests->transformers==4.51.3->-r requirements-local_chat.txt (line 2)) (2025.7.14)
Collecting mpmath<1.4,>=1.1.0 (from sympy>=1.13.3->torch>=2.3.0->-r requirements-local_chat.txt (line 4))
Using cached mpmath-1.3.0-py3-none-any.whl.metadata (8.6 kB)
Collecting MarkupSafe>=2.0 (from jinja2->torch>=2.3.0->-r requirements-local_chat.txt (line 4))
Using cached MarkupSafe-3.0.2-cp313-cp313-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (4.0 kB)
Using cached transformers-4.51.3-py3-none-any.whl (10.4 MB)
Using cached huggingface_hub-0.34.1-py3-none-any.whl (558 kB)
Using cached hf_xet-1.1.5-cp37-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.1 MB)
Using cached tokenizers-0.21.2-cp39-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.1 MB)
Using cached numpy-2.3.2-cp313-cp313-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl (16.6 MB)
Downloading torch-2.7.1-cp313-cp313-manylinux_2_28_x86_64.whl (821.0 MB)
━╺━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 29.9/821.0 MB 42.7 kB/s eta 5:08:48
WARNING: Connection timed out while downloading.
WARNING: Attempting to resume incomplete download (29.9 MB/821.0 MB, attempt 1)
Resuming download torch-2.7.1-cp313-cp313-manylinux_2_28_x86_64.whl (29.9 MB/821.0 MB)
━╸━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 34.6/821.0 MB 116.1 kB/s eta 1:52:53
WARNING: Connection timed out while downloading.
WARNING: Attempting to resume incomplete download (34.6 MB/821.0 MB, attempt 2)
Resuming download torch-2.7.1-cp313-cp313-manylinux_2_28_x86_64.whl (34.6 MB/821.0 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 821.0/821.0 MB 534.0 kB/s eta 0:00:00
Downloading nvidia_cublas_cu12-12.6.4.1-py3-none-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (393.1 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 393.1/393.1 MB 576.2 kB/s eta 0:00:00
Downloading nvidia_cuda_cupti_cu12-12.6.80-py3-none-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (8.9 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 8.9/8.9 MB 580.5 kB/s eta 0:00:00
Downloading nvidia_cuda_nvrtc_cu12-12.6.77-py3-none-manylinux2014_x86_64.whl (23.7 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 23.7/23.7 MB 570.1 kB/s eta 0:00:00
Downloading nvidia_cuda_runtime_cu12-12.6.77-py3-none-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (897 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 897.7/897.7 kB 627.1 kB/s eta 0:00:00
Downloading nvidia_cudnn_cu12-9.5.1.17-py3-none-manylinux_2_28_x86_64.whl (571.0 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 571.0/571.0 MB 569.4 kB/s eta 0:00:00
Downloading nvidia_cufft_cu12-11.3.0.4-py3-none-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (200.2 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 200.2/200.2 MB 566.4 kB/s eta 0:00:00
Downloading nvidia_cufile_cu12-1.11.1.6-py3-none-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (1.1 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.1/1.1 MB 962.3 kB/s eta 0:00:00
Downloading nvidia_curand_cu12-10.3.7.77-py3-none-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (56.3 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 56.3/56.3 MB 555.0 kB/s eta 0:00:00
Downloading nvidia_cusolver_cu12-11.7.1.2-py3-none-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (158.2 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 158.2/158.2 MB 594.4 kB/s eta 0:00:00
Downloading nvidia_cusparse_cu12-12.5.4.2-py3-none-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (216.6 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 216.6/216.6 MB 583.9 kB/s eta 0:00:00
Downloading nvidia_cusparselt_cu12-0.6.3-py3-none-manylinux2014_x86_64.whl (156.8 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 156.8/156.8 MB 580.6 kB/s eta 0:00:00
Downloading nvidia_nccl_cu12-2.26.2-py3-none-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (201.3 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 201.3/201.3 MB 584.8 kB/s eta 0:00:00
Downloading nvidia_nvjitlink_cu12-12.6.85-py3-none-manylinux2010_x86_64.manylinux_2_12_x86_64.whl (19.7 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 19.7/19.7 MB 599.8 kB/s eta 0:00:00
Downloading nvidia_nvtx_cu12-12.6.77-py3-none-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (89 kB)
Downloading triton-3.3.1-cp313-cp313-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl (155.7 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 155.7/155.7 MB 562.3 kB/s eta 0:00:00
Downloading protobuf-6.31.1-cp39-abi3-manylinux2014_x86_64.whl (321 kB)
Downloading tiktoken-0.9.0-cp313-cp313-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.2 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.2/1.2 MB 936.5 kB/s eta 0:00:00
Downloading blobfile-3.0.0-py3-none-any.whl (75 kB)
Downloading filelock-3.18.0-py3-none-any.whl (16 kB)
Downloading fsspec-2025.7.0-py3-none-any.whl (199 kB)
Downloading lxml-6.0.0-cp313-cp313-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl (5.2 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 5.2/5.2 MB 643.8 kB/s eta 0:00:00
Downloading pycryptodomex-3.23.0-cp37-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.3 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.3/2.3 MB 608.5 kB/s eta 0:00:00
Downloading PyYAML-6.0.2-cp313-cp313-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (759 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 759.5/759.5 kB 506.6 kB/s eta 0:00:00
Downloading regex-2024.11.6-cp313-cp313-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (796 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 796.9/796.9 kB 1.4 MB/s eta 0:00:00
Downloading safetensors-0.5.3-cp38-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (471 kB)
Downloading sympy-1.14.0-py3-none-any.whl (6.3 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 6.3/6.3 MB 574.4 kB/s eta 0:00:00
Downloading mpmath-1.3.0-py3-none-any.whl (536 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 536.2/536.2 kB 787.2 kB/s eta 0:00:00
Downloading jinja2-3.1.6-py3-none-any.whl (134 kB)
Downloading MarkupSafe-3.0.2-cp313-cp313-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (23 kB)
Downloading networkx-3.5-py3-none-any.whl (2.0 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.0/2.0 MB 796.7 kB/s eta 0:00:00
Downloading termcolor-3.1.0-py3-none-any.whl (7.7 kB)
Building wheels for collected packages: fire
DEPRECATION: Building 'fire' using the legacy setup.py bdist_wheel mechanism, which will be removed in a future version. pip 25.3 will enforce this behaviour change. A possible replacement is to use the standardized build interface by setting the `--use-pep517` option, (possibly combined with `--no-build-isolation`), or adding a `pyproject.toml` file to the source tree of 'fire'. Discussion can be found at https://github.com/pypa/pip/issues/6334
Building wheel for fire (setup.py) ... done
Created wheel for fire: filename=fire-0.7.0-py3-none-any.whl size=114330 sha256=7a1eed374cb4c90baa1084ae632b51326d2a46f24d120a0b737da290013fdaa2
Stored in directory: /root/.cache/pip/wheels/92/61/3f/600cf4d91dac9f979f4648ca6db99ed6d9fc762abc6f06b2b5
Successfully built fire
Installing collected packages: nvidia-cusparselt-cu12, mpmath, triton, termcolor, sympy, safetensors, regex, pyyaml, pycryptodomex, protobuf, nvidia-nvtx-cu12, nvidia-nvjitlink-cu12, nvidia-nccl-cu12, nvidia-curand-cu12, nvidia-cufile-cu12, nvidia-cuda-runtime-cu12, nvidia-cuda-nvrtc-cu12, nvidia-cuda-cupti-cu12, nvidia-cublas-cu12, numpy, networkx, MarkupSafe, lxml, hf-xet, fsspec, filelock, tiktoken, nvidia-cusparse-cu12, nvidia-cufft-cu12, nvidia-cudnn-cu12, jinja2, huggingface-hub, fire, blobfile, tokenizers, nvidia-cusolver-cu12, transformers, torch
Successfully installed MarkupSafe-3.0.2 blobfile-3.0.0 filelock-3.18.0 fire-0.7.0 fsspec-2025.7.0 hf-xet-1.1.5 huggingface-hub-0.34.1 jinja2-3.1.6 lxml-6.0.0 mpmath-1.3.0 networkx-3.5 numpy-2.3.2 nvidia-cublas-cu12-12.6.4.1 nvidia-cuda-cupti-cu12-12.6.80 nvidia-cuda-nvrtc-cu12-12.6.77 nvidia-cuda-runtime-cu12-12.6.77 nvidia-cudnn-cu12-9.5.1.17 nvidia-cufft-cu12-11.3.0.4 nvidia-cufile-cu12-1.11.1.6 nvidia-curand-cu12-10.3.7.77 nvidia-cusolver-cu12-11.7.1.2 nvidia-cusparse-cu12-12.5.4.2 nvidia-cusparselt-cu12-0.6.3 nvidia-nccl-cu12-2.26.2 nvidia-nvjitlink-cu12-12.6.85 nvidia-nvtx-cu12-12.6.77 protobuf-6.31.1 pycryptodomex-3.23.0 pyyaml-6.0.2 regex-2024.11.6 safetensors-0.5.3 sympy-1.14.0 termcolor-3.1.0 tiktoken-0.9.0 tokenizers-0.21.2 torch-2.7.1 transformers-4.51.3 triton-3.3.1
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager, possibly rendering your system unusable. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv. Use the --root-user-action option if you know what you are doing and want to suppress this warning.
Requirement already satisfied: torch>=2.3.0 in /root/miniconda3/lib/python3.13/site-packages (from -r ktransformers/server/requirements.txt (line 1)) (2.7.1)
Requirement already satisfied: transformers==4.51.3 in /root/miniconda3/lib/python3.13/site-packages (from -r ktransformers/server/requirements.txt (line 2)) (4.51.3)
Collecting fastapi>=0.111.0 (from -r ktransformers/server/requirements.txt (line 3))
Downloading fastapi-0.116.1-py3-none-any.whl.metadata (28 kB)
Collecting langchain>=0.2.0 (from -r ktransformers/server/requirements.txt (line 4))
Downloading langchain-0.3.27-py3-none-any.whl.metadata (7.8 kB)
Collecting blessed>=1.20.0 (from -r ktransformers/server/requirements.txt (line 5))
Downloading blessed-1.21.0-py2.py3-none-any.whl.metadata (13 kB)
Collecting accelerate>=0.31.0 (from -r ktransformers/server/requirements.txt (line 6))
Downloading accelerate-1.9.0-py3-none-any.whl.metadata (19 kB)
Collecting sentencepiece>=0.1.97 (from -r ktransformers/server/requirements.txt (line 7))
Downloading sentencepiece-0.2.0.tar.gz (2.6 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.6/2.6 MB 110.2 kB/s eta 0:00:00
Preparing metadata (setup.py) ... done
Collecting openai (from -r ktransformers/server/requirements.txt (line 8))
Downloading openai-1.97.1-py3-none-any.whl.metadata (29 kB)
Requirement already satisfied: setuptools in /root/miniconda3/lib/python3.13/site-packages (from -r ktransformers/server/requirements.txt (line 9)) (78.1.1)
Collecting build (from -r ktransformers/server/requirements.txt (line 10))
Downloading build-1.2.2.post1-py3-none-any.whl.metadata (6.5 kB)
Collecting ninja (from -r ktransformers/server/requirements.txt (line 11))
Downloading ninja-1.11.1.4-py3-none-manylinux_2_12_x86_64.manylinux2010_x86_64.whl.metadata (5.0 kB)
Requirement already satisfied: wheel in /root/miniconda3/lib/python3.13/site-packages (from -r ktransformers/server/requirements.txt (line 12)) (0.45.1)
Collecting colorlog (from -r ktransformers/server/requirements.txt (line 13))
Downloading colorlog-6.9.0-py3-none-any.whl.metadata (10 kB)
Requirement already satisfied: fire in /root/miniconda3/lib/python3.13/site-packages (from -r ktransformers/server/requirements.txt (line 14)) (0.7.0)
Collecting zmq (from -r ktransformers/server/requirements.txt (line 15))
Downloading zmq-0.0.0.zip (2.2 kB)
Preparing metadata (setup.py) ... done
Collecting psutil (from -r ktransformers/server/requirements.txt (line 16))
Downloading psutil-7.0.0-cp36-abi3-manylinux_2_12_x86_64.manylinux2010_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (22 kB)
Requirement already satisfied: filelock in /root/miniconda3/lib/python3.13/site-packages (from transformers==4.51.3->-r ktransformers/server/requirements.txt (line 2)) (3.18.0)
Requirement already satisfied: huggingface-hub<1.0,>=0.30.0 in /root/miniconda3/lib/python3.13/site-packages (from transformers==4.51.3->-r ktransformers/server/requirements.txt (line 2)) (0.34.1)
Requirement already satisfied: numpy>=1.17 in /root/miniconda3/lib/python3.13/site-packages (from transformers==4.51.3->-r ktransformers/server/requirements.txt (line 2)) (2.3.2)
Requirement already satisfied: packaging>=20.0 in /root/miniconda3/lib/python3.13/site-packages (from transformers==4.51.3->-r ktransformers/server/requirements.txt (line 2)) (24.2)
Requirement already satisfied: pyyaml>=5.1 in /root/miniconda3/lib/python3.13/site-packages (from transformers==4.51.3->-r ktransformers/server/requirements.txt (line 2)) (6.0.2)
Requirement already satisfied: regex!=2019.12.17 in /root/miniconda3/lib/python3.13/site-packages (from transformers==4.51.3->-r ktransformers/server/requirements.txt (line 2)) (2024.11.6)
Requirement already satisfied: requests in /root/miniconda3/lib/python3.13/site-packages (from transformers==4.51.3->-r ktransformers/server/requirements.txt (line 2)) (2.32.4)
Requirement already satisfied: tokenizers<0.22,>=0.21 in /root/miniconda3/lib/python3.13/site-packages (from transformers==4.51.3->-r ktransformers/server/requirements.txt (line 2)) (0.21.2)
Requirement already satisfied: safetensors>=0.4.3 in /root/miniconda3/lib/python3.13/site-packages (from transformers==4.51.3->-r ktransformers/server/requirements.txt (line 2)) (0.5.3)
Requirement already satisfied: tqdm>=4.27 in /root/miniconda3/lib/python3.13/site-packages (from transformers==4.51.3->-r ktransformers/server/requirements.txt (line 2)) (4.67.1)
Requirement already satisfied: fsspec>=2023.5.0 in /root/miniconda3/lib/python3.13/site-packages (from huggingface-hub<1.0,>=0.30.0->transformers==4.51.3->-r ktransformers/server/requirements.txt (line 2)) (2025.7.0)
Requirement already satisfied: typing-extensions>=3.7.4.3 in /root/miniconda3/lib/python3.13/site-packages (from huggingface-hub<1.0,>=0.30.0->transformers==4.51.3->-r ktransformers/server/requirements.txt (line 2)) (4.12.2)
Requirement already satisfied: hf-xet<2.0.0,>=1.1.3 in /root/miniconda3/lib/python3.13/site-packages (from huggingface-hub<1.0,>=0.30.0->transformers==4.51.3->-r ktransformers/server/requirements.txt (line 2)) (1.1.5)
Requirement already satisfied: sympy>=1.13.3 in /root/miniconda3/lib/python3.13/site-packages (from torch>=2.3.0->-r ktransformers/server/requirements.txt (line 1)) (1.14.0)
Requirement already satisfied: networkx in /root/miniconda3/lib/python3.13/site-packages (from torch>=2.3.0->-r ktransformers/server/requirements.txt (line 1)) (3.5)
Requirement already satisfied: jinja2 in /root/miniconda3/lib/python3.13/site-packages (from torch>=2.3.0->-r ktransformers/server/requirements.txt (line 1)) (3.1.6)
Requirement already satisfied: nvidia-cuda-nvrtc-cu12==12.6.77 in /root/miniconda3/lib/python3.13/site-packages (from torch>=2.3.0->-r ktransformers/server/requirements.txt (line 1)) (12.6.77)
Requirement already satisfied: nvidia-cuda-runtime-cu12==12.6.77 in /root/miniconda3/lib/python3.13/site-packages (from torch>=2.3.0->-r ktransformers/server/requirements.txt (line 1)) (12.6.77)
Requirement already satisfied: nvidia-cuda-cupti-cu12==12.6.80 in /root/miniconda3/lib/python3.13/site-packages (from torch>=2.3.0->-r ktransformers/server/requirements.txt (line 1)) (12.6.80)
Requirement already satisfied: nvidia-cudnn-cu12==9.5.1.17 in /root/miniconda3/lib/python3.13/site-packages (from torch>=2.3.0->-r ktransformers/server/requirements.txt (line 1)) (9.5.1.17)
Requirement already satisfied: nvidia-cublas-cu12==12.6.4.1 in /root/miniconda3/lib/python3.13/site-packages (from torch>=2.3.0->-r ktransformers/server/requirements.txt (line 1)) (12.6.4.1)
Requirement already satisfied: nvidia-cufft-cu12==11.3.0.4 in /root/miniconda3/lib/python3.13/site-packages (from torch>=2.3.0->-r ktransformers/server/requirements.txt (line 1)) (11.3.0.4)
Requirement already satisfied: nvidia-curand-cu12==10.3.7.77 in /root/miniconda3/lib/python3.13/site-packages (from torch>=2.3.0->-r ktransformers/server/requirements.txt (line 1)) (10.3.7.77)
Requirement already satisfied: nvidia-cusolver-cu12==11.7.1.2 in /root/miniconda3/lib/python3.13/site-packages (from torch>=2.3.0->-r ktransformers/server/requirements.txt (line 1)) (11.7.1.2)
Requirement already satisfied: nvidia-cusparse-cu12==12.5.4.2 in /root/miniconda3/lib/python3.13/site-packages (from torch>=2.3.0->-r ktransformers/server/requirements.txt (line 1)) (12.5.4.2)
Requirement already satisfied: nvidia-cusparselt-cu12==0.6.3 in /root/miniconda3/lib/python3.13/site-packages (from torch>=2.3.0->-r ktransformers/server/requirements.txt (line 1)) (0.6.3)
Requirement already satisfied: nvidia-nccl-cu12==2.26.2 in /root/miniconda3/lib/python3.13/site-packages (from torch>=2.3.0->-r ktransformers/server/requirements.txt (line 1)) (2.26.2)
Requirement already satisfied: nvidia-nvtx-cu12==12.6.77 in /root/miniconda3/lib/python3.13/site-packages (from torch>=2.3.0->-r ktransformers/server/requirements.txt (line 1)) (12.6.77)
Requirement already satisfied: nvidia-nvjitlink-cu12==12.6.85 in /root/miniconda3/lib/python3.13/site-packages (from torch>=2.3.0->-r ktransformers/server/requirements.txt (line 1)) (12.6.85)
Requirement already satisfied: nvidia-cufile-cu12==1.11.1.6 in /root/miniconda3/lib/python3.13/site-packages (from torch>=2.3.0->-r ktransformers/server/requirements.txt (line 1)) (1.11.1.6)
Requirement already satisfied: triton==3.3.1 in /root/miniconda3/lib/python3.13/site-packages (from torch>=2.3.0->-r ktransformers/server/requirements.txt (line 1)) (3.3.1)
Collecting starlette<0.48.0,>=0.40.0 (from fastapi>=0.111.0->-r ktransformers/server/requirements.txt (line 3))
Downloading starlette-0.47.2-py3-none-any.whl.metadata (6.2 kB)
Requirement already satisfied: pydantic!=1.8,!=1.8.1,!=2.0.0,!=2.0.1,!=2.1.0,<3.0.0,>=1.7.4 in /root/miniconda3/lib/python3.13/site-packages (from fastapi>=0.111.0->-r ktransformers/server/requirements.txt (line 3)) (2.11.7)
Requirement already satisfied: annotated-types>=0.6.0 in /root/miniconda3/lib/python3.13/site-packages (from pydantic!=1.8,!=1.8.1,!=2.0.0,!=2.0.1,!=2.1.0,<3.0.0,>=1.7.4->fastapi>=0.111.0->-r ktransformers/server/requirements.txt (line 3)) (0.6.0)
Requirement already satisfied: pydantic-core==2.33.2 in /root/miniconda3/lib/python3.13/site-packages (from pydantic!=1.8,!=1.8.1,!=2.0.0,!=2.0.1,!=2.1.0,<3.0.0,>=1.7.4->fastapi>=0.111.0->-r ktransformers/server/requirements.txt (line 3)) (2.33.2)
Requirement already satisfied: typing-inspection>=0.4.0 in /root/miniconda3/lib/python3.13/site-packages (from pydantic!=1.8,!=1.8.1,!=2.0.0,!=2.0.1,!=2.1.0,<3.0.0,>=1.7.4->fastapi>=0.111.0->-r ktransformers/server/requirements.txt (line 3)) (0.4.0)
Collecting anyio<5,>=3.6.2 (from starlette<0.48.0,>=0.40.0->fastapi>=0.111.0->-r ktransformers/server/requirements.txt (line 3))
Downloading anyio-4.9.0-py3-none-any.whl.metadata (4.7 kB)
Requirement already satisfied: idna>=2.8 in /root/miniconda3/lib/python3.13/site-packages (from anyio<5,>=3.6.2->starlette<0.48.0,>=0.40.0->fastapi>=0.111.0->-r ktransformers/server/requirements.txt (line 3)) (3.7)
Collecting sniffio>=1.1 (from anyio<5,>=3.6.2->starlette<0.48.0,>=0.40.0->fastapi>=0.111.0->-r ktransformers/server/requirements.txt (line 3))
Downloading sniffio-1.3.1-py3-none-any.whl.metadata (3.9 kB)
Collecting langchain-core<1.0.0,>=0.3.72 (from langchain>=0.2.0->-r ktransformers/server/requirements.txt (line 4))
Downloading langchain_core-0.3.72-py3-none-any.whl.metadata (5.8 kB)
Collecting langchain-text-splitters<1.0.0,>=0.3.9 (from langchain>=0.2.0->-r ktransformers/server/requirements.txt (line 4))
Downloading langchain_text_splitters-0.3.9-py3-none-any.whl.metadata (1.9 kB)
Collecting langsmith>=0.1.17 (from langchain>=0.2.0->-r ktransformers/server/requirements.txt (line 4))
Downloading langsmith-0.4.8-py3-none-any.whl.metadata (15 kB)
Collecting SQLAlchemy<3,>=1.4 (from langchain>=0.2.0->-r ktransformers/server/requirements.txt (line 4))
Downloading sqlalchemy-2.0.41-cp313-cp313-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (9.6 kB)
Collecting tenacity!=8.4.0,<10.0.0,>=8.1.0 (from langchain-core<1.0.0,>=0.3.72->langchain>=0.2.0->-r ktransformers/server/requirements.txt (line 4))
Downloading tenacity-9.1.2-py3-none-any.whl.metadata (1.2 kB)
Requirement already satisfied: jsonpatch<2.0,>=1.33 in /root/miniconda3/lib/python3.13/site-packages (from langchain-core<1.0.0,>=0.3.72->langchain>=0.2.0->-r ktransformers/server/requirements.txt (line 4)) (1.33)
Requirement already satisfied: jsonpointer>=1.9 in /root/miniconda3/lib/python3.13/site-packages (from jsonpatch<2.0,>=1.33->langchain-core<1.0.0,>=0.3.72->langchain>=0.2.0->-r ktransformers/server/requirements.txt (line 4)) (2.1)
Requirement already satisfied: charset_normalizer<4,>=2 in /root/miniconda3/lib/python3.13/site-packages (from requests->transformers==4.51.3->-r ktransformers/server/requirements.txt (line 2)) (3.3.2)
Requirement already satisfied: urllib3<3,>=1.21.1 in /root/miniconda3/lib/python3.13/site-packages (from requests->transformers==4.51.3->-r ktransformers/server/requirements.txt (line 2)) (2.5.0)
Requirement already satisfied: certifi>=2017.4.17 in /root/miniconda3/lib/python3.13/site-packages (from requests->transformers==4.51.3->-r ktransformers/server/requirements.txt (line 2)) (2025.7.14)
Collecting greenlet>=1 (from SQLAlchemy<3,>=1.4->langchain>=0.2.0->-r ktransformers/server/requirements.txt (line 4))
Downloading greenlet-3.2.3-cp313-cp313-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl.metadata (4.1 kB)
Collecting wcwidth>=0.1.4 (from blessed>=1.20.0->-r ktransformers/server/requirements.txt (line 5))
Downloading wcwidth-0.2.13-py2.py3-none-any.whl.metadata (14 kB)
Requirement already satisfied: distro<2,>=1.7.0 in /root/miniconda3/lib/python3.13/site-packages (from openai->-r ktransformers/server/requirements.txt (line 8)) (1.9.0)
Collecting httpx<1,>=0.23.0 (from openai->-r ktransformers/server/requirements.txt (line 8))
Downloading httpx-0.28.1-py3-none-any.whl.metadata (7.1 kB)
Collecting jiter<1,>=0.4.0 (from openai->-r ktransformers/server/requirements.txt (line 8))
Downloading jiter-0.10.0-cp313-cp313-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (5.2 kB)
Collecting httpcore==1.* (from httpx<1,>=0.23.0->openai->-r ktransformers/server/requirements.txt (line 8))
Downloading httpcore-1.0.9-py3-none-any.whl.metadata (21 kB)
Collecting h11>=0.16 (from httpcore==1.*->httpx<1,>=0.23.0->openai->-r ktransformers/server/requirements.txt (line 8))
Downloading h11-0.16.0-py3-none-any.whl.metadata (8.3 kB)
Collecting pyproject_hooks (from build->-r ktransformers/server/requirements.txt (line 10))
Downloading pyproject_hooks-1.2.0-py3-none-any.whl.metadata (1.3 kB)
Requirement already satisfied: termcolor in /root/miniconda3/lib/python3.13/site-packages (from fire->-r ktransformers/server/requirements.txt (line 14)) (3.1.0)
Collecting pyzmq (from zmq->-r ktransformers/server/requirements.txt (line 15))
Downloading pyzmq-27.0.0-cp312-abi3-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl.metadata (6.0 kB)
Collecting orjson<4.0.0,>=3.9.14 (from langsmith>=0.1.17->langchain>=0.2.0->-r ktransformers/server/requirements.txt (line 4))
Downloading orjson-3.11.1-cp313-cp313-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (42 kB)
Collecting requests-toolbelt<2.0.0,>=1.0.0 (from langsmith>=0.1.17->langchain>=0.2.0->-r ktransformers/server/requirements.txt (line 4))
Downloading requests_toolbelt-1.0.0-py2.py3-none-any.whl.metadata (14 kB)
Requirement already satisfied: zstandard<0.24.0,>=0.23.0 in /root/miniconda3/lib/python3.13/site-packages (from langsmith>=0.1.17->langchain>=0.2.0->-r ktransformers/server/requirements.txt (line 4)) (0.23.0)
Requirement already satisfied: mpmath<1.4,>=1.1.0 in /root/miniconda3/lib/python3.13/site-packages (from sympy>=1.13.3->torch>=2.3.0->-r ktransformers/server/requirements.txt (line 1)) (1.3.0)
Requirement already satisfied: MarkupSafe>=2.0 in /root/miniconda3/lib/python3.13/site-packages (from jinja2->torch>=2.3.0->-r ktransformers/server/requirements.txt (line 1)) (3.0.2)
Downloading fastapi-0.116.1-py3-none-any.whl (95 kB)
Downloading starlette-0.47.2-py3-none-any.whl (72 kB)
Downloading anyio-4.9.0-py3-none-any.whl (100 kB)
Downloading langchain-0.3.27-py3-none-any.whl (1.0 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.0/1.0 MB 698.2 kB/s eta 0:00:00
Downloading langchain_core-0.3.72-py3-none-any.whl (442 kB)
Downloading langchain_text_splitters-0.3.9-py3-none-any.whl (33 kB)
Downloading sqlalchemy-2.0.41-cp313-cp313-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.2 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.2/3.2 MB 603.5 kB/s eta 0:00:00
Downloading tenacity-9.1.2-py3-none-any.whl (28 kB)
Downloading blessed-1.21.0-py2.py3-none-any.whl (84 kB)
Downloading accelerate-1.9.0-py3-none-any.whl (367 kB)
Downloading openai-1.97.1-py3-none-any.whl (764 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 764.4/764.4 kB 568.1 kB/s eta 0:00:00
Downloading httpx-0.28.1-py3-none-any.whl (73 kB)
Downloading httpcore-1.0.9-py3-none-any.whl (78 kB)
Downloading jiter-0.10.0-cp313-cp313-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (350 kB)
Downloading build-1.2.2.post1-py3-none-any.whl (22 kB)
Downloading ninja-1.11.1.4-py3-none-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (422 kB)
Downloading colorlog-6.9.0-py3-none-any.whl (11 kB)
Downloading psutil-7.0.0-cp36-abi3-manylinux_2_12_x86_64.manylinux2010_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (277 kB)
Downloading greenlet-3.2.3-cp313-cp313-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl (608 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 608.4/608.4 kB 371.3 kB/s eta 0:00:00
Downloading h11-0.16.0-py3-none-any.whl (37 kB)
Downloading langsmith-0.4.8-py3-none-any.whl (367 kB)
Downloading orjson-3.11.1-cp313-cp313-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (131 kB)
Downloading requests_toolbelt-1.0.0-py2.py3-none-any.whl (54 kB)
Downloading sniffio-1.3.1-py3-none-any.whl (10 kB)
Downloading wcwidth-0.2.13-py2.py3-none-any.whl (34 kB)
Downloading pyproject_hooks-1.2.0-py3-none-any.whl (10 kB)
Downloading pyzmq-27.0.0-cp312-abi3-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl (839 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 839.8/839.8 kB 966.6 kB/s eta 0:00:00
Building wheels for collected packages: sentencepiece, zmq
DEPRECATION: Building 'sentencepiece' using the legacy setup.py bdist_wheel mechanism, which will be removed in a future version. pip 25.3 will enforce this behaviour change. A possible replacement is to use the standardized build interface by setting the `--use-pep517` option, (possibly combined with `--no-build-isolation`), or adding a `pyproject.toml` file to the source tree of 'sentencepiece'. Discussion can be found at https://github.com/pypa/pip/issues/6334
Building wheel for sentencepiece (setup.py) ... done
Created wheel for sentencepiece: filename=sentencepiece-0.2.0-cp313-cp313-linux_x86_64.whl size=1283235 sha256=dc47701160ddc521d2c72468ddebd6adc0ed450889287019cb6f4df92a0f7ead
Stored in directory: /root/.cache/pip/wheels/02/3d/f0/8dbb11925fbd58340b128ae9334ae7028332d7a5751738f616
DEPRECATION: Building 'zmq' using the legacy setup.py bdist_wheel mechanism, which will be removed in a future version. pip 25.3 will enforce this behaviour change. A possible replacement is to use the standardized build interface by setting the `--use-pep517` option, (possibly combined with `--no-build-isolation`), or adding a `pyproject.toml` file to the source tree of 'zmq'. Discussion can be found at https://github.com/pypa/pip/issues/6334
Building wheel for zmq (setup.py) ... done
Created wheel for zmq: filename=zmq-0.0.0-py3-none-any.whl size=1307 sha256=3a177a499e85461a8f86647037c52f09e20d1c7c614f37a9227ee6fda0601300
Stored in directory: /root/.cache/pip/wheels/6e/50/99/9d9a15ac80ab63c153ca2bac60484e40f93900032a4e7470e5
Successfully built sentencepiece zmq
Installing collected packages: wcwidth, sentencepiece, tenacity, sniffio, pyzmq, pyproject_hooks, psutil, orjson, ninja, jiter, h11, greenlet, colorlog, blessed, zmq, SQLAlchemy, requests-toolbelt, httpcore, build, anyio, starlette, httpx, openai, langsmith, fastapi, accelerate, langchain-core, langchain-text-splitters, langchain
Successfully installed SQLAlchemy-2.0.41 accelerate-1.9.0 anyio-4.9.0 blessed-1.21.0 build-1.2.2.post1 colorlog-6.9.0 fastapi-0.116.1 greenlet-3.2.3 h11-0.16.0 httpcore-1.0.9 httpx-0.28.1 jiter-0.10.0 langchain-0.3.27 langchain-core-0.3.72 langchain-text-splitters-0.3.9 langsmith-0.4.8 ninja-1.11.1.4 openai-1.97.1 orjson-3.11.1 psutil-7.0.0 pyproject_hooks-1.2.0 pyzmq-27.0.0 requests-toolbelt-1.0.0 sentencepiece-0.2.0 sniffio-1.3.1 starlette-0.47.2 tenacity-9.1.2 wcwidth-0.2.13 zmq-0.0.0
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager, possibly rendering your system unusable. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv. Use the --root-user-action option if you know what you are doing and want to suppress this warning.
Installing ktransformers
Using pip 25.1 from /root/miniconda3/lib/python3.13/site-packages/pip (python 3.13)
Processing /root/ktransformers
Running command Preparing metadata (pyproject.toml)
cpuinfer_ext /root/ktransformers/csrc/ktransformers_ext
Using native cpu instruct
Traceback (most recent call last):
File "/root/miniconda3/lib/python3.13/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 389, in <module>
main()
~~~~^^
File "/root/miniconda3/lib/python3.13/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 373, in main
json_out["return_val"] = hook(**hook_input["kwargs"])
~~~~^^^^^^^^^^^^^^^^^^^^^^^^
File "/root/miniconda3/lib/python3.13/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 175, in prepare_metadata_for_build_wheel
return hook(metadata_directory, config_settings)
File "/root/miniconda3/lib/python3.13/site-packages/setuptools/build_meta.py", line 377, in prepare_metadata_for_build_wheel
self.run_setup()
~~~~~~~~~~~~~~^^
File "/root/miniconda3/lib/python3.13/site-packages/setuptools/build_meta.py", line 320, in run_setup
exec(code, locals())
~~~~^^^^^^^^^^^^^^^^
File "<string>", line 670, in <module>
File "<string>", line 233, in get_package_version
File "<string>", line 148, in get_cuda_bare_metal_version
File "/root/miniconda3/lib/python3.13/subprocess.py", line 472, in check_output
return run(*popenargs, stdout=PIPE, timeout=timeout, check=True,
~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
**kwargs).stdout
^^^^^^^^^
File "/root/miniconda3/lib/python3.13/subprocess.py", line 554, in run
with Popen(*popenargs, **kwargs) as process:
~~~~~^^^^^^^^^^^^^^^^^^^^^^
File "/root/miniconda3/lib/python3.13/subprocess.py", line 1039, in __init__
self._execute_child(args, executable, preexec_fn, close_fds,
~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
pass_fds, cwd, env,
^^^^^^^^^^^^^^^^^^^
...<5 lines>...
gid, gids, uid, umask,
^^^^^^^^^^^^^^^^^^^^^^
start_new_session, process_group)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/root/miniconda3/lib/python3.13/subprocess.py", line 1972, in _execute_child
raise child_exception_type(errno_num, err_msg, err_filename)
FileNotFoundError: [Errno 2] No such file or directory: ':/usr/local/cuda/bin/nvcc'
error: subprocess-exited-with-error
× Preparing metadata (pyproject.toml) did not run successfully.
│ exit code: 1
╰─> See above for output.
note: This error originates from a subprocess, and is likely not a problem with pip.
full command: /root/miniconda3/bin/python3.13 /root/miniconda3/lib/python3.13/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py prepare_metadata_for_build_wheel /tmp/tmpgm0hg0yc
cwd: /root/ktransformers
Preparing metadata (pyproject.toml) ... error
error: metadata-generation-failed
× Encountered error while generating package metadata.
╰─> See above for output.
note: This is an issue with the package mentioned above, not pip.
hint: See above for details.
(base) root@Frostia:~/ktransformers#
环境信息
windows11系统，使用wsl运行Ubuntu 22.04.05。
配置：
CPU：7800X3D
内存：48G ddr5 3600MHz *4
主板：B650M
显卡：4080S+2080Ti *2
