install error

[shiwanghua]

Reminder

• I have read the above rules and searched the existing issues.

System Info

(swh-llama) (llamafactory) ➜  ktransformers-0.5.0.post1 git:(master) ✗ ls
archive  book.toml  doc  docker  kt-kernel  kt-sft  LICENSE  README.md  README_ZH.md  third_party  version.py
(swh-llama) (llamafactory) ➜  ktransformers-0.5.0.post1 git:(master) ✗ cd kt-kernel
(swh-llama) (llamafactory) ➜  kt-kernel git:(master) ✗ pip install .
Looking in indexes: https://pypi.tuna.tsinghua.edu.cn/simple
Processing /home/ubisec/swh/codes/ktransformers-0.5.0.post1/kt-kernel
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Preparing metadata (pyproject.toml) ... done
Requirement already satisfied: torch>=2.0.0 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from kt-kernel==0.5.0.post1) (2.8.0)
Requirement already satisfied: safetensors>=0.4.0 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from kt-kernel==0.5.0.post1) (0.5.3)
Collecting compressed-tensors>=0.7.0 (from kt-kernel==0.5.0.post1)
  Downloading https://pypi.tuna.tsinghua.edu.cn/packages/0b/b5/61ac2563c62490922b603c09113a083fd74af3630ec3931e769484d6dcb5/compressed_tensors-0.13.0-py3-none-any.whl (192 kB)
Requirement already satisfied: numpy>=1.24.0 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from kt-kernel==0.5.0.post1) (1.26.4)
Requirement already satisfied: triton>=2.0.0 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from kt-kernel==0.5.0.post1) (3.4.0)
Collecting gguf>=0.17.0 (from kt-kernel==0.5.0.post1)
  Using cached https://pypi.tuna.tsinghua.edu.cn/packages/fc/31/6a93a887617ee7deeaa602ca3d02d1c12a6cb8a742a695de5d128f5fa46a/gguf-0.17.1-py3-none-any.whl (96 kB)
Requirement already satisfied: typer>=0.9.0 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from typer[all]>=0.9.0->kt-kernel==0.5.0.post1) (0.16.1)
Requirement already satisfied: rich>=13.0.0 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from kt-kernel==0.5.0.post1) (14.1.0)
Requirement already satisfied: pyyaml>=6.0 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from kt-kernel==0.5.0.post1) (6.0.2)
Requirement already satisfied: httpx>=0.25.0 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from kt-kernel==0.5.0.post1) (0.28.1)
Requirement already satisfied: packaging>=23.0 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from kt-kernel==0.5.0.post1) (25.0)
Collecting black>=25.9.0 (from kt-kernel==0.5.0.post1)
  Using cached https://pypi.tuna.tsinghua.edu.cn/packages/12/80/e187079df1ea4c12a0c63282ddd8b81d5107db6d642f7d7b75a6bcd6fc21/black-25.12.0-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl (1.8 MB)
Requirement already satisfied: click>=8.0.0 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from black>=25.9.0->kt-kernel==0.5.0.post1) (8.2.1)
Collecting mypy-extensions>=0.4.3 (from black>=25.9.0->kt-kernel==0.5.0.post1)
  Using cached https://pypi.tuna.tsinghua.edu.cn/packages/79/7b/2c79738432f5c924bef5071f933bcc9efd0473bac3b4aa584a6f7c1c8df8/mypy_extensions-1.1.0-py3-none-any.whl (5.0 kB)
Collecting pathspec>=0.9.0 (from black>=25.9.0->kt-kernel==0.5.0.post1)
  Using cached https://pypi.tuna.tsinghua.edu.cn/packages/32/2b/121e912bd60eebd623f873fd090de0e84f322972ab25a7f9044c056804ed/pathspec-1.0.3-py3-none-any.whl (55 kB)
Requirement already satisfied: platformdirs>=2 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from black>=25.9.0->kt-kernel==0.5.0.post1) (4.3.8)
Collecting pytokens>=0.3.0 (from black>=25.9.0->kt-kernel==0.5.0.post1)
  Using cached https://pypi.tuna.tsinghua.edu.cn/packages/84/25/d9db8be44e205a124f6c98bc0324b2bb149b7431c53877fc6d1038dddaf5/pytokens-0.3.0-py3-none-any.whl (12 kB)
Requirement already satisfied: transformers in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from compressed-tensors>=0.7.0->kt-kernel==0.5.0.post1) (4.57.1)
Requirement already satisfied: pydantic>=2.0 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from compressed-tensors>=0.7.0->kt-kernel==0.5.0.post1) (2.10.6)
Collecting loguru (from compressed-tensors>=0.7.0->kt-kernel==0.5.0.post1)
  Using cached https://pypi.tuna.tsinghua.edu.cn/packages/0c/29/0348de65b8cc732daa3e33e67806420b2ae89bdce2b04af740289c5c6c8c/loguru-0.7.3-py3-none-any.whl (61 kB)
Requirement already satisfied: tqdm>=4.27 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from gguf>=0.17.0->kt-kernel==0.5.0.post1) (4.67.1)
Requirement already satisfied: anyio in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from httpx>=0.25.0->kt-kernel==0.5.0.post1) (4.10.0)
Requirement already satisfied: certifi in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from httpx>=0.25.0->kt-kernel==0.5.0.post1) (2025.8.3)
Requirement already satisfied: httpcore==1.* in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from httpx>=0.25.0->kt-kernel==0.5.0.post1) (1.0.9)
Requirement already satisfied: idna in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from httpx>=0.25.0->kt-kernel==0.5.0.post1) (3.10)
Requirement already satisfied: h11>=0.16 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from httpcore==1.*->httpx>=0.25.0->kt-kernel==0.5.0.post1) (0.16.0)
Requirement already satisfied: annotated-types>=0.6.0 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from pydantic>=2.0->compressed-tensors>=0.7.0->kt-kernel==0.5.0.post1) (0.7.0)
Requirement already satisfied: pydantic-core==2.27.2 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from pydantic>=2.0->compressed-tensors>=0.7.0->kt-kernel==0.5.0.post1) (2.27.2)
Requirement already satisfied: typing-extensions>=4.12.2 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from pydantic>=2.0->compressed-tensors>=0.7.0->kt-kernel==0.5.0.post1) (4.14.1)
Requirement already satisfied: markdown-it-py>=2.2.0 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from rich>=13.0.0->kt-kernel==0.5.0.post1) (4.0.0)
Requirement already satisfied: pygments<3.0.0,>=2.13.0 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from rich>=13.0.0->kt-kernel==0.5.0.post1) (2.19.2)
Requirement already satisfied: mdurl~=0.1 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from markdown-it-py>=2.2.0->rich>=13.0.0->kt-kernel==0.5.0.post1) (0.1.2)
Requirement already satisfied: filelock in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from torch>=2.0.0->kt-kernel==0.5.0.post1) (3.19.1)
Requirement already satisfied: sympy>=1.13.3 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from torch>=2.0.0->kt-kernel==0.5.0.post1) (1.14.0)
Requirement already satisfied: networkx in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from torch>=2.0.0->kt-kernel==0.5.0.post1) (3.5)
Requirement already satisfied: jinja2 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from torch>=2.0.0->kt-kernel==0.5.0.post1) (3.1.6)
Requirement already satisfied: fsspec in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from torch>=2.0.0->kt-kernel==0.5.0.post1) (2025.3.0)
Requirement already satisfied: nvidia-cuda-nvrtc-cu12==12.8.93 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from torch>=2.0.0->kt-kernel==0.5.0.post1) (12.8.93)
Requirement already satisfied: nvidia-cuda-runtime-cu12==12.8.90 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from torch>=2.0.0->kt-kernel==0.5.0.post1) (12.8.90)
Requirement already satisfied: nvidia-cuda-cupti-cu12==12.8.90 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from torch>=2.0.0->kt-kernel==0.5.0.post1) (12.8.90)
Requirement already satisfied: nvidia-cudnn-cu12==9.10.2.21 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from torch>=2.0.0->kt-kernel==0.5.0.post1) (9.10.2.21)
Requirement already satisfied: nvidia-cublas-cu12==12.8.4.1 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from torch>=2.0.0->kt-kernel==0.5.0.post1) (12.8.4.1)
Requirement already satisfied: nvidia-cufft-cu12==11.3.3.83 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from torch>=2.0.0->kt-kernel==0.5.0.post1) (11.3.3.83)
Requirement already satisfied: nvidia-curand-cu12==10.3.9.90 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from torch>=2.0.0->kt-kernel==0.5.0.post1) (10.3.9.90)
Requirement already satisfied: nvidia-cusolver-cu12==11.7.3.90 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from torch>=2.0.0->kt-kernel==0.5.0.post1) (11.7.3.90)
Requirement already satisfied: nvidia-cusparse-cu12==12.5.8.93 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from torch>=2.0.0->kt-kernel==0.5.0.post1) (12.5.8.93)
Requirement already satisfied: nvidia-cusparselt-cu12==0.7.1 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from torch>=2.0.0->kt-kernel==0.5.0.post1) (0.7.1)
Requirement already satisfied: nvidia-nccl-cu12==2.27.3 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from torch>=2.0.0->kt-kernel==0.5.0.post1) (2.27.3)
Requirement already satisfied: nvidia-nvtx-cu12==12.8.90 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from torch>=2.0.0->kt-kernel==0.5.0.post1) (12.8.90)
Requirement already satisfied: nvidia-nvjitlink-cu12==12.8.93 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from torch>=2.0.0->kt-kernel==0.5.0.post1) (12.8.93)
Requirement already satisfied: nvidia-cufile-cu12==1.13.1.3 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from torch>=2.0.0->kt-kernel==0.5.0.post1) (1.13.1.3)
Requirement already satisfied: setuptools>=40.8.0 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from triton>=2.0.0->kt-kernel==0.5.0.post1) (80.9.0)
Requirement already satisfied: mpmath<1.4,>=1.1.0 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from sympy>=1.13.3->torch>=2.0.0->kt-kernel==0.5.0.post1) (1.3.0)
Requirement already satisfied: shellingham>=1.3.0 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from typer>=0.9.0->typer[all]>=0.9.0->kt-kernel==0.5.0.post1) (1.5.4)
WARNING: typer 0.16.1 does not provide the extra 'all'
Requirement already satisfied: sniffio>=1.1 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from anyio->httpx>=0.25.0->kt-kernel==0.5.0.post1) (1.3.1)
Requirement already satisfied: MarkupSafe>=2.0 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from jinja2->torch>=2.0.0->kt-kernel==0.5.0.post1) (3.0.2)
Requirement already satisfied: huggingface-hub<1.0,>=0.34.0 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from transformers->compressed-tensors>=0.7.0->kt-kernel==0.5.0.post1) (0.34.4)
Requirement already satisfied: regex!=2019.12.17 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from transformers->compressed-tensors>=0.7.0->kt-kernel==0.5.0.post1) (2025.7.34)
Requirement already satisfied: requests in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from transformers->compressed-tensors>=0.7.0->kt-kernel==0.5.0.post1) (2.32.5)
Requirement already satisfied: tokenizers<=0.23.0,>=0.22.0 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from transformers->compressed-tensors>=0.7.0->kt-kernel==0.5.0.post1) (0.22.2)
Requirement already satisfied: hf-xet<2.0.0,>=1.1.3 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from huggingface-hub<1.0,>=0.34.0->transformers->compressed-tensors>=0.7.0->kt-kernel==0.5.0.post1) (1.1.8)
Requirement already satisfied: charset_normalizer<4,>=2 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from requests->transformers->compressed-tensors>=0.7.0->kt-kernel==0.5.0.post1) (3.4.3)
Requirement already satisfied: urllib3<3,>=1.21.1 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from requests->transformers->compressed-tensors>=0.7.0->kt-kernel==0.5.0.post1) (2.5.0)
Building wheels for collected packages: kt-kernel
  Building wheel for kt-kernel (pyproject.toml) ... error
  error: subprocess-exited-with-error
  
  × Building wheel for kt-kernel (pyproject.toml) did not run successfully.
  │ exit code: 1
  ╰─> [234 lines of output]
      /tmp/pip-build-env-gvfyf0jf/overlay/lib/python3.11/site-packages/setuptools/config/_apply_pyprojecttoml.py:82: SetuptoolsWarning: `license` overwritten by `pyproject.toml`
        corresp(dist, value, root_dir)
      -- Version: 0.5.0.post1
      -- Building kt-kernel (CPU-only multi-variant)
      running bdist_wheel
      running build
      running build_py
      creating build/lib.linux-x86_64-cpython-311/kt_kernel
      copying python/_cpu_detect.py -> build/lib.linux-x86_64-cpython-311/kt_kernel
      copying python/__init__.py -> build/lib.linux-x86_64-cpython-311/kt_kernel
      copying python/experts.py -> build/lib.linux-x86_64-cpython-311/kt_kernel
      copying python/experts_base.py -> build/lib.linux-x86_64-cpython-311/kt_kernel
      creating build/lib.linux-x86_64-cpython-311/kt_kernel/utils
      copying python/utils/__init__.py -> build/lib.linux-x86_64-cpython-311/kt_kernel/utils
      copying python/utils/moe_kernel.py -> build/lib.linux-x86_64-cpython-311/kt_kernel/utils
      copying python/utils/amx.py -> build/lib.linux-x86_64-cpython-311/kt_kernel/utils
      copying python/utils/loader.py -> build/lib.linux-x86_64-cpython-311/kt_kernel/utils
      copying python/utils/llamafile.py -> build/lib.linux-x86_64-cpython-311/kt_kernel/utils
      creating build/lib.linux-x86_64-cpython-311/kt_kernel/cli
      copying python/cli/main.py -> build/lib.linux-x86_64-cpython-311/kt_kernel/cli
      copying python/cli/__init__.py -> build/lib.linux-x86_64-cpython-311/kt_kernel/cli
      copying python/cli/i18n.py -> build/lib.linux-x86_64-cpython-311/kt_kernel/cli
      creating build/lib.linux-x86_64-cpython-311/kt_kernel/cli/commands
      copying python/cli/commands/bench.py -> build/lib.linux-x86_64-cpython-311/kt_kernel/cli/commands
      copying python/cli/commands/chat.py -> build/lib.linux-x86_64-cpython-311/kt_kernel/cli/commands
      copying python/cli/commands/version.py -> build/lib.linux-x86_64-cpython-311/kt_kernel/cli/commands
      copying python/cli/commands/sft.py -> build/lib.linux-x86_64-cpython-311/kt_kernel/cli/commands
      copying python/cli/commands/__init__.py -> build/lib.linux-x86_64-cpython-311/kt_kernel/cli/commands
      copying python/cli/commands/quant.py -> build/lib.linux-x86_64-cpython-311/kt_kernel/cli/commands
      copying python/cli/commands/doctor.py -> build/lib.linux-x86_64-cpython-311/kt_kernel/cli/commands
      copying python/cli/commands/config.py -> build/lib.linux-x86_64-cpython-311/kt_kernel/cli/commands
      copying python/cli/commands/model.py -> build/lib.linux-x86_64-cpython-311/kt_kernel/cli/commands
      copying python/cli/commands/run.py -> build/lib.linux-x86_64-cpython-311/kt_kernel/cli/commands
      creating build/lib.linux-x86_64-cpython-311/kt_kernel/cli/config
      copying python/cli/config/settings.py -> build/lib.linux-x86_64-cpython-311/kt_kernel/cli/config
      copying python/cli/config/__init__.py -> build/lib.linux-x86_64-cpython-311/kt_kernel/cli/config
      creating build/lib.linux-x86_64-cpython-311/kt_kernel/cli/utils
      copying python/cli/utils/model_registry.py -> build/lib.linux-x86_64-cpython-311/kt_kernel/cli/utils
      copying python/cli/utils/sglang_checker.py -> build/lib.linux-x86_64-cpython-311/kt_kernel/cli/utils
      copying python/cli/utils/__init__.py -> build/lib.linux-x86_64-cpython-311/kt_kernel/cli/utils
      copying python/cli/utils/environment.py -> build/lib.linux-x86_64-cpython-311/kt_kernel/cli/utils
      copying python/cli/utils/console.py -> build/lib.linux-x86_64-cpython-311/kt_kernel/cli/utils
      creating build/lib.linux-x86_64-cpython-311/kt_kernel/cli/completions
      copying python/cli/completions/__init__.py -> build/lib.linux-x86_64-cpython-311/kt_kernel/cli/completions
      running egg_info
      writing kt_kernel.egg-info/PKG-INFO
      writing dependency_links to kt_kernel.egg-info/dependency_links.txt
      writing entry points to kt_kernel.egg-info/entry_points.txt
      writing requirements to kt_kernel.egg-info/requires.txt
      writing top-level names to kt_kernel.egg-info/top_level.txt
      reading manifest file 'kt_kernel.egg-info/SOURCES.txt'
      reading manifest template 'MANIFEST.in'
      warning: no files found matching 'LICENSE'
      warning: no files found matching '*.in' under directory 'cmake'
      warning: no files found matching '*.hpp' under directory 'cpu_backend'
      warning: no files found matching '*.c' under directory 'cpu_backend'
      warning: no files found matching '*.cc' under directory 'cpu_backend'
      warning: no files found matching '*.c' under directory 'operators'
      warning: no files found matching '*.cc' under directory 'operators'
      warning: no files found matching '*' under directory 'third_party'
      warning: no previously-included files matching '*.pyc' found anywhere in distribution
      warning: no previously-included files matching '*.pyo' found anywhere in distribution
      warning: no previously-included files matching '__pycache__' found anywhere in distribution
      warning: no previously-included files matching '.git*' found anywhere in distribution
      warning: no previously-included files matching '*.so' found anywhere in distribution
      warning: no previously-included files matching '*.o' found anywhere in distribution
      warning: no previously-included files matching '*.a' found anywhere in distribution
      warning: no previously-included files matching 'build' found anywhere in distribution
      warning: no previously-included files matching 'dist' found anywhere in distribution
      warning: no previously-included files matching '*.egg-info' found anywhere in distribution
      writing manifest file 'kt_kernel.egg-info/SOURCES.txt'
      copying python/cli/completions/_kt -> build/lib.linux-x86_64-cpython-311/kt_kernel/cli/completions
      copying python/cli/completions/kt-completion.bash -> build/lib.linux-x86_64-cpython-311/kt_kernel/cli/completions
      copying python/cli/completions/kt.fish -> build/lib.linux-x86_64-cpython-311/kt_kernel/cli/completions
      running build_ext
      -- The C compiler identification is GNU 10.5.0
      -- The CXX compiler identification is GNU 10.5.0
      -- Detecting C compiler ABI info
      -- Detecting C compiler ABI info - done
      -- Check for working C compiler: /usr/bin/cc - skipped
      -- Detecting C compile features
      -- Detecting C compile features - done
      -- Detecting CXX compiler ABI info
      -- Detecting CXX compiler ABI info - done
      -- Check for working CXX compiler: /usr/bin/c++ - skipped
      -- Detecting CXX compile features
      -- Detecting CXX compile features - done
      -- Detected git worktree at /home/ubisec; installing hooks from kt-kernel/.githooks
      -- Found OpenMP_C: -fopenmp (found version "4.5")
      -- Found OpenMP_CXX: -fopenmp (found version "4.5")
      -- Found OpenMP: TRUE (found version "4.5")
      -- CMAKE_CXX_FLAGS:  -O3 -ffast-math
      -- CMAKE_SYSTEM_PROCESSOR: x86_64
      -- x86 detected
      -- AVX512 extensions: F=ON, BF16=, VNNI=ON, VBMI=ON
      -- ARCH_FLAGS: -mfma;-mavx;-mavx2;-march=native;-mavx512f;-mavx512bw;-mavx512dq;-mfma;-mf16c;-msse3;-mavx512vbmi;-mavx512vnni;-mf16c
      CMake Error at CMakeLists.txt:402 (add_subdirectory):
        The source directory
      
          /home/ubisec/swh/codes/ktransformers-0.5.0.post1/third_party/pybind11
      
        does not contain a CMakeLists.txt file.
      
      
      CMake Error at CMakeLists.txt:403 (add_subdirectory):
        The source directory
      
          /home/ubisec/swh/codes/ktransformers-0.5.0.post1/third_party/llama.cpp
      
        does not contain a CMakeLists.txt file.
      
      
      -- CUDA detected
      -- Found CUDAToolkit: /usr/local/cuda-12.5/targets/x86_64-linux/include (found version "12.5.82")
      -- Performing Test CMAKE_HAVE_LIBC_PTHREAD
      -- Performing Test CMAKE_HAVE_LIBC_PTHREAD - Success
      -- Found Threads: TRUE
      -- enabling CUDA
      -- The CUDA compiler identification is NVIDIA 12.5.82 with host compiler GNU 10.5.0
      -- Detecting CUDA compiler ABI info
      -- Detecting CUDA compiler ABI info - done
      -- Check for working CUDA compiler: /usr/local/cuda-12.5/bin/nvcc - skipped
      -- Detecting CUDA compile features
      -- Detecting CUDA compile features - done
      -- CUDA architectures (user): 80;86;89;90
      -- CUDA compiler: /usr/local/cuda-12.5/bin/nvcc
      -- CUDA toolkit: 12.5.82
      -- CUDA flags:  -O3 --use_fast_math --expt-relaxed-constexpr
      -- SOURCE_DIR7:
      CMake Warning at CMakeLists.txt:529 (message):
        ONLY for developer: clang-format not found.  Please install clang-format
        (>=18) or pass -DCLANG_FORMAT_BIN=/full/path and reconfigure.
      
      
      -- Found PkgConfig: /usr/bin/pkg-config (found version "0.29.2")
      -- Checking for one of the modules 'hwloc'
      CMake Error at /tmp/pip-build-env-gvfyf0jf/overlay/lib/python3.11/site-packages/cmake/data/share/cmake-4.2/Modules/FindPkgConfig.cmake:1203 (message):
        None of the required 'hwloc' found
      Call Stack (most recent call first):
        CMakeLists.txt:573 (pkg_search_module)
      
      
      CMake Error at CMakeLists.txt:589 (pybind11_add_module):
        Unknown CMake command "pybind11_add_module".
      
      
      -- Configuring incomplete, errors occurred!
      -- CPUINFER_USE_CUDA not set; auto-detected CUDA toolkit: YES
      Detected CPU info: {'vendor': 'intel', 'arch': 'x86_64', 'features': {'AVX512', 'AVX512_VNNI', 'AVX512_VBMI', 'AVX2', 'AVX512_VPOPCNTDQ'}, 'raw': {'flags': {'avx512vbmi', 'intel_ppin', 'ept', 'rdtscp', 'aperfmperf', 'vaes', 'dtes64', 'lm', 'mba', '3dnowprefetch', 'xtpr', 'ept_ad', 'ds_cpl', 'avx512bw', 'bts', 'adx', 'nx', 'dtherm', 'avx512_vpopcntdq', 'invpcid_single', 'cpuid_fault', 'est', 'clwb', 'mmx', 'xsaves', 'rep_good', 'pbe', 'ibrs', 'pclmulqdq', 'avx512_bitalg', 'avx2', 'pat', 'intel_pt', 'ida', 'vpid', 'tsc', 'syscall', 'flush_l1d', 'sse4_2', 'avx', 'ibpb', 'erms', 'cqm_llc', 'acpi', 'cqm_occup_llc', 'sse2', 'pae', 'vpclmulqdq', 'pdcm', 'tm2', 'ht', 'ssse3', 'cpuid', 'cmov', 'fxsr', 'ss', 'clflush', 'nopl', 'fma', 'rdrand', 'pse', 'xgetbv1', 'pebs', 'xsave', 'invpcid', 'x2apic', 'avx512_vnni', 'pni', 'arat', 'avx512vl', 'avx512f', 'sdbg', 'ssbd', 'rdt_a', 'pdpe1gb', 'la57', 'ibrs_enhanced', 'msr', 'xsaveopt', 'sse4_1', 'popcnt', 'clflushopt', 'movbe', 'bmi1', 'avx512cd', 'cqm_mbm_local', 'pln', 'mce', 'arch_perfmon', 'fsgsbase', 'sha_ni', 'constant_tsc', 'arch_capabilities', 'fpu', 'vnmi', 'xtopology', 'pge', 'ospke', 'tm', 'abm', 'avx512_vbmi2', 'mtrr', 'lahf_lm', 'cx16', 'cqm', 'bmi2', 'pku', 'aes', 'fsrm', 'rdseed', 'tsc_deadline_timer', 'pts', 'vmx', 'tme', 'rdpid', 'smep', 'pconfig', 'vme', 'art', 'smx', 'cqm_mbm_total', 'xsavec', 'mca', 'f16c', 'tsc_adjust', 'nonstop_tsc', 'pse36', 'dca', 'avx512dq', 'stibp', 'sse', 'tpr_shadow', 'dts', 'apic', 'de', 'epb', 'pcid', 'cx8', 'md_clear', 'flexpriority', 'gfni', 'umip', 'avx512ifma', 'sep', 'wbnoinvd', 'split_lock_detect', 'cat_l3', 'smap'}}}
      -- Enabling AMX/AVX512 umbrella (-DKTRANSFORMERS_CPU_USE_AMX_AVX512=ON)
      -- AVX512_VNNI detected; enabling (-DLLAMA_AVX512_VNNI=ON)
      -- AVX512_VBMI detected; enabling (-DLLAMA_AVX512_VBMI=ON)
      -- AVX512 extensions enabled; also enabling base AVX512F (-DLLAMA_AVX512=ON)
      -- CPU detection: vendor=intel arch=x86_64 features=['AVX2', 'AVX512', 'AVX512_VBMI', 'AVX512_VNNI', 'AVX512_VPOPCNTDQ']
      -- Enabling CUDA backend (-DKTRANSFORMERS_USE_CUDA=ON)
      -- Auto-detected nvcc: /usr/local/cuda-12.5/bin/nvcc (adding -DCMAKE_CUDA_COMPILER)
      -- Set CUDA architectures: 80;86;89;90
      -- CMake configure args:
          -DCMAKE_LIBRARY_OUTPUT_DIRECTORY=/home/ubisec/swh/codes/ktransformers-0.5.0.post1/kt-kernel/build/lib.linux-x86_64-cpython-311/kt_kernel/
          -DPYTHON_EXECUTABLE=/home/ubisec/miniconda3/envs/swh-llama/bin/python3.11
          -DCMAKE_BUILD_TYPE=Release
          -DLLAMA_NATIVE=ON
          -DKTRANSFORMERS_CPU_USE_AMX_AVX512=ON
          -DLLAMA_AVX512_VNNI=ON
          -DLLAMA_AVX512_VBMI=ON
          -DLLAMA_AVX512=ON
          -DKTRANSFORMERS_USE_CUDA=ON
          -DCMAKE_CUDA_COMPILER=/usr/local/cuda-12.5/bin/nvcc
          -DCMAKE_CUDA_ARCHITECTURES=80;86;89;90
      Traceback (most recent call last):
        File "/home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 389, in <module>
          main()
        File "/home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 373, in main
          json_out["return_val"] = hook(**hook_input["kwargs"])
                                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "/home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 280, in build_wheel
          return _build_backend().build_wheel(
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "/tmp/pip-build-env-gvfyf0jf/overlay/lib/python3.11/site-packages/setuptools/build_meta.py", line 435, in build_wheel
          return _build(['bdist_wheel', '--dist-info-dir', str(metadata_directory)])
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "/tmp/pip-build-env-gvfyf0jf/overlay/lib/python3.11/site-packages/setuptools/build_meta.py", line 423, in _build
          return self._build_with_temp_dir(
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "/tmp/pip-build-env-gvfyf0jf/overlay/lib/python3.11/site-packages/setuptools/build_meta.py", line 404, in _build_with_temp_dir
          self.run_setup()
        File "/tmp/pip-build-env-gvfyf0jf/overlay/lib/python3.11/site-packages/setuptools/build_meta.py", line 317, in run_setup
          exec(code, locals())
        File "<string>", line 723, in <module>
        File "/tmp/pip-build-env-gvfyf0jf/overlay/lib/python3.11/site-packages/setuptools/__init__.py", line 115, in setup
          return distutils.core.setup(**attrs)
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "/tmp/pip-build-env-gvfyf0jf/overlay/lib/python3.11/site-packages/setuptools/_distutils/core.py", line 186, in setup
          return run_commands(dist)
                 ^^^^^^^^^^^^^^^^^^
        File "/tmp/pip-build-env-gvfyf0jf/overlay/lib/python3.11/site-packages/setuptools/_distutils/core.py", line 202, in run_commands
          dist.run_commands()
        File "/tmp/pip-build-env-gvfyf0jf/overlay/lib/python3.11/site-packages/setuptools/_distutils/dist.py", line 1002, in run_commands
          self.run_command(cmd)
        File "/tmp/pip-build-env-gvfyf0jf/overlay/lib/python3.11/site-packages/setuptools/dist.py", line 1102, in run_command
          super().run_command(command)
        File "/tmp/pip-build-env-gvfyf0jf/overlay/lib/python3.11/site-packages/setuptools/_distutils/dist.py", line 1021, in run_command
          cmd_obj.run()
        File "/tmp/pip-build-env-gvfyf0jf/overlay/lib/python3.11/site-packages/setuptools/command/bdist_wheel.py", line 370, in run
          self.run_command("build")
        File "/tmp/pip-build-env-gvfyf0jf/overlay/lib/python3.11/site-packages/setuptools/_distutils/cmd.py", line 357, in run_command
          self.distribution.run_command(command)
        File "/tmp/pip-build-env-gvfyf0jf/overlay/lib/python3.11/site-packages/setuptools/dist.py", line 1102, in run_command
          super().run_command(command)
        File "/tmp/pip-build-env-gvfyf0jf/overlay/lib/python3.11/site-packages/setuptools/_distutils/dist.py", line 1021, in run_command
          cmd_obj.run()
        File "/tmp/pip-build-env-gvfyf0jf/overlay/lib/python3.11/site-packages/setuptools/_distutils/command/build.py", line 135, in run
          self.run_command(cmd_name)
        File "/tmp/pip-build-env-gvfyf0jf/overlay/lib/python3.11/site-packages/setuptools/_distutils/cmd.py", line 357, in run_command
          self.distribution.run_command(command)
        File "/tmp/pip-build-env-gvfyf0jf/overlay/lib/python3.11/site-packages/setuptools/dist.py", line 1102, in run_command
          super().run_command(command)
        File "/tmp/pip-build-env-gvfyf0jf/overlay/lib/python3.11/site-packages/setuptools/_distutils/dist.py", line 1021, in run_command
          cmd_obj.run()
        File "<string>", line 150, in run
        File "/tmp/pip-build-env-gvfyf0jf/overlay/lib/python3.11/site-packages/setuptools/command/build_ext.py", line 96, in run
          _build_ext.run(self)
        File "/tmp/pip-build-env-gvfyf0jf/overlay/lib/python3.11/site-packages/setuptools/_distutils/command/build_ext.py", line 368, in run
          self.build_extensions()
        File "/tmp/pip-build-env-gvfyf0jf/overlay/lib/python3.11/site-packages/setuptools/_distutils/command/build_ext.py", line 484, in build_extensions
          self._build_extensions_serial()
        File "/tmp/pip-build-env-gvfyf0jf/overlay/lib/python3.11/site-packages/setuptools/_distutils/command/build_ext.py", line 510, in _build_extensions_serial
          self.build_extension(ext)
        File "<string>", line 256, in build_extension
        File "<string>", line 439, in _build_single_variant
        File "<string>", line 664, in _build_single_variant_impl
        File "/home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/subprocess.py", line 571, in run
          raise CalledProcessError(retcode, process.args,
      subprocess.CalledProcessError: Command '['cmake', '/home/ubisec/swh/codes/ktransformers-0.5.0.post1/kt-kernel', '-DCMAKE_LIBRARY_OUTPUT_DIRECTORY=/home/ubisec/swh/codes/ktransformers-0.5.0.post1/kt-kernel/build/lib.linux-x86_64-cpython-311/kt_kernel/', '-DPYTHON_EXECUTABLE=/home/ubisec/miniconda3/envs/swh-llama/bin/python3.11', '-DCMAKE_BUILD_TYPE=Release', '-DLLAMA_NATIVE=ON', '-DKTRANSFORMERS_CPU_USE_AMX_AVX512=ON', '-DLLAMA_AVX512_VNNI=ON', '-DLLAMA_AVX512_VBMI=ON', '-DLLAMA_AVX512=ON', '-DKTRANSFORMERS_USE_CUDA=ON', '-DCMAKE_CUDA_COMPILER=/usr/local/cuda-12.5/bin/nvcc', '-DCMAKE_CUDA_ARCHITECTURES=80;86;89;90']' returned non-zero exit status 1.

Reproduction

Put your message here.

Others

No response

[ErvinXie]

please git submodule init --recursive

[shiwanghua]

(swh-llama) (llamafactory) ➜  kt-kernel git:(master) ✗ git submodule init --recursive
usage: git submodule [--quiet] [--cached]
   or: git submodule [--quiet] add [-b <branch>] [-f|--force] [--name <name>] [--reference <repository>] [--] <repository> [<path>]
   or: git submodule [--quiet] status [--cached] [--recursive] [--] [<path>...]
   or: git submodule [--quiet] init [--] [<path>...]
   or: git submodule [--quiet] deinit [-f|--force] (--all| [--] <path>...)
   or: git submodule [--quiet] update [--init] [--remote] [-N|--no-fetch] [-f|--force] [--checkout|--merge|--rebase] [--[no-]recommend-shallow] [--reference <repository>] [--recursive] [--[no-]single-branch] [--] [<path>...]
   or: git submodule [--quiet] set-branch (--default|--branch <branch>) [--] <path>
   or: git submodule [--quiet] set-url [--] <path> <newurl>
   or: git submodule [--quiet] summary [--cached|--files] [--summary-limit <n>] [commit] [--] [<path>...]
   or: git submodule [--quiet] foreach [--recursive] <command>
   or: git submodule [--quiet] sync [--recursive] [--] [<path>...]
   or: git submodule [--quiet] absorbgitdirs [--] [<path>...]
(swh-llama) (llamafactory) ➜  kt-kernel git:(master) ✗ cd ..
(swh-llama) (llamafactory) ➜  ktransformers-0.5.0.post1 git:(master) ✗ git submodule init --recursive
usage: git submodule [--quiet] [--cached]
   or: git submodule [--quiet] add [-b <branch>] [-f|--force] [--name <name>] [--reference <repository>] [--] <repository> [<path>]
   or: git submodule [--quiet] status [--cached] [--recursive] [--] [<path>...]
   or: git submodule [--quiet] init [--] [<path>...]
   or: git submodule [--quiet] deinit [-f|--force] (--all| [--] <path>...)
   or: git submodule [--quiet] update [--init] [--remote] [-N|--no-fetch] [-f|--force] [--checkout|--merge|--rebase] [--[no-]recommend-shallow] [--reference <repository>] [--recursive] [--[no-]single-branch] [--] [<path>...]
   or: git submodule [--quiet] set-branch (--default|--branch <branch>) [--] <path>
   or: git submodule [--quiet] set-url [--] <path> <newurl>
   or: git submodule [--quiet] summary [--cached|--files] [--summary-limit <n>] [commit] [--] [<path>...]
   or: git submodule [--quiet] foreach [--recursive] <command>
   or: git submodule [--quiet] sync [--recursive] [--] [<path>...]
   or: git submodule [--quiet] absorbgitdirs [--] [<path>...]

please git submodule init --recursive

[shiwanghua]

git submodule update --init --recursive
still error:

git submodule update --init --recursive
(swh-llama) (llamafactory) ➜  ktransformers-0.5.0.post1 git:(master) ✗ 
(swh-llama) (llamafactory) ➜  ktransformers-0.5.0.post1 git:(master) ✗ pip install .                          
ERROR: Directory '.' is not installable. Neither 'setup.py' nor 'pyproject.toml' found.
(swh-llama) (llamafactory) ➜  ktransformers-0.5.0.post1 git:(master) ✗ cd kt-kernel 
(swh-llama) (llamafactory) ➜  kt-kernel git:(master) ✗ pip install .
Looking in indexes: https://pypi.tuna.tsinghua.edu.cn/simple
Processing /home/ubisec/swh/codes/ktransformers-0.5.0.post1/kt-kernel
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Preparing metadata (pyproject.toml) ... done
Requirement already satisfied: torch>=2.0.0 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from kt-kernel==0.5.0.post1) (2.9.1)
Requirement already satisfied: safetensors>=0.4.0 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from kt-kernel==0.5.0.post1) (0.5.3)
Collecting compressed-tensors>=0.7.0 (from kt-kernel==0.5.0.post1)
  Using cached https://pypi.tuna.tsinghua.edu.cn/packages/0b/b5/61ac2563c62490922b603c09113a083fd74af3630ec3931e769484d6dcb5/compressed_tensors-0.13.0-py3-none-any.whl (192 kB)
Requirement already satisfied: numpy>=1.24.0 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from kt-kernel==0.5.0.post1) (2.4.1)
Requirement already satisfied: triton>=2.0.0 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from kt-kernel==0.5.0.post1) (3.5.1)
Collecting gguf>=0.17.0 (from kt-kernel==0.5.0.post1)
  Using cached https://pypi.tuna.tsinghua.edu.cn/packages/fc/31/6a93a887617ee7deeaa602ca3d02d1c12a6cb8a742a695de5d128f5fa46a/gguf-0.17.1-py3-none-any.whl (96 kB)
Requirement already satisfied: typer>=0.9.0 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from typer[all]>=0.9.0->kt-kernel==0.5.0.post1) (0.16.1)
Requirement already satisfied: rich>=13.0.0 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from kt-kernel==0.5.0.post1) (14.1.0)
Requirement already satisfied: pyyaml>=6.0 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from kt-kernel==0.5.0.post1) (6.0.2)
Requirement already satisfied: httpx>=0.25.0 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from kt-kernel==0.5.0.post1) (0.28.1)
Requirement already satisfied: packaging>=23.0 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from kt-kernel==0.5.0.post1) (25.0)
Collecting black>=25.9.0 (from kt-kernel==0.5.0.post1)
  Using cached https://pypi.tuna.tsinghua.edu.cn/packages/12/80/e187079df1ea4c12a0c63282ddd8b81d5107db6d642f7d7b75a6bcd6fc21/black-25.12.0-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl (1.8 MB)
Requirement already satisfied: click>=8.0.0 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from black>=25.9.0->kt-kernel==0.5.0.post1) (8.2.1)
Collecting mypy-extensions>=0.4.3 (from black>=25.9.0->kt-kernel==0.5.0.post1)
  Using cached https://pypi.tuna.tsinghua.edu.cn/packages/79/7b/2c79738432f5c924bef5071f933bcc9efd0473bac3b4aa584a6f7c1c8df8/mypy_extensions-1.1.0-py3-none-any.whl (5.0 kB)
Collecting pathspec>=0.9.0 (from black>=25.9.0->kt-kernel==0.5.0.post1)
  Using cached https://pypi.tuna.tsinghua.edu.cn/packages/32/2b/121e912bd60eebd623f873fd090de0e84f322972ab25a7f9044c056804ed/pathspec-1.0.3-py3-none-any.whl (55 kB)
Requirement already satisfied: platformdirs>=2 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from black>=25.9.0->kt-kernel==0.5.0.post1) (4.3.8)
Collecting pytokens>=0.3.0 (from black>=25.9.0->kt-kernel==0.5.0.post1)
  Using cached https://pypi.tuna.tsinghua.edu.cn/packages/84/25/d9db8be44e205a124f6c98bc0324b2bb149b7431c53877fc6d1038dddaf5/pytokens-0.3.0-py3-none-any.whl (12 kB)
Requirement already satisfied: transformers in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from compressed-tensors>=0.7.0->kt-kernel==0.5.0.post1) (4.57.1)
Requirement already satisfied: pydantic>=2.0 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from compressed-tensors>=0.7.0->kt-kernel==0.5.0.post1) (2.10.6)
Collecting loguru (from compressed-tensors>=0.7.0->kt-kernel==0.5.0.post1)
  Using cached https://pypi.tuna.tsinghua.edu.cn/packages/0c/29/0348de65b8cc732daa3e33e67806420b2ae89bdce2b04af740289c5c6c8c/loguru-0.7.3-py3-none-any.whl (61 kB)
Requirement already satisfied: tqdm>=4.27 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from gguf>=0.17.0->kt-kernel==0.5.0.post1) (4.67.1)
Requirement already satisfied: anyio in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from httpx>=0.25.0->kt-kernel==0.5.0.post1) (4.10.0)
Requirement already satisfied: certifi in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from httpx>=0.25.0->kt-kernel==0.5.0.post1) (2025.8.3)
Requirement already satisfied: httpcore==1.* in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from httpx>=0.25.0->kt-kernel==0.5.0.post1) (1.0.9)
Requirement already satisfied: idna in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from httpx>=0.25.0->kt-kernel==0.5.0.post1) (3.10)
Requirement already satisfied: h11>=0.16 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from httpcore==1.*->httpx>=0.25.0->kt-kernel==0.5.0.post1) (0.16.0)
Requirement already satisfied: annotated-types>=0.6.0 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from pydantic>=2.0->compressed-tensors>=0.7.0->kt-kernel==0.5.0.post1) (0.7.0)
Requirement already satisfied: pydantic-core==2.27.2 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from pydantic>=2.0->compressed-tensors>=0.7.0->kt-kernel==0.5.0.post1) (2.27.2)
Requirement already satisfied: typing-extensions>=4.12.2 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from pydantic>=2.0->compressed-tensors>=0.7.0->kt-kernel==0.5.0.post1) (4.15.0)
Requirement already satisfied: markdown-it-py>=2.2.0 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from rich>=13.0.0->kt-kernel==0.5.0.post1) (4.0.0)
Requirement already satisfied: pygments<3.0.0,>=2.13.0 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from rich>=13.0.0->kt-kernel==0.5.0.post1) (2.19.2)
Requirement already satisfied: mdurl~=0.1 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from markdown-it-py>=2.2.0->rich>=13.0.0->kt-kernel==0.5.0.post1) (0.1.2)
Requirement already satisfied: filelock in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from torch>=2.0.0->kt-kernel==0.5.0.post1) (3.20.3)
Requirement already satisfied: sympy>=1.13.3 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from torch>=2.0.0->kt-kernel==0.5.0.post1) (1.14.0)
Requirement already satisfied: networkx>=2.5.1 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from torch>=2.0.0->kt-kernel==0.5.0.post1) (3.6.1)
Requirement already satisfied: jinja2 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from torch>=2.0.0->kt-kernel==0.5.0.post1) (3.1.6)
Requirement already satisfied: fsspec>=0.8.5 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from torch>=2.0.0->kt-kernel==0.5.0.post1) (2026.1.0)
Requirement already satisfied: nvidia-cuda-nvrtc-cu12==12.8.93 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from torch>=2.0.0->kt-kernel==0.5.0.post1) (12.8.93)
Requirement already satisfied: nvidia-cuda-runtime-cu12==12.8.90 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from torch>=2.0.0->kt-kernel==0.5.0.post1) (12.8.90)
Requirement already satisfied: nvidia-cuda-cupti-cu12==12.8.90 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from torch>=2.0.0->kt-kernel==0.5.0.post1) (12.8.90)
Requirement already satisfied: nvidia-cudnn-cu12==9.10.2.21 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from torch>=2.0.0->kt-kernel==0.5.0.post1) (9.10.2.21)
Requirement already satisfied: nvidia-cublas-cu12==12.8.4.1 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from torch>=2.0.0->kt-kernel==0.5.0.post1) (12.8.4.1)
Requirement already satisfied: nvidia-cufft-cu12==11.3.3.83 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from torch>=2.0.0->kt-kernel==0.5.0.post1) (11.3.3.83)
Requirement already satisfied: nvidia-curand-cu12==10.3.9.90 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from torch>=2.0.0->kt-kernel==0.5.0.post1) (10.3.9.90)
Requirement already satisfied: nvidia-cusolver-cu12==11.7.3.90 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from torch>=2.0.0->kt-kernel==0.5.0.post1) (11.7.3.90)
Requirement already satisfied: nvidia-cusparse-cu12==12.5.8.93 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from torch>=2.0.0->kt-kernel==0.5.0.post1) (12.5.8.93)
Requirement already satisfied: nvidia-cusparselt-cu12==0.7.1 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from torch>=2.0.0->kt-kernel==0.5.0.post1) (0.7.1)
Requirement already satisfied: nvidia-nccl-cu12==2.27.5 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from torch>=2.0.0->kt-kernel==0.5.0.post1) (2.27.5)
Requirement already satisfied: nvidia-nvshmem-cu12==3.3.20 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from torch>=2.0.0->kt-kernel==0.5.0.post1) (3.3.20)
Requirement already satisfied: nvidia-nvtx-cu12==12.8.90 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from torch>=2.0.0->kt-kernel==0.5.0.post1) (12.8.90)
Requirement already satisfied: nvidia-nvjitlink-cu12==12.8.93 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from torch>=2.0.0->kt-kernel==0.5.0.post1) (12.8.93)
Requirement already satisfied: nvidia-cufile-cu12==1.13.1.3 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from torch>=2.0.0->kt-kernel==0.5.0.post1) (1.13.1.3)
Requirement already satisfied: mpmath<1.4,>=1.1.0 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from sympy>=1.13.3->torch>=2.0.0->kt-kernel==0.5.0.post1) (1.3.0)
Requirement already satisfied: shellingham>=1.3.0 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from typer>=0.9.0->typer[all]>=0.9.0->kt-kernel==0.5.0.post1) (1.5.4)
WARNING: typer 0.16.1 does not provide the extra 'all'
Requirement already satisfied: sniffio>=1.1 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from anyio->httpx>=0.25.0->kt-kernel==0.5.0.post1) (1.3.1)
Requirement already satisfied: MarkupSafe>=2.0 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from jinja2->torch>=2.0.0->kt-kernel==0.5.0.post1) (3.0.3)
Requirement already satisfied: huggingface-hub<1.0,>=0.34.0 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from transformers->compressed-tensors>=0.7.0->kt-kernel==0.5.0.post1) (0.34.4)
Requirement already satisfied: regex!=2019.12.17 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from transformers->compressed-tensors>=0.7.0->kt-kernel==0.5.0.post1) (2025.7.34)
Requirement already satisfied: requests in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from transformers->compressed-tensors>=0.7.0->kt-kernel==0.5.0.post1) (2.32.5)
Requirement already satisfied: tokenizers<=0.23.0,>=0.22.0 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from transformers->compressed-tensors>=0.7.0->kt-kernel==0.5.0.post1) (0.22.2)
Requirement already satisfied: hf-xet<2.0.0,>=1.1.3 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from huggingface-hub<1.0,>=0.34.0->transformers->compressed-tensors>=0.7.0->kt-kernel==0.5.0.post1) (1.1.8)
Requirement already satisfied: charset_normalizer<4,>=2 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from requests->transformers->compressed-tensors>=0.7.0->kt-kernel==0.5.0.post1) (3.4.3)
Requirement already satisfied: urllib3<3,>=1.21.1 in /home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages (from requests->transformers->compressed-tensors>=0.7.0->kt-kernel==0.5.0.post1) (2.5.0)
Building wheels for collected packages: kt-kernel
  Building wheel for kt-kernel (pyproject.toml) ... error
  error: subprocess-exited-with-error
  
  × Building wheel for kt-kernel (pyproject.toml) did not run successfully.
  │ exit code: 1
  ╰─> [227 lines of output]
      /tmp/pip-build-env-3y2p3i4y/overlay/lib/python3.11/site-packages/setuptools/config/_apply_pyprojecttoml.py:82: SetuptoolsWarning: `license` overwritten by `pyproject.toml`
        corresp(dist, value, root_dir)
      -- Version: 0.5.0.post1
      -- Building kt-kernel (CPU-only multi-variant)
      running bdist_wheel
      running build
      running build_py
      copying python/_cpu_detect.py -> build/lib.linux-x86_64-cpython-311/kt_kernel
      copying python/__init__.py -> build/lib.linux-x86_64-cpython-311/kt_kernel
      copying python/experts.py -> build/lib.linux-x86_64-cpython-311/kt_kernel
      copying python/experts_base.py -> build/lib.linux-x86_64-cpython-311/kt_kernel
      copying python/utils/__init__.py -> build/lib.linux-x86_64-cpython-311/kt_kernel/utils
      copying python/utils/moe_kernel.py -> build/lib.linux-x86_64-cpython-311/kt_kernel/utils
      copying python/utils/amx.py -> build/lib.linux-x86_64-cpython-311/kt_kernel/utils
      copying python/utils/loader.py -> build/lib.linux-x86_64-cpython-311/kt_kernel/utils
      copying python/utils/llamafile.py -> build/lib.linux-x86_64-cpython-311/kt_kernel/utils
      copying python/cli/main.py -> build/lib.linux-x86_64-cpython-311/kt_kernel/cli
      copying python/cli/__init__.py -> build/lib.linux-x86_64-cpython-311/kt_kernel/cli
      copying python/cli/i18n.py -> build/lib.linux-x86_64-cpython-311/kt_kernel/cli
      copying python/cli/commands/bench.py -> build/lib.linux-x86_64-cpython-311/kt_kernel/cli/commands
      copying python/cli/commands/chat.py -> build/lib.linux-x86_64-cpython-311/kt_kernel/cli/commands
      copying python/cli/commands/version.py -> build/lib.linux-x86_64-cpython-311/kt_kernel/cli/commands
      copying python/cli/commands/sft.py -> build/lib.linux-x86_64-cpython-311/kt_kernel/cli/commands
      copying python/cli/commands/__init__.py -> build/lib.linux-x86_64-cpython-311/kt_kernel/cli/commands
      copying python/cli/commands/quant.py -> build/lib.linux-x86_64-cpython-311/kt_kernel/cli/commands
      copying python/cli/commands/doctor.py -> build/lib.linux-x86_64-cpython-311/kt_kernel/cli/commands
      copying python/cli/commands/config.py -> build/lib.linux-x86_64-cpython-311/kt_kernel/cli/commands
      copying python/cli/commands/model.py -> build/lib.linux-x86_64-cpython-311/kt_kernel/cli/commands
      copying python/cli/commands/run.py -> build/lib.linux-x86_64-cpython-311/kt_kernel/cli/commands
      copying python/cli/config/settings.py -> build/lib.linux-x86_64-cpython-311/kt_kernel/cli/config
      copying python/cli/config/__init__.py -> build/lib.linux-x86_64-cpython-311/kt_kernel/cli/config
      copying python/cli/utils/model_registry.py -> build/lib.linux-x86_64-cpython-311/kt_kernel/cli/utils
      copying python/cli/utils/sglang_checker.py -> build/lib.linux-x86_64-cpython-311/kt_kernel/cli/utils
      copying python/cli/utils/__init__.py -> build/lib.linux-x86_64-cpython-311/kt_kernel/cli/utils
      copying python/cli/utils/environment.py -> build/lib.linux-x86_64-cpython-311/kt_kernel/cli/utils
      copying python/cli/utils/console.py -> build/lib.linux-x86_64-cpython-311/kt_kernel/cli/utils
      copying python/cli/completions/__init__.py -> build/lib.linux-x86_64-cpython-311/kt_kernel/cli/completions
      running egg_info
      writing kt_kernel.egg-info/PKG-INFO
      writing dependency_links to kt_kernel.egg-info/dependency_links.txt
      writing entry points to kt_kernel.egg-info/entry_points.txt
      writing requirements to kt_kernel.egg-info/requires.txt
      writing top-level names to kt_kernel.egg-info/top_level.txt
      reading manifest file 'kt_kernel.egg-info/SOURCES.txt'
      reading manifest template 'MANIFEST.in'
      warning: no files found matching 'LICENSE'
      warning: no files found matching '*.in' under directory 'cmake'
      warning: no files found matching '*.hpp' under directory 'cpu_backend'
      warning: no files found matching '*.c' under directory 'cpu_backend'
      warning: no files found matching '*.cc' under directory 'cpu_backend'
      warning: no files found matching '*.c' under directory 'operators'
      warning: no files found matching '*.cc' under directory 'operators'
      warning: no files found matching '*' under directory 'third_party'
      warning: no previously-included files matching '*.pyc' found anywhere in distribution
      warning: no previously-included files matching '*.pyo' found anywhere in distribution
      warning: no previously-included files matching '__pycache__' found anywhere in distribution
      warning: no previously-included files matching '.git*' found anywhere in distribution
      warning: no previously-included files matching '*.so' found anywhere in distribution
      warning: no previously-included files matching '*.o' found anywhere in distribution
      warning: no previously-included files matching '*.a' found anywhere in distribution
      warning: no previously-included files matching 'build' found anywhere in distribution
      warning: no previously-included files matching 'dist' found anywhere in distribution
      warning: no previously-included files matching '*.egg-info' found anywhere in distribution
      writing manifest file 'kt_kernel.egg-info/SOURCES.txt'
      copying python/cli/completions/_kt -> build/lib.linux-x86_64-cpython-311/kt_kernel/cli/completions
      copying python/cli/completions/kt-completion.bash -> build/lib.linux-x86_64-cpython-311/kt_kernel/cli/completions
      copying python/cli/completions/kt.fish -> build/lib.linux-x86_64-cpython-311/kt_kernel/cli/completions
      running build_ext
      -- The C compiler identification is GNU 10.5.0
      -- The CXX compiler identification is GNU 10.5.0
      -- Detecting C compiler ABI info
      -- Detecting C compiler ABI info - done
      -- Check for working C compiler: /usr/bin/cc - skipped
      -- Detecting C compile features
      -- Detecting C compile features - done
      -- Detecting CXX compiler ABI info
      -- Detecting CXX compiler ABI info - done
      -- Check for working CXX compiler: /usr/bin/c++ - skipped
      -- Detecting CXX compile features
      -- Detecting CXX compile features - done
      -- Detected git worktree at /home/ubisec; installing hooks from kt-kernel/.githooks
      -- Found OpenMP_C: -fopenmp (found version "4.5")
      -- Found OpenMP_CXX: -fopenmp (found version "4.5")
      -- Found OpenMP: TRUE (found version "4.5")
      -- CMAKE_CXX_FLAGS:  -O3 -ffast-math
      -- CMAKE_SYSTEM_PROCESSOR: x86_64
      -- x86 detected
      -- AVX512 extensions: F=ON, BF16=, VNNI=ON, VBMI=ON
      -- ARCH_FLAGS: -mfma;-mavx;-mavx2;-march=native;-mavx512f;-mavx512bw;-mavx512dq;-mfma;-mf16c;-msse3;-mavx512vbmi;-mavx512vnni;-mf16c
      CMake Error at CMakeLists.txt:402 (add_subdirectory):
        The source directory
      
          /home/ubisec/swh/codes/ktransformers-0.5.0.post1/third_party/pybind11
      
        does not contain a CMakeLists.txt file.
      
      
      CMake Error at CMakeLists.txt:403 (add_subdirectory):
        The source directory
      
          /home/ubisec/swh/codes/ktransformers-0.5.0.post1/third_party/llama.cpp
      
        does not contain a CMakeLists.txt file.
      
      
      -- CUDA detected
      -- Found CUDAToolkit: /usr/local/cuda-12.5/targets/x86_64-linux/include (found version "12.5.82")
      -- Performing Test CMAKE_HAVE_LIBC_PTHREAD
      -- Performing Test CMAKE_HAVE_LIBC_PTHREAD - Success
      -- Found Threads: TRUE
      -- enabling CUDA
      -- The CUDA compiler identification is NVIDIA 12.5.82 with host compiler GNU 10.5.0
      -- Detecting CUDA compiler ABI info
      -- Detecting CUDA compiler ABI info - done
      -- Check for working CUDA compiler: /usr/local/cuda-12.5/bin/nvcc - skipped
      -- Detecting CUDA compile features
      -- Detecting CUDA compile features - done
      -- CUDA architectures (user): 80;86;89;90
      -- CUDA compiler: /usr/local/cuda-12.5/bin/nvcc
      -- CUDA toolkit: 12.5.82
      -- CUDA flags:  -O3 --use_fast_math --expt-relaxed-constexpr
      -- SOURCE_DIR7:
      CMake Warning at CMakeLists.txt:529 (message):
        ONLY for developer: clang-format not found.  Please install clang-format
        (>=18) or pass -DCLANG_FORMAT_BIN=/full/path and reconfigure.
      
      
      -- Found PkgConfig: /usr/bin/pkg-config (found version "0.29.2")
      -- Checking for one of the modules 'hwloc'
      CMake Error at /tmp/pip-build-env-3y2p3i4y/overlay/lib/python3.11/site-packages/cmake/data/share/cmake-4.2/Modules/FindPkgConfig.cmake:1203 (message):
        None of the required 'hwloc' found
      Call Stack (most recent call first):
        CMakeLists.txt:573 (pkg_search_module)
      
      
      CMake Error at CMakeLists.txt:589 (pybind11_add_module):
        Unknown CMake command "pybind11_add_module".
      
      
      -- Configuring incomplete, errors occurred!
      -- CPUINFER_USE_CUDA not set; auto-detected CUDA toolkit: YES
      Detected CPU info: {'vendor': 'intel', 'arch': 'x86_64', 'features': {'AVX2', 'AVX512_VPOPCNTDQ', 'AVX512_VNNI', 'AVX512_VBMI', 'AVX512'}, 'raw': {'flags': {'aperfmperf', 'invpcid_single', 'avx512bw', 'avx2', 'rep_good', 'bts', 'sse4_2', 'ida', 'sse4_1', 'ept_ad', 'cat_l3', 'pse', 'fpu', 'f16c', 'bmi1', 'apic', 'x2apic', 'xsaves', 'avx512_vnni', 'ht', 'mce', 'ibrs', 'xsaveopt', 'avx512dq', 'mtrr', 'smep', 'xtopology', 'flexpriority', 'xsavec', 'avx512_vpopcntdq', 'pconfig', 'cx16', 'cqm_mbm_local', 'avx', 'msr', 'ibpb', 'de', 'tme', 'rdtscp', 'xtpr', 'split_lock_detect', 'cqm_llc', 'sse', 'wbnoinvd', 'avx512vbmi', 'cx8', 'mmx', 'syscall', 'cpuid', 'avx512_vbmi2', 'cqm_occup_llc', 'art', 'pge', 'sse2', 'lahf_lm', 'fsgsbase', 'aes', 'avx512vl', 'pdpe1gb', 'mca', 'constant_tsc', 'cpuid_fault', 'tpr_shadow', 'arat', 'vaes', 'md_clear', 'smap', 'pni', 'tm2', 'cqm', 'avx512cd', 'fsrm', 'fma', 'pat', 'popcnt', 'ss', 'mba', 'tsc', 'xgetbv1', 'est', 'abm', 'flush_l1d', 'smx', 'vnmi', 'intel_pt', 'movbe', 'pclmulqdq', 'sep', 'adx', 'nx', 'clwb', 'invpcid', 'dtes64', 'stibp', 'arch_capabilities', 'arch_perfmon', 'clflushopt', 'cqm_mbm_total', 'nonstop_tsc', 'intel_ppin', 'rdseed', 'tsc_adjust', '3dnowprefetch', 'fxsr', 'ssbd', 'vme', 'pdcm', 'la57', 'ibrs_enhanced', 'ospke', 'tm', 'pcid', 'bmi2', 'acpi', 'pku', 'dca', 'pts', 'epb', 'xsave', 'sdbg', 'dts', 'lm', 'avx512_bitalg', 'tsc_deadline_timer', 'vpid', 'rdrand', 'avx512ifma', 'clflush', 'pse36', 'pae', 'vpclmulqdq', 'cmov', 'nopl', 'pebs', 'gfni', 'ssse3', 'rdt_a', 'pbe', 'umip', 'ept', 'erms', 'avx512f', 'vmx', 'rdpid', 'ds_cpl', 'sha_ni', 'dtherm', 'pln'}}}
      -- Enabling AMX/AVX512 umbrella (-DKTRANSFORMERS_CPU_USE_AMX_AVX512=ON)
      -- AVX512_VNNI detected; enabling (-DLLAMA_AVX512_VNNI=ON)
      -- AVX512_VBMI detected; enabling (-DLLAMA_AVX512_VBMI=ON)
      -- AVX512 extensions enabled; also enabling base AVX512F (-DLLAMA_AVX512=ON)
      -- CPU detection: vendor=intel arch=x86_64 features=['AVX2', 'AVX512', 'AVX512_VBMI', 'AVX512_VNNI', 'AVX512_VPOPCNTDQ']
      -- Enabling CUDA backend (-DKTRANSFORMERS_USE_CUDA=ON)
      -- Auto-detected nvcc: /usr/local/cuda-12.5/bin/nvcc (adding -DCMAKE_CUDA_COMPILER)
      -- Set CUDA architectures: 80;86;89;90
      -- CMake configure args:
          -DCMAKE_LIBRARY_OUTPUT_DIRECTORY=/home/ubisec/swh/codes/ktransformers-0.5.0.post1/kt-kernel/build/lib.linux-x86_64-cpython-311/kt_kernel/
          -DPYTHON_EXECUTABLE=/home/ubisec/miniconda3/envs/swh-llama/bin/python3.11
          -DCMAKE_BUILD_TYPE=Release
          -DLLAMA_NATIVE=ON
          -DKTRANSFORMERS_CPU_USE_AMX_AVX512=ON
          -DLLAMA_AVX512_VNNI=ON
          -DLLAMA_AVX512_VBMI=ON
          -DLLAMA_AVX512=ON
          -DKTRANSFORMERS_USE_CUDA=ON
          -DCMAKE_CUDA_COMPILER=/usr/local/cuda-12.5/bin/nvcc
          -DCMAKE_CUDA_ARCHITECTURES=80;86;89;90
      Traceback (most recent call last):
        File "/home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 389, in <module>
          main()
        File "/home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 373, in main
          json_out["return_val"] = hook(**hook_input["kwargs"])
                                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "/home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 280, in build_wheel
          return _build_backend().build_wheel(
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "/tmp/pip-build-env-3y2p3i4y/overlay/lib/python3.11/site-packages/setuptools/build_meta.py", line 435, in build_wheel
          return _build(['bdist_wheel', '--dist-info-dir', str(metadata_directory)])
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "/tmp/pip-build-env-3y2p3i4y/overlay/lib/python3.11/site-packages/setuptools/build_meta.py", line 423, in _build
          return self._build_with_temp_dir(
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "/tmp/pip-build-env-3y2p3i4y/overlay/lib/python3.11/site-packages/setuptools/build_meta.py", line 404, in _build_with_temp_dir
          self.run_setup()
        File "/tmp/pip-build-env-3y2p3i4y/overlay/lib/python3.11/site-packages/setuptools/build_meta.py", line 317, in run_setup
          exec(code, locals())
        File "<string>", line 723, in <module>
        File "/tmp/pip-build-env-3y2p3i4y/overlay/lib/python3.11/site-packages/setuptools/__init__.py", line 115, in setup
          return distutils.core.setup(**attrs)
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "/tmp/pip-build-env-3y2p3i4y/overlay/lib/python3.11/site-packages/setuptools/_distutils/core.py", line 186, in setup
          return run_commands(dist)
                 ^^^^^^^^^^^^^^^^^^
        File "/tmp/pip-build-env-3y2p3i4y/overlay/lib/python3.11/site-packages/setuptools/_distutils/core.py", line 202, in run_commands
          dist.run_commands()
        File "/tmp/pip-build-env-3y2p3i4y/overlay/lib/python3.11/site-packages/setuptools/_distutils/dist.py", line 1002, in run_commands
          self.run_command(cmd)
        File "/tmp/pip-build-env-3y2p3i4y/overlay/lib/python3.11/site-packages/setuptools/dist.py", line 1102, in run_command
          super().run_command(command)
        File "/tmp/pip-build-env-3y2p3i4y/overlay/lib/python3.11/site-packages/setuptools/_distutils/dist.py", line 1021, in run_command
          cmd_obj.run()
        File "/tmp/pip-build-env-3y2p3i4y/overlay/lib/python3.11/site-packages/setuptools/command/bdist_wheel.py", line 370, in run
          self.run_command("build")
        File "/tmp/pip-build-env-3y2p3i4y/overlay/lib/python3.11/site-packages/setuptools/_distutils/cmd.py", line 357, in run_command
          self.distribution.run_command(command)
        File "/tmp/pip-build-env-3y2p3i4y/overlay/lib/python3.11/site-packages/setuptools/dist.py", line 1102, in run_command
          super().run_command(command)
        File "/tmp/pip-build-env-3y2p3i4y/overlay/lib/python3.11/site-packages/setuptools/_distutils/dist.py", line 1021, in run_command
          cmd_obj.run()
        File "/tmp/pip-build-env-3y2p3i4y/overlay/lib/python3.11/site-packages/setuptools/_distutils/command/build.py", line 135, in run
          self.run_command(cmd_name)
        File "/tmp/pip-build-env-3y2p3i4y/overlay/lib/python3.11/site-packages/setuptools/_distutils/cmd.py", line 357, in run_command
          self.distribution.run_command(command)
        File "/tmp/pip-build-env-3y2p3i4y/overlay/lib/python3.11/site-packages/setuptools/dist.py", line 1102, in run_command
          super().run_command(command)
        File "/tmp/pip-build-env-3y2p3i4y/overlay/lib/python3.11/site-packages/setuptools/_distutils/dist.py", line 1021, in run_command
          cmd_obj.run()
        File "<string>", line 150, in run
        File "/tmp/pip-build-env-3y2p3i4y/overlay/lib/python3.11/site-packages/setuptools/command/build_ext.py", line 96, in run
          _build_ext.run(self)
        File "/tmp/pip-build-env-3y2p3i4y/overlay/lib/python3.11/site-packages/setuptools/_distutils/command/build_ext.py", line 368, in run
          self.build_extensions()
        File "/tmp/pip-build-env-3y2p3i4y/overlay/lib/python3.11/site-packages/setuptools/_distutils/command/build_ext.py", line 484, in build_extensions
          self._build_extensions_serial()
        File "/tmp/pip-build-env-3y2p3i4y/overlay/lib/python3.11/site-packages/setuptools/_distutils/command/build_ext.py", line 510, in _build_extensions_serial
          self.build_extension(ext)
        File "<string>", line 256, in build_extension
        File "<string>", line 439, in _build_single_variant
        File "<string>", line 664, in _build_single_variant_impl
        File "/home/ubisec/miniconda3/envs/swh-llama/lib/python3.11/subprocess.py", line 571, in run
          raise CalledProcessError(retcode, process.args,
      subprocess.CalledProcessError: Command '['cmake', '/home/ubisec/swh/codes/ktransformers-0.5.0.post1/kt-kernel', '-DCMAKE_LIBRARY_OUTPUT_DIRECTORY=/home/ubisec/swh/codes/ktransformers-0.5.0.post1/kt-kernel/build/lib.linux-x86_64-cpython-311/kt_kernel/', '-DPYTHON_EXECUTABLE=/home/ubisec/miniconda3/envs/swh-llama/bin/python3.11', '-DCMAKE_BUILD_TYPE=Release', '-DLLAMA_NATIVE=ON', '-DKTRANSFORMERS_CPU_USE_AMX_AVX512=ON', '-DLLAMA_AVX512_VNNI=ON', '-DLLAMA_AVX512_VBMI=ON', '-DLLAMA_AVX512=ON', '-DKTRANSFORMERS_USE_CUDA=ON', '-DCMAKE_CUDA_COMPILER=/usr/local/cuda-12.5/bin/nvcc', '-DCMAKE_CUDA_ARCHITECTURES=80;86;89;90']' returned non-zero exit status 1.
      [end of output]
  
  note: This error originates from a subprocess, and is likely not a problem with pip.
  ERROR: Failed building wheel for kt-kernel
Failed to build kt-kernel
error: failed-wheel-build-for-install

× Failed to build installable wheels for some pyproject.toml based projects

[CodeZ-Hao]

检查下cmake版本

[shiwanghua]

检查下cmake版本

cmake --version
cmake version 3.22.1

CMake suite maintained and supported by Kitware (kitware.com/cmake).

[shiwanghua]

检查下cmake版本

是不是cmake版本太低了？

不是 cmake 版本低，3.22.1 足够（≥3.18 即可）。
真正报错依旧是那两条：
third_party/pybind11 和 third_party/llama.cpp 目录里 没有 CMakeLists.txt
系统 缺少 hwloc 开发包
只要这两条还在，cmake 就必然失败。

[shiwanghua]

项目里面还有第三方项目，不递归下载下不完整。。
git clone --recursive https://github.com/kvcache-ai/ktransformers.git ktransformers-0.5.0.post1

[ovowei]

try git submodule update --init --recursive