Skip to content

Bug when install vllm_string #6

@FYYFU

Description

@FYYFU

Hi authors,
Thanks for your releasing code! Recently I want to try your vllm version and I follow the instructions to install. But I failed to build vllm, the error is:

File "/home//anaconda3/envs/vllm_string/lib/python3.10/subprocess.py", line 369, in check_call
          raise CalledProcessError(retcode, cmd)
      subprocess.CalledProcessError: Command '['cmake', '/home//STRING/vllm_string', '-G', 'Ninja', '-DCMAKE_BUILD_TYPE=RelWithDebInfo', '-DCMAKE_LIBRARY_OUTPUT_DIRECTORY=/tmp/tmp5amlvokb.build-lib/vllm', '-DCMAKE_ARCHIVE_OUTPUT_DIRECTORY=/tmp/tmp537_ioz7.build-temp', '-DVLLM_TARGET_DEVICE=cuda', '-DVLLM_PYTHON_EXECUTABLE=/home/anaconda3/envs/vllm_string/bin/python', '-DNVCC_THREADS=1', '-DCMAKE_JOB_POOL_COMPILE:STRING=compile', '-DCMAKE_JOB_POOLS:STRING=compile=128']' returned non-zero exit status 1.
      [end of output]
  note: This error originates from a subprocess, and is likely not a problem with pip.
  ERROR: Failed building editable for vllm
Failed to build vllm
ERROR: Failed to build installable wheels for some pyproject.toml based projects (vllm)

The vllm build error:

      -- Target device: cuda
      -- Found Python: /home/anaconda3/envs/vllm_string/bin/python (found version "3.10.16") found components: Interpreter Development.Module Development.SABIModule
      -- Found python matching: /home/anaconda3/envs/vllm_string/bin/python.
      -- Found CUDA: /usr/local/cuda (found version "12.6")
      -- The CUDA compiler identification is unknown
      CMake Error at /tmp/pip-build-env-im2k6qe4/overlay/lib/python3.10/site-packages/cmake/data/share/cmake-3.31/Modules/CMakeDetermineCUDACompiler.cmake:266 (message):
        Failed to detect a default CUDA architecture.

Here is my cude version:

Image

This specific version seems require a specific CUDA version. Could you please share your machine configuation? Or could you please share those files required to modify to impletement vllm_string?

Thank you!

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions