When I try to instal vLLM via a docker - any ideas?:
:/workspace# pip uninstall -y packaging
Found existing installation: packaging 23.2
Uninstalling packaging-23.2:
Successfully uninstalled packaging-23.2
WARNING: Running pip as the ‘root’ user can result in broken permissions and conflicting behaviour with the system package manager, possibly rendering your system unusable. It is recommended to use a virtual environment instead: 12. Virtual Environments and Packages — Python 3.14.0 documentation . Use the --root-user-action option if you know what you are doing and want to suppress this warning.
root@aaa:/workspace# pip install packaging>=24.2
DEPRECATION: Loading egg at /usr/local/lib/python3.12/dist-packages/dill-0.3.9-py3.12.egg is deprecated. pip 25.1 will enforce this behaviour change. A possible replacement is to use pip for package installation. Discussion can be found at Remove additional detection of `.egg` packages when using the `importlib.metadata` backend · Issue #12330 · pypa/pip · GitHub
DEPRECATION: Loading egg at /usr/local/lib/python3.12/dist-packages/lightning_utilities-0.14.0-py3.12.egg is deprecated. pip 25.1 will enforce this behaviour change. A possible replacement is to use pip for package installation. Discussion can be found at Remove additional detection of `.egg` packages when using the `importlib.metadata` backend · Issue #12330 · pypa/pip · GitHub
DEPRECATION: Loading egg at /usr/local/lib/python3.12/dist-packages/lightning_thunder-0.2.2.dev0-py3.12.egg is deprecated. pip 25.1 will enforce this behaviour change. A possible replacement is to use pip for package installation. Discussion can be found at Remove additional detection of `.egg` packages when using the `importlib.metadata` backend · Issue #12330 · pypa/pip · GitHub
DEPRECATION: Loading egg at /usr/local/lib/python3.12/dist-packages/looseversion-1.3.0-py3.12.egg is deprecated. pip 25.1 will enforce this behaviour change. A possible replacement is to use pip for package installation. Discussion can be found at Remove additional detection of `.egg` packages when using the `importlib.metadata` backend · Issue #12330 · pypa/pip · GitHub
DEPRECATION: Loading egg at /usr/local/lib/python3.12/dist-packages/opt_einsum-3.4.0-py3.12.egg is deprecated. pip 25.1 will enforce this behaviour change. A possible replacement is to use pip for package installation. Discussion can be found at Remove additional detection of `.egg` packages when using the `importlib.metadata` backend · Issue #12330 · pypa/pip · GitHub
DEPRECATION: Loading egg at /usr/local/lib/python3.12/dist-packages/nvfuser-0.2.26a0+c5e1555-py3.12-linux-aarch64.egg is deprecated. pip 25.1 will enforce this behaviour change. A possible replacement is to use pip for package installation. Discussion can be found at Remove additional detection of `.egg` packages when using the `importlib.metadata` backend · Issue #12330 · pypa/pip · GitHub
WARNING: Running pip as the ‘root’ user can result in broken permissions and conflicting behaviour with the system package manager, possibly rendering your system unusable. It is recommended to use a virtual environment instead: 12. Virtual Environments and Packages — Python 3.14.0 documentation . Use the --root-user-action option if you know what you are doing and want to suppress this warning.
root@aaa:/workspace# pip install vllm
DEPRECATION: Loading egg at /usr/local/lib/python3.12/dist-packages/dill-0.3.9-py3.12.egg is deprecated. pip 25.1 will enforce this behaviour change. A possible replacement is to use pip for package installation. Discussion can be found at Remove additional detection of `.egg` packages when using the `importlib.metadata` backend · Issue #12330 · pypa/pip · GitHub
DEPRECATION: Loading egg at /usr/local/lib/python3.12/dist-packages/lightning_utilities-0.14.0-py3.12.egg is deprecated. pip 25.1 will enforce this behaviour change. A possible replacement is to use pip for package installation. Discussion can be found at Remove additional detection of `.egg` packages when using the `importlib.metadata` backend · Issue #12330 · pypa/pip · GitHub
DEPRECATION: Loading egg at /usr/local/lib/python3.12/dist-packages/lightning_thunder-0.2.2.dev0-py3.12.egg is deprecated. pip 25.1 will enforce this behaviour change. A possible replacement is to use pip for package installation. Discussion can be found at Remove additional detection of `.egg` packages when using the `importlib.metadata` backend · Issue #12330 · pypa/pip · GitHub
DEPRECATION: Loading egg at /usr/local/lib/python3.12/dist-packages/looseversion-1.3.0-py3.12.egg is deprecated. pip 25.1 will enforce this behaviour change. A possible replacement is to use pip for package installation. Discussion can be found at Remove additional detection of `.egg` packages when using the `importlib.metadata` backend · Issue #12330 · pypa/pip · GitHub
DEPRECATION: Loading egg at /usr/local/lib/python3.12/dist-packages/opt_einsum-3.4.0-py3.12.egg is deprecated. pip 25.1 will enforce this behaviour change. A possible replacement is to use pip for package installation. Discussion can be found at Remove additional detection of `.egg` packages when using the `importlib.metadata` backend · Issue #12330 · pypa/pip · GitHub
DEPRECATION: Loading egg at /usr/local/lib/python3.12/dist-packages/nvfuser-0.2.26a0+c5e1555-py3.12-linux-aarch64.egg is deprecated. pip 25.1 will enforce this behaviour change. A possible replacement is to use pip for package installation. Discussion can be found at Remove additional detection of `.egg` packages when using the `importlib.metadata` backend · Issue #12330 · pypa/pip · GitHub
Collecting vllm
Using cached vllm-0.11.0-cp38-abi3-manylinux2014_aarch64.whl.metadata (17 kB)
Requirement already satisfied: regex in /usr/local/lib/python3.12/dist-packages (from vllm) (2024.11.6)
Requirement already satisfied: cachetools in /usr/local/lib/python3.12/dist-packages (from vllm) (5.5.2)
Requirement already satisfied: psutil in /usr/local/lib/python3.12/dist-packages (from vllm) (7.0.0)
Collecting sentencepiece (from vllm)
Using cached sentencepiece-0.2.1-cp312-cp312-manylinux_2_27_aarch64.manylinux_2_28_aarch64.whl.metadata (10 kB)
Requirement already satisfied: numpy in /usr/local/lib/python3.12/dist-packages (from vllm) (1.26.4)
Requirement already satisfied: requests>=2.26.0 in /usr/local/lib/python3.12/dist-packages (from vllm) (2.32.3)
Requirement already satisfied: tqdm in /usr/local/lib/python3.12/dist-packages (from vllm) (4.67.1)
Collecting blake3 (from vllm)
Using cached blake3-1.0.8-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.metadata (4.6 kB)
Collecting py-cpuinfo (from vllm)
Using cached py_cpuinfo-9.0.0-py3-none-any.whl.metadata (794 bytes)
Collecting transformers>=4.55.2 (from vllm)
Using cached transformers-4.57.1-py3-none-any.whl.metadata (43 kB)
Collecting tokenizers>=0.21.1 (from vllm)
Using cached tokenizers-0.22.1-cp39-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.metadata (6.8 kB)
Requirement already satisfied: protobuf in /usr/local/lib/python3.12/dist-packages (from vllm) (4.24.4)
Collecting fastapi>=0.115.0 (from fastapi[standard]>=0.115.0->vllm)
Using cached fastapi-0.121.1-py3-none-any.whl.metadata (28 kB)
Requirement already satisfied: aiohttp in /usr/local/lib/python3.12/dist-packages (from vllm) (3.11.13)
Collecting openai>=1.99.1 (from vllm)
Using cached openai-2.7.1-py3-none-any.whl.metadata (29 kB)
INFO: pip is looking at multiple versions of vllm to determine which version is compatible with other requirements. This could take a while.
Collecting vllm
Using cached vllm-0.10.2-cp38-abi3-manylinux2014_aarch64.whl.metadata (16 kB)
Using cached vllm-0.10.1.1.tar.gz (10.5 MB)
Installing build dependencies … error
error: subprocess-exited-with-error
× pip subprocess to install build dependencies did not run successfully.
│ exit code: 1
╰─> [15 lines of output]
Collecting cmake>=3.26.1
Using cached cmake-3.31.6-py3-none-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.metadata (6.3 kB)
Collecting ninja
Using cached ninja-1.11.1.3-py3-none-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.metadata (5.3 kB)
ERROR: Cannot install packaging>=24.2 because these package versions have conflicting dependencies.
The conflict is caused by:
The user requested packaging>=24.2
The user requested (constraint) packaging==23.2
To fix this you could try to:
1\. loosen the range of package versions you've specified
2\. remove package versions to allow pip to attempt to solve the dependency conflict
ERROR: ResolutionImpossible: for help visit https://pip.pypa.io/en/latest/topics/dependency-resolution/#dealing-with-dependency-conflicts
\[end of output\]
note: This error originates from a subprocess, and is likely not a problem with pip.
error: subprocess-exited-with-error
× pip subprocess to install build dependencies did not run successfully.
│ exit code: 1
╰─> See above for output.
note: This error originates from a subprocess, and is likely not a problem with pip.