OK,I tried to solve it using the method from the following link.
https://forums.developer.nvidia.com/t/libnvdla-compiler-so-not-found/323265
Download the package and install.
sudo dpkg -i --force-depends ./nvidia-l4t-dla-compiler_36.4.3-20250107174145_arm64.deb
sudo apt install -f -y
dpkg -l | grep nvidia-l4t-dla-compiler
ls /usr/lib/aarch64-linux-gnu/tegra/libnvdla*
# I can see libnvdla_compiler.so and libnvdla_runtime.so
But when I try to run the build_wheel.py, a new error occurred.
[100%] Built target nvinfer_plugin_tensorrt_llm
[100%] Building CXX object tensorrt_llm/executor_worker/CMakeFiles/executorWorker.dir/executorWorker.cpp.o
[100%] Linking CXX executable executorWorker
[100%] Built target executorWorker
Defaulting to user installation because normal site-packages is not writeable
Requirement already satisfied: pybind11-stubgen in /home/evoc/.local/lib/python3.10/site-packages (2.5.5)
Traceback (most recent call last):
File "/usr/lib/python3.10/runpy.py", line 196, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/usr/lib/python3.10/runpy.py", line 86, in _run_code
exec(code, run_globals)
File "/home/evoc/.local/lib/python3.10/site-packages/pybind11_stubgen/__main__.py", line 4, in <module>
main()
File "/home/evoc/.local/lib/python3.10/site-packages/pybind11_stubgen/__init__.py", line 320, in main
run(
File "/home/evoc/.local/lib/python3.10/site-packages/pybind11_stubgen/__init__.py", line 359, in run
QualifiedName.from_str(module_name), importlib.import_module(module_name)
File "/usr/lib/python3.10/importlib/__init__.py", line 126, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
File "<frozen importlib._bootstrap>", line 1050, in _gcd_import
File "<frozen importlib._bootstrap>", line 1027, in _find_and_load
File "<frozen importlib._bootstrap>", line 1006, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 674, in _load_unlocked
File "<frozen importlib._bootstrap>", line 571, in module_from_spec
File "<frozen importlib._bootstrap_external>", line 1176, in create_module
File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed
ImportError: libnvdla_compiler.so: cannot open shared object file: No such file or directory
Failed to build pybind11 stubgen: Command '"/usr/bin/python3" -m pybind11_stubgen -o . bindings' returned non-zero exit status 1.
* Building wheel...
Traceback (most recent call last):
File "/home/evoc/.local/lib/python3.10/site-packages/pyproject_hooks/_in_process/_in_process.py", line 389, in <module>
main()
File "/home/evoc/.local/lib/python3.10/site-packages/pyproject_hooks/_in_process/_in_process.py", line 373, in main
json_out["return_val"] = hook(**hook_input["kwargs"])
File "/home/evoc/.local/lib/python3.10/site-packages/pyproject_hooks/_in_process/_in_process.py", line 280, in build_wheel
return _build_backend().build_wheel(
File "/usr/lib/python3/dist-packages/setuptools/build_meta.py", line 230, in build_wheel
return self._build_with_temp_dir(['bdist_wheel'], '.whl',
File "/usr/lib/python3/dist-packages/setuptools/build_meta.py", line 215, in _build_with_temp_dir
self.run_setup()
File "/usr/lib/python3/dist-packages/setuptools/build_meta.py", line 267, in run_setup
super(_BuildMetaLegacyBackend,
File "/usr/lib/python3/dist-packages/setuptools/build_meta.py", line 158, in run_setup
exec(compile(code, __file__, 'exec'), locals())
File "setup.py", line 93, in <module>
sanity_check()
File "setup.py", line 48, in sanity_check
raise ImportError(
ImportError: The `bindings` module does not exist. Please check the package integrity. If you are attempting to use the pip development mode (editable installation), please execute `build_wheels.py` first, and then run `pip install -e .`.
ERROR Backend subprocess exited when trying to invoke build_wheel
Traceback (most recent call last):
File "/home/evoc/TensorRT-LLM/scripts/build_wheel.py", line 412, in <module>
main(**vars(args))
File "/home/evoc/TensorRT-LLM/scripts/build_wheel.py", line 325, in main
build_run(
File "/usr/lib/python3.10/subprocess.py", line 526, in run
raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '"/usr/bin/python3" -m build /home/evoc/TensorRT-LLM --skip-dependency-check --no-isolation --wheel --outdir "/home/evoc/TensorRT-LLM/build"' returned non-zero exit status 1.