Please provide complete information as applicable to your setup.
• Hardware Platform (Jetson / GPU)
Jetson
• DeepStream Version
6.0 GA on host, 5.1 on Jetson
• JetPack Version (valid for Jetson only)
4.5.1
• TensorRT Version
8
• NVIDIA GPU Driver Version (valid for GPU only)
470
• Issue Type( questions, new requirements, bugs)
Bug
• How to reproduce the issue ? (This is for bugs. Including which sample app is using, the configuration files content, the command line used and other details for reproducing)
I’m following the tutorial here. When running sudo container_builder -c ds_test4_container_builder_jetson.yaml -d /opt/nvidia/graph-composer/config/target_aarch64.yaml
, I get the following error:
2021-11-11 11:38:06,737 - ContainerBuilder.container_builder.docker_manager - INFO - Auto selected base image: nvcr.io/nvidia/deepstream-l4t:6.0-samples
2021-11-11 11:38:06,737 - ContainerBuilder.container_builder.docker_manager - INFO - start building stage image deepstream-test4-jetson
2021-11-11 11:38:06,754 - ContainerBuilder.container_builder.docker_templ.docker_templ_maker - INFO - writing docker content to /root/.cache/container_builder/.dockerfile_6908
2021-11-11 11:38:06,754 - ContainerBuilder.container_builder.docker_manager - INFO - docker file /root/.cache/container_builder/.dockerfile_6908 generated
2021-11-11 11:38:06,754 - ContainerBuilder.container_builder.docker_manager - INFO - start preparing work folder: /root/.cache/container_builder/.workfolder_6908
2021-11-11 11:38:06,754 - ContainerBuilder.container_builder.docker_workfolder - INFO - copying local files to work folder
2021-11-11 11:38:06,765 - ContainerBuilder.container_builder.docker_workfolder - INFO - Work folder: /root/.cache/container_builder/.workfolder_6908/final_image is ready
Traceback (most recent call last):
File "container_builder/cli.py", line 13, in <module>
File "container_builder/container_builder.py", line 88, in main
File "container_builder/container_builder.py", line 47, in build
File "container_builder/docker_manager.py", line 457, in build_main_yaml
File "container_builder/docker_manager.py", line 514, in build_stage_image
File "container_builder/docker_workfolder.py", line 105, in prepare_all
File "container_builder/graph_handler.py", line 45, in __init__
File "container_builder/graph_handler.py", line 49, in init_registry
File "<frozen registry.core.core_interface>", line 28, in __init__
File "<frozen registry.core.core>", line 54, in __init__
File "<frozen registry.core.core>", line 1154, in _setup_logger
File "logging/handlers.py", line 150, in __init__
File "logging/handlers.py", line 57, in __init__
File "logging/__init__.py", line 1032, in __init__
File "logging/__init__.py", line 1061, in _open
PermissionError: [Errno 13] Permission denied: '/tmp/nvgraph_registry.log'
[6908] Failed to execute script cli
I can build the container using Graph Composer (Update: apparently the same issue can happen in Graph Composer as well). But deploying the container to Azure Edge device (Jetson Xavier NX) results in the following error:
2021-11-11 02:49:22.477 INFO gxf/gxe/gxe.cpp@98: Creating context
2021-11-11 02:49:22.483 ERROR gxf/std/extension_loader.cpp@109: libcudart.so.10.2: cannot open shared object file: No such file or directory
2021-11-11 02:49:22.486 ERROR gxf/gxe/gxe.cpp@143: LoadExtensionManifest Error: GXF_EXTENSION_FILE_NOT_FOUND
I’m thinking the error on Jetson is probably related to the container_builder error. What should I do to resolve this?
Thank you.
Update 1:
I found a workaround by deleting /tmp/nvgraph_registry.log
and /tmp/gxf_log
, and then running registry repo sync -n ngc-public
.
Now, running sudo container_builder -c ds_test4_container_builder_jetson.yaml -d /opt/nvidia/graph-composer/config/target_aarch64.yaml
produces the error below:
2021-11-12 09:44:15,042 - ContainerBuilder.container_builder.docker_manager - INFO - Auto selected base image: nvcr.io/nvidia/deepstream-l4t:6.0-samples
2021-11-12 09:44:15,042 - ContainerBuilder.container_builder.docker_manager - INFO - start building stage image deepstream-test4-jetson
2021-11-12 09:44:15,059 - ContainerBuilder.container_builder.docker_templ.docker_templ_maker - INFO - writing docker content to /root/.cache/container_builder/.dockerfile_64677
2021-11-12 09:44:15,059 - ContainerBuilder.container_builder.docker_manager - INFO - docker file /root/.cache/container_builder/.dockerfile_64677 generated
2021-11-12 09:44:15,060 - ContainerBuilder.container_builder.docker_manager - INFO - start preparing work folder: /root/.cache/container_builder/.workfolder_64677
2021-11-12 09:44:15,060 - ContainerBuilder.container_builder.docker_workfolder - INFO - copying local files to work folder
2021-11-12 09:44:15,071 - ContainerBuilder.container_builder.docker_workfolder - INFO - Work folder: /root/.cache/container_builder/.workfolder_64677/final_image is ready
2021-11-12 09:44:16,310 - Registry - INFO - Installing graph ...
2021-11-12 09:44:16,342 - Registry - INFO -
Requested target configuration:
arch: aarch64 os: linux distribution: ubuntu_18.04 cuda: 10.2 cudnn: 8.0.3 tensorrt: 8.0.1.6 deepstream: 6.0 vpi: 1.1.12
Selected extension variants:
MultimediaExtension
Version: 1.0.0 Variant: arch: aarch64 os: linux distribution: ubuntu_18.04
StandardExtension
Version: 1.0.1 Variant: arch: aarch64 os: linux distribution: ubuntu_18.04 cuda: 10.2
NvDsInterfaceExt
Version: 0.0.3 Variant: arch: aarch64 os: linux distribution: ubuntu_18.04 deepstream: 6.0
NvDsBaseExt
Version: 0.0.4 Variant: arch: aarch64 os: linux distribution: ubuntu_18.04 deepstream: 6.0
NvDsCloudMsgExt
Version: 0.0.3 Variant: arch: aarch64 os: linux distribution: ubuntu_18.04 deepstream: 6.0
NvDsInferenceExt
Version: 0.0.4 Variant: arch: aarch64 os: linux distribution: ubuntu_18.04 deepstream: 6.0
NvDsInferenceUtilsExt
Version: 0.0.5 Variant: arch: aarch64 os: linux distribution: ubuntu_18.04 deepstream: 6.0
NvDsSourceExt
Version: 0.0.6 Variant: arch: aarch64 os: linux distribution: ubuntu_18.04 deepstream: 6.0
NvDsMuxDemuxExt
Version: 0.0.4 Variant: arch: aarch64 os: linux distribution: ubuntu_18.04 deepstream: 6.0
NvDsOutputSinkExt
Version: 0.0.3 Variant: arch: aarch64 os: linux distribution: ubuntu_18.04 deepstream: 6.0
NvDsVisualizationExt
Version: 0.0.3 Variant: arch: aarch64 os: linux distribution: ubuntu_18.04 deepstream: 6.0
NvDsTemplateExt
Version: 0.0.3 Variant: arch: aarch64 os: linux distribution: ubuntu_18.04 deepstream: 6.0
NvDsSampleExt
Version: 0.0.3 Variant: arch: aarch64 os: linux distribution: ubuntu_18.04 deepstream: 6.0
NvDsSampleModelsExt
Version: 0.0.4 Variant: arch: aarch64 os: linux distribution: ubuntu_18.04 deepstream: 6.0
2021-11-12 09:45:08,407 - ContainerBuilder.container_builder.docker_manager - INFO - work folder: /root/.cache/container_builder/.workfolder_64677 is ready
2021-11-12 09:45:08,407 - ContainerBuilder.container_builder.docker_manager - INFO - start build docker file /root/.cache/container_builder/.dockerfile_64677
Traceback (most recent call last):
File "urllib3/connectionpool.py", line 601, in urlopen
File "urllib3/connectionpool.py", line 357, in _make_request
File "http/client.py", line 1281, in request
File "http/client.py", line 1327, in _send_request
File "http/client.py", line 1276, in endheaders
File "http/client.py", line 1042, in _send_output
File "http/client.py", line 980, in send
File "docker/transport/unixconn.py", line 30, in connect
FileNotFoundError: [Errno 2] No such file or directory
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "requests/adapters.py", line 440, in send
File "urllib3/connectionpool.py", line 639, in urlopen
File "urllib3/util/retry.py", line 357, in increment
File "urllib3/packages/six.py", line 685, in reraise
File "urllib3/connectionpool.py", line 601, in urlopen
File "urllib3/connectionpool.py", line 357, in _make_request
File "http/client.py", line 1281, in request
File "http/client.py", line 1327, in _send_request
File "http/client.py", line 1276, in endheaders
File "http/client.py", line 1042, in _send_output
File "http/client.py", line 980, in send
File "docker/transport/unixconn.py", line 30, in connect
urllib3.exceptions.ProtocolError: ('Connection aborted.', FileNotFoundError(2, 'No such file or directory'))
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "docker/api/client.py", line 214, in _retrieve_server_version
File "docker/api/daemon.py", line 181, in version
File "docker/utils/decorators.py", line 46, in inner
File "docker/api/client.py", line 237, in _get
File "requests/sessions.py", line 521, in get
File "requests/sessions.py", line 508, in request
File "requests/sessions.py", line 618, in send
File "requests/adapters.py", line 490, in send
requests.exceptions.ConnectionError: ('Connection aborted.', FileNotFoundError(2, 'No such file or directory'))
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "container_builder/cli.py", line 13, in <module>
File "container_builder/container_builder.py", line 88, in main
File "container_builder/container_builder.py", line 47, in build
File "container_builder/docker_manager.py", line 457, in build_main_yaml
File "container_builder/docker_manager.py", line 528, in build_stage_image
File "container_builder/docker_builder.py", line 113, in build_from
File "container_builder/docker_builder.py", line 66, in _internal_build
File "container_builder/docker_builder.py", line 47, in _ensure_client
File "container_builder/docker_builder.py", line 37, in _create_client
File "docker/client.py", line 101, in from_env
File "docker/client.py", line 45, in __init__
File "docker/api/client.py", line 197, in __init__
File "docker/api/client.py", line 222, in _retrieve_server_version
docker.errors.DockerException: Error while fetching server API version: ('Connection aborted.', FileNotFoundError(2, 'No such file or directory'))
[64677] Failed to execute script cli