Deepstream 7.0 failed to connect to Docker deamon - Ubuntu RTX 3080 GPU accessed trough SSH connection

matheus.berto · September 20, 2024, 5:29pm

• Hardware platform: Ubuntu 22.04.4 LTS, accessed trough SSH connection, GPU RTX 3080
• Hardware architecture: x86_64
• DeepStream Version 7
• TensorRT Version: I don’t know, maybe I didn’t install it.
• CUDA Version: 12.5
• NVIDIA GPU Driver Version: 555.42.02
• NVIDIA Container Toolkit: NVIDIA Container Runtime Hook version 1.16.1
• Docker version: 27.2.0, build 3ab4256

• Issue Type: help with Deepstream SDK
• I’m facing a problem when I try to use the Deepstream SDk 7.0 with docker, the executed commands and the output are written below:

COMANDS:

ssh -X $USER@$SSH_server_IP
export DISPLAY="::1:10.0"
xhost +
docker run --gpus all -it --rm --net=host --privileged -v /tmp/.X11-unix:/tmp/.X11-unix -e DISPLAY=$DISPLAY -w /opt/nvidia/deepstream/deepstream-7.0 nvcr.io/nvidia/deepstream:7.0-triton-multiarch
cd /opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-3d-lidar-sensor-fusion
bevfusion/docker_build_bevfusion_image.sh nvcr.io/nvidia/deepstream:7.0-triton-multiarch

OUTPUT: (see the last 2 lines)

with BASE_IMAGE: nvcr.io/nvidia/deepstream:7.0-triton-multiarch
build bevfusion TARGET_IMAGE: deepstream-triton-bevfusion:7.0
Installing docker.cli to build docker inside container
Hit:1 https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2204/x86_64  InRelease
Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease
Hit:3 http://security.ubuntu.com/ubuntu jammy-security InRelease
Hit:4 http://archive.ubuntu.com/ubuntu jammy-updates InRelease
Hit:5 https://librealsense.intel.com/Debian/apt-repo jammy InRelease
Hit:6 http://archive.ubuntu.com/ubuntu jammy-backports InRelease
Reading package lists...
Building dependency tree...
Reading state information...
171 packages can be upgraded. Run 'apt list --upgradable' to see them.
Reading package lists...
Building dependency tree...
Reading state information...
The following additional packages will be installed:
  apparmor bridge-utils containerd dns-root-data dnsmasq-base iproute2
  iptables libatm1 libbpf0 libip4tc2 libip6tc2 libmnl0 libnetfilter-conntrack3
  libnfnetlink0 libnftnl11 libxtables12 netbase netcat netcat-openbsd pigz
  runc ubuntu-fan
Suggested packages:
  apparmor-profiles-extra apparmor-utils ifupdown aufs-tools btrfs-progs
  cgroupfs-mount | cgroup-lite debootstrap docker-doc rinse zfs-fuse
  | zfsutils iproute2-doc firewalld kmod nftables
The following NEW packages will be installed:
  apparmor bridge-utils containerd dns-root-data dnsmasq-base docker.io
  iproute2 iptables libatm1 libbpf0 libip6tc2 libmnl0 libnetfilter-conntrack3
  libnfnetlink0 libnftnl11 libxtables12 netbase netcat netcat-openbsd pigz
  runc ubuntu-fan
The following packages will be upgraded:
  libip4tc2
1 upgraded, 22 newly installed, 0 to remove and 170 not upgraded.
Need to get 78.1 MB of archives.
After this operation, 294 MB of additional disk space will be used.
Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 pigz amd64 2.6-1 [63.6 kB]
Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbpf0 amd64 1:0.5.0-1ubuntu22.04.1 [140 kB]
Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 libmnl0 amd64 1.0.4-3build2 [13.2 kB]
Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libxtables12 amd64 1.8.7-1ubuntu5.2 [31.3 kB]
Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 iproute2 amd64 5.15.0-1ubuntu2 [1070 kB]
Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 libatm1 amd64 1:2.5.1-4build2 [22.8 kB]
Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libip4tc2 amd64 1.8.7-1ubuntu5.2 [19.9 kB]
Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 netbase all 6.3 [12.9 kB]
Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 netcat-openbsd amd64 1.218-4ubuntu1 [39.4 kB]
Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 apparmor amd64 3.0.4-2ubuntu2.4 [598 kB]
Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libip6tc2 amd64 1.8.7-1ubuntu5.2 [20.3 kB]
Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libnfnetlink0 amd64 1.0.1-3build3 [14.6 kB]
Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libnetfilter-conntrack3 amd64 1.0.9-1 [45.3 kB]
Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libnftnl11 amd64 1.2.1-1build1 [65.5 kB]
Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 iptables amd64 1.8.7-1ubuntu5.2 [455 kB]
Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 bridge-utils amd64 1.7-1ubuntu3 [34.4 kB]
Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 runc amd64 1.1.12-0ubuntu2~22.04.1 [8405 kB]
Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 containerd amd64 1.7.12-0ubuntu2~22.04.1 [37.8 MB]
Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 dns-root-data all 2023112702~ubuntu0.22.04.1 [5136 B]
Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 dnsmasq-base amd64 2.90-0ubuntu0.22.04.1 [374 kB]
Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 docker.io amd64 24.0.7-0ubuntu2~22.04.1 [28.8 MB]
Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 netcat all 1.218-4ubuntu1 [2044 B]
Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 ubuntu-fan all 0.12.16 [35.2 kB]
Preconfiguring packages ...
Fetched 78.1 MB in 8s (9527 kB/s)
Selecting previously unselected package pigz.
(Reading database ... 70823 files and directories currently installed.)
Preparing to unpack .../00-pigz_2.6-1_amd64.deb ...
Unpacking pigz (2.6-1) ...
Selecting previously unselected package libbpf0:amd64.
Preparing to unpack .../01-libbpf0_1%3a0.5.0-1ubuntu22.04.1_amd64.deb ...
Unpacking libbpf0:amd64 (1:0.5.0-1ubuntu22.04.1) ...
Selecting previously unselected package libmnl0:amd64.
Preparing to unpack .../02-libmnl0_1.0.4-3build2_amd64.deb ...
Unpacking libmnl0:amd64 (1.0.4-3build2) ...
Selecting previously unselected package libxtables12:amd64.
Preparing to unpack .../03-libxtables12_1.8.7-1ubuntu5.2_amd64.deb ...
Unpacking libxtables12:amd64 (1.8.7-1ubuntu5.2) ...
Selecting previously unselected package iproute2.
Preparing to unpack .../04-iproute2_5.15.0-1ubuntu2_amd64.deb ...
Unpacking iproute2 (5.15.0-1ubuntu2) ...
Selecting previously unselected package libatm1:amd64.
Preparing to unpack .../05-libatm1_1%3a2.5.1-4build2_amd64.deb ...
Unpacking libatm1:amd64 (1:2.5.1-4build2) ...
Preparing to unpack .../06-libip4tc2_1.8.7-1ubuntu5.2_amd64.deb ...
Unpacking libip4tc2:amd64 (1.8.7-1ubuntu5.2) over (1.8.7-1ubuntu5.1) ...
Selecting previously unselected package netbase.
Preparing to unpack .../07-netbase_6.3_all.deb ...
Unpacking netbase (6.3) ...
Selecting previously unselected package netcat-openbsd.
Preparing to unpack .../08-netcat-openbsd_1.218-4ubuntu1_amd64.deb ...
Unpacking netcat-openbsd (1.218-4ubuntu1) ...
Selecting previously unselected package apparmor.
Preparing to unpack .../09-apparmor_3.0.4-2ubuntu2.4_amd64.deb ...
Unpacking apparmor (3.0.4-2ubuntu2.4) ...
Selecting previously unselected package libip6tc2:amd64.
Preparing to unpack .../10-libip6tc2_1.8.7-1ubuntu5.2_amd64.deb ...
Unpacking libip6tc2:amd64 (1.8.7-1ubuntu5.2) ...
Selecting previously unselected package libnfnetlink0:amd64.
Preparing to unpack .../11-libnfnetlink0_1.0.1-3build3_amd64.deb ...
Unpacking libnfnetlink0:amd64 (1.0.1-3build3) ...
Selecting previously unselected package libnetfilter-conntrack3:amd64.
Preparing to unpack .../12-libnetfilter-conntrack3_1.0.9-1_amd64.deb ...
Unpacking libnetfilter-conntrack3:amd64 (1.0.9-1) ...
Selecting previously unselected package libnftnl11:amd64.
Preparing to unpack .../13-libnftnl11_1.2.1-1build1_amd64.deb ...
Unpacking libnftnl11:amd64 (1.2.1-1build1) ...
Selecting previously unselected package iptables.
Preparing to unpack .../14-iptables_1.8.7-1ubuntu5.2_amd64.deb ...
Unpacking iptables (1.8.7-1ubuntu5.2) ...
Selecting previously unselected package bridge-utils.
Preparing to unpack .../15-bridge-utils_1.7-1ubuntu3_amd64.deb ...
Unpacking bridge-utils (1.7-1ubuntu3) ...
Selecting previously unselected package runc.
Preparing to unpack .../16-runc_1.1.12-0ubuntu2~22.04.1_amd64.deb ...
Unpacking runc (1.1.12-0ubuntu2~22.04.1) ...
Selecting previously unselected package containerd.
Preparing to unpack .../17-containerd_1.7.12-0ubuntu2~22.04.1_amd64.deb ...
Unpacking containerd (1.7.12-0ubuntu2~22.04.1) ...
Selecting previously unselected package dns-root-data.
Preparing to unpack .../18-dns-root-data_2023112702~ubuntu0.22.04.1_all.deb ...
Unpacking dns-root-data (2023112702~ubuntu0.22.04.1) ...
Selecting previously unselected package dnsmasq-base.
Preparing to unpack .../19-dnsmasq-base_2.90-0ubuntu0.22.04.1_amd64.deb ...
Unpacking dnsmasq-base (2.90-0ubuntu0.22.04.1) ...
Selecting previously unselected package docker.io.
Preparing to unpack .../20-docker.io_24.0.7-0ubuntu2~22.04.1_amd64.deb ...
Unpacking docker.io (24.0.7-0ubuntu2~22.04.1) ...
Selecting previously unselected package netcat.
Preparing to unpack .../21-netcat_1.218-4ubuntu1_all.deb ...
Unpacking netcat (1.218-4ubuntu1) ...
Selecting previously unselected package ubuntu-fan.
Preparing to unpack .../22-ubuntu-fan_0.12.16_all.deb ...
Unpacking ubuntu-fan (0.12.16) ...
Setting up libip4tc2:amd64 (1.8.7-1ubuntu5.2) ...
Setting up libip6tc2:amd64 (1.8.7-1ubuntu5.2) ...
Setting up netcat-openbsd (1.218-4ubuntu1) ...
update-alternatives: using /bin/nc.openbsd to provide /bin/nc (nc) in auto mode
update-alternatives: warning: skip creation of /usr/share/man/man1/nc.1.gz because associated file /usr/share/man/man1/nc_openbsd.1.gz (of link group nc) doesn't exist
update-alternatives: warning: skip creation of /usr/share/man/man1/netcat.1.gz because associated file /usr/share/man/man1/nc_openbsd.1.gz (of link group nc) doesn't exist
Setting up netcat (1.218-4ubuntu1) ...
Setting up libatm1:amd64 (1:2.5.1-4build2) ...
Setting up runc (1.1.12-0ubuntu2~22.04.1) ...
Setting up dns-root-data (2023112702~ubuntu0.22.04.1) ...
Setting up apparmor (3.0.4-2ubuntu2.4) ...
Created symlink /etc/systemd/system/sysinit.target.wants/apparmor.service → /lib/systemd/system/apparmor.service.
Setting up libmnl0:amd64 (1.0.4-3build2) ...
Setting up libxtables12:amd64 (1.8.7-1ubuntu5.2) ...
Setting up bridge-utils (1.7-1ubuntu3) ...
Setting up pigz (2.6-1) ...
Setting up libnfnetlink0:amd64 (1.0.1-3build3) ...
Setting up netbase (6.3) ...
Setting up libbpf0:amd64 (1:0.5.0-1ubuntu22.04.1) ...
Setting up containerd (1.7.12-0ubuntu2~22.04.1) ...
Created symlink /etc/systemd/system/multi-user.target.wants/containerd.service → /lib/systemd/system/containerd.service.
Setting up iproute2 (5.15.0-1ubuntu2) ...
Setting up libnftnl11:amd64 (1.2.1-1build1) ...
Setting up libnetfilter-conntrack3:amd64 (1.0.9-1) ...
Setting up iptables (1.8.7-1ubuntu5.2) ...
update-alternatives: using /usr/sbin/iptables-legacy to provide /usr/sbin/iptables (iptables) in auto mode
update-alternatives: using /usr/sbin/ip6tables-legacy to provide /usr/sbin/ip6tables (ip6tables) in auto mode
update-alternatives: using /usr/sbin/iptables-nft to provide /usr/sbin/iptables (iptables) in auto mode
update-alternatives: using /usr/sbin/ip6tables-nft to provide /usr/sbin/ip6tables (ip6tables) in auto mode
update-alternatives: using /usr/sbin/arptables-nft to provide /usr/sbin/arptables (arptables) in auto mode
update-alternatives: using /usr/sbin/ebtables-nft to provide /usr/sbin/ebtables (ebtables) in auto mode
Setting up docker.io (24.0.7-0ubuntu2~22.04.1) ...
Adding group `docker' (GID 113) ...
Done.
Created symlink /etc/systemd/system/multi-user.target.wants/docker.service → /lib/systemd/system/docker.service.
Created symlink /etc/systemd/system/sockets.target.wants/docker.socket → /lib/systemd/system/docker.socket.
invoke-rc.d: unknown initscript, /etc/init.d/docker not found.
invoke-rc.d: could not determine current runlevel
Setting up dnsmasq-base (2.90-0ubuntu0.22.04.1) ...
Setting up ubuntu-fan (0.12.16) ...
Created symlink /etc/systemd/system/multi-user.target.wants/ubuntu-fan.service → /lib/systemd/system/ubuntu-fan.service.
invoke-rc.d: could not determine current runlevel
invoke-rc.d: policy-rc.d denied execution of start.
Processing triggers for man-db (2.10.2-1) ...
Processing triggers for dbus (1.12.20-2ubuntu4.1) ...
Processing triggers for libc-bin (2.35-0ubuntu3.6) ...
BASE_IMAGE: nvcr.io/nvidia/deepstream:7.0-triton-multiarch is not found, trying to pull
Cannot connect to the Docker daemon at unix:///var/run/docker

fanzh · September 21, 2024, 2:14pm

this is the fatal error. please refer to this link.

fanzh · September 25, 2024, 2:35am

Sorry for the late reply, Is this still an DeepStream issue to support? please use the following cmd to start docker, especially “-v /var/run/docker.sock:/var/run/docker.sock” is needed.

# $ docker run --gpus all -it --rm --net=host --privileged \
#  -v /var/run/docker.sock:/var/run/docker.sock-v /tmp/.X11-unix:/tmp/.X11-unix \
#  -e DISPLAY=$DISPLAY nvcr.io/nvidia/deepstream:{xx.xx.xx}-triton-multiarch

matheus.berto · September 25, 2024, 5:23pm

Hi, thank you for your reply.

I executed the command you suggested and now I’m facing another error. It seems that now the image nvcr.io/nvidia/deepstream:7.0-triton-multiarch was correctly found. However, another error, apparently related to my docker default builder occurs. I pasted below the executed commands and obtained outputs from the terminal.

Is that a docker-only related error? I’m sorry, I have no experience with docker and don’t have root privileges o this Ubuntu server that I’m accessing through SSH.

(base) matheus@lasid-ws2:~$ docker run --gpus all -it --rm --net=host --privileged \
-v /var/run/docker.sock:/var/run/docker.sock -v /tmp/.X11-unix:/tmp/.X11-unix \
-e DISPLAY=$DISPLAY nvcr.io/nvidia/deepstream:7.0-triton-multiarch

===============================
   DeepStreamSDK 7.0.0
===============================

*** LICENSE AGREEMENT ***
By using this software you agree to fully comply with the terms and conditions
of the License Agreement. The License Agreement is located at
/opt/nvidia/deepstream/deepstream/LicenseAgreement.pdf. If you do not agree
to the terms and conditions of the License Agreement do not use the software.


=============================
== Triton Inference Server ==
=============================

NVIDIA Release 23.10 (build 72127154)
Triton Server Version 2.39.0

Copyright (c) 2018-2023, NVIDIA CORPORATION & AFFILIATES.  All rights reserved.

Various files include modifications (c) NVIDIA CORPORATION & AFFILIATES.  All rights reserved.

This container image and its contents are governed by the NVIDIA Deep Learning Container License.
By pulling and using the container, you accept the terms and conditions of this license:
https://developer.nvidia.com/ngc/nvidia-deep-learning-container-license

root@lasid-ws2:/opt/nvidia/deepstream/deepstream-7.0# cd /opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-3d-lidar-sensor-fusion
root@lasid-ws2:/opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-3d-lidar-sensor-fusion# bevfusion/docker_build_bevfusion_image.sh nvcr.io/nvidia/deepstream:7.0-triton-multiarch
with BASE_IMAGE: nvcr.io/nvidia/deepstream:7.0-triton-multiarch
build bevfusion TARGET_IMAGE: deepstream-triton-bevfusion:7.0
Installing docker.cli to build docker inside container
Get:1 https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2204/x86_64  InRelease [1581 B]
Get:2 https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2204/x86_64  Packages [1001 kB]
Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB]
Hit:4 http://archive.ubuntu.com/ubuntu jammy InRelease
Get:5 https://librealsense.intel.com/Debian/apt-repo jammy InRelease [3249 B]
Get:6 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB]
Get:7 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [3113 kB]
Get:8 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB]
Get:9 https://librealsense.intel.com/Debian/apt-repo jammy/main amd64 Packages [15.2 kB]
Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [51.8 kB]
Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1442 kB]
Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [1154 kB]
Get:13 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [2317 kB]
Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [3191 kB]
Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2593 kB]
Get:16 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [33.7 kB]
Get:17 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [81.4 kB]
Fetched 15.4 MB in 3s (4471 kB/s)
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
171 packages can be upgraded. Run 'apt list --upgradable' to see them.
W: https://librealsense.intel.com/Debian/apt-repo/dists/jammy/InRelease: Key is stored in legacy trusted.gpg keyring (/etc/apt/trusted.gpg), see the DEPRECATION section in apt-key(8) for details.
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
The following additional packages will be installed:
  apparmor bridge-utils containerd dns-root-data dnsmasq-base iproute2 iptables libatm1 libbpf0 libip4tc2 libip6tc2
  libmnl0 libnetfilter-conntrack3 libnfnetlink0 libnftnl11 libxtables12 netbase netcat netcat-openbsd pigz runc
  ubuntu-fan
Suggested packages:
  apparmor-profiles-extra apparmor-utils ifupdown aufs-tools btrfs-progs cgroupfs-mount | cgroup-lite debootstrap
  docker-doc rinse zfs-fuse | zfsutils iproute2-doc firewalld kmod nftables
The following NEW packages will be installed:
  apparmor bridge-utils containerd dns-root-data dnsmasq-base docker.io iproute2 iptables libatm1 libbpf0 libip6tc2
  libmnl0 libnetfilter-conntrack3 libnfnetlink0 libnftnl11 libxtables12 netbase netcat netcat-openbsd pigz runc
  ubuntu-fan
The following packages will be upgraded:
  libip4tc2
1 upgraded, 22 newly installed, 0 to remove and 170 not upgraded.
Need to get 78.1 MB of archives.
After this operation, 294 MB of additional disk space will be used.
Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 pigz amd64 2.6-1 [63.6 kB]
Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbpf0 amd64 1:0.5.0-1ubuntu22.04.1 [140 kB]
Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 libmnl0 amd64 1.0.4-3build2 [13.2 kB]
Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libxtables12 amd64 1.8.7-1ubuntu5.2 [31.3 kB]
Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 iproute2 amd64 5.15.0-1ubuntu2 [1070 kB]
Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 libatm1 amd64 1:2.5.1-4build2 [22.8 kB]
Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libip4tc2 amd64 1.8.7-1ubuntu5.2 [19.9 kB]
Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 netbase all 6.3 [12.9 kB]
Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 netcat-openbsd amd64 1.218-4ubuntu1 [39.4 kB]
Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 apparmor amd64 3.0.4-2ubuntu2.4 [598 kB]
Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libip6tc2 amd64 1.8.7-1ubuntu5.2 [20.3 kB]
Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libnfnetlink0 amd64 1.0.1-3build3 [14.6 kB]
Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libnetfilter-conntrack3 amd64 1.0.9-1 [45.3 kB]
Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libnftnl11 amd64 1.2.1-1build1 [65.5 kB]
Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 iptables amd64 1.8.7-1ubuntu5.2 [455 kB]
Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 bridge-utils amd64 1.7-1ubuntu3 [34.4 kB]
Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 runc amd64 1.1.12-0ubuntu2~22.04.1 [8405 kB]
Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 containerd amd64 1.7.12-0ubuntu2~22.04.1 [37.8 MB]
Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 dns-root-data all 2023112702~ubuntu0.22.04.1 [5136 B]
Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 dnsmasq-base amd64 2.90-0ubuntu0.22.04.1 [374 kB]
Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 docker.io amd64 24.0.7-0ubuntu2~22.04.1 [28.8 MB]
Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 netcat all 1.218-4ubuntu1 [2044 B]
Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 ubuntu-fan all 0.12.16 [35.2 kB]
Fetched 78.1 MB in 5s (14.2 MB/s)
Preconfiguring packages ...
Selecting previously unselected package pigz.
(Reading database ... 70823 files and directories currently installed.)
Preparing to unpack .../00-pigz_2.6-1_amd64.deb ...
Unpacking pigz (2.6-1) ...
Selecting previously unselected package libbpf0:amd64.
Preparing to unpack .../01-libbpf0_1%3a0.5.0-1ubuntu22.04.1_amd64.deb ...
Unpacking libbpf0:amd64 (1:0.5.0-1ubuntu22.04.1) ...
Selecting previously unselected package libmnl0:amd64.
Preparing to unpack .../02-libmnl0_1.0.4-3build2_amd64.deb ...
Unpacking libmnl0:amd64 (1.0.4-3build2) ...
Selecting previously unselected package libxtables12:amd64.
Preparing to unpack .../03-libxtables12_1.8.7-1ubuntu5.2_amd64.deb ...
Unpacking libxtables12:amd64 (1.8.7-1ubuntu5.2) ...
Selecting previously unselected package iproute2.
Preparing to unpack .../04-iproute2_5.15.0-1ubuntu2_amd64.deb ...
Unpacking iproute2 (5.15.0-1ubuntu2) ...
Selecting previously unselected package libatm1:amd64.
Preparing to unpack .../05-libatm1_1%3a2.5.1-4build2_amd64.deb ...
Unpacking libatm1:amd64 (1:2.5.1-4build2) ...
Preparing to unpack .../06-libip4tc2_1.8.7-1ubuntu5.2_amd64.deb ...
Unpacking libip4tc2:amd64 (1.8.7-1ubuntu5.2) over (1.8.7-1ubuntu5.1) ...
Selecting previously unselected package netbase.
Preparing to unpack .../07-netbase_6.3_all.deb ...
Unpacking netbase (6.3) ...
Selecting previously unselected package netcat-openbsd.
Preparing to unpack .../08-netcat-openbsd_1.218-4ubuntu1_amd64.deb ...
Unpacking netcat-openbsd (1.218-4ubuntu1) ...
Selecting previously unselected package apparmor.
Preparing to unpack .../09-apparmor_3.0.4-2ubuntu2.4_amd64.deb ...
Unpacking apparmor (3.0.4-2ubuntu2.4) ...
Selecting previously unselected package libip6tc2:amd64.
Preparing to unpack .../10-libip6tc2_1.8.7-1ubuntu5.2_amd64.deb ...
Unpacking libip6tc2:amd64 (1.8.7-1ubuntu5.2) ...
Selecting previously unselected package libnfnetlink0:amd64.
Preparing to unpack .../11-libnfnetlink0_1.0.1-3build3_amd64.deb ...
Unpacking libnfnetlink0:amd64 (1.0.1-3build3) ...
Selecting previously unselected package libnetfilter-conntrack3:amd64.
Preparing to unpack .../12-libnetfilter-conntrack3_1.0.9-1_amd64.deb ...
Unpacking libnetfilter-conntrack3:amd64 (1.0.9-1) ...
Selecting previously unselected package libnftnl11:amd64.
Preparing to unpack .../13-libnftnl11_1.2.1-1build1_amd64.deb ...
Unpacking libnftnl11:amd64 (1.2.1-1build1) ...
Selecting previously unselected package iptables.
Preparing to unpack .../14-iptables_1.8.7-1ubuntu5.2_amd64.deb ...
Unpacking iptables (1.8.7-1ubuntu5.2) ...
Selecting previously unselected package bridge-utils.
Preparing to unpack .../15-bridge-utils_1.7-1ubuntu3_amd64.deb ...
Unpacking bridge-utils (1.7-1ubuntu3) ...
Selecting previously unselected package runc.
Preparing to unpack .../16-runc_1.1.12-0ubuntu2~22.04.1_amd64.deb ...
Unpacking runc (1.1.12-0ubuntu2~22.04.1) ...
Selecting previously unselected package containerd.
Preparing to unpack .../17-containerd_1.7.12-0ubuntu2~22.04.1_amd64.deb ...
Unpacking containerd (1.7.12-0ubuntu2~22.04.1) ...
Selecting previously unselected package dns-root-data.
Preparing to unpack .../18-dns-root-data_2023112702~ubuntu0.22.04.1_all.deb ...
Unpacking dns-root-data (2023112702~ubuntu0.22.04.1) ...
Selecting previously unselected package dnsmasq-base.
Preparing to unpack .../19-dnsmasq-base_2.90-0ubuntu0.22.04.1_amd64.deb ...
Unpacking dnsmasq-base (2.90-0ubuntu0.22.04.1) ...
Selecting previously unselected package docker.io.
Preparing to unpack .../20-docker.io_24.0.7-0ubuntu2~22.04.1_amd64.deb ...
Unpacking docker.io (24.0.7-0ubuntu2~22.04.1) ...
Selecting previously unselected package netcat.
Preparing to unpack .../21-netcat_1.218-4ubuntu1_all.deb ...
Unpacking netcat (1.218-4ubuntu1) ...
Selecting previously unselected package ubuntu-fan.
Preparing to unpack .../22-ubuntu-fan_0.12.16_all.deb ...
Unpacking ubuntu-fan (0.12.16) ...
Setting up libip4tc2:amd64 (1.8.7-1ubuntu5.2) ...
Setting up libip6tc2:amd64 (1.8.7-1ubuntu5.2) ...
Setting up netcat-openbsd (1.218-4ubuntu1) ...
update-alternatives: using /bin/nc.openbsd to provide /bin/nc (nc) in auto mode
update-alternatives: warning: skip creation of /usr/share/man/man1/nc.1.gz because associated file /usr/share/man/man1/nc_openbsd.1.gz (of link group nc) doesn't exist
update-alternatives: warning: skip creation of /usr/share/man/man1/netcat.1.gz because associated file /usr/share/man/man1/nc_openbsd.1.gz (of link group nc) doesn't exist
Setting up netcat (1.218-4ubuntu1) ...
Setting up libatm1:amd64 (1:2.5.1-4build2) ...
Setting up runc (1.1.12-0ubuntu2~22.04.1) ...
Setting up dns-root-data (2023112702~ubuntu0.22.04.1) ...
Setting up apparmor (3.0.4-2ubuntu2.4) ...
Created symlink /etc/systemd/system/sysinit.target.wants/apparmor.service → /lib/systemd/system/apparmor.service.
Setting up libmnl0:amd64 (1.0.4-3build2) ...
Setting up libxtables12:amd64 (1.8.7-1ubuntu5.2) ...
Setting up bridge-utils (1.7-1ubuntu3) ...
Setting up pigz (2.6-1) ...
Setting up libnfnetlink0:amd64 (1.0.1-3build3) ...
Setting up netbase (6.3) ...
Setting up libbpf0:amd64 (1:0.5.0-1ubuntu22.04.1) ...
Setting up containerd (1.7.12-0ubuntu2~22.04.1) ...
Created symlink /etc/systemd/system/multi-user.target.wants/containerd.service → /lib/systemd/system/containerd.service.
Setting up iproute2 (5.15.0-1ubuntu2) ...
Setting up libnftnl11:amd64 (1.2.1-1build1) ...
Setting up libnetfilter-conntrack3:amd64 (1.0.9-1) ...
Setting up iptables (1.8.7-1ubuntu5.2) ...
update-alternatives: using /usr/sbin/iptables-legacy to provide /usr/sbin/iptables (iptables) in auto mode
update-alternatives: using /usr/sbin/ip6tables-legacy to provide /usr/sbin/ip6tables (ip6tables) in auto mode
update-alternatives: using /usr/sbin/iptables-nft to provide /usr/sbin/iptables (iptables) in auto mode
update-alternatives: using /usr/sbin/ip6tables-nft to provide /usr/sbin/ip6tables (ip6tables) in auto mode
update-alternatives: using /usr/sbin/arptables-nft to provide /usr/sbin/arptables (arptables) in auto mode
update-alternatives: using /usr/sbin/ebtables-nft to provide /usr/sbin/ebtables (ebtables) in auto mode
Setting up docker.io (24.0.7-0ubuntu2~22.04.1) ...
Adding group `docker' (GID 113) ...
Done.
Created symlink /etc/systemd/system/multi-user.target.wants/docker.service → /lib/systemd/system/docker.service.
Created symlink /etc/systemd/system/sockets.target.wants/docker.socket → /lib/systemd/system/docker.socket.
invoke-rc.d: unknown initscript, /etc/init.d/docker not found.
invoke-rc.d: could not determine current runlevel
Setting up dnsmasq-base (2.90-0ubuntu0.22.04.1) ...
Setting up ubuntu-fan (0.12.16) ...
Created symlink /etc/systemd/system/multi-user.target.wants/ubuntu-fan.service → /lib/systemd/system/ubuntu-fan.service.
invoke-rc.d: could not determine current runlevel
invoke-rc.d: policy-rc.d denied execution of start.
Processing triggers for man-db (2.10.2-1) ...
Processing triggers for dbus (1.12.20-2ubuntu4.1) ...
Processing triggers for libc-bin (2.35-0ubuntu3.6) ...
BASE_IMAGE: nvcr.io/nvidia/deepstream:7.0-triton-multiarch exist
DEPRECATED: The legacy builder is deprecated and will be removed in a future release.
            Install the buildx component to build images with BuildKit:
            https://docs.docker.com/go/buildx/

unknown flag: --progress
See 'docker build --help'.
build TARGET_IMAGE: deepstream-triton-bevfusion:7.0 failed
root@lasid-ws2:/opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-3d-lidar-sensor-fusion#

matheus.berto · September 25, 2024, 11:25pm

Hi again.
After some new tests, we found out that there was a problem with the Docker version. I think we managed to solve this issue. However, another one emerged.

Below, I wrote the executed commands and the obtained output:

Executed commands:

xhost +
docker run --gpus all -it --rm --net=host --privileged \
-v /var/run/docker.sock:/var/run/docker.sock -v /tmp/.X11-unix:/tmp/.X11-unix \
-e DISPLAY=$DISPLAY nvcr.io/nvidia/deepstream:7.0-triton-multiarch

cd /opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-3d-lidar-sensor-fusion
apt-get update
apt-get install ca-certificates curl
install -m 0755 -d /etc/apt/keyrings
curl -fsSL https://download.docker.com/linux/ubuntu/gpg -o /etc/apt/keyrings/docker.asc
chmod a+r /etc/apt/keyrings/docker.asc

echo \
  "deb [arch=$(dpkg --print-architecture) signed-by=/etc/apt/keyrings/docker.asc] https://download.docker.com/linux/ubuntu \
  $(. /etc/os-release && echo "$VERSION_CODENAME") stable" | \
  tee /etc/apt/sources.list.d/docker.list > /dev/null
apt-get update
apt-get install docker-ce docker-ce-cli containerd.io docker-buildx-plugin docker-compose-plugin
bevfusion/docker_build_bevfusion_image.sh nvcr.io/nvidia/deepstream:7.0-triton-multiarch

Output:

with BASE_IMAGE: nvcr.io/nvidia/deepstream:7.0-triton-multiarch
build bevfusion TARGET_IMAGE: deepstream-triton-bevfusion:7.0
BASE_IMAGE: nvcr.io/nvidia/deepstream:7.0-triton-multiarch exist
#0 building with "default" instance using docker driver

#1 [internal] load build definition from bevfusion.Dockerfile
#1 transferring dockerfile:
#1 transferring dockerfile: 5.05kB 0.0s done
#1 DONE 0.4s

#2 [internal] load metadata for nvcr.io/nvidia/deepstream:7.0-triton-multiarch
#2 DONE 0.0s

#3 [internal] load .dockerignore
#3 transferring context:
#3 transferring context: 2B done
#3 DONE 0.5s

#4 [ 1/12] FROM nvcr.io/nvidia/deepstream:7.0-triton-multiarch
#4 DONE 0.0s

#5 [ 3/12] RUN apt update && DEBIAN_FRONTEND=noninteractive apt update &&     apt install -y --no-install-recommends cmake
#5 CACHED

#6 [ 4/12] RUN pip3 install gdown onnx nvidia-pytriton
#6 CACHED

#7 [ 5/12] RUN mkdir -p /opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-3d-lidar-sensor-fusion/bevfusion
#7 CACHED

#8 [ 6/12] RUN cd /opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-3d-lidar-sensor-fusion/bevfusion &&     git clone --recursive --depth 1 https://github.com/NVIDIA-AI-IOT/Lidar_AI_Solution.git     -b master --single-branch Lidar_AI_Solution || exit 1
#8 CACHED

#9 [ 2/12] WORKDIR /opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-3d-lidar-sensor-fusion
#9 CACHED

#10 [ 7/12] RUN cd /opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-3d-lidar-sensor-fusion/bevfusion &&     if [ -e local/CUDA-BEVFusion_patch_for_x86_cuda12-2.tgz ]; then         tar -pxvf local/CUDA-BEVFusion_patch_for_x86_cuda12-2.tgz -C Lidar_AI_Solution;     fi &&     cd /opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-3d-lidar-sensor-fusion/bevfusion/Lidar_AI_Solution/CUDA-BEVFusion &&     sed -i '/^set(CMAKE_CXX_FLAGS_RELEASE/d' CMakeLists.txt &&     sed -i '/^set(CUDA_NVCC_FLAGS_RELEASE/d' CMakeLists.txt &&     cd /opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-3d-lidar-sensor-fusion/bevfusion/Lidar_AI_Solution &&     if [ -e libraries/3DSparseConvolution/libspconv/lib/x86_64/libspconv.so_x86_cuda12.2 ]; then         mv libraries/3DSparseConvolution/libspconv/lib/x86_64/libspconv.so_x86_cuda12.2 libraries/3DSparseConvolution/libspconv/lib/x86_64/libspconv.so;     fi
#10 CACHED

#11 [ 8/12] RUN apt update && DEBIAN_FRONTEND=noninteractive apt update &&     apt install -y --no-install-recommends libprotobuf-dev protobuf-compiler
#11 CACHED

#12 [ 9/12] RUN export USE_Python=ON &&     export CUDASM=86 &&     export CUDA_Lib=/usr/local/cuda/lib64 &&     export CUDA_Inc=/usr/local/cuda/include &&     export CUDA_Bin=/usr/local/cuda/bin &&     export Python_Inc=`python3 -c "import sysconfig;print(sysconfig.get_path('include'))"`  &&     export Python_Lib=`python3 -c "import sysconfig;print(sysconfig.get_config_var('LIBDIR'))"`  &&     export Python_Soname=`python3 -c "import sysconfig;import re;print(re.sub('.a', '.so', sysconfig.get_config_var('LIBRARY')))"`  &&     export PATH=$CUDA_Bin:/opt/proto/bin:/opt/tritonserver/bin:/usr/local/mpi/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/ucx/bin:/.local/bin &&     mkdir -p /opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-3d-lidar-sensor-fusion/bevfusion/Lidar_AI_Solution/CUDA-BEVFusion/build &&     cd /opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-3d-lidar-sensor-fusion/bevfusion/Lidar_AI_Solution/CUDA-BEVFusion/build &&     cmake -DCUDA_NVCC_FLAGS="-gencode arch=compute_90,code=compute_90      -gencode arch=compute_89,code=sm_89      -gencode arch=compute_80,code=sm_80      -gencode arch=compute_75,code=sm_75      -gencode arch=compute_70,code=sm_70"     -DCMAKE_CXX_FLAGS_RELEASE="-std=c++17 -Wextra -Wall -Wno-missing-field-initializers -Wno-deprecated-declarations -O3 -DENABLE_TEXT_BACKEND_STB"     -DCUDA_NVCC_FLAGS_RELEASE="-Werror=all-warnings -Xcompiler -std=c++17,-Wextra,-Wall,-Wno-deprecated-declarations,-O3 -DENABLE_TEXT_BACKEND_STB"     -DProtobuf_PROTOC_EXECUTABLE=/usr/bin/protoc     .. && make  VERBOSE=1 -j || exit 1
#12 6.158 4 errors detected in the compilation of "/opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-3d-lidar-sensor-fusion/bevfusion/Lidar_AI_Solution/CUDA-BEVFusion/src/plugins/custom_layernorm.cu".
#12 6.190 -- Removing /opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-3d-lidar-sensor-fusion/bevfusion/Lidar_AI_Solution/CUDA-BEVFusion/build/CMakeFiles/custom_layernorm.dir/src/plugins/./custom_layernorm_generated_custom_layernorm.cu.o
#12 6.205 /usr/bin/cmake -E rm -f /opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-3d-lidar-sensor-fusion/bevfusion/Lidar_AI_Solution/CUDA-BEVFusion/build/CMakeFiles/custom_layernorm.dir/src/plugins/./custom_layernorm_generated_custom_layernorm.cu.o
#12 6.222 CMake Error at custom_layernorm_generated_custom_layernorm.cu.o.Release.cmake:280 (message):
#12 6.222   Error generating file
#12 6.222   /opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-3d-lidar-sensor-fusion/bevfusion/Lidar_AI_Solution/CUDA-BEVFusion/build/CMakeFiles/custom_layernorm.dir/src/plugins/./custom_layernorm_generated_custom_layernorm.cu.o
#12 6.222
#12 6.222
#12 6.225 make[2]: *** [CMakeFiles/custom_layernorm.dir/build.make:77: CMakeFiles/custom_layernorm.dir/src/plugins/custom_layernorm_generated_custom_layernorm.cu.o] Error 1
#12 6.225 make[2]: Leaving directory '/opt/nvidia/deepstream/deepstream-7.0/sources/apps/sample_apps/deepstream-3d-lidar-sensor-fusion/bevfusion/Lidar_AI_Solution/CUDA-BEVFusion/build'
#12 6.225 make[1]: *** [CMakeFiles/Makefile2:140: CMakeFiles/custom_layernorm.dir/all] Error 2
#12 6.225 make[1]: *** Waiting for unfinished jobs....
#12 9.566 -- Generating temporary cmake readable file: /opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-3d-lidar-sensor-fusion/bevfusion/Lidar_AI_Solution/CUDA-BEVFusion/build/CMakeFiles/bevfusion_core.dir/src/bevfusion/bevfusion_core_generated_camera-geometry.cu.o.depend.tmp
#12 9.580 /usr/bin/cmake -D input_file:FILEPATH=/opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-3d-lidar-sensor-fusion/bevfusion/Lidar_AI_Solution/CUDA-BEVFusion/build/CMakeFiles/bevfusion_core.dir/src/bevfusion/bevfusion_core_generated_camera-geometry.cu.o.NVCC-depend -D output_file:FILEPATH=/opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-3d-lidar-sensor-fusion/bevfusion/Lidar_AI_Solution/CUDA-BEVFusion/build/CMakeFiles/bevfusion_core.dir/src/bevfusion/bevfusion_core_generated_camera-geometry.cu.o.depend.tmp -D verbose=1 -P /usr/share/cmake-3.22/Modules/FindCUDA/make2cmake.cmake
#12 9.770 -- Copy if different /opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-3d-lidar-sensor-fusion/bevfusion/Lidar_AI_Solution/CUDA-BEVFusion/build/CMakeFiles/bevfusion_core.dir/src/bevfusion/bevfusion_core_generated_camera-geometry.cu.o.depend.tmp to /opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-3d-lidar-sensor-fusion/bevfusion/Lidar_AI_Solution/CUDA-BEVFusion/build/CMakeFiles/bevfusion_core.dir/src/bevfusion/bevfusion_core_generated_camera-geometry.cu.o.depend
#12 9.783 /usr/bin/cmake -E copy_if_different /opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-3d-lidar-sensor-fusion/bevfusion/Lidar_AI_Solution/CUDA-BEVFusion/build/CMakeFiles/bevfusion_core.dir/src/bevfusion/bevfusion_core_generated_camera-geometry.cu.o.depend.tmp /opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-3d-lidar-sensor-fusion/bevfusion/Lidar_AI_Solution/CUDA-BEVFusion/build/CMakeFiles/bevfusion_core.dir/src/bevfusion/bevfusion_core_generated_camera-geometry.cu.o.depend
#12 9.811 -- Removing /opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-3d-lidar-sensor-fusion/bevfusion/Lidar_AI_Solution/CUDA-BEVFusion/build/CMakeFiles/bevfusion_core.dir/src/bevfusion/bevfusion_core_generated_camera-geometry.cu.o.depend.tmp and /opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-3d-lidar-sensor-fusion/bevfusion/Lidar_AI_Solution/CUDA-BEVFusion/build/CMakeFiles/bevfusion_core.dir/src/bevfusion/bevfusion_core_generated_camera-geometry.cu.o.NVCC-depend
#12 9.823 /usr/bin/cmake -E rm -f /opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-3d-lidar-sensor-fusion/bevfusion/Lidar_AI_Solution/CUDA-BEVFusion/build/CMakeFiles/bevfusion_core.dir/src/bevfusion/bevfusion_core_generated_camera-geometry.cu.o.depend.tmp /opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-3d-lidar-sensor-fusion/bevfusion/Lidar_AI_Solution/CUDA-BEVFusion/build/CMakeFiles/bevfusion_core.dir/src/bevfusion/bevfusion_core_generated_camera-geometry.cu.o.NVCC-depend
#12 9.848 -- Generating /opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-3d-lidar-sensor-fusion/bevfusion/Lidar_AI_Solution/CUDA-BEVFusion/build/CMakeFiles/bevfusion_core.dir/src/bevfusion/./bevfusion_core_generated_camera-geometry.cu.o
#12 9.862 /usr/local/cuda/bin/nvcc /opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-3d-lidar-sensor-fusion/bevfusion/Lidar_AI_Solution/CUDA-BEVFusion/src/bevfusion/camera-geometry.cu -c -o /opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-3d-lidar-sensor-fusion/bevfusion/Lidar_AI_Solution/CUDA-BEVFusion/build/CMakeFiles/bevfusion_core.dir/src/bevfusion/./bevfusion_core_generated_camera-geometry.cu.o -ccbin /usr/bin/cc -m64 -Dbevfusion_core_EXPORTS -Xcompiler ,\"-fPIC\",\"-std=c++17\",\"-Wextra\",\"-Wall\",\"-Wno-missing-field-initializers\",\"-Wno-deprecated-declarations\",\"-O3\",\"-DENABLE_TEXT_BACKEND_STB\",\"-Wno-unused-parameter\" -gencode arch=compute_90,code=compute_90 -gencode arch=compute_89,code=sm_89 -gencode arch=compute_80,code=sm_80 -gencode arch=compute_75,code=sm_75 -gencode arch=compute_70,code=sm_70 -gencode arch=compute_86,code=compute_86 -Werror=all-warnings -Xcompiler -std=c++17,-Wextra,-Wall,-Wno-deprecated-declarations,-O3 -DENABLE_TEXT_BACKEND_STB -DNVCC -I/usr/local/cuda/include -I/usr/include -I/usr/include/python3.10 -I/opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-3d-lidar-sensor-fusion/bevfusion/Lidar_AI_Solution/CUDA-BEVFusion/../dependencies/stb -I/opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-3d-lidar-sensor-fusion/bevfusion/Lidar_AI_Solution/CUDA-BEVFusion/../dependencies/dlpack/include -I/opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-3d-lidar-sensor-fusion/bevfusion/Lidar_AI_Solution/CUDA-BEVFusion/../dependencies/pybind11/include -I/opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-3d-lidar-sensor-fusion/bevfusion/Lidar_AI_Solution/CUDA-BEVFusion/../libraries/cuOSD/src -I/opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-3d-lidar-sensor-fusion/bevfusion/Lidar_AI_Solution/CUDA-BEVFusion/../libraries/3DSparseConvolution/libspconv/include -I/opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-3d-lidar-sensor-fusion/bevfusion/Lidar_AI_Solution/CUDA-BEVFusion/src/common -I/opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-3d-lidar-sensor-fusion/bevfusion/Lidar_AI_Solution/CUDA-BEVFusion/src
#12 79.67 cd /opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-3d-lidar-sensor-fusion/bevfusion/Lidar_AI_Solution/CUDA-BEVFusion/build && /usr/bin/cmake -E cmake_depends "Unix Makefiles" /opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-3d-lidar-sensor-fusion/bevfusion/Lidar_AI_Solution/CUDA-BEVFusion /opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-3d-lidar-sensor-fusion/bevfusion/Lidar_AI_Solution/CUDA-BEVFusion /opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-3d-lidar-sensor-fusion/bevfusion/Lidar_AI_Solution/CUDA-BEVFusion/build /opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-3d-lidar-sensor-fusion/bevfusion/Lidar_AI_Solution/CUDA-BEVFusion/build /opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-3d-lidar-sensor-fusion/bevfusion/Lidar_AI_Solution/CUDA-BEVFusion/build/CMakeFiles/bevfusion_core.dir/DependInfo.cmake --color=
#12 79.70 make[2]: Leaving directory '/opt/nvidia/deepstream/deepstream-7.0/sources/apps/sample_apps/deepstream-3d-lidar-sensor-fusion/bevfusion/Lidar_AI_Solution/CUDA-BEVFusion/build'
#12 79.70 make  -f CMakeFiles/bevfusion_core.dir/build.make CMakeFiles/bevfusion_core.dir/build
#12 79.70 make[2]: Entering directory '/opt/nvidia/deepstream/deepstream-7.0/sources/apps/sample_apps/deepstream-3d-lidar-sensor-fusion/bevfusion/Lidar_AI_Solution/CUDA-BEVFusion/build'
#12 79.73 [ 44%] Building CXX object CMakeFiles/bevfusion_core.dir/src/onnx/onnx-operators-ml.pb.cpp.o
#12 79.73 [ 44%] Building CXX object CMakeFiles/bevfusion_core.dir/src/common/tensorrt.cpp.o
#12 79.73 /usr/bin/c++ -Dbevfusion_core_EXPORTS -I/usr/local/cuda/include -I/usr/include/python3.10 -I/opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-3d-lidar-sensor-fusion/bevfusion/Lidar_AI_Solution/CUDA-BEVFusion/../dependencies/stb -I/opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-3d-lidar-sensor-fusion/bevfusion/Lidar_AI_Solution/CUDA-BEVFusion/../dependencies/dlpack/include -I/opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-3d-lidar-sensor-fusion/bevfusion/Lidar_AI_Solution/CUDA-BEVFusion/../dependencies/pybind11/include -I/opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-3d-lidar-sensor-fusion/bevfusion/Lidar_AI_Solution/CUDA-BEVFusion/../libraries/cuOSD/src -I/opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-3d-lidar-sensor-fusion/bevfusion/Lidar_AI_Solution/CUDA-BEVFusion/../libraries/3DSparseConvolution/libspconv/include -I/opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-3d-lidar-sensor-fusion/bevfusion/Lidar_AI_Solution/CUDA-BEVFusion/src/common -I/opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-3d-lidar-sensor-fusion/bevfusion/Lidar_AI_Solution/CUDA-BEVFusion/src -std=c++17 -Wextra -Wall -Wno-missing-field-initializers -Wno-deprecated-declarations -O3 -DENABLE_TEXT_BACKEND_STB -Wno-unused-parameter -fPIC -MD -MT CMakeFiles/bevfusion_core.dir/src/onnx/onnx-operators-ml.pb.cpp.o -MF CMakeFiles/bevfusion_core.dir/src/onnx/onnx-operators-ml.pb.cpp.o.d -o CMakeFiles/bevfusion_core.dir/src/onnx/onnx-operators-ml.pb.cpp.o -c /opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-3d-lidar-sensor-fusion/bevfusion/Lidar_AI_Solution/CUDA-BEVFusion/src/onnx/onnx-operators-ml.pb.cpp
#12 79.73 /usr/bin/c++ -Dbevfusion_core_EXPORTS -I/usr/local/cuda/include -I/usr/include/python3.10 -I/opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-3d-lidar-sensor-fusion/bevfusion/Lidar_AI_Solution/CUDA-BEVFusion/../dependencies/stb -I/opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-3d-lidar-sensor-fusion/bevfusion/Lidar_AI_Solution/CUDA-BEVFusion/../dependencies/dlpack/include -I/opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-3d-lidar-sensor-fusion/bevfusion/Lidar_AI_Solution/CUDA-BEVFusion/../dependencies/pybind11/include -I/opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-3d-lidar-sensor-fusion/bevfusion/Lidar_AI_Solution/CUDA-BEVFusion/../libraries/cuOSD/src -I/opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-3d-lidar-sensor-fusion/bevfusion/Lidar_AI_Solution/CUDA-BEVFusion/../libraries/3DSparseConvolution/libspconv/include -I/opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-3d-lidar-sensor-fusion/bevfusion/Lidar_AI_Solution/CUDA-BEVFusion/src/common -I/opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-3d-lidar-sensor-fusion/bevfusion/Lidar_AI_Solution/CUDA-BEVFusion/src -std=c++17 -Wextra -Wall -Wno-missing-field-initializers -Wno-deprecated-declarations -O3 -DENABLE_TEXT_BACKEND_STB -Wno-unused-parameter -fPIC -MD -MT CMakeFiles/bevfusion_core.dir/src/common/tensorrt.cpp.o -MF CMakeFiles/bevfusion_core.dir/src/common/tensorrt.cpp.o.d -o CMakeFiles/bevfusion_core.dir/src/common/tensorrt.cpp.o -c /opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-3d-lidar-sensor-fusion/bevfusion/Lidar_AI_Solution/CUDA-BEVFusion/src/common/tensorrt.cpp
87.13 [ 62%] Linking CXX shared library libbevfusion_core.so
87.13 /usr/bin/cmake -E cmake_link_script CMakeFiles/bevfusion_core.dir/link.txt --verbose=1
87.14 /usr/bin/c++ -fPIC -std=c++17 -Wextra -Wall -Wno-missing-field-initializers -Wno-deprecated-declarations -O3 -DENABLE_TEXT_BACKEND_STB -Wno-unused-parameter -shared -Wl,-soname,libbevfusion_core.so -o libbevfusion_core.so CMakeFiles/bevfusion_core.dir/src/bevfusion/bevfusion.cpp.o CMakeFiles/bevfusion_core.dir/src/bevfusion/lidar-scn-onnx-parser.cpp.o CMakeFiles/bevfusion_core.dir/src/bevfusion/lidar-scn.cpp.o CMakeFiles/bevfusion_core.dir/src/common/tensorrt.cpp.o CMakeFiles/bevfusion_core.dir/src/onnx/onnx-ml.pb.cpp.o CMakeFiles/bevfusion_core.dir/src/onnx/onnx-operators-ml.pb.cpp.o CMakeFiles/bevfusion_core.dir/src/bevfusion/bevfusion_core_generated_camera-backbone.cu.o CMakeFiles/bevfusion_core.dir/src/bevfusion/bevfusion_core_generated_camera-bevpool.cu.o CMakeFiles/bevfusion_core.dir/src/bevfusion/bevfusion_core_generated_camera-depth.cu.o CMakeFiles/bevfusion_core.dir/src/bevfusion/bevfusion_core_generated_camera-geometry.cu.o CMakeFiles/bevfusion_core.dir/src/bevfusion/bevfusion_core_generated_camera-normalization.cu.o CMakeFiles/bevfusion_core.dir/src/bevfusion/bevfusion_core_generated_camera-vtransform.cu.o CMakeFiles/bevfusion_core.dir/src/bevfusion/bevfusion_core_generated_head-transbbox.cu.o CMakeFiles/bevfusion_core.dir/src/bevfusion/bevfusion_core_generated_lidar-voxelization.cu.o CMakeFiles/bevfusion_core.dir/src/bevfusion/bevfusion_core_generated_transfusion.cu.o CMakeFiles/bevfusion_core.dir/src/common/bevfusion_core_generated_tensor.cu.o   -L/usr/local/cuda/lib64  -L/opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-3d-lidar-sensor-fusion/bevfusion/Lidar_AI_Solution/CUDA-BEVFusion/../libraries/3DSparseConvolution/libspconv/lib/x86_64_cuda  -L/opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-3d-lidar-sensor-fusion/bevfusion/Lidar_AI_Solution/CUDA-BEVFusion/build  -Wl,-rpath,/usr/local/cuda/lib64:/opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-3d-lidar-sensor-fusion/bevfusion/Lidar_AI_Solution/CUDA-BEVFusion/../libraries/3DSparseConvolution/libspconv/lib/x86_64_cuda:/opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-3d-lidar-sensor-fusion/bevfusion/Lidar_AI_Solution/CUDA-BEVFusion/build /usr/local/cuda/lib64/libcudart_static.a -ldl -Wl,-Bstatic -lrt -Wl,-Bdynamic -lcudart -lcublasLt -lnvinfer -lspconv -lprotobuf -lnvinfer_plugin
87.21 /usr/bin/ld: cannot find -lspconv: No such file or directory
87.26 collect2: error: ld returned 1 exit status
87.27 make[2]: Leaving directory '/opt/nvidia/deepstream/deepstream-7.0/sources/apps/sample_apps/deepstream-3d-lidar-sensor-fusion/bevfusion/Lidar_AI_Solution/CUDA-BEVFusion/build'
87.27 make[2]: *** [CMakeFiles/bevfusion_core.dir/build.make:270: libbevfusion_core.so] Error 1
87.27 make[1]: *** [CMakeFiles/Makefile2:89: CMakeFiles/bevfusion_core.dir/all] Error 2
87.27 make[1]: Leaving directory '/opt/nvidia/deepstream/deepstream-7.0/sources/apps/sample_apps/deepstream-3d-lidar-sensor-fusion/bevfusion/Lidar_AI_Solution/CUDA-BEVFusion/build'
87.27 make: *** [Makefile:91: all] Error 2
------
bevfusion.Dockerfile:79
--------------------
  78 |     # build github cuda-bevfusion python-bindings from source
  79 | >>> RUN export USE_Python=ON && \
  80 | >>>     export CUDASM=${CUDASM} && \
  81 | >>>     export CUDA_Lib=/usr/local/cuda/lib64 && \
  82 | >>>     export CUDA_Inc=/usr/local/cuda/include && \
  83 | >>>     export CUDA_Bin=/usr/local/cuda/bin && \
  84 | >>>     export Python_Inc=`python3 -c "import sysconfig;print(sysconfig.get_path('include'))"`  && \
  85 | >>>     export Python_Lib=`python3 -c "import sysconfig;print(sysconfig.get_config_var('LIBDIR'))"`  && \
  86 | >>>     export Python_Soname=`python3 -c "import sysconfig;import re;print(re.sub('.a', '.so', sysconfig.get_config_var('LIBRARY')))"`  && \
  87 | >>>     export PATH=$CUDA_Bin:$PATH && \
  88 | >>>     mkdir -p ${WORKSPACE}/bevfusion/Lidar_AI_Solution/CUDA-BEVFusion/build && \
  89 | >>>     cd ${WORKSPACE}/bevfusion/Lidar_AI_Solution/CUDA-BEVFusion/build && \
  90 | >>>     cmake -DCUDA_NVCC_FLAGS="${CUDA_NVCC_FLAGS}" \
  91 | >>>     -DCMAKE_CXX_FLAGS_RELEASE="${CMAKE_CXX_FLAGS_RELEASE}" \
  92 | >>>     -DCUDA_NVCC_FLAGS_RELEASE="${CUDA_NVCC_FLAGS_RELEASE}" \
  93 | >>>     ${CMAKE_PROTOBUF_ARGS} \
  94 | >>>     .. && make  VERBOSE=1 -j || exit 1
  95 |
--------------------
ERROR: failed to solve: process "/bin/sh -c export USE_Python=ON &&     export CUDASM=${CUDASM} &&     export CUDA_Lib=/usr/local/cuda/lib64 &&     export CUDA_Inc=/usr/local/cuda/include &&     export CUDA_Bin=/usr/local/cuda/bin &&     export Python_Inc=`python3 -c \"import sysconfig;print(sysconfig.get_path('include'))\"`  &&     export Python_Lib=`python3 -c \"import sysconfig;print(sysconfig.get_config_var('LIBDIR'))\"`  &&     export Python_Soname=`python3 -c \"import sysconfig;import re;print(re.sub('.a', '.so', sysconfig.get_config_var('LIBRARY')))\"`  &&     export PATH=$CUDA_Bin:$PATH &&     mkdir -p ${WORKSPACE}/bevfusion/Lidar_AI_Solution/CUDA-BEVFusion/build &&     cd ${WORKSPACE}/bevfusion/Lidar_AI_Solution/CUDA-BEVFusion/build &&     cmake -DCUDA_NVCC_FLAGS=\"${CUDA_NVCC_FLAGS}\"     -DCMAKE_CXX_FLAGS_RELEASE=\"${CMAKE_CXX_FLAGS_RELEASE}\"     -DCUDA_NVCC_FLAGS_RELEASE=\"${CUDA_NVCC_FLAGS_RELEASE}\"     ${CMAKE_PROTOBUF_ARGS}     .. && make  VERBOSE=1 -j || exit 1" did not complete successfully: exit code: 1
build TARGET_IMAGE: deepstream-triton-bevfusion:7.0 failed

fanzh · September 26, 2024, 4:17am

After add the following modificaiaons to bevfusion.Dockerfile, the script run successfully.
diff.txt (665 Bytes)
log-0926.txt (201.8 KB)

matheus.berto · September 26, 2024, 6:28pm

Thank you very much.
I followed your instructions and mannualy edited bevfusion.Dockerfile, the command now executes without erros.

Then, I continued to follow this official instructions. When I tried to execute the command:

bevfusion/docker_run_generate_trt_engine_models.sh bevfusion/model_root

The following error occurred:

MarkupResemblesLocatorWarning: The input looks more like a filename than markup. You may want to open this file and pass the filehandle into Beautiful Soup.
  soup = bs4.BeautifulSoup(line, features="html.parser")
Failed to retrieve file url:

        Cannot retrieve the public link of the file. You may need to change
        the permission to 'Anyone with the link', or have had many accesses.
        Check FAQ in https://github.com/wkentaro/gdown?tab=readme-ov-file#faq.

You may still be able to access the file from the browser:

        https://drive.google.com/uc?id=1bPt3D07yyVuSuzRAHySZVR2N15RqGHHN

but Gdown can't. Please check connections and permissions.

It seems that the model.zip file once storaged in Google Drive it is not available anymore. Could you please confirm that?

fanzh · September 27, 2024, 10:07am

please use wget https://nvidia.box.com/shared/static/t1t67uytge97tn4q7xteehtauutaqxz7 -O model.zip

matheus.berto · October 1, 2024, 5:00pm

Hi, thank you for your reply.

I modified the following lines of the file bevfusion/build_bevfusion_model.sh, which were:

# download bevfusion models
(cd ${MODEL_ROOT} && \
    gdown ${MODEL_ID} && unzip -o model.zip)

into

# download bevfusion models
(cd ${MODEL_ROOT} && \
    wget https://nvidia.box.com/shared/static/t1t67uytge97tn4q7xteehtauutaqxz7 -O model.zip && unzip -o model.zip)

And now I was able to continue to the next step of BEVFusion tutorial, which is to execute the following command:
bevfusion/docker_run_triton_server_bevfusion.sh bevfusion/model_root

The execution of the above command seems to be successfully, as the terminal outputs this:

root@lasid-ws2:/opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-3d-lidar-sensor-fusion# bevfusion/docker_run_triton_server_bevfusion.sh bevfusion/model_root
Starting tritonserver for bevfusion.
2024-10-01 19:48:26,587 - INFO - __main__: preparing models: ['bevfusion']
2024-10-01 19:48:27,634 - INFO - pytriton.triton: Read more about configuring and serving models in documentation: https://triton-inference-server.github.io/pytriton.
2024-10-01 19:48:27,635 - INFO - pytriton.triton: (Press CTRL+C or use the command `kill -SIGINT 1` to send a SIGINT signal and quit)
2024-10-01 19:48:27,635 - INFO - __main__: Loading models ['bevfusion']
2024-10-01 19:48:27,635 - INFO - __main__: Loading BEVFusion model.
2024-10-01 19:48:28,131 - INFO - triton_lmm.models.bevfusion.bevfusion_model: camera_intrinsics shape: (1, 6, 4, 4), float32, data
: [[[[1.2664172e+03 0.0000000e+00 8.1626703e+02 0.0000000e+00]
   [0.0000000e+00 1.2664172e+03 4.9150708e+02 0.0000000e+00]
   [0.0000000e+00 0.0000000e+00 1.0000000e+00 0.0000000e+00]
   [0.0000000e+00 0.0000000e+00 0.0000000e+00 1.0000000e+00]]

  [[1.2608474e+03 0.0000000e+00 8.0796826e+02 0.0000000e+00]
   [0.0000000e+00 1.2608474e+03 4.9533441e+02 0.0000000e+00]
   [0.0000000e+00 0.0000000e+00 1.0000000e+00 0.0000000e+00]
   [0.0000000e+00 0.0000000e+00 0.0000000e+00 1.0000000e+00]]

  [[1.2725979e+03 0.0000000e+00 8.2661548e+02 0.0000000e+00]
   [0.0000000e+00 1.2725979e+03 4.7975165e+02 0.0000000e+00]
   [0.0000000e+00 0.0000000e+00 1.0000000e+00 0.0000000e+00]
   [0.0000000e+00 0.0000000e+00 0.0000000e+00 1.0000000e+00]]

  [[8.0922101e+02 0.0000000e+00 8.2921960e+02 0.0000000e+00]
   [0.0000000e+00 8.0922101e+02 4.8177841e+02 0.0000000e+00]
   [0.0000000e+00 0.0000000e+00 1.0000000e+00 0.0000000e+00]
   [0.0000000e+00 0.0000000e+00 0.0000000e+00 1.0000000e+00]]

  [[1.2567415e+03 0.0000000e+00 7.9211255e+02 0.0000000e+00]
   [0.0000000e+00 1.2567415e+03 4.9277576e+02 0.0000000e+00]
   [0.0000000e+00 0.0000000e+00 1.0000000e+00 0.0000000e+00]
   [0.0000000e+00 0.0000000e+00 0.0000000e+00 1.0000000e+00]]

  [[1.2595138e+03 0.0000000e+00 8.0725293e+02 0.0000000e+00]
   [0.0000000e+00 1.2595138e+03 5.0119580e+02 0.0000000e+00]
   [0.0000000e+00 0.0000000e+00 1.0000000e+00 0.0000000e+00]
   [0.0000000e+00 0.0000000e+00 0.0000000e+00 1.0000000e+00]]]].
2024-10-01 19:48:28,132 - INFO - triton_lmm.models.bevfusion.bevfusion_model: camera2lidar shape: (1, 6, 4, 4) float32, data
: [[[[ 0.999971    0.00670508 -0.00361619 -0.01262742]
   [ 0.00349105  0.01858322  0.99982125  0.76488155]
   [ 0.00677108 -0.99980485  0.01855927 -0.31093138]
   [ 0.          0.          0.          1.        ]]

  [[ 0.55165285 -0.01049361  0.8340078   0.4965345 ]
   [-0.83366805  0.02424959  0.55173326  0.61423177]
   [-0.02601402 -0.99965084  0.00462917 -0.3267865 ]
   [ 0.          0.          0.          1.        ]]

  [[ 0.57293636  0.00265955 -0.8195955  -0.49169856]
   [ 0.81932807  0.02389283  0.5728269   0.5890876 ]
   [ 0.02110592 -0.999711    0.01151002 -0.31962872]
   [ 0.          0.          0.          1.        ]]

  [[-0.9999412   0.00981312 -0.00462126 -0.00381823]
   [ 0.00469454  0.00745826 -0.99996114 -0.9087652 ]
   [-0.00977827 -0.99992406 -0.00750389 -0.28325802]
   [ 0.          0.          0.          1.        ]]

  [[-0.31705007  0.0198902  -0.9482002  -0.4831373 ]
   [ 0.94808286  0.03285569 -0.31632164  0.09905002]
   [ 0.02486207 -0.99926215 -0.02927446 -0.24979047]
   [ 0.          0.          0.          1.        ]]

  [[-0.3569066  -0.00545405  0.9341242   0.48225552]
   [-0.9334642   0.0401144  -0.35642022  0.07683985]
   [-0.03552789 -0.9991802  -0.01940826 -0.2732292 ]
   [ 0.          0.          0.          1.        ]]]].
2024-10-01 19:48:28,133 - INFO - triton_lmm.models.bevfusion.bevfusion_model: lidar2image shape: (1, 6, 4, 4) float32, data
: [[[[ 1.2634287e+03  8.2054224e+02  2.3724329e+01 -6.0428711e+02]
   [ 6.7140379e+00  5.1495331e+02 -1.2570480e+03 -7.8464923e+02]
   [-3.6161933e-03  9.9982125e-01  1.8559270e-02 -7.5901979e-01]
   [ 0.0000000e+00  0.0000000e+00  0.0000000e+00  1.0000000e+00]]

  [[ 1.3694019e+03 -6.0534521e+02 -2.9059496e+01 -3.1762927e+02]
   [ 3.9988193e+02  3.0386749e+02 -1.2581143e+03 -7.9633502e+02]
   [ 8.3400780e-01  5.5173326e-01  4.6291691e-03 -7.5149298e-01]
   [ 0.0000000e+00  0.0000000e+00  0.0000000e+00  1.0000000e+00]]

  [[ 5.1627274e+01  1.5161827e+03  3.6373707e+01 -8.5615338e+02]
   [-3.8981775e+02  3.0522061e+02 -1.2667081e+03 -7.7635083e+02]
   [-8.1959552e-01  5.7282692e-01  1.1510021e-02 -7.3676026e-01]
   [ 0.0000000e+00  0.0000000e+00  0.0000000e+00  1.0000000e+00]]

  [[-8.1300543e+02 -8.2538843e+02 -1.4135155e+01 -7.5719244e+02]
   [ 5.7145619e+00 -4.7572430e+02 -8.1277478e+02 -6.6252484e+02]
   [-4.6212552e-03 -9.9996114e-01 -7.5038881e-03 -9.1087306e-01]
   [ 0.0000000e+00  0.0000000e+00  0.0000000e+00  1.0000000e+00]]

  [[-1.1495312e+03  9.4093268e+02  8.0565224e+00 -6.4656842e+02]
   [-4.4225323e+02 -1.1458453e+02 -1.2702400e+03 -5.1961328e+02]
   [-9.4820023e-01 -3.1632164e-01 -2.9274460e-02 -4.3409172e-01]
   [ 0.0000000e+00  0.0000000e+00  0.0000000e+00  1.0000000e+00]]

  [[ 3.0454568e+02 -1.4634324e+03 -6.0415245e+01 -5.0926125e+01]
   [ 4.6130966e+02 -1.2811168e+02 -1.2682085e+03 -5.5913666e+02]
   [ 9.3412417e-01 -3.5642022e-01 -1.9408258e-02 -4.2840216e-01]
   [ 0.0000000e+00  0.0000000e+00  0.0000000e+00  1.0000000e+00]]]].
2024-10-01 19:48:28,134 - INFO - triton_lmm.models.bevfusion.bevfusion_model: img_aug_matrix shape: (1, 6, 4, 4) float32, data
: [[[[   0.48    0.      0.    -32.  ]
   [   0.      0.48    0.   -176.  ]
   [   0.      0.      1.      0.  ]
   [   0.      0.      0.      1.  ]]

  [[   0.48    0.      0.    -32.  ]
   [   0.      0.48    0.   -176.  ]
   [   0.      0.      1.      0.  ]
   [   0.      0.      0.      1.  ]]

  [[   0.48    0.      0.    -32.  ]
   [   0.      0.48    0.   -176.  ]
   [   0.      0.      1.      0.  ]
   [   0.      0.      0.      1.  ]]

  [[   0.48    0.      0.    -32.  ]
   [   0.      0.48    0.   -176.  ]
   [   0.      0.      1.      0.  ]
   [   0.      0.      0.      1.  ]]

  [[   0.48    0.      0.    -32.  ]
   [   0.      0.48    0.   -176.  ]
   [   0.      0.      1.      0.  ]
   [   0.      0.      0.      1.  ]]

  [[   0.48    0.      0.    -32.  ]
   [   0.      0.48    0.   -176.  ]
   [   0.      0.      1.      0.  ]
   [   0.      0.      0.      1.  ]]]].
2024-10-01 19:48:28,135 - INFO - __main__: BEVFusion model is loaded.
2024-10-01 19:48:28,135 - INFO - __main__: triton binding models: ['bevfusion']
2024-10-01 19:48:28,135 - INFO - triton_lmm.models.bevfusion.bevfusion_model: binding model: bevfusion to triton
2024-10-01 19:48:28,136 - INFO - pytriton.client.client: Patch ModelClient http
2024-10-01 19:48:30,333 - INFO - __main__: triton is serving models

However, after that, nothing else is printed on the terminal. Was anything else supposed to happen? What should I do now?

fanzh · October 3, 2024, 2:58pm

please continue to execute step 3.2 in opt\nvidia\deepstream\deepstream-7.0\sources\apps\sample_apps\deepstream-3d-lidar-sensor-fusion\README. seems the step 3.1 did not output any error.