Jetson Orin 32G. trtexec onnx->trt inside container

Good day.

Detected a memory issue with trtexec inside the LXC container. Outside container everything works as a charm. Container and host has the same packages installed, the same /dev/* devices (mounted everything inside the container).

Environment: Jetson Orin 32G, Jetpack 6.2 (ubuntu 22.04), CUDA 12.6, TensorRT 10.3

See the following logs:

/usr/src/tensorrt/bin/trtexec --onnx="input.onnx" --saveEngine="output-fp16.trt" --fp16
&&&& RUNNING TensorRT.trtexec [TensorRT v100300] # /usr/src/tensorrt/bin/trtexec --onnx=input.onnx --saveEngine=output-fp16.trt --fp16
[06/09/2025-13:08:37] [I] === Model Options ===
[06/09/2025-13:08:37] [I] Format: ONNX
[06/09/2025-13:08:37] [I] Model: input.onnx
[06/09/2025-13:08:37] [I] Output:
[06/09/2025-13:08:37] [I] === Build Options ===
[06/09/2025-13:08:37] [I] Memory Pools: workspace: default, dlaSRAM: default, dlaLocalDRAM: default, dlaGlobalDRAM: default, tacticSharedMem: default
[06/09/2025-13:08:37] [I] avgTiming: 8
[06/09/2025-13:08:37] [I] Precision: FP32+FP16
[06/09/2025-13:08:37] [I] LayerPrecisions: 
[06/09/2025-13:08:37] [I] Layer Device Types: 
[06/09/2025-13:08:37] [I] Calibration: 
[06/09/2025-13:08:37] [I] Refit: Disabled
[06/09/2025-13:08:37] [I] Strip weights: Disabled
[06/09/2025-13:08:37] [I] Version Compatible: Disabled
[06/09/2025-13:08:37] [I] ONNX Plugin InstanceNorm: Disabled
[06/09/2025-13:08:37] [I] TensorRT runtime: full
[06/09/2025-13:08:37] [I] Lean DLL Path: 
[06/09/2025-13:08:37] [I] Tempfile Controls: { in_memory: allow, temporary: allow }
[06/09/2025-13:08:37] [I] Exclude Lean Runtime: Disabled
[06/09/2025-13:08:37] [I] Sparsity: Disabled
[06/09/2025-13:08:37] [I] Safe mode: Disabled
[06/09/2025-13:08:37] [I] Build DLA standalone loadable: Disabled
[06/09/2025-13:08:37] [I] Allow GPU fallback for DLA: Disabled
[06/09/2025-13:08:37] [I] DirectIO mode: Disabled
[06/09/2025-13:08:37] [I] Restricted mode: Disabled
[06/09/2025-13:08:37] [I] Skip inference: Disabled
[06/09/2025-13:08:37] [I] Save engine: output-fp16.trt
[06/09/2025-13:08:37] [I] Load engine: 
[06/09/2025-13:08:37] [I] Profiling verbosity: 0
[06/09/2025-13:08:37] [I] Tactic sources: Using default tactic sources
[06/09/2025-13:08:37] [I] timingCacheMode: local
[06/09/2025-13:08:37] [I] timingCacheFile: 
[06/09/2025-13:08:37] [I] Enable Compilation Cache: Enabled
[06/09/2025-13:08:37] [I] errorOnTimingCacheMiss: Disabled
[06/09/2025-13:08:37] [I] Preview Features: Use default preview flags.
[06/09/2025-13:08:37] [I] MaxAuxStreams: -1
[06/09/2025-13:08:37] [I] BuilderOptimizationLevel: -1
[06/09/2025-13:08:37] [I] Calibration Profile Index: 0
[06/09/2025-13:08:37] [I] Weight Streaming: Disabled
[06/09/2025-13:08:37] [I] Runtime Platform: Same As Build
[06/09/2025-13:08:37] [I] Debug Tensors: 
[06/09/2025-13:08:37] [I] Input(s)s format: fp32:CHW
[06/09/2025-13:08:37] [I] Output(s)s format: fp32:CHW
[06/09/2025-13:08:37] [I] Input build shapes: model
[06/09/2025-13:08:37] [I] Input calibration shapes: model
[06/09/2025-13:08:37] [I] === System Options ===
[06/09/2025-13:08:37] [I] Device: 0
[06/09/2025-13:08:37] [I] DLACore: 
[06/09/2025-13:08:37] [I] Plugins:
[06/09/2025-13:08:37] [I] setPluginsToSerialize:
[06/09/2025-13:08:37] [I] dynamicPlugins:
[06/09/2025-13:08:37] [I] ignoreParsedPluginLibs: 0
[06/09/2025-13:08:37] [I] 
[06/09/2025-13:08:37] [I] === Inference Options ===
[06/09/2025-13:08:37] [I] Batch: Explicit
[06/09/2025-13:08:37] [I] Input inference shapes: model
[06/09/2025-13:08:37] [I] Iterations: 10
[06/09/2025-13:08:37] [I] Duration: 3s (+ 200ms warm up)
[06/09/2025-13:08:37] [I] Sleep time: 0ms
[06/09/2025-13:08:37] [I] Idle time: 0ms
[06/09/2025-13:08:37] [I] Inference Streams: 1
[06/09/2025-13:08:37] [I] ExposeDMA: Disabled
[06/09/2025-13:08:37] [I] Data transfers: Enabled
[06/09/2025-13:08:37] [I] Spin-wait: Disabled
[06/09/2025-13:08:37] [I] Multithreading: Disabled
[06/09/2025-13:08:37] [I] CUDA Graph: Disabled
[06/09/2025-13:08:37] [I] Separate profiling: Disabled
[06/09/2025-13:08:37] [I] Time Deserialize: Disabled
[06/09/2025-13:08:37] [I] Time Refit: Disabled
[06/09/2025-13:08:37] [I] NVTX verbosity: 0
[06/09/2025-13:08:37] [I] Persistent Cache Ratio: 0
[06/09/2025-13:08:37] [I] Optimization Profile Index: 0
[06/09/2025-13:08:37] [I] Weight Streaming Budget: 100.000000%
[06/09/2025-13:08:37] [I] Inputs:
[06/09/2025-13:08:37] [I] Debug Tensor Save Destinations:
[06/09/2025-13:08:37] [I] === Reporting Options ===
[06/09/2025-13:08:37] [I] Verbose: Disabled
[06/09/2025-13:08:37] [I] Averages: 10 inferences
[06/09/2025-13:08:37] [I] Percentiles: 90,95,99
[06/09/2025-13:08:37] [I] Dump refittable layers:Disabled
[06/09/2025-13:08:37] [I] Dump output: Disabled
[06/09/2025-13:08:37] [I] Profile: Disabled
[06/09/2025-13:08:37] [I] Export timing to JSON file: 
[06/09/2025-13:08:37] [I] Export output to JSON file: 
[06/09/2025-13:08:37] [I] Export profile to JSON file: 
[06/09/2025-13:08:37] [I] 
[06/09/2025-13:08:37] [I] === Device Information ===
[06/09/2025-13:08:37] [I] Available Devices: 
[06/09/2025-13:08:37] [I]   Device 0: "Orin" UUID: GPU-2a7e34c1-8b4a-5dd0-b35c-79aca35f2a43
[06/09/2025-13:08:37] [I] Selected Device: Orin
[06/09/2025-13:08:37] [I] Selected Device ID: 0
[06/09/2025-13:08:37] [I] Selected Device UUID: GPU-2a7e34c1-8b4a-5dd0-b35c-79aca35f2a43
[06/09/2025-13:08:37] [I] Compute Capability: 8.7
[06/09/2025-13:08:37] [I] SMs: 14
[06/09/2025-13:08:37] [I] Device Global Memory: 30697 MiB
[06/09/2025-13:08:37] [I] Shared Memory per SM: 164 KiB
[06/09/2025-13:08:37] [I] Memory Bus Width: 256 bits (ECC disabled)
[06/09/2025-13:08:37] [I] Application Compute Clock Rate: 0.93 GHz
[06/09/2025-13:08:37] [I] Application Memory Clock Rate: 0.93 GHz
[06/09/2025-13:08:37] [I] 
[06/09/2025-13:08:37] [I] Note: The application clock rates do not reflect the actual clock rates that the GPU is currently running at.
[06/09/2025-13:08:37] [I] 
[06/09/2025-13:08:37] [I] TensorRT version: 10.3.0
[06/09/2025-13:08:37] [I] Loading standard plugins
[06/09/2025-13:08:37] [I] [TRT] [MemUsageChange] Init CUDA: CPU +2, GPU +0, now: CPU 31, GPU 4708 (MiB)
[06/09/2025-13:08:39] [I] [TRT] [MemUsageChange] Init builder kernel library: CPU +928, GPU +752, now: CPU 1002, GPU 5505 (MiB)
[06/09/2025-13:08:39] [I] Start parsing network model.
[06/09/2025-13:08:39] [I] [TRT] ----------------------------------------------------------------
[06/09/2025-13:08:39] [I] [TRT] Input filename:   input.onnx
[06/09/2025-13:08:39] [I] [TRT] ONNX IR version:  0.0.10
[06/09/2025-13:08:39] [I] [TRT] Opset version:    11
[06/09/2025-13:08:39] [I] [TRT] Producer name:    pytorch
[06/09/2025-13:08:39] [I] [TRT] Producer version: 2.0.1
[06/09/2025-13:08:39] [I] [TRT] Domain:           
[06/09/2025-13:08:39] [I] [TRT] Model version:    0
[06/09/2025-13:08:39] [I] [TRT] Doc string:       
[06/09/2025-13:08:39] [I] [TRT] ----------------------------------------------------------------
[06/09/2025-13:08:39] [I] [TRT] No checker registered for op: EfficientNMS_TRT. Attempting to check as plugin.
[06/09/2025-13:08:39] [I] [TRT] No importer registered for op: EfficientNMS_TRT. Attempting to import as plugin.
[06/09/2025-13:08:39] [I] [TRT] Searching for plugin: EfficientNMS_TRT, plugin_version: 1, plugin_namespace: 
[06/09/2025-13:08:39] [W] [TRT] onnxOpImporters.cpp:6117: Attribute class_agnostic not found in plugin node! Ensure that the plugin creator has a default value defined or the engine may fail to build.
[06/09/2025-13:08:39] [I] [TRT] Successfully created plugin: EfficientNMS_TRT
[06/09/2025-13:08:39] [I] Finished parsing network model. Parse time: 0.054917
[06/09/2025-13:08:39] [I] [TRT] Local timing cache in use. Profiling results in this builder pass will not be stored.
[06/09/2025-13:08:39] [W] [TRT] Tactic Device request: 17MB Available: 9MB. Device memory is insufficient to use tactic.
[06/09/2025-13:08:39] [W] [TRT] UNSUPPORTED_STATE: Skipping tactic 0 due to insufficient memory on requested size of 18432000 detected for tactic 0x0000000000000000.
[06/09/2025-13:08:39] [W] [TRT] Tactic Device request: 17MB Available: 5MB. Device memory is insufficient to use tactic.
[06/09/2025-13:08:39] [W] [TRT] UNSUPPORTED_STATE: Skipping tactic 0 due to insufficient memory on requested size of 18432000 detected for tactic 0x0000000000000000.
[06/09/2025-13:08:39] [W] [TRT] Tactic Device request: 8MB Available: 5MB. Device memory is insufficient to use tactic.
[06/09/2025-13:08:39] [W] [TRT] UNSUPPORTED_STATE: Skipping tactic 0 due to insufficient memory on requested size of 9216000 detected for tactic 0x0000000000000000.
[06/09/2025-13:08:39] [W] [TRT] Tactic Device request: 8MB Available: 5MB. Device memory is insufficient to use tactic.
[06/09/2025-13:08:39] [W] [TRT] UNSUPPORTED_STATE: Skipping tactic 0 due to insufficient memory on requested size of 9216000 detected for tactic 0x0000000000000000.
[06/09/2025-13:08:39] [W] [TRT] Tactic Device request: 17MB Available: 5MB. Device memory is insufficient to use tactic.
[06/09/2025-13:08:39] [W] [TRT] UNSUPPORTED_STATE: Skipping tactic 0 due to insufficient memory on requested size of 18432000 detected for tactic 0x0000000000000000.
[06/09/2025-13:08:39] [W] [TRT] Tactic Device request: 8MB Available: 5MB. Device memory is insufficient to use tactic.
[06/09/2025-13:08:39] [W] [TRT] UNSUPPORTED_STATE: Skipping tactic 0 due to insufficient memory on requested size of 9216000 detected for tactic 0x0000000000000000.
[06/09/2025-13:08:39] [W] [TRT] Tactic Device request: 8MB Available: 5MB. Device memory is insufficient to use tactic.
[06/09/2025-13:08:39] [W] [TRT] UNSUPPORTED_STATE: Skipping tactic 0 due to insufficient memory on requested size of 9216000 detected for tactic 0x0000000000000000.
[06/09/2025-13:08:39] [W] [TRT] Tactic Device request: 17MB Available: 5MB. Device memory is insufficient to use tactic.
[06/09/2025-13:08:39] [W] [TRT] UNSUPPORTED_STATE: Skipping tactic 0 due to insufficient memory on requested size of 18432000 detected for tactic 0x0000000000000000.
[06/09/2025-13:08:39] [W] [TRT] Tactic Device request: 8MB Available: 5MB. Device memory is insufficient to use tactic.
[06/09/2025-13:08:39] [W] [TRT] UNSUPPORTED_STATE: Skipping tactic 0 due to insufficient memory on requested size of 9216000 detected for tactic 0x0000000000000000.
[06/09/2025-13:08:39] [E] Error[10]: IBuilder::buildSerializedNetwork: Error Code 10: Internal Error (Could not find any implementation for node /backbone/stem/Slice.)
[06/09/2025-13:08:39] [E] Engine could not be created from network
[06/09/2025-13:08:39] [E] Building engine failed
[06/09/2025-13:08:39] [E] Failed to create engine from model or file.
[06/09/2025-13:08:39] [E] Engine set up failed
&&&& FAILED TensorRT.trtexec [TensorRT v100300] # /usr/src/tensorrt/bin/trtexec --onnx=input.onnx --saveEngine=output-fp16.trt --fp16

LXC config:

# Common configuration
lxc.include = /usr/share/lxc/config/ubuntu.common.conf
lxc.log.level = 8
lxc.log.file = /var/log/lxc/container_ph.log

lxc.apparmor.profile = unconfined
lxc.cap.drop =

# Container specific configuration
lxc.rootfs.path = dir:/data/philimonov/base/rootfs
lxc.uts.name = ph
lxc.arch = arm64

# Network configuration
# Clear all previous
lxc.net=
lxc.net.0.type = none

# /dev
lxc.autodev = 1

# Allow all devices
lxc.cgroup.devices.allow = c *:* rmw
lxc.cgroup.devices.allow = b *:* rmw
lxc.cgroup2.devices.allow = c *:* rmw
lxc.cgroup2.devices.allow = b *:* rmw

# Mounts
lxc.mount.auto = cgroup:mixed proc:rw sys:rw
lxc.mount.entry = /sys/fs/fuse/connections sys/fs/fuse/connections none bind,optional,create=dir 0 0

lxc.mount.entry = /dev/autofs dev/autofs none bind,optional,create=file 0 0
lxc.mount.entry = /dev/block dev/block none bind,optional,create=dir 0 0
lxc.mount.entry = /dev/btrfs-control dev/btrfs-control none bind,optional,create=file 0 0
lxc.mount.entry = /dev/bus dev/bus none bind,optional,create=dir 0 0
lxc.mount.entry = /dev/capture-isp-channel0 dev/capture-isp-channel0 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-isp-channel1 dev/capture-isp-channel1 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-isp-channel10 dev/capture-isp-channel10 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-isp-channel11 dev/capture-isp-channel11 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-isp-channel12 dev/capture-isp-channel12 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-isp-channel13 dev/capture-isp-channel13 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-isp-channel14 dev/capture-isp-channel14 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-isp-channel15 dev/capture-isp-channel15 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-isp-channel16 dev/capture-isp-channel16 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-isp-channel17 dev/capture-isp-channel17 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-isp-channel18 dev/capture-isp-channel18 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-isp-channel19 dev/capture-isp-channel19 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-isp-channel2 dev/capture-isp-channel2 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-isp-channel20 dev/capture-isp-channel20 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-isp-channel21 dev/capture-isp-channel21 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-isp-channel22 dev/capture-isp-channel22 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-isp-channel23 dev/capture-isp-channel23 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-isp-channel24 dev/capture-isp-channel24 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-isp-channel25 dev/capture-isp-channel25 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-isp-channel26 dev/capture-isp-channel26 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-isp-channel27 dev/capture-isp-channel27 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-isp-channel28 dev/capture-isp-channel28 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-isp-channel29 dev/capture-isp-channel29 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-isp-channel3 dev/capture-isp-channel3 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-isp-channel30 dev/capture-isp-channel30 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-isp-channel31 dev/capture-isp-channel31 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-isp-channel32 dev/capture-isp-channel32 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-isp-channel33 dev/capture-isp-channel33 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-isp-channel34 dev/capture-isp-channel34 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-isp-channel35 dev/capture-isp-channel35 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-isp-channel36 dev/capture-isp-channel36 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-isp-channel37 dev/capture-isp-channel37 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-isp-channel38 dev/capture-isp-channel38 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-isp-channel39 dev/capture-isp-channel39 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-isp-channel4 dev/capture-isp-channel4 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-isp-channel40 dev/capture-isp-channel40 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-isp-channel41 dev/capture-isp-channel41 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-isp-channel42 dev/capture-isp-channel42 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-isp-channel43 dev/capture-isp-channel43 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-isp-channel44 dev/capture-isp-channel44 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-isp-channel45 dev/capture-isp-channel45 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-isp-channel46 dev/capture-isp-channel46 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-isp-channel47 dev/capture-isp-channel47 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-isp-channel48 dev/capture-isp-channel48 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-isp-channel49 dev/capture-isp-channel49 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-isp-channel5 dev/capture-isp-channel5 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-isp-channel50 dev/capture-isp-channel50 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-isp-channel51 dev/capture-isp-channel51 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-isp-channel52 dev/capture-isp-channel52 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-isp-channel53 dev/capture-isp-channel53 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-isp-channel54 dev/capture-isp-channel54 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-isp-channel55 dev/capture-isp-channel55 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-isp-channel56 dev/capture-isp-channel56 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-isp-channel57 dev/capture-isp-channel57 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-isp-channel58 dev/capture-isp-channel58 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-isp-channel59 dev/capture-isp-channel59 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-isp-channel6 dev/capture-isp-channel6 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-isp-channel60 dev/capture-isp-channel60 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-isp-channel61 dev/capture-isp-channel61 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-isp-channel62 dev/capture-isp-channel62 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-isp-channel63 dev/capture-isp-channel63 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-isp-channel7 dev/capture-isp-channel7 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-isp-channel8 dev/capture-isp-channel8 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-isp-channel9 dev/capture-isp-channel9 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-vi-channel0 dev/capture-vi-channel0 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-vi-channel1 dev/capture-vi-channel1 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-vi-channel10 dev/capture-vi-channel10 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-vi-channel11 dev/capture-vi-channel11 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-vi-channel12 dev/capture-vi-channel12 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-vi-channel13 dev/capture-vi-channel13 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-vi-channel14 dev/capture-vi-channel14 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-vi-channel15 dev/capture-vi-channel15 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-vi-channel16 dev/capture-vi-channel16 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-vi-channel17 dev/capture-vi-channel17 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-vi-channel18 dev/capture-vi-channel18 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-vi-channel19 dev/capture-vi-channel19 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-vi-channel2 dev/capture-vi-channel2 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-vi-channel20 dev/capture-vi-channel20 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-vi-channel21 dev/capture-vi-channel21 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-vi-channel22 dev/capture-vi-channel22 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-vi-channel23 dev/capture-vi-channel23 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-vi-channel24 dev/capture-vi-channel24 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-vi-channel25 dev/capture-vi-channel25 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-vi-channel26 dev/capture-vi-channel26 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-vi-channel27 dev/capture-vi-channel27 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-vi-channel28 dev/capture-vi-channel28 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-vi-channel29 dev/capture-vi-channel29 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-vi-channel3 dev/capture-vi-channel3 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-vi-channel30 dev/capture-vi-channel30 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-vi-channel31 dev/capture-vi-channel31 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-vi-channel32 dev/capture-vi-channel32 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-vi-channel33 dev/capture-vi-channel33 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-vi-channel34 dev/capture-vi-channel34 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-vi-channel35 dev/capture-vi-channel35 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-vi-channel36 dev/capture-vi-channel36 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-vi-channel37 dev/capture-vi-channel37 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-vi-channel38 dev/capture-vi-channel38 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-vi-channel39 dev/capture-vi-channel39 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-vi-channel4 dev/capture-vi-channel4 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-vi-channel40 dev/capture-vi-channel40 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-vi-channel41 dev/capture-vi-channel41 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-vi-channel42 dev/capture-vi-channel42 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-vi-channel43 dev/capture-vi-channel43 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-vi-channel44 dev/capture-vi-channel44 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-vi-channel45 dev/capture-vi-channel45 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-vi-channel46 dev/capture-vi-channel46 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-vi-channel47 dev/capture-vi-channel47 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-vi-channel48 dev/capture-vi-channel48 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-vi-channel49 dev/capture-vi-channel49 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-vi-channel5 dev/capture-vi-channel5 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-vi-channel50 dev/capture-vi-channel50 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-vi-channel51 dev/capture-vi-channel51 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-vi-channel52 dev/capture-vi-channel52 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-vi-channel53 dev/capture-vi-channel53 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-vi-channel54 dev/capture-vi-channel54 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-vi-channel55 dev/capture-vi-channel55 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-vi-channel56 dev/capture-vi-channel56 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-vi-channel57 dev/capture-vi-channel57 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-vi-channel58 dev/capture-vi-channel58 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-vi-channel59 dev/capture-vi-channel59 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-vi-channel6 dev/capture-vi-channel6 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-vi-channel60 dev/capture-vi-channel60 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-vi-channel61 dev/capture-vi-channel61 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-vi-channel62 dev/capture-vi-channel62 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-vi-channel63 dev/capture-vi-channel63 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-vi-channel64 dev/capture-vi-channel64 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-vi-channel65 dev/capture-vi-channel65 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-vi-channel66 dev/capture-vi-channel66 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-vi-channel67 dev/capture-vi-channel67 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-vi-channel68 dev/capture-vi-channel68 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-vi-channel69 dev/capture-vi-channel69 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-vi-channel7 dev/capture-vi-channel7 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-vi-channel70 dev/capture-vi-channel70 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-vi-channel71 dev/capture-vi-channel71 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-vi-channel8 dev/capture-vi-channel8 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/capture-vi-channel9 dev/capture-vi-channel9 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/char dev/char none bind,optional,create=dir 0 0
lxc.mount.entry = /dev/cpu_dma_latency dev/cpu_dma_latency none bind,optional,create=file 0 0
lxc.mount.entry = /dev/cuse dev/cuse none bind,optional,create=file 0 0
lxc.mount.entry = /dev/disk dev/disk none bind,optional,create=dir 0 0
lxc.mount.entry = /dev/dm-0 dev/dm-0 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/dri dev/dri none bind,optional,create=dir 0 0
lxc.mount.entry = /dev/efi_capsule_loader dev/efi_capsule_loader none bind,optional,create=file 0 0
lxc.mount.entry = /dev/fd dev/fd none bind,optional,create=dir 0 0
lxc.mount.entry = /dev/full dev/full none bind,optional,create=file 0 0
lxc.mount.entry = /dev/fuse dev/fuse none bind,optional,create=file 0 0
lxc.mount.entry = /dev/gpiochip0 dev/gpiochip0 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/gpiochip1 dev/gpiochip1 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/host1x-fence dev/host1x-fence none bind,optional,create=file 0 0
lxc.mount.entry = /dev/hugepages dev/hugepages none bind,optional,create=dir 0 0
lxc.mount.entry = /dev/hwrng dev/hwrng none bind,optional,create=file 0 0
lxc.mount.entry = /dev/i2c-0 dev/i2c-0 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/i2c-1 dev/i2c-1 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/i2c-2 dev/i2c-2 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/i2c-3 dev/i2c-3 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/i2c-4 dev/i2c-4 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/i2c-5 dev/i2c-5 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/i2c-6 dev/i2c-6 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/i2c-7 dev/i2c-7 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/initctl dev/initctl none bind,optional,create=file 0 0
lxc.mount.entry = /dev/input dev/input none bind,optional,create=dir 0 0
lxc.mount.entry = /dev/kmsg dev/kmsg none bind,optional,create=file 0 0
lxc.mount.entry = /dev/kvm dev/kvm none bind,optional,create=file 0 0
lxc.mount.entry = /dev/log dev/log none bind,optional,create=file 0 0
lxc.mount.entry = /dev/loop0 dev/loop0 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/loop1 dev/loop1 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/loop2 dev/loop2 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/loop3 dev/loop3 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/loop4 dev/loop4 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/loop5 dev/loop5 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/loop6 dev/loop6 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/loop7 dev/loop7 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/loop-control dev/loop-control none bind,optional,create=file 0 0
lxc.mount.entry = /dev/mapper dev/mapper none bind,optional,create=dir 0 0
lxc.mount.entry = /dev/media0 dev/media0 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/megaraid_sas_ioctl_node dev/megaraid_sas_ioctl_node none bind,optional,create=file 0 0
lxc.mount.entry = /dev/mem dev/mem none bind,optional,create=file 0 0
lxc.mount.entry = /dev/mmcblk0 dev/mmcblk0 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/mmcblk0boot0 dev/mmcblk0boot0 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/mmcblk0boot1 dev/mmcblk0boot1 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/mmcblk0p1 dev/mmcblk0p1 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/mmcblk0p10 dev/mmcblk0p10 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/mmcblk0p11 dev/mmcblk0p11 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/mmcblk0p12 dev/mmcblk0p12 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/mmcblk0p13 dev/mmcblk0p13 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/mmcblk0p14 dev/mmcblk0p14 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/mmcblk0p15 dev/mmcblk0p15 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/mmcblk0p2 dev/mmcblk0p2 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/mmcblk0p3 dev/mmcblk0p3 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/mmcblk0p4 dev/mmcblk0p4 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/mmcblk0p5 dev/mmcblk0p5 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/mmcblk0p6 dev/mmcblk0p6 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/mmcblk0p7 dev/mmcblk0p7 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/mmcblk0p8 dev/mmcblk0p8 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/mmcblk0p9 dev/mmcblk0p9 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/mmcblk0rpmb dev/mmcblk0rpmb none bind,optional,create=file 0 0
lxc.mount.entry = /dev/mqueue dev/mqueue none bind,optional,create=dir 0 0
lxc.mount.entry = /dev/net dev/net none bind,optional,create=dir 0 0
lxc.mount.entry = /dev/ng0n1 dev/ng0n1 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/null dev/null none bind,optional,create=file 0 0
lxc.mount.entry = /dev/nvgpu dev/nvgpu none bind,optional,create=dir 0 0
lxc.mount.entry = /dev/nvhost-as-gpu dev/nvhost-as-gpu none bind,optional,create=file 0 0
lxc.mount.entry = /dev/nvhost-ctrl-gpu dev/nvhost-ctrl-gpu none bind,optional,create=file 0 0
lxc.mount.entry = /dev/nvhost-ctrl-isp dev/nvhost-ctrl-isp none bind,optional,create=file 0 0
lxc.mount.entry = /dev/nvhost-ctrl-isp-thi dev/nvhost-ctrl-isp-thi none bind,optional,create=file 0 0
lxc.mount.entry = /dev/nvhost-ctrl-nvcsi dev/nvhost-ctrl-nvcsi none bind,optional,create=file 0 0
lxc.mount.entry = /dev/nvhost-ctrl-nvdla0 dev/nvhost-ctrl-nvdla0 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/nvhost-ctrl-nvdla1 dev/nvhost-ctrl-nvdla1 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/nvhost-ctrl-pva0 dev/nvhost-ctrl-pva0 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/nvhost-ctrl-vi0 dev/nvhost-ctrl-vi0 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/nvhost-ctrl-vi0-thi dev/nvhost-ctrl-vi0-thi none bind,optional,create=file 0 0
lxc.mount.entry = /dev/nvhost-ctrl-vi1 dev/nvhost-ctrl-vi1 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/nvhost-ctrl-vi1-thi dev/nvhost-ctrl-vi1-thi none bind,optional,create=file 0 0
lxc.mount.entry = /dev/nvhost-ctxsw-gpu dev/nvhost-ctxsw-gpu none bind,optional,create=file 0 0
lxc.mount.entry = /dev/nvhost-dbg-gpu dev/nvhost-dbg-gpu none bind,optional,create=file 0 0
lxc.mount.entry = /dev/nvhost-gpu dev/nvhost-gpu none bind,optional,create=file 0 0
lxc.mount.entry = /dev/nvhost-nvsched_ctrl_fifo-gpu dev/nvhost-nvsched_ctrl_fifo-gpu none bind,optional,create=file 0 0
lxc.mount.entry = /dev/nvhost-nvsched-gpu dev/nvhost-nvsched-gpu none bind,optional,create=file 0 0
lxc.mount.entry = /dev/nvhost-power-gpu dev/nvhost-power-gpu none bind,optional,create=file 0 0
lxc.mount.entry = /dev/nvhost-prof-ctx-gpu dev/nvhost-prof-ctx-gpu none bind,optional,create=file 0 0
lxc.mount.entry = /dev/nvhost-prof-dev-gpu dev/nvhost-prof-dev-gpu none bind,optional,create=file 0 0
lxc.mount.entry = /dev/nvhost-prof-gpu dev/nvhost-prof-gpu none bind,optional,create=file 0 0
lxc.mount.entry = /dev/nvhost-sched-gpu dev/nvhost-sched-gpu none bind,optional,create=file 0 0
lxc.mount.entry = /dev/nvhost-tsg-gpu dev/nvhost-tsg-gpu none bind,optional,create=file 0 0
lxc.mount.entry = /dev/nvidia0 dev/nvidia0 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/nvidiactl dev/nvidiactl none bind,optional,create=file 0 0
lxc.mount.entry = /dev/nvmap dev/nvmap none bind,optional,create=file 0 0
lxc.mount.entry = /dev/nvme0 dev/nvme0 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/nvme0n1 dev/nvme0n1 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/nvme0n1p1 dev/nvme0n1p1 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/nvme-fabrics dev/nvme-fabrics none bind,optional,create=file 0 0
lxc.mount.entry = /dev/nvpps0 dev/nvpps0 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/nvsciipc dev/nvsciipc none bind,optional,create=file 0 0
lxc.mount.entry = /dev/port dev/port none bind,optional,create=file 0 0
lxc.mount.entry = /dev/pps0 dev/pps0 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/ptp0 dev/ptp0 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/pts dev/pts none bind,optional,create=dir 0 0
lxc.mount.entry = /dev/ptyp0 dev/ptyp0 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/ptyp1 dev/ptyp1 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/ptyp2 dev/ptyp2 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/ptyp3 dev/ptyp3 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/ptyp4 dev/ptyp4 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/ptyp5 dev/ptyp5 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/ptyp6 dev/ptyp6 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/ptyp7 dev/ptyp7 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/ptyp8 dev/ptyp8 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/ptyp9 dev/ptyp9 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/ptypa dev/ptypa none bind,optional,create=file 0 0
lxc.mount.entry = /dev/ptypb dev/ptypb none bind,optional,create=file 0 0
lxc.mount.entry = /dev/ptypc dev/ptypc none bind,optional,create=file 0 0
lxc.mount.entry = /dev/ptypd dev/ptypd none bind,optional,create=file 0 0
lxc.mount.entry = /dev/ptype dev/ptype none bind,optional,create=file 0 0
lxc.mount.entry = /dev/ptypf dev/ptypf none bind,optional,create=file 0 0
lxc.mount.entry = /dev/random dev/random none bind,optional,create=file 0 0
lxc.mount.entry = /dev/rfkill dev/rfkill none bind,optional,create=file 0 0
lxc.mount.entry = /dev/rtc dev/rtc none bind,optional,create=file 0 0
lxc.mount.entry = /dev/rtc0 dev/rtc0 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/rtc1 dev/rtc1 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/shm dev/shm none bind,optional,create=dir 0 0
lxc.mount.entry = /dev/snd dev/snd none bind,optional,create=dir 0 0
lxc.mount.entry = /dev/spidev0.0 dev/spidev0.0 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/spidev0.1 dev/spidev0.1 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/spidev1.0 dev/spidev1.0 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/spidev1.1 dev/spidev1.1 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/tee0 dev/tee0 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/teepriv0 dev/teepriv0 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/tegra_camera_ctrl dev/tegra_camera_ctrl none bind,optional,create=file 0 0
lxc.mount.entry = /dev/tegra-soc-hwpm dev/tegra-soc-hwpm none bind,optional,create=file 0 0
lxc.mount.entry = /dev/uhid dev/uhid none bind,optional,create=file 0 0
lxc.mount.entry = /dev/urandom dev/urandom none bind,optional,create=file 0 0
lxc.mount.entry = /dev/v4l2-nvdec dev/v4l2-nvdec none bind,optional,create=file 0 0
lxc.mount.entry = /dev/v4l2-nvenc dev/v4l2-nvenc none bind,optional,create=file 0 0
lxc.mount.entry = /dev/vcs dev/vcs none bind,optional,create=file 0 0
lxc.mount.entry = /dev/vcs1 dev/vcs1 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/vcs2 dev/vcs2 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/vcs3 dev/vcs3 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/vcs4 dev/vcs4 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/vcs5 dev/vcs5 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/vcs6 dev/vcs6 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/vcsa dev/vcsa none bind,optional,create=file 0 0
lxc.mount.entry = /dev/vcsa1 dev/vcsa1 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/vcsa2 dev/vcsa2 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/vcsa3 dev/vcsa3 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/vcsa4 dev/vcsa4 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/vcsa5 dev/vcsa5 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/vcsa6 dev/vcsa6 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/vcsu dev/vcsu none bind,optional,create=file 0 0
lxc.mount.entry = /dev/vcsu1 dev/vcsu1 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/vcsu2 dev/vcsu2 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/vcsu3 dev/vcsu3 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/vcsu4 dev/vcsu4 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/vcsu5 dev/vcsu5 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/vcsu6 dev/vcsu6 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/vfio dev/vfio none bind,optional,create=dir 0 0
lxc.mount.entry = /dev/vga_arbiter dev/vga_arbiter none bind,optional,create=file 0 0
lxc.mount.entry = /dev/watchdog dev/watchdog none bind,optional,create=file 0 0
lxc.mount.entry = /dev/watchdog0 dev/watchdog0 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/zero dev/zero none bind,optional,create=file 0 0
lxc.mount.entry = /dev/zram0 dev/zram0 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/zram1 dev/zram1 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/zram2 dev/zram2 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/zram3 dev/zram3 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/zram4 dev/zram4 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/zram5 dev/zram5 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/zram6 dev/zram6 none bind,optional,create=file 0 0
lxc.mount.entry = /dev/zram7 dev/zram7 none bind,optional,create=file 0 0

lxc.mount.entry = /etc/nv_boot_control.conf etc/nv_boot_control.conf none bind,create=file 0 0
lxc.mount.entry = /home/philimonov home/philimonov none bind,create=dir 0 0

What has been tried so far:

  1. Running on host - works
  2. chroot with mount --bind for /dev, /proc, /sys, .. - works
  3. Running inside LXC - doesn’t work in 99%, however extremely rarely it succeeded, once I saw how it started, but broke in the middle of execution with the same errors
  4. Turning /proc/sys/vm/overcommit_memory == 1 doesn’t help
  5. nvidia-container meta package is installed
  6. LXC is in priviledged mode, apparmor/cap is turned off
  7. tried a different workload from here: GitHub - anseeto/jetson-gpu-burn: Multi-GPU CUDA stress test.
    The same behaviour: works on host, doesn’t work inside the container.

Honestly, I has exhausted all my at hand tooling, what could be wrong with container and GPU specific workload inside it? Haven’t seen any troubles with ubuntu 20.04 / jetpack 5 / jetson xavier.

Sincerely yours,
Dmtriy Philimonov

Update: /usr/src/tensorrt/bin/samble_* binaries worked on both container and host.

for what it’s worth, I had these memory-related error messages when running tensorRT conversion utility from a Yolo ONNX model.
I don’t know what was wrong, but I rebooted the jetson to start from a clean state and conversion went through.
That doesn’t fix any of the underlying issue and it’s quite annoying because it means tests/conversions can’t be automated.

Hi,

There is a known issue of TensorRT 10.3 related to container memory.
Could you try to generate the engine file outside of the container and copy it into the container to see if it can work?

If yes, please upgrade to TensorRT to 10.5+ which already contains the fix.

Thanks.

Could you recommend the most stable and best supported for Jetson Orin AGX package versions ? For example CUDA 12.6 + TensorRT 10.5, or CUDA 12.9 + TensorRT 10.11?

What exact versions would you choose for the Jetson AGX Orin 32G platform?

Hi,

For this particular issue, you only need to update the TensorRT to 10.5+.
So both ways should work fine.

Thanks.

Tried TensorRT 10.7 + CUDA 12.6. Works on both: container and host. The problem is solved.