Please provide the following info (tick the boxes after creating this topic):
Software Version
[1] DRIVE OS 6.0.5
DRIVE OS 6.0.4 (rev. 1)
DRIVE OS 6.0.4 SDK
other
Target Operating System
[1] Linux
QNX
other
Hardware Platform
DRIVE AGX Orin Developer Kit (940-63710-0010-D00)
DRIVE AGX Orin Developer Kit (940-63710-0010-C00)
[1] DRIVE AGX Orin Developer Kit (not sure its number)
other
SDK Manager Version
[1] 1.9.1.10844
other
Host Machine Version
[1] native Ubuntu Linux 20.04 Host installed with SDK Manager
native Ubuntu Linux 20.04 Host installed with DRIVE OS Docker Containers
native Ubuntu Linux 18.04 Host installed with DRIVE OS Docker Containers
other
I have encountered a problem with TensorRT model deployment.
The error message is as below:
[02/22/2023-02:24:45] [V] [TRT] --------------- Timing Runner: {ForeignNode[4107…ScatterND_8175]} (Myelin)
[02/22/2023-02:25:03] [W] [TRT] Skipping tactic 0 due to insufficient memory on requested size of 110933120 detected for tactic 0x0000000000000000.
[02/22/2023-02:25:03] [V] [TRT] Fastest Tactic: 0xd15ea5edd15ea5ed Time: inf
[02/22/2023-02:25:03] [V] [TRT] Deleting timing cache: 3792 entries, served 17385 hits since creation.
[02/22/2023-02:25:03] [E] Error[4]: [optimizer.cpp::computeCosts::3635] Error Code 4: Internal Error (Could not find any implementation for node {ForeignNode[4107…ScatterND_8175]} due to insufficient workspace. See verbose log for requested sizes.)
[02/22/2023-02:25:03] [E] Error[2]: [builder.cpp::buildSerializedNetwork::636] Error Code 2: Internal Error (Assertion engine != nullptr failed. )
[02/22/2023-02:25:03] [E] Engine could not be created from network
[02/22/2023-02:25:03] [E] Building engine failed
[02/22/2023-02:25:03] [E] Failed to create engine from model.
[02/22/2023-02:25:03] [E] Engine set up failed
However, the model can be deployed by TensorRT on 3060Ti with 12GB GPU memory.
So I want to know, what is the GPU memory limitation of Drive Orin 32GB Verion? And how to solve above problem.