matrix operations

Autonomous Machines Jetson & Embedded Systems Jetson Nano
1

Hi,

Does TensorRT support matrix operations, including matrix transpose and matrix multiplication?

If not, when will TensorRT support these matrix operations?

2

Hi hi-bigcat,

Currently, almost all the TensorRT features support ARM environment.
Please refer to [url]Support Matrix :: NVIDIA Deep Learning TensorRT Documentation

3

Hi Kayccc,

Don’t understand your last reply, could you explain more?

I mean I found matrix operations are not supported in TensorRT and I haven’t found matrix operations in TensorRT Caffe supported layers
If matrix operations are really not supported , we will start to develop them as custom layers in TensorRT

4

Hi,

TensorRT has shuffle(transpose) and MatrixMultiply layers can meet your requirement.

For the parser side, are you using onnx based frameworks?
Our onnx parser also supports Transpose and MatMul operations.
You can check the document shared by kayccc for the detail support matrix.

Thanks.

5

Hi,

I am using Caffe parser now, but i haven’t found MatrixMultiply and shuffle layers in Caffe support list, and the Parser reports cannot parser these two layers.

ONNX parser will be used after all Caffe models are successfully done.

6

Hi,

Would you mind to share the layer definition with us so we can check it for you?
Thanks.

7

Hi,

I am using TensorRT custom layer ways to solve these two layers, thanks

8

Hi,

Please let us know if you have further question.
Thanks.