TensorRT8, Tensorflow1.15.5 and Cuda 10.2

AI & Data Science Deep Learning (Training & Inference) TensorRT
1

Description

It seems like TRT8 only supports Cuda10.2 or above. However it was only tested with Tensorflow 1.15.5 and when I install Tensorflow I realize that the wheel installation was built from Cuda10.0.
How did you use Tensorflow1.15.5 then with Cuda10.2 or above. Did you have to install Tensorflow from source? is there an nvidia container that I can use that already has Tensorflow1.15.5 along with cuda10.2 and cudnn8.2.0… (all the requirements for TRT8)

Thank you

5

Hi @fatma.tlili,

We have Tensorflow NGC container.

Please refer following release notes to choose container tag to match the required Tensorflow version. TensorFlow Release Notes :: NVIDIA Deep Learning Frameworks Documentation

Thank you.

6

Thank you for your reply. I don’t see Tensorflow 1.15.5 there. The oldest container has Tensorflow 1.16.
Is there an NGC container with TensorRT8? If so could you link it please.

Thank you

7

Hi @fatma.tlili,

TensorRT 8 NGC container is not yet available. Latest container has 7.2.3.4 version, if required you can upgrade TensorRT version by following installation guide.

Thank you.