TensorRT compatible with conda installations?

Hey everybody,

I’ve recently started working with tensorflow-gpu. In order to get everything started I installed cuda and cudnn via conda and currently I’m looking for some ways to speed up the inference.
Can anyone tell me if tensorrt would work even tho cuda and cudnn were installed via conda or do I have to install them manually?

Hi @anh.maxiking,
There might be a possibility that installing cudatoolkit with Conda may lead to broken packages, for example this installation may possibly conflict or at least confuse apt when it might expect CUDA to be in a certain place rather than wherever Conda puts it when trying to install something dependent on CUDA.
You can use NGC containers to avoid any such system dependencies related issues.
https://ngc.nvidia.com/catalog/containers?orderBy=modifiedDESC&pageNumber=0&query=&quickFilter=containers&filters=

Thanks!