RuntimeError: [TensorRT-LLM][ERROR] CUDA runtime error in error: peer access is not supported between these two devices

[AakankshaS]

Hi @pbi2 ,
Apologies for the miss.

@pbi2

RuntimeError: [TensorRT-LLM][ERROR] CUDA runtime error in error: peer access is not supported between these two devices (/home/jenkins/agent/workspace/LLM/main/L0_PostMerge/tensorrt_llm/cpp/tensorrt_llm/runtime/ipcUtils.cpp:48)

You should give this a try Peer access not supported between devices - #12 by Robert_Crovella

Thanks