Nvidia NIM Inference with Nvidia Hosted model taking very long

AI & Data Science NVIDIA NIM Models
1

Hello Nvidia team,

I am trying python inference with nvidia hosted model with nim key. However, it’s taking more than 10-15 minutes and not giving any proper response. It was working fine until few days back. I tried running this with different keys as well.

I am using code given here.

vila Model by NVIDIA | NVIDIA NIM

This is where it is getting stuck.

image
image1919×1003 210 KB

Can you please help to resolve this issue?

2

hi @dhruv.makwana thanks for bringing this to our attention. We are working to fix the issue now. Will update here when it is resolved.

Thanks for your patience,

Sophie

3

Hi @dhruv.makwana The hosted vila Model is now back online. Thanks again for letting us know it wasn’t working as expected.

Best,

Sophie