Privacy Concern about NVIDIA NIM

AI & Data Science NVIDIA NIM Models
,
1

I have some privacy concern about nvidia/llama-3_1-nemotron-70b-instruct. If I deploy it in my local env :

  • Its safe to upload some confidential information or personal data into it ?
  • It also will be uploaded to NVIDIA ?
  • Is NVIDIA logged each interaction of NIM that deployed in local env ?
2
  • Its safe to upload some confidential information or personal data into it ?

As safe as your environment otherwise is, yes!

  • It also will be uploaded to NVIDIA ?

If you have deployed the NIM locally, then no - there is no separate upload to NVIDIA.

  • Is NVIDIA logged each interaction of NIM that deployed in local env ?

No, NVIDIA will not log each interaction of the NIM if deployed locally.

1 Like
3

Glad to hear that, maybe if there is a reference link to elaborate on this topic it would be my pleasure, thanks