Video-search-and-summarization single deployment

AI & Data Science NVIDIA Blueprints
1

Hello NVIDIA team

Could you please tell me about SINGLE DEPLOYMENT of VSS.
Is it possible to deploy with RTX PRO 6000 x1?

The document contains this statement.
/////
Single GPU Deployment recipe using non-default low memory modes and smaller LLMs verified on 1XH100, 1XH200, 1XA100 (80GB+, HBM) machine is available below.
/////

I think there is no problem in terms of GPU memory, but I cannot determine if it is possible to deploy because of the different architecture and the lack of NIM profile.

Best Regards

2

Hi @kawabe-k ,

VSS 2.3.1 is due to be released in June, and will have remote-endpoint support for RTX Pro 6000 Blackwell, as full NIM support will come in July.

Best,

Sophie

3

Thank you for your reply.

I understood that all NIMs can be deployed on a single GPU(RTX Pro 6000), which is JULY scheduled.
Is that correct?

What I want to know is local deployment, not REMOTE.
Best regards

4

Correct - July for local deployment.

Best,

Sophie

5

Thank you for your reply.
I’m looking forward to release it.

Bestregards

6

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.