Deepseek Resources requirements ( Deepseek-R1 7B)

AI & Data Science Deep Learning (Training & Inference) TensorRT
1

Hi Team,

I am currently working on a project to run multiple instances of Deepseek R1 7B for various projects. This will serve as a testing environment for my teams working on different use cases. I am seeking expert advice on the estimated resources required to run one Deepseek R1 7B on H200. I have one server with 8 GPU cards on-premises.

Your expertise and guidance will be invaluable for the success of this initiative. Thanks in Advance.
Thanks

2

Hi @kravindra ,
This forum talsk about issues specific to TRT, however i will keep this thread open for community to assist on your query.
But would recommend reaching out to Deepseek based forums for better assistance.

Thanks.