I am looking for some user guide or some steps in order to run my first AI model training on this GPU. Could anyone please help me finding out how to get started using this for AI workloads?

From my experience, there is not much difference between running on H100 and on other GPUs.

@Yifan-Tan Since, these are Confidential Computing GPU, therefore I am wondering if any extra steps are needed to get started with it.

You can refer to https://docs.nvidia.com/confidential-computing-deployment-guide.pdf Additionally, H100 can be configured with Confidential Computing (CC) disabled (which is the default mode) if you do not require the CC feature.

Actually, I need to run AI apps on CC enabled GPU itself. Just, I am not sure if by default, it will run in CC or not.

Userguide to get started with H100 GPUs?

Accelerated Computing Confidential Computing

Yifan-Tan January 23, 2024, 8:17am 7

CC is disabled by default. You should follow https://docs.nvidia.com/confidential-computing-deployment-guide.pdf to setup the CC environment.

Topic		Replies	Views
How to run H100 GPU without CC Mode? Confidential Computing cuda	5	649	February 28, 2024
H100 GPUs in Confidential Computing (CC) mode Confidential Computing	1	490	December 30, 2024
Announcing Confidential Computing General Access on NVIDIA H100 Tensor Core GPUs Technical Blog	2	356	May 14, 2025
Confidential Computing on NVIDIA H100 GPUs for Secure and Trustworthy AI Technical Blog	1	786	July 3, 2024
Does H800 support HCC? Confidential Computing	5	302	February 24, 2025
Confidential Compute on GitHub? AMA with CUDA 12 Team kb	2	750	July 26, 2023
Inquiry on Confidential Computing GPUs Confidential Computing inception	2	661	February 3, 2024
Pass-through cc-disabled H100 to a non-confidential VM Confidential Computing	0	453	May 23, 2024
Does H20 support Condential Computing? Confidential Computing	1	485	August 12, 2024
Seeking Advice on Selecting the Right GPU for Deep Learning: Grace Hopper Superchip vs. H100 Series vs. HGX H100 Confidential Computing inception	2	1462	March 11, 2024

Userguide to get started with H100 GPUs?

Related topics