NVIDIA Hopper Architecture In-Depth

Originally published at: https://developer.nvidia.com/blog/nvidia-hopper-architecture-in-depth/

Everything you want to know about the new H100 GPU.


A question, arose with reading the news, is related to L2 (L1) bandwidth for sustained 3TB/s memory bandwidth on that latency levels of Grace and Hopper architectures.
Are there suggestions or real numbers (from cpu/gpu analysis) for to sort in these high numbers on cache and memory transfer bw (thx)?

Any news on this GPU accelerator?

Where (in the cloud?) can I test it? More specifically, I would like to test its TEE capabilities. Is there any SDK/documentation available for this GPU?

1 Like