Here’s a closer look at NVIDIA’s H100 SXM with 4nm Hopper GPU

It has now been over a month since the GTC 2022 conference and finally, after all that long wait, the photos of NVIDIA’s latest data center GPU have been published by ServeTheHome.

The H100 is the latest accelerator to come with a 4nm GPU build and is designed based on the Hopper architecture. Until now we had only looked at different renderings of this, but now we finally get the new design on the SXM form factor in real photos. ServeTheHome has also confirmed that the H100 will have a board called the PG520.

The NVIDIA H100 has adopted the TSMC CoWoS packaging technology which utilizes an 814mm² GH100 GPU chip along with six memory modules. This variant in particular has 16896 CUDA cores and will come with 80 GB HBM3 memory. The SXM mezzanine connectors we see on this variant are different from what we saw on the A100. NVIDIA ditched the design with two long connectors on each side of the GPU for a shorter connector.

The H100 consumes more power than previous SXM data center GPUs designed on different architectures. This will consume up to 700W of power.

It is available for pre-order in Japan for $33,000.

Via ServetheHome, VideoCardz

Leave a Comment