United States: Nvidia launches H200 GPU, its latest high-end GPU

Nvidia has launched H200, its latest high-end GPU for training AI models. This new GPU, identical to the H100, has significant improvements as it features 41GB of HBM3e and a 4.8TBps memory bandwidth compared to the H100's 80GB of HBM3 and 3.5TBps of memory bandwidth.

Ian Buck, vice president of hyperscale and HPC at Nvidia, said, “To create intelligence with generative AI and HPC applications, vast amounts of data must be efficiently processed at high speed using large, fast GPU memory. With Nvidia H200, the industry’s leading end-to-end AI supercomputing platform just got faster to solve some of the world’s most important challenges.”

The H200 GPU will be available in HGX H200 server boards with four- and eight-way configurations, which are compatible with both the hardware and software of HGX H100 systems. Systems powered by this GPU are scheduled to ship in the second quarter of 2024.