On August 9th, Nvidia (Nvidia) released an upgraded version of its next-generation Grace Hopper super chip platform on Tuesday, which uses HBM3e memory technology and is designed for artificial intelligence and high-performance computing. The new GH200 Grace Hopper super chip platform consists of a 72-core Grace CPU and a GH100 Hopper computing GPU, but unlike the first generation, it uses HBM3e memory, which has significantly improved memory capacity and bandwidth.
Nvidia launched the Grace Hopper super chip in March 2022, which for the first time combined CPU and GPU on one motherboard.
HBM3e memory is a new high-bandwidth memory technology that can provide higher data transfer rates in a smaller space. The new GH200 Grace Hopper superchip platform is based on a 72-core Grace CPU with 480 GB of ECC LPDDR5X memory and a GH100 computing GPU paired with 141 GB of HBM3e memory divided into six 24 GB stacks and using a 6,144-bit memory interface. While Nvidia actually has 144 GB of memory installed, only 141 GB is usable.
Nvidia's current GH200 Grace Hopper superchip platform features 96 GB of HBM3 memory and a bandwidth of less than 4 TB/s. In comparison, the upgraded version has about 50 percent more memory capacity and more than 25 percent more bandwidth. Such dramatic improvements enable the new platform to run much larger AI models than the original version, and provide significant performance improvements (which are especially important for training).
According to Nvidia, the current GH200 Grace Hopper superchip platform with HBM3 memory is already in production and will begin commercial sales next month. The GH200 Grace Hopper superchip platform with HBM3e memory is now sampling and is expected to be available in the second quarter of 2024.
Nvidia emphasized that the new GH200 Grace Hopper uses the same Grace CPU and GH100 GPU chips as the original, so the company didn't need to introduce any new versions or steps. Nvidia says that the original GH200 and the upgraded GH200 will coexist in the market, which means the latter will be sold at a higher price, after all, due to the higher performance brought about by its more advanced memory technology.
Nvidia said that the next-generation Grace Hopper superchip platform with HBM3e memory is fully compatible with Nvidia's MGX server specification and can be directly compatible with existing server designs.
Recommended related articles：