Get the App
SLTechnology News&Howtos  ›  IT Information  › 

Nvidia launches dual GPU product H100 NVL for the AI market, using up to 188GB HBM3 video memory

Shulou Source: shulou.com Published: 2023-11-24 15:41:07 11月17日 Update

Thanks to CTOnews.com netizens Wu Yanzu in South China for the delivery of clues! CTOnews.com March 22 news, Nvidia in the GTC Spring 2023 keynote speech, aimed at the growing AI market, launched a new dual GPU product H100 NVL. The H100 NVL is equipped with three NVLink connectors at the top, using two adjacent PCIe video card slots.

Nvidia says that when running a large language model (LLM), the video memory of a conventional graphics card cannot handle large data streams. Therefore, the H100 NVL launched this time can provide up to 188GB HBM3 video memory, single card video memory capacity 94GB.

The H100 NVL consumes slightly more power than the H100 PCIe, with an increase of 50W from 350W to 400W per GPU (configurable). CTOnews.com learned from the report that the overall performance is actually twice that of the H100 SXM: 134teraflops,TF32, 1979 teraflops,FP8, 7916 teraflops,INT8, 7916 teraops.

The memory bandwidth is also much higher than that of H100 PCIe, with a total of 7.8 TB / s per GPU (2 TB / s for H100 PCIe and 3.35 TB / s for H100 SXM).

Tags: Video memory Yingwei graphics card highest product market continuous two theme brand new memory power consumption Daniel Wu actually capacity bandwidth conventional large performance Apple Docker Huawei Linux macOS MariaDB Microsoft MySQL NVidia OPPO Reno Shulou Tech Info Huawei MySQL Shulou Technology OPPO Reno