Nvidia Hopper architecture H100 GPU is fully put into production and more than 50 server models will be available by the end of the year.

CTOnews.com Sept. 21, Nvidia announced today that the NVIDIA H100 Tensor Core GPU is in full production, and NVIDIA Global Technology Partners plan to launch the first products and services based on the groundbreaking NVIDIA Hopper architecture in October.

CTOnews.com learned that the H100, released in April 2022, consists of 80 billion transistors and uses a number of groundbreaking technologies, including a powerful new Transformer engine and NVIDIA NVLink interconnection technology, to accelerate the largest AI models, such as advanced recommendation systems and large language models, and to drive innovation in areas such as conversational AI and drug discovery.

Nvidia said the H100 enabled companies to reduce the cost of deploying AI, increasing energy efficiency by 3.5 times with the same AI performance compared to the previous generation, reducing the total cost of ownership to 1 pound 3 and using less server nodes than the previous generation.

The NVIDIA DGX H100 system has now begun to accept customer bookings. The system contains 8 H100 GPU,FP8 precision with peak performance up to 32 PFlops. Each DGX system contains NVIDIA Base Command and NVIDIA AI Enterprise software that enables cluster deployment from a single node to NVIDIA DGX SuperPOD, supporting advanced AI development efforts for large language models and other large workloads.

H100 systems provided by the world's leading computer manufacturers are expected to ship in the next few weeks, with more than 50 server models on the market by the end of this year and dozens more in the first half of 2023. Partners who are already building the system include Atos, Cisco, Dell Technology, Fujitsu, gigabyte Technology, Wisdom, Lenovo and Nano.