Nvidia is launching a new must-have AI chip — as customers still scramble for its last one

Nvidia’s HGX H200. | Image: Nvidia

Nvidia is introducing a new top-of-the-line chip for AI work, the HGX H200. The new GPU upgrades the wildly in demand H100 with 1.4x more memory bandwidth and 1.8x more memory capacity, improving its ability to handle intensive generative AI work.

The big question is whether companies will be able to get their hands on the new chips or whether they’ll be as supply constrained as the H100 — and Nvidia doesn’t quite have an answer for that. The first H200 chips will be released in the second quarter of 2024, and Nvidia says it’s working with “global system manufacturers and cloud service providers” to make them available.

The H200 appears to be substantially the same as the H100 outside of its memory. But the changes to its memory make for...

Continue reading…



source https://www.theverge.com/2023/11/13/23958823/nvidia-h200-ai-gpu-announced-specs-release-date

Comments

Popular posts from this blog

Google Assistant will soon be on a billion devices, and feature phones are next

TP-Link unveils its first family of Wi-Fi 6 routers

GE made a 27-inch smart display for above your stove that streams Netflix and Spotify