More recently we've seen Nvidia condense a smaller version of this down to a single rack with the GH200-NVL32 announced in collaboration with AWS at Re:Invent this fall. That system packs 16 1U ...
[Related: Nvidia CEO Explains How AI Chips Could Save ... thanks to a new “rack-scale” GPU architecture called the GH200 NVL32 multi-node platform that combines as many chips in one liquid ...