NVIDIA DGX H100 AI infrastructure

NVIDIA DGX H100 AI infrastructure

DESCRIPTION

Artificial intelligence has become the go-to approach for solving  difficult business challenges. Whether improving customer service,  optimizing supply chains, extracting business intelligence, or  designing leading-edge products and services with generative AI  and other transformer models, AI gives organizations across nearly  every industry the mechanism to realize innovation. And as a pioneer  in AI infrastructure, NVIDIA DGX™ provides the most powerful and  complete AI platform for bringing these essential ideas to fruition.

NVIDIA DGX H100 powers business innovation and optimization.  Part of the DGX platform and the latest iteration of NVIDIA’s  legendary DGX systems, DGX H100 is the AI powerhouse that’s the  foundation of NVIDIA DGX SuperPOD™, accelerated by the  groundbreaking performance of the NVIDIA H100 Tensor Core GPU.  The system is designed to maximize AI throughput, providing  enterprises with a highly refined, systemized, and scalable platform  to help them achieve breakthroughs in natural language  processing, recommender systems, data analytics, and much more.  Available on-premises and through a wide variety of access and  deployment options, DGX H100 delivers the performance needed  for enterprises to solve the biggest challenges with AI.

Specifications

GPU: 8x NVIDIA H100 Tensor Core GPUs

GPU memory: 640GB total

Performance:32 petaFLOPS FP8

System power  usage:10.2kW max

CPU:Dual Intel® Xeon® Platinum 8480C Processors  112 Cores total, 2.00 GHz (Base), 3.80 GHz (Max Boost)

System memory:2TB

Storage:OS: 2x 1.92TB NVMe M.2

Internal storage:8x 3.84TB NVMe U.2

Support:Comes with 3-year business-standard  hardware and software support

System weight:287.6lbs (130.45kgs)

System dimensions:Height: 14.0in (356mm) Width: 19.0in (482.2mm) Length: 35.3in (897.1mm)

Operating  temperature range:5–30°C (41–86°F)

The Cornerstone of Your AI Center of Excellence

AI has bridged the gap between science and business. No longer  the domain of experimentation, AI is used day in and day out by  companies large and small to fuel their innovation and optimize  their business. As the fourth generation of the world’s first  purpose-built AI infrastructure, DGX H100 is designed to be the  centerpiece of an enterprise AI center of excellence. It’s a fully  optimized hardware and software platform that includes full  support for the new range of NVIDIA AI software solutions, a rich  ecosystem of third-party support, and access to expert advice  from NVIDIA professional services. DGX H100 offers proven  reliability, with the DGX platform being used by thousands of  customers around the world spanning nearly every industry.