|
|
|
List of Xi Servers with NVIDIA H200/H200 NVL Tensor Core GPU
|
|
|
|
 |
The world’s most powerful GPU for supercharging AI and HPC workloads.
The NVIDIA H200/H200 NVL Tensor Core GPU supercharges generative AI and high-performance computing (HPC) workloads with game-changing performance and memory capabilities. As the first GPU with HBM3e, the H200’s larger and faster memory fuels the acceleration of generative AI and large language models (LLMs) while advancing scientific computing for HPC workloads.
|
Higher Performance and Larger, Faster Memory
Based on the NVIDIA Hopper architecture, the NVIDIA H200 is the first GPU to offer 141 gigabytes (GB) of HBM3e memory at 4.8 terabytes per second (TB/s) —that’s nearly double the capacity of the NVIDIA H100 Tensor Core GPU with 1.4X more memory bandwidth. The H200’s larger and faster memory accelerates generative AI and LLMs, while advancing scientific computing for HPC workloads with better energy efficiency and lower total cost of ownership.
.
|
|
|
 |
Unlock Insights With High-Performance LLM Inference
In the ever-evolving landscape of AI, businesses rely on large language models to
address a diverse range of inference needs. An AI inference accelerator must deliver
the highest throughput at the lowest TCO when deployed at scale for a massive
user base.
The H200 doubles inference performance compared to H100 GPUs when handling
large language models such as Llama2 70B.
|
 |
Supercharge High-Performance Computing
Memory bandwidth is crucial for HPC applications, as it enables faster data
transfer and reduces complex processing bottlenecks. For memory-intensive
HPC applications like simulations, scientific research, and artificial intelligence,
the H200’s higher memory bandwidth ensures that data can be accessed and
manipulated efficiently, leading to 110X faster time to results.
|
 |
Reduce Energy and TCO
With the introduction of H200, energy efficiency and TCO reach new levels. This
cutting-edge technology offers unparalleled performance, all within the same power
profile as the H100 Tensor Core GPU. AI factories and supercomputing systems that
are not only faster but also more eco-friendly deliver an economic edge that propels
the AI and scientific communities forward. |
To learn more about the NVIDIA H200 Tensor Core GPU, visit www.nvidia.com/h200
© 2024 NVIDIA Corporation. All rights reserved. NVIDIA, the NVIDIA logo, CUDA, DGX, HGX, HGX H200, NVLink, NVSwitch, OpenACC, TensorRT, and Volta are trademarks and/or registered trademarks of NVIDIA Corporation in the U.S. and other countries. OpenCL is a trademark of Apple Inc. used under license to the Khronos Group Inc. All other trademarks and copyrights are the property of their respective owners. |
|
|
|
Ready for Enterprise AI?
|
|
NVIDIA AI Enterprise, together with NVIDIA H200, simplifies the building of an AI-ready platform, accelerating AI development and deployment of production-ready generative AI, computer vision, speech AI, and more. Together, they deliver enterprise-grade security, manageability, stability, and support to gather actionable insights faster and achieve tangible business value sooner. |
|
|
|
DATA CENTER GPUs QUICK SPECS: |
|
Model Name |
NVIDIA H200 NVL for PCIe |
NVIDIA H200 for SXM |
|
FP32 CUDA Cores |
- |
- |
|
SM Tensor Cores |
- |
- |
|
FP64 |
34 teraFLOPS |
34 teraFLOPS |
|
FP64 Tensor
Core |
67 teraFLOPS |
67 teraFLOPS |
|
FP32 |
67 teraFLOPS |
67 teraFLOPS |
|
TF32 Tensor
Core |
989 teraFLOPS* |
989 teraFLOPS* |
|
BFLOAT16 Tensor
Core |
1,979 teraFLOPS* |
1,979 teraFLOPS* |
|
FP16 Tensor
Core |
1,979 teraFLOPS* |
1,979 teraFLOPS* |
|
FP8 Tensor Core
|
3,958 teraFLOPS* |
3,958 teraFLOPS* |
|
INT8 Tensor
Core |
3,958 TOPS* |
3,958 TOPS* |
|
GPU Memory |
141 GB HBM2e |
141 GB HBM2e |
|
GPU Memory Bandwidth |
4.8TB/s |
4.8TB/s |
|
Interconnect |
NVIDIA NVLink 900 GB/s PCIe Gen5 128 GB/s |
NVIDIA NVLink 900 GB/s PCIe Gen5 128 GB/s |
|
Multi-instance GPUs |
Various instance
Up to 7 MIGS @ 16.5GB each |
Various instance
Up to 7 MIGS @ 16.5GB each |
|
Form Factor |
PCIe |
SXM |
|
Max TDP Power |
Up to 600W |
700W |
|
Networking |
- |
- |
|
NVIDIA AI Enterprise |
Included |
Add-on |
|
* With sparsity
** Preliminary specifications. May be subject to change.
Hopper family
NVIDIA H200 for PCIe -
NVIDIA H200 NVL for PCIe -
NVIDIA H200 for SXM - |
|
Best Optimized Data Center Servers |
Xi® NetRAIDer™ 64LT
Xi® NetRAIDer™ 64XLT
Xi® NetRAIDer™ 64XE
Xi® WebRAIDer™ 64X-1U |
|
|
*Published Prices. Prices shown (provided by way of a Quotation or a Pre-Configured List) are subject to change without prior notice to the prices in effect at the time of Quotation or placing an Order. Seller reserves the right to make any corrections to prices quoted due to availability, clerical errors or errors of omission. In the event of any specific requirements (including without limitation any design, specification, ordered quantity, or shipment changes) representing a price increase.
|
|
|
|
Follow us on @Xi Social Media:
|
|
|
|
|
.:Total views:.
4066
|
Typographic errors are subject to correction. Merchandise enlarged to show detail and may not always be exactly as pictured.
All trademarks and brands mentioned on this website may be legally registered in
the U.S. and/or other countries. They are subject without restriction to the terms of applicable registered trademark rights and the ownership rights of the respective registered owners. The mention of a trademark should not be taken to indicate that such a trademark is not subject to third-party rights.
If you wish to view this webpage properly, please use Firefox, Google Chrome or Microsoft Edge.
|
|
Home
| Products
|
Support
|
Company
|
Contact |
Terms & Privacy
© 1996- @Xi® Computer Corporation | All Rights reserved. |
|
|
