Ultra performance AI server with scalability and reliability for hyperscale data centers.

Hyperscale AI Server with 500W A100 GPU

NF5688M6 is a new generation of NVLink AI server for hyperscale data centers with high performance, compatibility and expansion capabilities. It is the first server to support 2 latest generation Intel Xeon Scalable processors and 8 NVIDIA 500W A100 GPUs with NVSwitch interconnect.

NF5688M6 is the industry’s first air-cooled server that supports 500W A100 GPU. It can support up to 12 PCIe expansion cards, dual-width N20X, NV DPU and other smart network cards. Combined with the AIStation resource scheduling platform, it can unleash a maximum compute performance of 5 petaFLOPS.

Leading Technology

2 Intel Xeon Scalable processors, using 10nm process

8 NVIDIA A100 GPUs, 600GB/s bandwidth NVSwitch fully interconnected

Support multi-instance GPU (MIG), greatly improving GPU resource utilization

Up to 10 200G HDR InfiniBand, high-speed interconnection expansion

Stability & Reliability

Support hard/soft RAID scheme to ensure data security

N+N redundant power supply to ensure reliable operation of the system

Optimized heat dissipation design to support stable work under high ambient temperature

Intelligent remote management to quickly locate faults

Optimal Design

The industry’s only air-cooled support 500W A100 GPU

High performance ratio, GPU: computing IB: storage IB=8:8:2

Modular design, flexible operation, easy operation and maintenance

Leading support for Inspur N20X, NV-DPU, A/T customer smart network card

Comprehensive Ecosystem

Extensive and mature x86+CUDA global development ecology

Leading deep learning framework support, TensorFlow/PyTorch/flying paddle, etc.

Efficiently support large-scale CV/NLP/NMT/DLRM model training and inference

Easily connect with Yuan 1.0 ecosystem partners and provide rich industry AI solutions


Model NF5688M6
Height 6U
GPU 1x HGX A100 8GPU
CPU 2x 3rd Intel® Xeon® Scalable processors, TDP 270W, support 3 UPI interconnections
Chipset Intel® C621A Series Chipset (Lewisburg-R)
Memory 32x DDR4 RDIMM/LRDIMM, up to 3200MT/s
Storage 8x 2.5″ NVMe SSD or 16x 2.5″ SATA/SAS SSD
M.2 On-board 2x NVMe/SATA M.2
PCIe 10x PCIe 4.0 x16 slots,2x PCIe 4.0 x16 slots (PCIe 4.0 x8 rate)
or 6x PCIe 4.0 x16
RAID Optional support RAID0/1/10/5/50/6/60, etc., support Cache super capacitor protection, provide RAID state migration, RAID configuration memory
NIC Optional 1 PCIe 4.0 x16 OCP 3.0 network card, rate support 10G/25G/100G
I/O Front: 1x USB 3.0,1x USB 2.0,1x VGA,1x RJ45 management port
Rear: 1x USB 3.0,1x VGA
Management Built-in BMC remote management module, support Redfish/IPMI/SOL/KVM, etc.
OS Red Hat Enterprise 7.8 64bit, CentOS 7.8, Ubuntu 18.04 or higher version
Cooling N+1 redundant hot-swappable fans
Power 6* 3000W 80Plus platinum power supply, support 3+3 redundancy
Dimensions (WxHxD) 447mm x 263.9mm x 850mm
Operating Temperature 10℃~35℃/50℉~95℉
Full Load Weight ≤88kg