Versatile 4U AI server offering 3 configurations supporting 4 to 16 GPUs for different applications.

NF5468M6 is a highly versatile 4U AI server supporting between 4 and 16 NVIDIA single and double-width GPUs, making it ideal for a wide range of AI applications including AI cloud, IVA, video processing and much more. NF5468M6 offers ultra-high storage capacity and the unique function of switching topologies between Balance, Common and Cascade in one click, which helps to flexibly adapt to various needs for AI application performance optimization.

Leading Architecture

• Supports up to 20x PCIe GPUs/accelerators in 4U
• Integrates the latest NVIDIA A40 and MIG-empowered A100 GPU
• Supports AMD processors
• Instinct MI100 powered by the latest Matrix Core technology
• Supports 200G HDR InfiniBand Switch and 100Gb OCP 3.0 Card

Flexible Configuration

• Compatible with the most AI accelerators and home-grown AI chips
• Unique function of switching topologies in one click for various AI applications
• Three different GPU configurations designed for a variety of AI applications

Supreme Performance

• Supports 2x 3rd Gen Intel® Xeon ®Scalable processors, TDP 270W, 3UPl
• 4GPU non-blocking communication, CPU-to-GPU communication without PCIe switching
• 8x hot swap NVMe SSD, providing outstanding I/O performance
• Up to 8x 350W GPUs in the PCIe 4.0-empowered system with 2x bandwidth

Comprehensive Ecosystem

• Wide array of AI accelerator and solutions partners including NVIDIA, AMD, Intel, Cambricon
• Leading deep learning frameworks including TensorFIow, PyTorch, PaddlePaddIe, MXNet
• Powerful AI development toolkits like Inspur AIStation, algorithm and application optimization services

Model NF5468M6-P NF5468M6-T NF5468M6-V
Processor 2x 3rd Gen Intel® Xeon® Scalable processors, TDP 270W
GPU 8x A100, A40, MI100 FHFL Double Width PCIe GPU 4x A100, A40, MI100 FHFL Double Width PCIe GPU 16x A10 FHFL Single Width PCIe GPU
Memory 32x DDR4 3200MHz LRDIMM/RDIMM, up to 4TB
Storage 24x 2.5″ or 12 x 3.5″ SAS/SATA
(up to 8x NVME SSD), 2x M.2 SATA SSD
16x 2.5″ or 12 x 3.5″ SAS/SATA
(up to 2x NVME SSD), 2x M.2 SATA SSD
24x 2.5″ or 12 x 3.5″ SAS/SATA
(up to 8x NVME SSD), 2x M.2 SATA SSD
I/O Expansion 4x PCIe 4.0 x 16 slot
2x RAID Mezz card
2x PCIe 3.0 x 8 slot, 2x PCIe 4.0 x 8 slot
2x RAID Mezz card
4x PCIe 4.0 x 16 slot
2x RAID Mezz card
PSU 2+2 redundant, 4x 1600W / 2000W / 2200W / 3000W 80Plus Platinum hot-swap PSU
Working Temperature 5℃-35℃