4U 8x A100 GPU Server for AI Training and Inference

Versatile 8GPU Server for AI Workloads

Ranking first in single server performance in MLPerf 0.7, it supports 8 fully interconnected NVLink 3.0 NVIDIA A100 Tensor Core GPUs, and 2 AMD EPYC™ processors enabling PCIe 4.0 in a 4U space, NF5488A5 delivers outstanding AI performance of 5 petaFLOPS and ultra-high data throughput, making it ideal choice for AI applications like image, video and voice processing, financial analysis and virtual assistants.

Key Features

Record-Setting AI Performance

Best single server performance in the MLPerf v0.7 benchmark, setting 18 performance records and achieving 549,000 inferences per second in the ResNet50 inference task.

Learn more: Press Release | Blog Post | Official MLPerf v0.7 Results

Extreme Hardware Design

8x fully interconnected NVLink 3.0 NVIDIA A100 GPUs, 2x AMD EPYC™ processors enabling PCIe4.0 in 4U and delivering 5 petaFLOPS and high data throughput.

Accelerating AI Training

Supports the latest A100 80G GPU with HBM2e, doubling the memory capacity of its predecessor and a 30% increase in GPU memory bandwidth in a single node, delivering 15% performance increase in AI model training tasks with tens of billions of parameters.

Peek under the hood of Inspur’s NF5488A5 to see how this 4U 8x A100 GPU server delivers leading-edge, record-breaking 5 petaFLOPS performance for AI training and inference applications.

Take a dive into the NF5488A5 with Serve The Home, who share a detailed look at features like the 8x A100 GPU assembly, optimized hardware design, and MLperf-chart-topping performance.

The Experts Weigh In on NF5488A5

Hardware industry specialists Serve The Home gives the NF5488A5 a 9.7 out of 10 in this comprehensive review, where they break down the server’s features like hardware design and performance.

Read the Review »

Model	NF5488A5
Accelerator	8* NVIDIA SXM4 A100 40GB/80GB
Processor	2* 2nd or 3rd Generation AMD EPYC™ processor (Up to 280W TDP)
Performance	5 petaFLOPS
Memory	32* DDR4 RDIMMs / LRDIMM, up to 4 TB
PCIe Slots (Switch)	4* low profile PCIe x16, up to 4* 200Gb/s InfiniBand / Ethernet
PCIe Slot (CPU)	SKU 1: On-board 10G	SKU 2: 1* PCIe×16 slot for standard NIC
Front I/O	SKU 1:	SKU 2: 1* RJ45 management port
Rear I/O	SKU 1: 2* USB 3.0 port 1* VGA port 1* RJ45 management port	SKU 2: 2* USB 3.0 port 1* VGA port
Ethernet Card	10G Ethernet Optical Interface
Management	Built-in Aspeed2500 BMC module, support IPMI, SOL, KVM Over IP, VM, etc.
Storage	8* 2.5” SAS/SATA (or 4* NVMe + 4* SATA/SAS), 4* NVMe M.2
OS Boot Drive	2* SATA M.2
SAS / RAID	Support 3508 Raid Card
Cooling	(N+1) Redundant hot swap fans
PSU	(3+1) Redundant, up to 9 kw in total
Chassis	4U, W 448mm x H 175.5mm x D 850mm

Interested to learn more?

Inquire Now

	Record-Setting AI Performance Best single server performance in the MLPerf v0.7 benchmark, setting 18 performance records and achieving 549,000 inferences per second in the ResNet50 inference task. Learn more: Press Release \| Blog Post \| Official MLPerf v0.7 Results

	Extreme Hardware Design 8x fully interconnected NVLink 3.0 NVIDIA A100 GPUs, 2x AMD EPYC™ processors enabling PCIe4.0 in 4U and delivering 5 petaFLOPS and high data throughput.

	Accelerating AI Training Supports the latest A100 80G GPU with HBM2e, doubling the memory capacity of its predecessor and a 30% increase in GPU memory bandwidth in a single node, delivering 15% performance increase in AI model training tasks with tens of billions of parameters.