Versatile 8GPU Server for AI Workloads
Ranking first in single sever performance in MLPerf 0.7, it supports 8 fully interconnected NVLink 3.0 NVIDIA A100 Tensor Core GPUs, and 2 AMD® EPYC® Rome processors enabling PCIe4.0 in a 4U space, NF5488A5 delivers outstanding AI performance of 5 petaFLOPS and ultra-high data throughput, making it ideal choice for AI applications like image, video and voice processing, financial analysis and virtual assistants.
Key Features
Record-Setting AI Performance
Best single sever performance in the MLPerf v0.7 benchmark, setting 18 performance records and achieving 549,000 inferences per second in the ResNet50 inference task.
Learn more: Press Release | Blog Post | Official MLPerf v0.7 Results
Extreme Hardware Design
8x fully interconnected NVLink 3.0 NVIDIA A100 GPUs, 2x AMD EPYC Rome processors enabling PCIe4.0 in 4U and delivering 5 petaFLOPS and high data throughput.
Accelerating AI Training
Supports the latest A100 80G GPU with HBM2e, doubling the memory capacity of its predecessor and a 30% increase in GPU memory bandwidth in a single node, delivering 15% performance increase in AI model training tasks with tens of billions of parameters.
|
Record-Setting AI PerformanceBest single sever performance in the MLPerf v0.7 benchmark, setting 18 performance records and achieving 549,000 inferences per second in the ResNet50 inference task. Learn more: Press Release | Blog Post | Official MLPerf v0.7 Results |
|---|---|
|
|
|
|
Extreme Hardware Design8x fully interconnected NVLink 3.0 NVIDIA A100 GPUs, 2x AMD EPYC Rome processors enabling PCIe4.0 in 4U and delivering 5 petaFLOPS and high data throughput. |
|
|
|
|
Accelerating AI TrainingSupports the latest A100 80G GPU with HBM2e, doubling the memory capacity of its predecessor and a 30% increase in GPU memory bandwidth in a single node, delivering 15% performance increase in AI model training tasks with tens of billions of parameters. |
Peek under the hood of Inspur’s NF5488A5 to see how this 4U 8x A100 GPU server delivers leading-edge, record-breaking 5 petaFLOPS performance for AI training and inference applications.
| Model | NF5488A5 |
|---|---|
| GPU | 1* HGX A100 8GPU |
| Processor | 2* AMD® EPYC® Rome Processor (Up to 225W TDP) |
| Performance | 5 petaFLOPS |
| Memory | 32* DDR4 2933MT/s RDIMMs//LRDIMM, up to 4 TB |
| Storage | 8* 2.5” SAS/SATA (or 4*NVMe+4* SATA/SAS), 4* NVMe M.2, 2* SATA M.2 |
| PCIe | 4* built-in low profile PCIe x16 |
| Front I/O | 2* USB 3.0 port, 1* VGA port, 1* RJ45 management port |
| Ethernet Card | 10G Ethernet Optical Interface |
| Management | Built-in Aspeed2500 BMC module, support IPMI, SOL, KVM Over IP, VM, etc. |
| RAID | Support 3508 Raid Card (NVMe Raid with Raid Key) |
| OS | Red Hat Enterprise 7.8 64bit, CentOS 7.8; Ubuntu 18.04 |
| Cooling | N+1 Redundant hot swap fans |
| PSU | 3+1 Redundant PSUs |
| Chassis | 4U, 448mm W x 175.5mm H x 850mm D |