NF5468M5
4U 16GPU AI Inference Server for Large-Scale Deployment
Key Features:
- High Performance for Al Model Training
- High Reliability for More Al Application Scenarios
- High Efficiency for Al Edge Inference
Overview
The Inspur NF5468M5 is high density AI inference server designed for large-scale deployment in the data center. Equipped with 2nd Generation Intel® Xeon® Scalable Processors, it supports up to 16 NVDIA GPU accelerators in a compact 4U chassis. It comes in 3 flexible configurations, making it versatile for AI Cloud, security, finance, communication, healthcare and other scenarios.
Features
High Performance for Al Model Training
- Supports 8 PCIe & NVLink NVDIA V100 GPUs
- Integrates 4 cutting-edge technologies: NVLink 2.0, RDMA, GPUDricet, 32G HBM2.
- Offers highest computing performance and lowest communication latency
High Reliability for More AI Application Scenarios
- Supports over 10 kinds of GPU configurations, enabling easy switching without opening the chassis
- CPUs are interconnected via 3 UPI, providing industry leading communication bandwidth
- Suitable for a wide range of AI application scenarios
High Efficiency for AI Inference
- Supports up to 20 NVIDIA Tesla T4 GPUs and 24x 3.5” HDD
- Capable of processing 300 streams of 1080P video in video structuring application
| Model | NF5468M5-S | NF5468M5-P | NF5468M5-V |
|---|---|---|---|
| GPU Support | Support 8* NVIDIA® Tesla® NVLink™ V100; Support 4* PCIe 3.0 x16 slot, 12* PCIe 3.0 x16 slot in total |
Support 8* NVIDIA® Tesla® PCIe V100 / V100S / RTX6000 passive / RTX8000 passive Support 4* PCIe 3.0 x16 slot, 12* PCIe 3.0 x16 slot in total Support 8 Cambricon MLU270 |
Support up to 20* NVIDIA® Tesla® T4 Support 4* PCIe 3.0 x16 slot, 20* PCIe 3.0 x16 slot in total |
| Processors | 2* Intel Xeon Skylake Gold/Platinum | ||
| Memory | 24 DDR4 2933MT/s ECC RDIMMs, 12 channels | ||
| Built-in PCIe | Support up to 2* built in RAID | ||
| Front I/O | 2* USB 3.0 port, 1* VGA port, 1* RJ45 port | ||
| Rear I/O | 1* port, 1* VGA port, 2* USB 3.0 port, 1* RJ45 management port, 2* 10G SFP+ Ethernet port | ||
| Storage | Front: 12* 2.5 / 3.5 SAS / SATA HDD (4* U.2 NVME SSD), 2* M.2 SSD HDD | Front: 12* 2.5 / 3.5 SAS / SATA HDD (8* U.2 NVME SSD), 2* M.2 SSD HDD | Front: 24* 2.5 / 3.5 SAS / SATA HDD (4*U.2 NVME SSD), 2* M.2 SSD HDD |
| RAID | Support RAID 0/1/10/5/50/6/60, etc. Support Cache supercapacitor protection; RAID State Transitions, RAID memory allocation |
||
| OS | Microsoft Windows Sever, Red Hat Enterprise Linux, Ubuntu Linux, CentOS and other mainstream OS | ||
| Cooling | Redundant hot swap fan | ||
| PSU | 2+2 Redundant, 4* 1600W / 2000W / 2200W PSU 80 plus Platinum | ||
| Operating Temperature | 5 – 35°C / 41°F – 95°F | ||
| Dimensions & Weight | 4U 435mm W * 175.5mm H * 830mm D, ≤70kg | ||