GPUDatacenterReleased Nov 8, 2021

AMD Instinct MI250X

128 GB HBM2e · 8192-bit · 14,080 cores

The flagship of AMD's Instinct MI200 series, announced in November 2021 and AMD's first multi-die GPU, combining two Aldebaran dies (GCDs) in one OAM module. The two dies are connected with four Infinity Fabric links but appear to the system as two separate GPUs. It powered the Frontier supercomputer, the first system to officially exceed one exaflop, and draws 500 W with peaks up to 560 W.

General

Manufacturer: AMD
Model: Instinct MI250X
Segment: Datacenter
GPU chip: Aldebaran
Architecture: CDNA 2
Release date: Nov 8, 2021
Price: Search on Amazon

Memory

Memory size: 128 GB
Memory type: HBM2e
Bus width: 8192-bit
Bandwidth: 3,276.8 GB/s
Memory clock: 1,600 MHz

Clocks & silicon

GPU clock: —
Boost clock: 1,700 MHz
Shader units: 14,080 Stream Processors (220 CU)
Tensor / AI cores: —
RT cores: —
Transistors: 58 billion
Technology (nm): 6 nm
TSMC N6
TDP / TBP: 500 W

Interface & APIs

Bus interface: OAM (PCIe 4.0 x16 host)
SLI / multi-GPU: AMD Infinity Fabric (8 links, 100 GB/s peak per link)
DirectX: N/A (compute only)
OpenGL: N/A (compute only)
Vulkan: N/A
Other APIs: ROCm (HIP), OpenCL

AI support

Precisions: FP8FP16BF16INT8INT4TF32FP64
AI accelerator: Matrix Cores (CDNA 2)
Peak AI TOPS: 383 TOPS
Notes: Matrix Cores deliver 383 TFLOPS in FP16 and bfloat16 and 383 TOPS in INT8 and INT4. FP64 runs at the same rate as FP32 (47.9 TFLOPS vector, 95.7 TFLOPS matrix), a key CDNA 2 feature for HPC. No FP8 or TF32 support, which arrived with CDNA 3.

All AMD GPUs →

Datacenter gpus from AMD announced around the same time as the AMD Instinct MI250X. Add any of them to your compare list to see the specs side by side.

gpu