GPUDatacenterReleased Nov 16, 2020

NVIDIA A100 SXM4 80GB

80 GB HBM2e · 5120-bit · 6,912 cores

A refreshed SXM module version of the Ampere data center accelerator that doubles the memory of the original 40 GB part and moves to faster HBM2e, giving large AI models and HPC workloads more capacity per GPU. It is used in HGX and DGX A100 systems linked over NVLink and NVSwitch. Announced at SC20 in November 2020.

General

Manufacturer: NVIDIA
Model: A100 SXM4 80GB
Segment: Datacenter
GPU chip: GA100
Architecture: Ampere
Release date: Nov 16, 2020
Price: Search on Amazon

Memory

Memory size: 80 GB
Memory type: HBM2e
Bus width: 5120-bit
Bandwidth: 2,039 GB/s
Memory clock: 1,593 MHz

Clocks & silicon

GPU clock: —
Boost clock: 1,410 MHz
Shader units: 6,912 CUDA Cores
Tensor / AI cores: 432
RT cores: —
Transistors: 54.2 billion
Technology (nm): 7 nm
TSMC N7
TDP / TBP: 400 W

Interface & APIs

Bus interface: SXM4 (PCIe 4.0 x16 host)
SLI / multi-GPU: NVLink 3.0 (600 GB/s)
DirectX: N/A (compute-only)
OpenGL: N/A (compute-only)
Vulkan: N/A (compute-only)
Other APIs: CUDA (compute capability 8.0)

AI support

Precisions: FP8FP16BF16INT8INT4TF32FP64
AI accelerator: Third-generation Tensor Cores (432)
Peak AI TOPS: 1,248 TOPS
Notes: Third-generation Tensor Cores supporting FP64, TF32, BF16, FP16, INT8, INT4 and binary; FP8 arrived with Hopper. Peak throughput with structured sparsity: INT8 1,248 TOPS, FP16 and BFLOAT16 624 TFLOPS, TF32 312 TFLOPS; dense rates are half. FP64 is 9.7 TFLOPS, FP64 Tensor Core and FP32 19.5 TFLOPS each. Multi-Instance GPU partitions the card into up to seven instances.

All NVIDIA GPUs →

Datacenter gpus from NVIDIA announced around the same time as the NVIDIA A100 SXM4 80GB. Add any of them to your compare list to see the specs side by side.

gpu