GPUNVIDIA· edited 1 year ago

NVIDIA B200

Launched in 2024

NVIDIA B200 is a 5 nm chip, launched by NVIDIA in 2024. It has 192 GB of built-in (on-board or on-chip) memory with bandwidth up to 8000 GB/s.

Integrated Memory

Capacity

192 GB

HBM3e

Bandwidth

8 TB/s

Vector Compute

FP64

40 T

FP32

80 T

vs FP64×2

FP16

BF16

INT32

INT8

Matrix · Tensor Compute

×2 structured sparsity

FP64

40 T

FP32

TF32

1100 T

vs FP64×28

FP16

2250 T

vs FP64×56

BF16

2250 T

vs FP64×56

FP8

4500 T

vs FP64×113

FP4

9000 T

vs FP64×225

INT16

INT8

INT4

Hardware Specs

Process Node

5 nm

Launch Year

2024

Cache

50 MB