CPU

Intel Xeon Gold 6416H

Edit@2 months ago

Socketed Memory
Capacity

4 TB

(8 t('channels'))

Bandwidth

307.2 GB/s

(DDR5 4800MT/s)

Vector Compute
FP64
1.67 T
FP32
3.34 T
FP16
6.68 T
BF16
6.68 T
INT32
X
INT8
13.36 T
Theoretical peak performance: 18 Cores @ 2900 MHz with 512-bit AVX512 and Dual 512-bit FMAs (Support INT8, BF16, FP16)

Intel Xeon Gold 6416H General-Purpose Float-Point performance (Vector Performance / Scalar Performance)

FP64: 1.67 TFLOPS

FP32: 3.34 TFLOPS

FP16: 6.68 TFLOPS

BF16: 6.68 TFLOPS

INT8: 13.36 TOPS

Matirx Compute
FP64
X
FP32
X
FP16
53.45 T
FP8
X
TF32
X
BF16
53.45 T
INT16
X
INT8
106.91 T
INT4
X
Theoretical peak performance: 18 Cores @ 2900 MHz with Intel Advanced Matrix Extensions

Intel Xeon Gold 6416H AI performance (Tensor Performance / Matrix Performance)

FP16: 53.45 TFLOPS

BF16: 53.45 TFLOPS

INT8: 106.91 TOPS

Hardware Specs
Intel Xeon Gold 6416H is a 10nm chip, launched by Intel at 2023. It has 18 cores, can run up to 36 threads.It can use DDR5 4800MT/s memory modules.It supports up to 8 memory channels with max bandwidth 307.2 GB/s and max capacity 4 TB.
Process Node
10 nm
Launch Year
2023
Max SMP
4
Cache
45MB
Threads
36
Num of Cores
18
Base Frequency
2200MHz
Boost Frequency
4200MHz
All Core Turbo Freq
2900MHz
SIMD Extensions
SSE4.2
AVX
AVX2
AVX-512
FMA3
AMX

Comment without registration

Share your experience with Intel Xeon Gold 6416H / Found an Error? Help Us Improve!