Top GPUs & CPUs & AI accelerators Ranked by INT4 TOPS of Matrix(Tensor) cores

This is NOT a ranking of gaming performance, it's a ranking for AI workloads.
This is NOT a ranking of processors—many of them may be missing since their specifications aren’t available. If you know them, feel free to comment.
This is NOT a ranking of actual task performances, as they may vary due to many factors like thermal throttling, driver support, and framework compatibility...

1321.21 T

1.01 TB/s

#2

GPU
80 GB
NVIDIA A100 SXM

1247.48 T

2.04 TB/s

1247.48 T

1.94 TB/s

#4

GPU
32 GB
MLU 290

1024 T

1.23 TB/s

835.58 T

736 GB/s

779.80 T

716 GB/s

778.57 T

644 GB/s

#8

GPU
48 GB
NVIDIA L40

724.13 T

864 GB/s

705.58 T

672 GB/s

641.43 T

504 GB/s

639.96 T

1.01 TB/s

#12

GPU
16 GB
Intel Arc A770

629.15 T

512 GB/s

#13

GPU
48 GB
NVIDIA RTX A6000

619.32 T

768 GB/s

#14

GPU
48 GB
NVIDIA A40 PCIe

598.67 T

695 GB/s

578.03 T

644 GB/s

569.30 T

936 GB/s

567.71 T

504 GB/s

#18

GPU
8 GB
Intel Arc A750

550.50 T

512 GB/s

545.59 T

912 GB/s

#20

GPU
16 GB
Intel Arc A770M

537.40 T

512 GB/s

527.65 T

576 GB/s

#22

AIU
MLU 370

512 T

476.28 T

760 GB/s

466.33 T

504 GB/s

#25

GPU
12 GB
Intel Arc B580

466.12 T

456 GB/s

455.39 T

616 GB/s

#27

GPU
12 GB
Intel Arc A730M

403.05 T

336 GB/s

395.55 T

432 GB/s

#29

GPU
8 GB
Intel Arc A580

393.22 T

512 GB/s

383 T

3.20 TB/s

356.84 T

495 GB/s

353.03 T

288 GB/s

348.00 T

608 GB/s

325.02 T

448 GB/s

322.19 T

448 GB/s

306.71 T

448 GB/s

303.76 T

448 GB/s

299.34 T

512 GB/s

290.00 T

448 GB/s

#40

GPU
8 GB
Intel Arc A550M

268.70 T

224 GB/s

265.67 T

448 GB/s

#42

GPU
16 GB
NVIDIA Tesla T4

260.51 T

320 GB/s

259.15 T

448 GB/s

#44

AIU
MLU 270

256 T

255.59 T

448 GB/s

249.94 T

256 GB/s

245.56 T

960 GB/s

245.27 T

864 GB/s

241.83 T

272 GB/s

238.88 T

448 GB/s

229.79 T

448 GB/s

212.34 T

448 GB/s

206.44 T

336 GB/s

205.92 T

800 GB/s

203.80 T

360 GB/s

185.79 T

256 GB/s

183.91 T

576 GB/s

180.99 T

576 GB/s

#59

GPU
8 GB
Intel Arc A570M

170.39 T

224 GB/s

154.09 T

576 GB/s

149.30 T

624 GB/s

147.46 T

336 GB/s

145.57 T

224 GB/s

143.77 T

192 GB/s

143.46 T

432 GB/s

140.67 T

432 GB/s

#67

GPU
6 GB
Intel Arc A380

134.35 T

185 GB/s

#68

GPU
4 GB
Intel Arc A370M

134.35 T

112 GB/s

#69

GPU
6 GB
Intel Arc A380M

131.07 T

185 GB/s

127.80 T

576 GB/s

#71

GPU
8 GB
Intel Arc A530M

127.80 T

224 GB/s

121.65 T

192 GB/s

110.59 T

504 GB/s

#74

GPU
4 GB
Intel Arc A350M

108.13 T

112 GB/s

#75

GPU
4 GB
Intel Arc A350

98.30 T

123 GB/s

90.28 T

288 GB/s

88.31 T

288 GB/s

88.01 T

192 GB/s

87.00 T

288 GB/s

#80

GPU
4 GB
Intel Arc A310

86.02 T

123 GB/s

81.92 T

288 GB/s

81.59 T

112 GB/s

80.90 T

288 GB/s

79.95 T

288 GB/s

75.69 T

96 GB/s

69.10 T

256 GB/s

63.08 T

256 GB/s

48.74 T

172 GB/s