Top Server GPUs Ranked by INT8 TOPS of Matrix(Tensor) cores

This is NOT a ranking of gaming performance, it's a ranking for AI workloads.
This is NOT a ranking of processors—many of them may be missing since their specifications aren’t available. If you know them, feel free to comment.
This is NOT a ranking of actual task performances, as they may vary due to many factors like thermal throttling, driver support, and framework compatibility...
PC GPUServer GPUCPUAll Processors

#1

256 GB
AMD Instinct MI325X GPU

2614.90 T

6 TB/s

#2

192 GB
AMD Instinct MI300X GPU

2614.90 T

5.30 TB/s

#3

141 GB
NVIDIA H200 SXM

1979 T

4.80 TB/s

#4

80 GB
NVIDIA H100 SXM

1979 T

3.36 TB/s

#5

128 GB
AMD Instinct MI300A GPU

1961.20 T

5.30 TB/s

#6

141 GB
NVIDIA H200 NVL

1930.20 T

4.80 TB/s

#7

80 GB
NVIDIA A100 SXM

623.74 T

2.04 TB/s

#8

80 GB
NVIDIA A100 PCIe

623.74 T

1.94 TB/s

#9

128 GB
AMD Instinct MI250X GPU

383 T

3.20 TB/s

#10

128 GB
AMD Instinct MI250 GPU

362.10 T

3.20 TB/s

#11

48 GB
NVIDIA L40

362.07 T

864 GB/s

#12

48 GB
NVIDIA RTX A6000

309.66 T

768 GB/s

#13

48 GB
NVIDIA A40 PCIe

299.34 T

695 GB/s

#14

24 GB
NVIDIA L2 PCIe

193 T

300 GB/s

#15

32 GB
AMD Instinct MI100 GPU

184.60 T

1.20 TB/s

#16

64 GB
AMD Instinct MI210 GPU

181 T

1.60 TB/s

#17

16 GB
NVIDIA Tesla T4

130.25 T

320 GB/s

#18

48 GB
AMD Radeon PRO W7900

122.63 T

864 GB/s

#19

32 GB
AMD Radeon PRO W7800

90.50 T

576 GB/s

#20

16 GB
AMD Radeon PRO W7700

63.90 T

576 GB/s

#21

28 GB
AMD Radeon PRO V710

55.30 T

504 GB/s

#22

8 GB
AMD Radeon PRO W7600

39.98 T

288 GB/s

#23

8 GB
AMD Radeon PRO W7500

24.37 T

172 GB/s