Top GPUs & CPUs & AI accelerators Ranked by INT8 TOPS of Matrix(Tensor) cores

This is NOT a ranking of gaming performance, it's a ranking for AI workloads.
This is NOT a ranking of processors—many of them may be missing since their specifications aren’t available. If you know them, feel free to comment.
This is NOT a ranking of actual task performances, as they may vary due to many factors like thermal throttling, driver support, and framework compatibility...

2614.90 T

5.30 TB/s

2614.90 T

6 TB/s

#3

GPU
141 GB
NVIDIA H200 SXM

1979 T

4.80 TB/s

#4

GPU
80 GB
NVIDIA H100 SXM

1979 T

3.36 TB/s

1961.20 T

5.30 TB/s

#6

GPU
141 GB
NVIDIA H200 NVL

1930.20 T

4.80 TB/s

#7

AIU
32 GB
Google TPUv6e

1836 T

1.64 TB/s

#8

AIU
95 GB
Google TPUv5p

918 T

2.77 TB/s

#9

AIU
96 GB
AWS Trainium2

861 T

4 TB/s

838.86 T

844.80 GB/s

838.02 T

1.79 TB/s

825 T

786.43 T

844.80 GB/s

688.13 T

844.80 GB/s

660.60 T

1.01 TB/s

629.15 T

844.80 GB/s

#17

GPU
80 GB
NVIDIA A100 SXM

623.74 T

2.04 TB/s

#18

GPU
80 GB
NVIDIA A100 PCIe

623.74 T

1.94 TB/s

589.82 T

307.20 GB/s

563.61 T

512 GB/s

563.61 T

409.60 GB/s

560.33 T

844.80 GB/s

550.50 T

307.20 GB/s

524.29 T

512 GB/s

#25

GPU
32 GB
MLU 290

512 T

1.23 TB/s

498.07 T

409.60 GB/s

471.86 T

512 GB/s

457.11 T

614.40 GB/s

450.21 T

960 GB/s

445.64 T

409.60 GB/s

432.54 T

307.20 GB/s

419.43 T

512 GB/s

417.79 T

736 GB/s

393.22 T

358.40 GB/s

#36

AIU
16 GB
Google TPUv5e

393 T

819 GB/s

389.90 T

716 GB/s

389.28 T

644 GB/s

383 T

3.20 TB/s

380.11 T

307.20 GB/s

380.11 T

307.20 GB/s

380.11 T

358.40 GB/s

#43

AIU
32 GB
AWS Trainium1

380 T

820 GB/s

373.56 T

512 GB/s

373.56 T

409.60 GB/s

363.72 T

409.60 GB/s

362.10 T

3.20 TB/s

#48

GPU
48 GB
NVIDIA L40

362.07 T

864 GB/s

356.35 T

358.40 GB/s

353.89 T

307.20 GB/s

352.79 T

672 GB/s

351.52 T

896 GB/s

344.06 T

358.40 GB/s

332.60 T

307.20 GB/s

324.40 T

409.60 GB/s

320.72 T

504 GB/s

319.98 T

1.01 TB/s

319.49 T

307.20 GB/s

314.57 T

358.40 GB/s

#60

GPU
16 GB
Intel Arc A770

314.57 T

512 GB/s

314.57 T

307.20 GB/s

314.57 T

358.40 GB/s

#63

GPU
48 GB
NVIDIA RTX A6000

309.66 T

768 GB/s

#64

GPU
48 GB
NVIDIA A40 PCIe

299.34 T

695 GB/s

298.19 T

1.60 TB/s

294.91 T

307.20 GB/s

294.91 T

332.80 GB/s

289.01 T

644 GB/s

287.54 T

1.60 TB/s

285.08 T

307.20 GB/s

284.65 T

936 GB/s

283.85 T

504 GB/s

275.25 T

307.20 GB/s

275.25 T

307.20 GB/s

#75

GPU
8 GB
Intel Arc A750

275.25 T

512 GB/s

272.79 T

912 GB/s

268.70 T

409.60 GB/s

#78

GPU
16 GB
Intel Arc A770M

268.70 T

512 GB/s

268.70 T

409.60 GB/s

268.70 T

512 GB/s

263.82 T

576 GB/s

262.14 T

307.20 GB/s

262.14 T

512 GB/s

#84

AIU
MLU 370

256 T

255.59 T

153.60 GB/s

255.59 T

1.60 TB/s

254.42 T

896 GB/s

250.68 T

204.80 GB/s

250.68 T

409.60 GB/s

249.45 T

204.80 GB/s

249.04 T

358.40 GB/s

246.94 T

672 GB/s

242.48 T

409.60 GB/s

241.25 T

204.80 GB/s

238.14 T

760 GB/s

237.57 T

204.80 GB/s

237.57 T

204.80 GB/s

237.40 T

768 GB/s

235.93 T

409.60 GB/s

235.93 T

307.20 GB/s

235.93 T

307.20 GB/s

235.93 T

153.60 GB/s

233.16 T

504 GB/s

#104

GPU
12 GB
Intel Arc B580

233.06 T

456 GB/s

229.38 T

332.80 GB/s

229.38 T

332.80 GB/s

227.70 T

616 GB/s

221.18 T

332.80 GB/s

221.18 T

1.60 TB/s

216.27 T

153.60 GB/s

213.81 T

204.80 GB/s

206.44 T

409.60 GB/s

203.16 T

1.60 TB/s

#114

GPU
12 GB
Intel Arc A730M

201.52 T

336 GB/s

201.52 T

409.60 GB/s

197.78 T

432 GB/s

196.61 T

307.20 GB/s

#118

GPU
8 GB
Intel Arc A580

196.61 T

512 GB/s

196.61 T

307.20 GB/s

196.61 T

896 GB/s

196.61 T

153.60 GB/s

#122

GPU
24 GB
NVIDIA L2 PCIe

193 T

300 GB/s

191.69 T

409.60 GB/s

190.05 T

204.80 GB/s

190.05 T

332.80 GB/s

185.79 T

512 GB/s

184.60 T

1.20 TB/s

183.50 T

307.20 GB/s

183.50 T

307.20 GB/s

181 T

1.60 TB/s

178.42 T

495 GB/s

176.95 T

153.60 GB/s

176.95 T

332.80 GB/s

176.95 T

307.20 GB/s

176.95 T

307.20 GB/s

176.52 T

288 GB/s

174.00 T

608 GB/s

172.03 T

307.20 GB/s

172.03 T

307.20 GB/s

170.39 T

307.20 GB/s

170.39 T

281.60 GB/s

170.39 T

179.20 GB/s

170.39 T

281.60 GB/s

170.39 T

179.20 GB/s

167.12 T

409.60 GB/s

163.84 T

256 GB/s

162.51 T

448 GB/s

162.20 T

179.20 GB/s

161.10 T

448 GB/s

160.56 T

281.60 GB/s

157.29 T

307.20 GB/s

154.83 T

281.60 GB/s

154.01 T

153.60 GB/s

154.01 T

307.20 GB/s

153.35 T

448 GB/s

151.88 T

448 GB/s

149.67 T

512 GB/s

145.00 T

448 GB/s

144.51 T

512 GB/s

142.54 T

281.60 GB/s

137.63 T

153.60 GB/s

137.63 T

409.60 GB/s

137.63 T

409.60 GB/s

134.35 T

409.60 GB/s

#165

GPU
8 GB
Intel Arc A550M

134.35 T

224 GB/s

134.35 T

332.80 GB/s

132.83 T

448 GB/s

131.07 T

307.20 GB/s

#169

GPU
16 GB
NVIDIA Tesla T4

130.25 T

320 GB/s

129.58 T

448 GB/s

#171

AIU
MLU 270

128 T

127.80 T

448 GB/s

124.97 T

256 GB/s

124.52 T

409.60 GB/s

122.78 T

960 GB/s

122.63 T

864 GB/s

120.91 T

272 GB/s

119.44 T

448 GB/s

118.78 T

153.60 GB/s

118.78 T

256 GB/s

115.51 T

153.60 GB/s

114.89 T

448 GB/s

113.05 T

307.20 GB/s

113.05 T

153.60 GB/s

108.13 T

307.20 GB/s

106.91 T

307.20 GB/s

106.50 T

179.20 GB/s

106.17 T

448 GB/s

104.86 T

307.20 GB/s

103.22 T

336 GB/s

102.96 T

800 GB/s

101.90 T

360 GB/s

95.85 T

409.60 GB/s

94.21 T

153.60 GB/s

94.21 T

140.80 GB/s

92.90 T

256 GB/s

91.96 T

576 GB/s

91.75 T

332.80 GB/s

91.75 T

281.60 GB/s

90.50 T

576 GB/s

#201

GPU
8 GB
Intel Arc A570M

85.20 T

224 GB/s

85.20 T

281.60 GB/s

81.10 T

281.60 GB/s

77.05 T

576 GB/s

74.65 T

624 GB/s

73.73 T

140.80 GB/s

73.73 T

140.80 GB/s

73.73 T

336 GB/s

72.79 T

224 GB/s

71.88 T

192 GB/s

71.73 T

432 GB/s

70.45 T

409.60 GB/s

70.45 T

409.60 GB/s

70.34 T

432 GB/s

69.63 T

256 GB/s

68.81 T

256 GB/s

68.81 T

281.60 GB/s

68.81 T

307.20 GB/s

67.17 T

307.20 GB/s

#220

GPU
4 GB
Intel Arc A370M

67.17 T

112 GB/s

#221

GPU
6 GB
Intel Arc A380

67.17 T

185 GB/s

67.17 T

307.20 GB/s

#223

GPU
6 GB
Intel Arc A380M

65.54 T

185 GB/s

63.90 T

576 GB/s

#225

GPU
8 GB
Intel Arc A530M

63.90 T

224 GB/s

63.90 T

153.60 GB/s

60.83 T

192 GB/s

58.98 T

281.60 GB/s

58.98 T

307.20 GB/s

58.98 T

281.60 GB/s

55.30 T

504 GB/s

54.07 T

140.80 GB/s

#233

GPU
4 GB
Intel Arc A350M

54.07 T

112 GB/s

51.61 T

140.80 GB/s

#235

GPU
4 GB
Intel Arc A350

49.15 T

123 GB/s

45.14 T

288 GB/s

44.15 T

288 GB/s

44.01 T

192 GB/s

43.50 T

288 GB/s

#240

GPU
4 GB
Intel Arc A310

43.01 T

123 GB/s

40.96 T

288 GB/s

40.80 T

112 GB/s

40.45 T

288 GB/s

39.98 T

288 GB/s

37.85 T

96 GB/s

36.04 T

281 GB/s

34.55 T

256 GB/s

31.54 T

256 GB/s

31.13 T

256 GB/s

24.37 T

172 GB/s