GPU

NVIDIA GeForce RTX 4070

Edit@6 days ago

Intergrated Memory(VRAM)
Capacity

12 GB

(GDDR6X 192-bit)

Bandwidth

504 GB/s

72 Token/s

Vector Compute
FP64
455.40 G
FP32
29.15 T
FP16
29.15 T
BF16
29.15 T
INT32
14.57 T
INT8
X

NVIDIA GeForce RTX 4070 General-Purpose Float-Point performance (Vector Performance / Scalar Performance)

FP64: 455.40 GFLOPS

FP32: 29.15 TFLOPS

FP16: 29.15 TFLOPS

BF16: 29.15 TFLOPS

INT32: 14.57 TOPS

Matirx Compute
FP64
X
FP32
X
FP16
58.29 T
116.58 T
FP8
116.58 T
233.16 T
TF32
29.15 T
58.29 T
BF16
58.29 T
116.58 T
INT16
X
INT8
233.16 T
466.33 T
INT4
466.33 T
932.66 T

NVIDIA GeForce RTX 4070 AI performance (Tensor Performance / Matrix Performance)

FP16: 58.29 TFLOPS, with sparsity: 116.58 TFLOPS

FP8: 116.58 TFLOPS, with sparsity: 233.16 TFLOPS

TF32: 29.15 TFLOPS, with sparsity: 58.29 TFLOPS

BF16: 58.29 TFLOPS, with sparsity: 116.58 TFLOPS

INT8: 233.16 TOPS, with sparsity: 466.33 TOPS

INT4: 466.33 TOPS, with sparsity: 932.66 TOPS

Hardware Specs
NVIDIA GeForce RTX 4070 is a 5nm chip, has 35800 million transistors, launched by NVIDIA at 2023. It has 12 GB built-in(On-Board/On-Chip) memory with bandwidth up to 504 GB/s. It has 5888 general-purpose ALUs(CUDA cores/Shader cores) and 184 matrix cores(Tensor cores) .
Process Node
5 nm
Launch Year
2023
Vector(CUDA) Cores
5888
Matrix(Tensor) Cores
184
Core Frequency
1920 ~ 2475 MHz
Cache
36MB

Comment without registration

Share your experience with NVIDIA GeForce RTX 4070 / Found an Error? Help Us Improve!