GPU

NVIDIA GeForce RTX 4090 Laptop

Edit@2 months ago

Intergrated Memory(VRAM)
Capacity

16 GB

(GDDR6 256-bit)

Bandwidth

576 GB/s

82 Token/s

Vector Compute
FP64
515.30 G
FP32
32.98 T
FP16
32.98 T
BF16
32.98 T
INT32
16.49 T
INT8
X

NVIDIA GeForce RTX 4090 Laptop General-Purpose Float-Point performance (Vector Performance / Scalar Performance)

FP64: 515.30 GFLOPS

FP32: 32.98 TFLOPS

FP16: 32.98 TFLOPS

BF16: 32.98 TFLOPS

INT32: 16.49 TOPS

Matirx Compute
FP64
X
FP32
X
FP16
65.96 T
131.91 T
FP8
131.91 T
263.82 T
TF32
32.98 T
65.96 T
BF16
65.96 T
131.91 T
INT16
X
INT8
263.82 T
527.65 T
INT4
527.65 T
1055.29 T

NVIDIA GeForce RTX 4090 Laptop AI performance (Tensor Performance / Matrix Performance)

FP16: 65.96 TFLOPS, with sparsity: 131.91 TFLOPS

FP8: 131.91 TFLOPS, with sparsity: 263.82 TFLOPS

TF32: 32.98 TFLOPS, with sparsity: 65.96 TFLOPS

BF16: 65.96 TFLOPS, with sparsity: 131.91 TFLOPS

INT8: 263.82 TOPS, with sparsity: 527.65 TOPS

INT4: 527.65 TOPS, with sparsity: 1055.29 TOPS

Hardware Specs
NVIDIA GeForce RTX 4090 Laptop is a 5nm chip, has 45900 million transistors, launched by NVIDIA at 2023. It has 16 GB built-in(On-Board/On-Chip) memory with bandwidth up to 576 GB/s. It has 9728 general-purpose ALUs(CUDA cores/Shader cores) and 304 matrix cores(Tensor cores) .
Process Node
5 nm
Launch Year
2023
Vector(CUDA) Cores
9728
Matrix(Tensor) Cores
304
Core Frequency
1335 ~ 1695 MHz
Cache
64MB

Comment without registration

Share your experience with NVIDIA GeForce RTX 4090 Laptop / Found an Error? Help Us Improve!