AIU

AWS Trainium1

Edit@2 months ago

Intergrated Memory
Capacity

32 GB

( )

Bandwidth

820 GB/s

117 Token/s

Vector Compute
FP64
X
FP32
X
FP16
X
BF16
X
INT32
X
INT8
X

AWS Trainium1 General-Purpose Float-Point performance (Vector Performance / Scalar Performance)

Matirx Compute
FP64
X
FP32
47.50 T
FP16
190 T
FP8
X
TF32
190 T
BF16
190 T
INT16
X
INT8
380 T
INT4
X

AWS Trainium1 AI performance (Tensor Performance / Matrix Performance)

FP32: 47.50 TFLOPS

FP16: 190 TFLOPS

TF32: 190 TFLOPS

BF16: 190 TFLOPS

INT8: 380 TOPS

Hardware Specs
AWS Trainium1 launched by Amazon at 2022. It has 32 GB built-in(On-Board/On-Chip) memory with bandwidth up to 820 GB/s.
Process Node
nm
Launch Year
2022

Comment without registration

Share your experience with AWS Trainium1 / Found an Error? Help Us Improve!