T16240-AIE

CPU

Number of Cores240
Frequency (GHz)4.5
Multiprocessor Scalability4-socket
PipelineOut-of-Order, 8 instructions per clock
L1 Cache Size64 KB ICache, Dcache, both with ECC
L2/L3 Cache Size240 MB with DECTED ECC
Vector Processor2 x 1024-bit per core
Matrix Processor2 x 1024-bit per core

Memory

DIMMs per Channel2
Maximum Capacity (256 GB DIMMs)4 TB
Maximum Capacity (2 TB DIMMs)32 TB
Number of Memory Controllers16
Maximum Memory SpeedDDR5-7200

I/O

PCIe 5.0 LanesUp to 96
PCIe Controllers48
C2C Lanes (Hardware Coherency)Up to 48 (4-socket)
C2C Bandwidth per Lane (Gb/sec)112

AI/ HPC

Data TypesFP64, FP32, FP64 (tensor), TF32, BF16, Int8, FP8, FP4, TAI
Sparse Matrix SupportSparsity (8:4), SuperSparsity (8:3)

Maximum HPC Performance

FP64 (TF)66

Maximum AI Performance

TAI (PF)66

Package, Power, Thermal

Package64mm x 83mm FCLGA
Maximum TDP (W)760
Tj85C
CoolingLiquid

Markets

Target Markets and ApplicationsEntry HPC, Big AI, Crypto/Digital Currency