T16120-HS

    CPU

    Number of Cores120
    Frequency (GHz)5.7
    Multiprocessor Scalability2-socket
    PipelineOut-of-Order, 8 instructions per clock
    L1 Cache Size64 KB ICache, Dcache, both with ECC
    L2/L3 Cache Size120 MB with DECTED ECC
    Vector Processor2 x 1024-bit per core
    Matrix Processor2 x 1024-bit per core

    Memory

    DIMMs per Channel2
    Maximum Capacity (256 GB DIMMs)4 TB
    Maximum Capacity (2 TB DIMMs)32 TB
    Number of Memory Controllers16
    Maximum Memory SpeedDDR5-7200

    I/O

    PCIe 5.0 LanesUp to 96
    PCIe Controllers48
    C2C Lanes (Hardware Coherency)16 (2-socket)
    C2C Bandwidth per Lane (Gb/sec)112

    AI/ HPC

    Data TypesFP64, FP32, FP64 (tensor), TF32, BF16, Int8, FP8, FP4, TAI
    Sparse Matrix SupportSparsity (8:4), SuperSparsity (8:3)

    Maximum HPC Performance

    FP64 (TF)42

    Maximum AI Performance

    TAI (PF)42

    Package, Power, Thermal

    Package64mm x 83mm FCLGA
    Maximum TDP (W)480
    Tj85C
    CoolingAir

    Markets

    Target Markets and ApplicationsCloud, Databases, Edge/Telco