HBM GPU DRAM: large, off chip, slow

On-chip SRAM registers + shared memory of one SM: tiny, fast

tiles loaded from HBM
values computed on chip