The Game of Latency, Bandwidth, and Hardware Prefetching

A processor’s cache hierarchy exploits locality in memory accesses to reduce latency but can’t satisfy all memory accesses. Modern processors contain hardware prefetchers to predict data to be used in the future and bring them into a cache in a timely manner.