Average memory access time

Jump to navigation Jump to search

In computer science, average memory access time (AMAT) is a common metric to analyze memory system performance. AMAT uses hit time, miss penalty, and miss rate to measure memory performance. It accounts for the fact that hits and misses affect memory system performance differently. In addition, AMAT can be extended recursively to multiple layers of the memory hierarchy. It focuses on how locality and cache misses affect overall performance and allows for a quick analysis of different cache design techniques. A tacit assumption of AMAT is that a data access is either a hit or a miss, meaning the memory only supports sequential accesses and cannot have multiple accesses occurring simultaneously. Recently AMAT has been extended to consider concurrent data access. A model, called Concurrent-AMAT (C-AMAT), is introduced for more accurate analysis of current memory systems. More information on C-AMAT can be found in the external links section.

AMAT's three parameters hit time (or hit latency), miss rate, and miss penalty provide a quick analysis of memory systems. Hit latency (H) is the time to hit in the cache. Miss rate (MR) is the frequency of cache misses, while average miss penalty (AMP) is the cost of a cache miss in terms of time. Concretely it can be defined as follows.[1]

${\displaystyle AMAT=H+MR\cdot AMP}$

It can also be defined recursively as,

${\displaystyle AMAT=H_{1}+MR_{1}\cdot AMP_{1}}$

where

${\displaystyle AMP_{1}=H_{2}+MR_{2}\cdot AMP_{2}}$

In this manner, this recursive definition can be extended throughout all layers of the memory hierarchy.