Average memory access time
In computer science, average memory access time (AMAT) is a common metric to analyze memory system performance. AMAT uses hit time, miss penalty, and miss rate to measure memory performance. It accounts for the fact that hits and misses affect memory system performance differently. In addition, AMAT can be extended recursively to multiple layers of the memory hierarchy. It focuses on how locality and cache misses affect overall performance and allows for a quick analysis of different cache design techniques. A tacit assumption of AMAT is that a data access is either a hit or a miss, meaning the memory only supports sequential accesses and cannot have multiple accesses occurring simultaneously. Recently AMAT has been extended to consider concurrent data access. A model, called Concurrent-AMAT (C-AMAT), is introduced for more accurate analysis of current memory systems. More information on C-AMAT can be found in the external links section.
AMAT's three parameters hit time (or hit latency), miss rate, and miss penalty provide a quick analysis of memory systems. Hit latency (H) is the time to hit in the cache. Miss rate (MR) is the frequency of cache misses, while average miss penalty (AMP) is the cost of a cache miss in terms of time. Concretely it can be defined as follows.
It can also be defined recursively as,
In this manner, this recursive definition can be extended throughout all layers of the memory hierarchy.
- John L. Hennessy and David A. Patterson, Computer Architecture a Quantitative Approach Fifth Edition, 2012, pp.B9-B19