Mean absolute percentage error

The mean absolute percentage error (MAPE), also known as mean absolute percentage deviation (MAPD), is a measure of prediction accuracy of a forecasting method in statistics, for example in trend estimation. It usually expresses accuracy as a percentage, and is defined by the formula:

${\mbox{M}}={\frac {100}{n}}\sum _{t=1}^{n}\left|{\frac {A_{t}-F_{t}}{A_{t}}}\right|,$

where A_t is the actual value and F_t is the forecast value.

The difference between A_t and F_t is divided by the Actual value A_t again. The absolute value in this calculation is summed for every forecasted point in time and divided by the number of fitted points n. Multiplying by 100 makes it a percentage error.

Although the concept of MAPE sounds very simple and convincing, it has major drawbacks in practical application

• It cannot be used if there are zero values (which sometimes happens for example in demand data) because there would be a division by zero.
• For forecasts which are too low the percentage error cannot exceed 100%, but for forecasts which are too high there is no upper limit to the percentage error.
• When MAPE is used to compare the accuracy of prediction methods it is biased in that it will systematically select a method whose forecasts are too low. This little-known but serious issue can be overcome by using an accuracy measure based on the ratio of the predicted to actual value (called the Accuracy Ratio), this approach leads to superior statistical properties and leads to predictions which can be interpreted in terms of the geometric mean.

Alternative MAPE definitions

Problems can occur when calculating the MAPE value with a series of small denominators. A singularity problem of the form 'one divided by zero' and/or the creation of very large changes in the Absolute Percentage Error, caused by a small deviation in error, can occur.

As an alternative, each actual value (A_t) of the series in the original formula can be replaced by the average of all actual values (Ā_t) of that series. This alternative is still being used for measuring the performance of models that forecast spot electricity prices.

Note that this is the same as dividing the sum of absolute differences by the sum of actual values, and is sometimes referred to as WAPE (weighted absolute percentage error).

Issues

While MAPE is one of the most popular measures for forecasting error, there are many studies on shortcomings and misleading results from MAPE. First the measure is not defined when the actual value is zero, $A_{t}=0$. Moreover, MAPE puts a heavier penalty on negative errors, $A_{t}<F_{t}$ than on positive errors. To overcome these issues with MAPE, there are some other measures proposed in literature:

• Mean Absolute Scaled Error (MASE)
• Symmetric Mean Absolute Percentage Error (sMAPE)
• Mean Directional Accuracy (MDA)

See also

• Least absolute deviations
• Mean absolute error
• Mean percentage error
• Symmetric mean absolute percentage error

External links

• Mean Absolute Percentage Error (MAPE)
• Errors on percentage errors - variants of MAPE