It is based on the BLEU metric, but with some alterations. Where BLEU simply calculates n-gram precision adding equal weight to each one, NIST also calculates how informative a particular n-gram is. That is to say when a correct n-gram is found, the rarer that n-gram is, the more weight it will be given.
For example, if the bigram "on the" is correctly matched, it will receive lower weight than the correct matching of bigram "interesting calculations", as this is less likely to occur.
NIST also differs from BLEU in its calculation of the brevity penalty insofar as small variations in translation length do not impact the overall score as much.
- "Automatic Evaluation of Machine Translation Quality Using N-gram Co-Occurrence Statistics" (PDF). Retrieved 2010-04-17.
|This technology-related article is a stub. You can help Wikipedia by expanding it.|