Number needed to treat
The number needed to treat (NNT) is an epidemiological measure used in assessing the effectiveness of a health-care intervention, typically a treatment with medication. The NNT is the average number of patients who need to be treated to prevent one additional bad outcome (e.g. the number of patients that need to be treated for one to benefit compared with a control in a clinical trial). It is defined as the inverse of the absolute risk reduction. It was described in 1988. The ideal NNT is 1, where everyone improves with treatment and no one improves with control. The higher the NNT, the less effective is the treatment.
NNT values are time-specific. For example, if a study ran for 5 years and it was found that the NNT was 100 during this 5 year period, in one year the NNT would have to be multiplied by 5 to correctly assume the right NNT for only the one year period (in the example the one year NNT would be 500).
NNT is the statistical inverse of incidence i.e. 1/incidence. In other words, in case of the vaccination for a disease with incidence of 1 per 1000, the NNT is 1000. In general, NNT is computed with respect to two treatments A and B, with A typically the intervention and B the control (e.g., A might be a 5-year treatment with a drug, while B is no treatment). A defined endpoint has to be specified (e.g., the appearance of colon cancer in a five-year period). If the probabilities pA and pB of this endpoint under treatments A and B, respectively, are known, then the NNT is computed as 1/(pB – pA). NNT is a number between 1 and ∞; effective interventions have a low NNT. A negative number would not be presented as a NNT, rather, as the intervention is harmful, it is expressed as a number needed to harm (NNH). The units of the aforementioned probabilities are expressed as number of events per subject (see worked out example below); therefore, the inverse NNH will be number of subjects (required) per event.
The NNT is an important measure in pharmacoeconomics. If a clinical endpoint is devastating enough (e.g. death, heart attack), drugs with a high NNT may still be indicated in particular situations. If the endpoint is minor, health insurers may decline to reimburse drugs with a high NNT. NNT is significant to consider when comparing possible side effects of a medication against its benefits. For medications with a high NNT, even a small incidence of adverse effects may outweigh the benefits. Even though NNT is an important measure in a clinical trial, it is infrequently included in medical journal articles reporting the results of clinical trials. There are several important problems with the NNT, involving bias and lack of reliable confidence intervals, as well as difficulties in excluding the possibility of no difference between two treatments or groups.
Example: statins for primary prevention
For example, the ASCOT-LLA manufacturer-sponsored study addressed the benefit of atorvastatin 10 mg (a cholesterol-lowering drug) in patients with hypertension (high blood pressure) but no previous cardiovascular disease (primary prevention). The trial ran for 3.3 years, and during this period the relative risk of a "primary event" (heart attack) was reduced by 36% (relative risk reduction, RRR). The absolute risk reduction (ARR), however, was much smaller, because the study group did not have a very high rate of cardiovascular events over the study period: 2.67% in the control group, compared to 1.65% in the treatment group. Taking atorvastatin for 3.3 years, therefore, would lead to an ARR of only 1.02% (2.67% minus 1.65%). The number needed to treat to prevent one cardiovascular event would then be 99.7 for 3.3 years.
|Example 1: risk reduction||Example 2: risk increase|
|Experimental group (E)||Control group (C)||Total||(E)||(C)||Total|
|Events (E)||EE = 15||CE = 100||115||EE = 75||CE = 100||175|
|Non-events (N)||EN = 135||CN = 150||285||EN = 75||CN = 150||225|
|Total subjects (S)||ES = EE + EN = 150||CS = CE + CN = 250||400||ES = 150||CS = 250||400|
|Event rate (ER)||EER = EE / ES = 0.1, or 10%||CER = CE / CS = 0.4, or 40%||EER = 0.5 (50%)||CER = 0.4 (40%)|
|Equation||Variable||Abbr.||Example 1||Example 2|
|EER − CER||< 0: absolute risk reduction||ARR||(−)0.3, or (−)30%||N/A|
|> 0: absolute risk increase||ARI||N/A||0.1, or 10%|
|(EER − CER) / CER||< 0: relative risk reduction||RRR||(−)0.75, or (−)75%||N/A|
|> 0: relative risk increase||RRI||N/A||0.25, or 25%|
|1 / (EER − CER)||< 0: number needed to treat||NNT||(−)3.33||N/A|
|> 0: number needed to harm||NNH||N/A||10|
|EER / CER||relative risk||RR||0.25||1.25|
|(EE / EN) / (CE / CN)||odds ratio||OR||0.167||1.5|
|EER − CER||attributable risk||AR||(−)0.30, or (−)30%||0.1, or 10%|
|(RR − 1) / RR||attributable risk percent||ARP||N/A||20%|
|1 − RR (or 1 − OR)||preventive fraction||PF||0.75, or 75%||N/A|
The relative risk is 0.25 in the example above. It is always 1-relative risk reduction, or vice versa. (The signs of the numbers needed to treat and the numbers needed to hurt are reversed: NNT is 3.33 and NNH is −10.)
There are a number of factors that can affect the NNT. Let's say we have a disease, and a pill to treat the disease, that should work over the course of a week.
- PA is the probability of still having the disease after taking the pill (i.e. complement of the probability of being cured after taking the pill). The experimental group.
- PB is the probability of still having the disease even though you didn't take the pill (i.e. complement of the probability of the disease going away by itself). This is the control group, who probably got a placebo pill instead of the real pill.
|Perfect drug||0.0||1.0||1.0||Everybody is cured with the pill; nobody without|
|Very good drug||0.1||0.9||1.25||Ten take the pill; 8 cured by the pill, 1 cured by itself, 1 still sick.|
|Satisfactory drug||0.3||0.7||2.5||Ten take the pill; 4 cured by the pill, 3 cured by itself, 3 still sick.|
|High placebo effect||0.4||0.5||10||Ten take the pill; 6 cured but 5 of those would be cured anyway.|
|Low cure rate||0.8||0.9||10||Ten take the pill, one is cured by the pill, one cured by itself, 8 still have the disease.|
|Goes away by itself||0.1||0.2||10||Ten take the pill and 9 are cured; but 8 would have been cured anyway.|
|Sabotages cure||0.9||0.8||−10||Ten take the pill, two would have been cured without it, but with the pill, only one is cured, so really NNH=10.|
- Laupacis A, Sackett DL, Roberts RS (1988). "An assessment of clinically useful measures of the consequences of treatment". N. Engl. J. Med. 318 (26): 1728–33. doi:10.1056/NEJM198806303182605. PMID 3374545.
- "Number Needed to Treat". Bandolier. Retrieved 2009-05-30.
- Kelly H, Attia J, Andrews R, Heller RF (June 2004). "The number needed to vaccinate (NNV) and population extensions of the NNV: comparison of influenza and pneumococcal vaccine programmes for people aged 65 years and over". Vaccine 22 (17-18): 2192–8. doi:10.1016/j.vaccine.2003.11.052. PMID 15149776.
- Brisson M (2008). "Estimating the number needed to vaccinate to prevent herpes zoster-related disease, health care resource use and mortality". Can J Public Health 99 (5): 383–6. PMID 19009921.
- Lewis EN, Griffin MR, Szilagyi PG, Zhu Y, Edwards KM, Poehling KA (September 2007). "Childhood influenza: number needed to vaccinate to prevent 1 hospitalization or outpatient visit". Pediatrics 120 (3): 467–72. doi:10.1542/peds.2007-0167. PMID 17766517.
- Palle Mark Christensen; Kristiansen, IS (2006). "Number-Needed-to-Treat (NNT) – Needs Treatment with Care". Basic & Clinical Pharmacology & Toxicology 99 (1): 12–16. doi:10.1111/j.1742-7843.2006.pto_412.x. PMID 16867164.
- Nuovo, J.; Melnikow J.; Chang D. (2002-06-05). "Reporting number needed to treat and absolute risk reduction in randomized controlled trials.". JAMA 287 (21): 2813–4. doi:10.1001/jama.287.21.2813. PMID 12038920.
- Hutton JL (2010). "Misleading Statistics: The Problems Surrounding Number Needed to Treat and Number Needed to Harm". Pharm Med 24 (3): 145–9. doi:10.1007/BF03256810. ISSN 1178-2595.
- Sever PS, Dahlöf B, Poulter NR, et al. (2003). "Prevention of coronary and stroke events with atorvastatin in hypertensive patients who have average or lower-than-average cholesterol concentrations, in the Anglo-Scandinavian Cardiac Outcomes Trial—Lipid Lowering Arm (ASCOT-LLA): a multicentre randomised controlled trial". Lancet 361 (9364): 1149–58. doi:10.1016/S0140-6736(03)12948-0. PMID 12686036.
- "Bandolier — Statin effectiveness: ASCOT update". Retrieved 2008-03-31.
- John Carey. "Do Cholesterol Drugs Do Any Good?". Business Week. Retrieved 2008-03-31.