Analysis of Alternatives
The Analysis of Alternatives in the United States is a cornerstone of military acquisition policy, ascontrolled by the Office of Management and Budget (OMB) and the United States Department of Defense (DoD). It ensures that at least three feasible alternatives are analyzed prior to making costly investment decisions. The AoA establishes and benchmarks metrics for Cost, Schedule, Performance (CSP) and Risk (CSPR) depending on military "needs" derived from the Joint Capabilities Integration Development System process. It moves away from employing a single acquisition source to the exploration of multiple alternatives so agencies have a basis for funding the best possible projects in a rational, defensible manner considering risk and uncertainty.
The AoA assesses critical technology elements (CTEs) associated with each proposed material solution, identified in the Initial Capabilities Document (ICD), including; technology maturity, integration risk, manufacturing feasibility, and, where necessary, technology maturation and demonstration needs. An AoA begins by establishing (or modifying) Key Performance Parameters (KPPs) metrics for each alternative. these metric help compare the operational effectiveness, suitability, and life cycle costs of alternatives to satisfy the military need.
DoD Instruction 5000.02 requires an AoA in support of each decision milestone: The Milestone Decision Authority (MDA) directs a study team to accomplish the AoA; the AoA then becomes the primary input to the documents for development of a weapons acquisition program. The results of the analysis provide the basis for the Technology Development Strategy (TDS), which must be approved by the MDA at program's Milestone A.† The AoA is executed before any solution is determined, and is updated throughout the life of the program.
The AoA attempts to arrive at the best value for a set of proposals received from the private sector or other sources. Though Source Selection criteria change per proposal request, and specifics are considered sensitive information, there is usually some form of the Cost Schedule Performance (CSP) trade-space analysis, and strong consideration of Risk, (CSPR). Performance is measured by n terms of Measures of Effectiveness (MOEs), and new capabilities. Risk is analyzed in many ways; aggressiveness of the schedule, cost reasonableness and finally, each MOE and capability may carry an associated risk. RiskAoA, designed for the AoA process, allows the alternative’s risks to be transformed into a single number, and compared.
Risks that affect cost may be evaluated separately from risks affecting an alternative’s schedule and MOEs. The risk from each alternative's capabilities assumes hat every unattained MOE and new capability has some associated risk.
According to the Office of Aerospace Studies, the AoA is the focus of Concept and Technology Development Phase (CTDP). The AoA is designed to examine a broad spectrum of potential alternatives to the mission need described in the Mission Needs Statement. The objective of the AoA is to:
- Refine alternatives
- Refine criteria
- Refine evaluation
- Work to gain consensus
- Reduce uncertainty
- Choose an alternative
Appendix A of General Services Administration’s (GSA's) IT Budget Submission Instructions (GSA, 2007) states: In order to achieve a Level 1 AoA, Section 300 requires that an organization identify and consider at least three viable alternatives. These alternatives need to be presented in a table that shows: 1. Alternative[s] Analyzed 2. Description of Alternative[s] Risk Adjusted Lifecycle Costs estimate[s] – the overall estimated cost over the life of the investment that has been adjusted to accommodate any risk identified and 4.Risk Adjusted Lifecycle Benefits estimate[s] – projected benefits and costs for each viable alternative. The normalized or advanced results of a RiskAoA analysis provides a proportional risk-multiplier for “Risk Adjusted” values (q.v.). It also states the following quantitative and qualitative benefits should be addressed when evaluating total annual benefits for each alternative:
- Qualitative benefits
- Cost savings
- Cost avoidance
- Stakeholder benefits
- Non-Monetary [benefits]
The AoA may also be important to the System Development and Demonstration Phase (SDDP) and the Production and Deployment Phase (PDP) Activities: Before Milestone C, the decision authority may require a new AoA or an update to a previous AoA to account for any factors that may have changed during the preceding phase. There are many elements in an AoA follow-on effort that are updated, focused, and refined. These elements were originally characterized and developed in the CTDP phase AoA and include:
- Mission need
- Threat scenarios
- Operating environment
- Constraints & assumptions
- Operations concept
- Description of alternatives
- Mission tasks
- MOEs/Measures of Performance (MOPs)
- Models & Data analysis
- Life cycle costs
- and the Report
The AoA and its associated documentation, is required before any major investment decision and before each decision milestone, is therefore one of the most important steps in the military acquisition process.
† = Milestone A approves entry into the Technology Development (TD) phase; Milestone B approves entry into the Engineering and Manufacturing Development (EMD) phase; and Milestone C approves entry into the Production and Deployment (P&D) phase.
- Joint Capabilities Integration Development System
- Capability (systems engineering)
- DODAF DoD Architecture Framework
- Military acquisition
- U.S. Office of Management and Budget. Circular No. A–11, Preparation, Submission, And Execution Of The Budget. Washington, DC: Executive Office of the President, 2008.
- Ullman, David G. Making Robust Decisions: Decision Management for Technical, Business, & Service Teams. Victoria, B.C.: Trafford Publishing, 2006. The Mechanical Design Process, 4th edition. New York: McGraw Hill, 2009.
- Ullman D. G., R. Ast (September 2011). "Analysis of Alternatives (AoA) Based Decisions" (PDF). MORS, Phalanx, Vol 44, No 3. p. 24.
- DOD Instruction 5000.02, USD(AT&L) December 8, 2008 http://www.dtic.mil/whs/directives/corres/pdf/500002p.pdf
- Tyler, Gregory; Masquelier, Barbra (January 2007). "Quantifying risk across the Department of Defense" (PDF). Defense AT&L. 36 (1): 60–61.
- U.S. General Services Administration. IT Budget Submission Instructions: Guide for Major IT Initiatives (BY2009 Exhibit 300 & Exhibit 53). Washington, DC: Office of the Chief Information Officer, 2007
- U.S. Air Force. Analysis of Alternative (AoA) Handbook: A practical Guide to Analysis of Alternatives. Kirtland AFB, NM: Air Force Materiel Command (AFMC‘s) Office of Aerospace Studies (OAS), 2008. http://www.oas.kirtland.af.mil/AoAHandbook, http://www.oas.kirtland.af.mil/AoAHandbook/AoA%20Handbook%20Final.pdf
AoA Related Documentation
- Mission Need Statement (MNS) became the Initial Capabilities Document (ICD) for Milestone A
- Operational Requirements Document (ORD) became the Capability Development Document for Milestone B and Capability Production Document for Milestone C
- System Threat Assessment Report
- Threat Assessment Report (TAR) for Air Force component programs, or
- Threat Planning Document (TPD)
- Test and Evaluation Master Plan (TEMP)
- Integrated Logistics Support Plan (ILSP)
- Single Acquisition Master Plan (SAMP)
- Systems Engineering Plan (SEP)
- Systems Engineering Management Plan (SEMP)
- Acquisition Program Baseline (APB)