Development testing

From Wikipedia, the free encyclopedia
  (Redirected from Development Testing)
Jump to: navigation, search
Main article: Unit testing

Development testing is a software development process that involves synchronized application of a broad spectrum of defect prevention and detection strategies in order to reduce software development risks, time, and costs.

Depending on the organization's expectations for software development, Development Testing might include static code analysis, data flow analysis metrics analysis, peer code reviews, unit testing, code coverage analysis, traceability, and other software verification practices.

Development Testing Overview[edit]

Main article: Unit testing

Development testing is performed by the software developer or engineer during the construction phase of the software development lifecycle.[1]

Rather than replace traditional QA focuses, it augments it.[2] Development testing aims to eliminate construction errors before code is promoted to QA; this strategy is intended to increase the quality of the resulting software as well as the efficiency of the overall development and QA process.[3]

Development Testing Applications and Benefits[edit]

Development testing is applied for the following main purposes:

VDC research reports that the standardized implementation of development testing processes within an overarching standardized process not only improves software quality (by aligning development activities with proven best practices) but also increases project predictability.[4] voke research reports that development testing makes software more predictable, traceable, visible, and transparent throughout the software development lifecycle.[2]

Key Principles of Development Testing[edit]

Main article: Unit testing

In each of the above applications, development testing starts by defining policies that express the organization's expectations for reliability, security, performance, and regulatory compliance. Then, after the team is trained on these policies, development testing practices are implemented to align software development activities with these policies.[5] These Development Testing practices include:

  • Practices that prevent as many defects as possible through a Deming-inspired approach that promotes reducing the opportunity for error via root cause analysis.
  • Practices that expose defects immediately after they are introduced—when finding and fixing defects is fastest, easiest, and cheapest.[3][6]

The emphasis on applying a broad spectrum of defect prevention and defect detection practices is based on the premise that different Development Testing techniques are tuned to expose different types of defects at different points in the software development lifecycle, so applying multiple techniques in concert decreases the risk of defects slipping through the cracks.[3] The importance of applying broad set of practices is confirmed by Boehm and Basili in the often-referenced "Software Defect Reduction Top 10 List."[5]

Development Testing and Static Analysis[edit]

The term "development testing" has occasionally been used to describe the application of static analysis tools. Numerous industry leaders have taken issue with this conflation because static analysis is not technically testing; even static analysis that "covers" every line of code is incapable of validating that the code does what it is supposed to do—or of exposing certain types of defects or security vulnerabilities that manifest themselves only as software is dynamically executed.[7][8][9]

Although many warn that static analysis alone should not be considered a silver bullet or panacea, most industry experts agree that static analysis is a proven method for eliminating many security, reliability, and performance defects. In other words, while static analysis is not the same as Development Testing, it is commonly considered a component of Development Testing.[9][10][11]

Additional Development Testing Activities[edit]

In addition to various implementations of static analysis, such as flow analysis, and unit testing, which is often extended to include integration testing,[12] Development Testing also includes peer code review as a primary quality activity. Code review is widely considered one of the most effective defect detection and prevention methods in software development.[13]

See also[edit]

References[edit]

  1. ^ McConnell, Steve (2004). Code Complete (2nd ed.). Microsoft Press. ISBN 0-7356-1967-0. 
  2. ^ a b voke Market Mover Array Report: Testing Platforms by Theresa Lanowitz, Lisa Dronzek, voke, June 05, 2012
  3. ^ a b c d Kolawa, Adam; Huizinga, Dorota (2007). Automated Defect Prevention: Best Practices in Software Management. Wiley-IEEE Computer Society Press. ISBN 0-470-04212-5. 
  4. ^ "Automated Defect Prevention for Embedded Software Quality" white paper by VDC Research
  5. ^ a b Great expectations for development—with policy automation by Wayne Ariola, SD Times, July 28, 2011
  6. ^ Rethinking Software Development, Testing and Inspection by Matthew Heusser , CIO, February 1, 2012
  7. ^ Static Analysis isn’t Development Testing by Jim Bird, Building Real Software, January 6, 2012
  8. ^ Static or Dynamic Application Security Testing? Both! by Neil MacDonald, Gartner Blog Network, January 19, 2011
  9. ^ a b Mythbusting: Static Analysis Software Testing – 100% Code Coverage by Jeremiah Grossman , White Hat Security Blog, March 22, 2011
  10. ^ Static Analyzers in Software Engineering by Dr. Paul E. Black , CrossTalk: The Journal of Defense Software Engineering, March/April 2009
  11. ^ Top 3 Mistakes with Static Analysis for Embedded and Safety-Critical Development by Arthur Hicken, EE Catalog, September 25, 2012
  12. ^ What is the difference between integration and unit tests? forum topic on Stack Overflow
  13. ^ Satisfying SIL Requirements: Ensuring Functional Safety of E/E/PE Safety-Related Systems article on DevelopmentTesting.com