Continuous integration (CI) is the practice, in software engineering, of merging all developer working copies with a shared mainline several times a day. It was first named and proposed as part of extreme programming (XP). Its main aim is to prevent integration problems, referred to as "integration hell" in early descriptions of XP. CI can be seen as an intensification of practices of periodic integration advocated by earlier published methods of incremental and iterative software development, such as the Booch method. CI isn't universally accepted as an improvement over frequent integration, so it is important to distinguish between the two as there is disagreement about the virtues of each.
CI was originally intended to be used in combination with automated unit tests written through the practices of test-driven development. Initially this was conceived of as running all unit tests and verifying they all passed before committing to the mainline. This helps avoid one developer's work in progress breaking another developer's copy. If necessary, partially complete features can be disabled before committing using feature toggles.
Later elaborations of the concept introduced build servers, which automatically run the unit tests periodically or even after every commit and report the results to the developers. The use of build servers (not necessarily running unit tests) had already been practised by some teams outside the XP community. Nowadays, many organisations have adopted CI without adopting all of XP.
In addition to automated unit tests, organisations using CI typically use a build server to implement continuous processes of applying quality control in general — small pieces of effort, applied frequently. In addition to running the unit and integration tests, such processes run additional static and dynamic tests, measure and profile performance, extract and format documentation from the source code and facilitate manual QA processes. This continuous application of quality control aims to improve the quality of software, and to reduce the time taken to deliver it, by replacing the traditional practice of applying quality control after completing all development. This is very similar to the original idea of integrating more frequently to make integration easier, only applied to QA processes.
In the same vein the practice of continuous delivery further extends CI by making sure the software checked in on the mainline is always in a state that can be deployed to users and makes the actual deployment process very rapid.
- 1 Theory
- 2 Principles
- 2.1 Maintain a code repository
- 2.2 Automate the build
- 2.3 Make the build self-testing
- 2.4 Everyone commits to the baseline every day
- 2.5 Every commit (to baseline) should be built
- 2.6 Keep the build fast
- 2.7 Test in a clone of the production environment
- 2.8 Make it easy to get the latest deliverables
- 2.9 Everyone can see the results of the latest build
- 2.10 Automate deployment
- 3 History
- 4 Advantages and disadvantages
- 5 Software
- 6 See also
- 7 References
- 8 Further reading
- 9 External links
When embarking on a change, a developer takes a copy of the current code base on which to work. As other developers submit changed code to the source code repository, this copy gradually ceases to reflect the repository code. Not only can the existing code base change, but new code can be added as well as new libraries, and other resources that create dependencies, and potential conflicts.
The longer a branch of code remains checked out, the greater the risk of multiple integration conflicts and failures when the developer branch is reintegrated into the main line. When developers submit code to the repository they must first update their code to reflect the changes in the repository since they took their copy. The more changes the repository contains, the more work developers must do before submitting their own changes.
Eventually, the repository may become so different from the developers' baselines that they enter what is sometimes referred to as "merge hell", or "integration hell", where the time it takes to integrate exceeds the time it took to make their original changes. In a worst-case scenario, developers may have to discard their changes and completely redo the work.
Continuous integration involves integrating early and often, so as to avoid the pitfalls of "integration hell". The practice aims to reduce rework and thus reduce cost and time.
A complementary practice to CI is that before submitting work, each programmer must do a complete build and run (and pass) all unit tests. Integration tests are usually run automatically on a CI server when it detects a new commit. All programmers should start the day by updating the project from the repository. That way, they will all stay up-to-date.
Continuous integration – the practice of frequently integrating one's new or changed code with the existing code repository – should occur frequently enough that no intervening window remains between commit and build, and such that no errors can arise without developers noticing them and correcting them immediately. Normal practice is to trigger these builds by every commit to a repository, rather than a periodically scheduled build. The practicalities of doing this in a multi-developer environment of rapid commits are such that it's usual to trigger a short time after each commit, then to start a build when either this timer expires, or after a rather longer interval since the last build. Many automated tools offer this scheduling automatically.
Another factor is the need for a version control system that supports atomic commits, i.e. all of a developer's changes may be seen as a single commit operation. There is no point in trying to build from only half of the changed files.
To achieve these objectives, continuous integration relies on the following principles.
Maintain a code repository
This practice advocates the use of a revision control system for the project's source code. All artifacts required to build the project should be placed in the repository. In this practice and in the revision control community, the convention is that the system should be buildable from a fresh checkout and not require additional dependencies. Extreme Programming advocate Martin Fowler also mentions that where branching is supported by tools, its use should be minimized. Instead, it is preferred for changes to be integrated rather than for multiple versions of the software to be maintained simultaneously. The mainline (or trunk) should be the place for the working version of the software.
Automate the build
A single command should have the capability of building the system. Many build-tools, such as make, have existed for many years. Other more recent tools are frequently used in continuous integration environments. Automation of the build should include automating the integration, which often includes deployment into a production-like environment. In many cases, the build script not only compiles binaries, but also generates documentation, website pages, statistics and distribution media (such as Debian DEB, Red Hat RPM or Windows MSI files).
Make the build self-testing
Once the code is built, all tests should run to confirm that it behaves as the developers expect it to behave.
Everyone commits to the baseline every day
By committing regularly, every committer can reduce the number of conflicting changes. Checking in a week's worth of work runs the risk of conflicting with other features and can be very difficult to resolve. Early, small conflicts in an area of the system cause team members to communicate about the change they are making. Committing all changes at least once a day (once per feature built) is generally considered part of the definition of Continuous Integration. In addition performing a nightly build is generally recommended. These are lower bounds, the typical frequency is expected to be much higher.
Every commit (to baseline) should be built
The system should build commits to the current working version in order to verify that they integrate correctly. A common practice is to use Automated Continuous Integration, although this may be done manually. For many[who?], continuous integration is synonymous with using Automated Continuous Integration where a continuous integration server or daemon monitors the revision control system for changes, then automatically runs the build process.
Keep the build fast
The build needs to complete rapidly, so that if there is a problem with integration, it is quickly identified.
Test in a clone of the production environment
Having a test environment can lead to failures in tested systems when they deploy in the production environment, because the production environment may differ from the test environment in a significant way. However, building a replica of a production environment is cost prohibitive. Instead, the pre-production environment should be built to be a scalable version of the actual production environment to both alleviate costs while maintaining technology stack composition and nuances.
Make it easy to get the latest deliverables
Making builds readily available to stakeholders and testers can reduce the amount of rework necessary when rebuilding a feature that doesn't meet requirements. Additionally, early testing reduces the chances that defects survive until deployment. Finding errors earlier also, in some cases, reduces the amount of work necessary to resolve them.
Everyone can see the results of the latest build
It should be easy to find out whether the build breaks and, if so, who made the relevant change.
Most CI systems allow the running of scripts after a build finishes. In most situations, it is possible to write a script to deploy the application to a live test server that everyone can look at. A further advance in this way of thinking is Continuous deployment, which calls for the software to be deployed directly into production, often with additional automation to prevent defects or regressions.
In 1997, Kent Beck and Ron Jeffries invented Extreme Programming (XP) while on the Chrysler Comprehensive Compensation System project, including continuous integration. Beck published about continuous integration in 1998, emphasising the importance of face-to-face communication over technological support. In 1999, Beck elaborated more in his first full book on Extreme Programming. CruiseControl was released in 2001.
Advantages and disadvantages
||This article contains a pro and con list, which is sometimes inappropriate. (November 2012)|
Continuous integration has many advantages:
- When unit tests fail or a bug emerges, developers might revert the codebase to a bug-free state, without wasting time debugging
- Developers detect and fix integration problems continuously — avoiding last-minute chaos at release dates, (when everyone tries to check in their slightly incompatible versions).
- Early warning of broken/incompatible code
- Early warning of conflicting changes
- Immediate unit testing of all changes
- Constant availability of a "current" build for testing, demo, or release purposes
- Immediate feedback to developers on the quality, functionality, or system-wide impact of code they are writing
- Frequent code check-in pushes developers to create modular, less complex code
- Metrics generated from automated testing and CI (such as metrics for code coverage, code complexity, and features complete) focus developers on developing functional, quality code, and help develop momentum in a team
- Initial setup time required
- Well-developed test-suite required to achieve automated testing advantages
Many teams using CI report that the advantages of CI well outweigh the disadvantages. The effect of finding and fixing integration bugs early in the development process saves both time and money over the lifespan of a project.
Software tools for continuous integration include:
- Apache Continuum: continuous integration server supporting Apache Maven and Apache Ant.
- Apache Gump: continuous integration tool.
- AutomatedQA Automated Build Studio: proprietary automated build, continuous integration and release management system
- Atlassian Software Systems Bamboo: proprietary continuous integration server.
- Buildbot: Python/Twisted-based continuous build system.
- BuildHive: free cloud-hosted continuous integration service for GitHub projects, based on Jenkins.
- CABIE (Continuous Automated Build and Integration Environment): open source, written in Perl
- Cascade: proprietary continuous integration tool.
- CruiseControl: Java-based framework for a continuous build process and .NET-based automated continuous integration server.
- CruiseControl.rb: lightweight, Ruby-based continuous integration server that can build any codebase, not only Ruby; released under Apache Licence 2.0.
- CruiseControl.NET: .NET-based continuous integration server that can build any codebase, not only .NET-Languages; released under the CCNet License, a very open license, very similar to the Apache & BSD licenses..
- Electric Cloud ElectricCommander: proprietary continuous integration and release management product.
- FinalBuilder Server: VSoft Technologies proprietary automated build and continuous integration server.
- Hudson: MIT-licensed, written in Java.
- Jenkins (fork of Hudson): MIT-licensed, written in Java.
- IBM Rational Team Concert: proprietary software development collaboration platform with built-in build engine.
- IBM Rational Software SCLM: software configuration management system for z/OS.
- Microsoft Team Foundation Server: proprietary software development collaboration platform with continuous integration server and source code repository.
- Shippable: a Saas platform that provides Continuous Integration/Deployment to Github repositories.
- TeamCity: a closed source, Java-based build management and continuous integration server from JetBrains
- Tinderbox: Mozilla-based product written in Perl.
- Travis CI: a distributed build system for the open source community.
- Xcode 5 also contains a proprietary continuous integration system, works closely with OS X Server for OS X Mavericks.
- Build light indicator
- Continuous delivery (continuous deployment)
- Continuous design
- Multi-stage continuous integration
- Rapid application development
- Cunningham, Ward (5 August 2009). "Integration Hell". WikiWikiWeb. Retrieved 19 Sep 2009.
- Brauneis, David (1 January 2010). "[OSLC Possible new Working Group – Automation"]. open-services.net Community mailing list. http://open-services.net/pipermail/community_open-services.net/2010-January/000214.html. Retrieved 16 February 2010.
- Taylor, Bradley. "Rails Deployment and Automation with ShadowPuppet and Capistrano". Rails machine (World wide web log).
- Fowler, Martin. "Practices". Continuous Integration (article). Retrieved 11 November 2009.
- Ries, Eric (30 March 2009). "Continuous deployment in 5 easy steps". Radar. O’Reilly. Retrieved 10 January 2013.
- Fitz, Timothy (10 February 2009). "Continuous Deployment at IMVU: Doing the impossible fifty times a day". Wordpress. Retrieved 10 January 2013.
- Fowler, Martin (1 May 2006). "Continuous Integration". martinfowler.com. Retrieved 9 January 2014.
- Beck, Kent (1998-03-28). "Extreme Programming: A Humanistic Discipline of Software Development". Fundamental Approaches to Software Engineering: First International Conference, FASE'98, Held as Part of the Joint European Conferences on Theory and Practice of Software, ETAPS'98, Lisbon, Portugal, March 28 - April 4, 1998, Proceedings, Volume 1. Lisbon: Springer. p. 4. ISBN 9783540643036.
- Beck, Kent (1999). Extreme Programming Explained. ISBN 0-201-61641-6.
- Richardson, Jared (September 2008). "Agile Testing Strategies". No Fluff Just Stuff. Boston, MA, US.
- Duvall, Paul M. (2007). Continuous Integration. Improving Software Quality and Reducing Risk. Addison-Wesley. ISBN 0-321-33638-0.
- Fowler, Martin. "Continuous integration" (article) (introduction).
- "Continuous Integration" (wiki). Portland Pattern Repository (a collegial discussion). C2.
- "Cross platform testing" (wiki). Portland Pattern Repository. C2.
- Continuous Integration Server Feature Matrix (a guide to tools). Thought works.
- Richardson, Jared. "Continuous Integration: The Cornerstone of a Great Shop". (introduction).
- Flowers, Jay. "A Recipe for Build Maintainability and Reusability".
- Duvall, Paul. "Continuous Integration anti-patterns". Developer works.
- "Integrate often". Rules. Extreme programming.
- Version lifecycle. MediaWiki.