Image stitching
From Wikipedia, the free encyclopedia
| Please help improve this article by expanding it. Further information might be found on the talk page. (December 2007) |
Image stitching or photo stitching is the process of combining multiple photographic images with overlapping fields of view to produce a segmented panorama or high-resolution image. Commonly performed through the use of computer software, most approaches to image stitching require nearly exact overlaps between images and identical exposures to produce seamless results.[1]It is also known as mosaicing.
Contents |
[edit] Stages of the stitching process
- Image calibration (perspective correction, vignetting correction, chromatic aberration correction). Images are processed in this stage to improve results.
- Image registration (analysis for translation, rotation, and focal length). Direct or feature-based image alignment methods may be used. Direct aligment methods search for image orientations that minimize the sum of absolute differences between overlapping pixels.[2] Feature-based methods determine proper image orientations by identifying features that appear in multiple images and overlapping them.[3]
- Image blending; combining the sections, possibly involving:
- Color correction (matching the adjoining areas of the component images for color, contrast and brightness to avoid visibility of the seams).
- Dynamic range extension.
- Motion compensation / deghosting / deblurring, to compensate for moving objects.
Not all of these tasks may be performed. In their omission, artifacts may result.
[edit] Projection geometry
For image segments that have been taken from the same point in space, stitched images can be arranged using one of these graphical projections:
- Rectilinear projection, where the stitched image is viewed on a 2D plane.
- Cylindrical projection, where the stitched image shows a 360° horizontal field of view and a limited vertical field of view. Panoramas in this projection are meant to be viewed as though the image is wrapped into a cylinder and viewed from within. When viewed on a 2D plane, horizontal lines appear curved while vertical lines remain straight.[4]
- Spherical projection, where the stitched image shows a 360° horizontal by 180° vertical field of view. Panoramas in this projection are meant to be viewed as though the image is wrapped into a sphere and viewed from within. When viewed on a 2D plane, horizontal lines appear curved as in a cylindrical projection, while vertical lines curve as they get closer to the poles of the sphere.[4]
[edit] Challenges of image stitching
- Compensation for images not taken from the same place (on a pivot about the entrance pupil of the camera[5]), which can introduce parallax errors between images.
- Coping with dynamic scenes, such as voluntary or wind-induced motion. Dynamic scenes can have ghosting or blurring artifacts as a result of time differences between the image segments.
- Recognition of component images belonging to a particular scene from an unsorted set of images ("blind" stitching) through feature-based alignment methods; see autostitch.
[edit] Image stitching applications
Dedicated programs include Autopano, Autostitch, Hugin, Ptgui, Panorama Tools, Photostitch, Microsoft Research Image Composite Editor, and CleVR.
Many other programs can also stitch multiple images. A popular example is Adobe Photoshop, which includes a tool known as "Photomerge" and the new "Auto-Blend" in CS3. Also, Photoshop has a "Nudge" option, which makes it easy to manually stitch two pictures if there is enough contrast along their edges.
[edit] Code
- Automatic Image Stitching in Matlab(Author: Baoyuan Liu in SJTU)
http://rapidshare.com/files/299499993/Automatic_Image_Stitching.rar
http://rapidshare.com/files/299505891/Automatic_Image_Stitching.pdf
[edit] Related problems
- Video stitching
- Image panorama generation from video
- Super-resolution imaging; combining images to increase the resolution.
- Combining images from multiple angles to form a 3D model; see Microsoft Live Labs Photosynth.
- Creating Panoramic images and ActionShot Panoramic images
[edit] See also
- Panoramic photography
- ActionShot panoramic photography
[edit] References
- ^ Ward, Greg (2006). "Hiding seams in high dynamic range panoramas". ACM International Conference Proceeding Series. Proceedings of the 3rd symposium on Applied perception in graphics and visualization. 153. ACM. doi:. ISBN 1-59593-429-4.
- ^ S. Suen; E. Lam, and K. Wong (2007). "Photographic stitching with optimized object and color matching based on image derivatives". Optics Express 15: 7689-7696. doi:. http://www.opticsinfobase.org/oe/abstract.cfm?uri=oe-15-12-7689.
- ^ Szeliski, Richard (2005) (PDF). Image Alignment and Stitching. http://www.caam.rice.edu/~zhang/caam699/p-files/Im-Align2005.pdf. Retrieved 2008-06-01.
- ^ a b Wells, Sarah et al. (2007). IATH Best Practices Guide to Digital Panoramic Photography. http://www.iath.virginia.edu/panorama/section4.html#4.1. Retrieved 2008-06-01.
- ^ Littlefield, Rik (2006-02-06) (PDF). Theory of the "No-Parallax" Point in Panorama Photography. ver. 1.0. http://www.janrik.net/PanoPostings/NoParallaxPoint/TheoryOfTheNoParallaxPoint.pdf. Retrieved 2008-06-01.