Image rectification is a transformation process used to project two-or-more images onto a common image plane. It corrects image distortion by transforming the image into a standard coordinate system.
- It is used in computer stereo vision to simplify the problem of finding matching points between images.
- It is used in geographic information systems to merge images taken from multiple perspectives into a common map coordinate system.
Computer stereo vision[clarification needed]
Between two cameras there is a problem[clarification needed] of finding a corresponding point viewed by one camera in the image of the other camera (known as the correspondence problem). In most camera configurations, finding correspondences requires a search in two-dimensions. However, if the two cameras are aligned to be coplanar, the search is simplified to one dimension - a horizontal line parallel to the line between the cameras. Furthermore, if the location of a point in the left image is known, it can be searched for in the right image by searching left of this location along the line, and vice versa (see binocular disparity). Image rectification is an equivalent (and more often used) alternative to perfect camera alignment. Image rectification is usually performed regardless of camera precision[clarification needed], because it may be impractical to perfectly align cameras, and even perfectly aligned cameras may become misaligned over time.
If the images to be rectified are taken from camera pairs without geometric distortion, this calculation can easily be made with a linear transformation. X & Y rotation puts the images on the same plane, scaling makes the image frames be the same size and Z rotation & skew adjustments make the image pixel rows directly line up. The rigid alignment of the cameras needs to be known (by calibration) and the calibration coefficients are used by the transform.
In performing the transform, if the cameras themselves are calibrated for internal parameters, an essential matrix provides the relationship between the cameras. The more general case (without camera calibration) is represented by the fundamental matrix. If the fundamental matrix is not known, it is necessary to find preliminary point correspondences between stereo images to facilitate its extraction.
Geographic information system
Image rectification in GIS converts images to a standard map coordinate system. This is done by matching ground control points (GCP) in the mapping system to points in the image. These GCPs calculate necessary image transforms.
Primary difficulties in the process occur
- when the accuracy of the map points are not well known
- when the images lack clearly identifiable points to correspond to the maps.
The maps that are used with rectified images are non-topographical. However, the images to be used may contain distortion from terrain. Image orthorectification additionally removes these effects.
Image rectification is a standard feature available with GIS software packages.
- Binocular disparity
- Correspondence problem
- Epipolar geometry
- Geographic information system
- Stereo camera
- Stereo vision
- Structure from motion
- Oram, Daniel (2001). "Rectification for Any Epipolar Geometry".
- Fusiello, Andrea (2000-03-17). "Epipolar Rectification". Retrieved 2008-06-09.
- Fusiello, Andrea; Trucco, Emanuele; Verri, Alessandro (2000-03-02). "A compact algorithm for rectification of stereo pairs". Machine Vision and Applications (Springer-Verlag) 12: 16–22. doi:10.1007/s001380050120. Retrieved 2010-06-08.
- Pollefeys, Marc; Koch, Reinhard; Van Gool, Luc (1999). "A simple and efficient rectification method for general motion". Proc. International Conference on Computer Vision: 496–501. Retrieved 2011-01-019.
- Lim, Ser-Nam; Mittal, Anurag; Davis, Larry; Paragios, Nikos. "Uncalibrated stereo rectification for automatic 3D surveillance". International Conference on Image Processing 2: 1357. Retrieved 2010-06-08.
- Roberto, Rafael; Teichrieb, Veronica; Kelner, Judith (2009). "Retificação Cilíndrica: um método eficente para retificar um par de imagens". Workshops of Sibgrapi 2009 - Undergraduate Works (in portuguese). Retrieved 2011-03-05.
- Fogel, David. "Image Rectification with Radial Basis Functions". Retrieved 2008-06-09.
- R. I. Hartley (1999). "Theory and Practice of Projective Rectification". Int. Journal of Computer Vision 35 (2): 115–127. doi:10.1023/A:1008115206617.
- Pollefeys, Marc. "Polar rectification". Retrieved 2007-06-09.
- Linda G. Shapiro and George C. Stockman (2001). Computer Vision. Prentice Hall. p. 580. ISBN 0-13-030796-3.