Camera resectioning is the process of estimating the parameters of a pinhole camera model approximating the camera that produced a given photograph or video. Usually, the pinhole camera parameters are represented in a 3 × 4 matrix called the camera matrix.
This process is often called camera calibration, but "camera calibration" can also mean photometric camera calibration.
Parameters of camera model
Often, we use to represent a 2D point position in Pixel coordinates. is used to represent a 3D point position in World coordinates. Note: they were expressed in augmented notation of Homogeneous coordinates which is most common notation in robotics and rigid body transforms. Referring to the pinhole camera model, a camera matrix is used to denote a projective mapping from World coordinates to Pixel coordinates.
The intrinsic matrix contains 5 intrinsic parameters. These parameters encompass focal length, image sensor format, and principal point. The parameters and represent focal length in terms of pixels, where and are the scale factors relating pixels to distance and is the focal length in terms of distance.  represents the skew coefficient between the x and the y axis, and is often 0. and represent the principal point, which would be ideally in the centre of the image.
Nonlinear intrinsic parameters such as lens distortion are also important although they cannot be included in the linear camera model described by the intrinsic parameter matrix. Many modern camera calibration algorithms estimate these intrinsic parameters as well.
are the extrinsic parameters which denote the coordinate system transformations from 3D world coordinates to 3D camera coordinates. Equivalently, the extrinsic parameters define the position of the camera center and the camera's heading in world coordinates. is the position of the origin of the world coordinate system expressed in coordinates of the camera-centered coordinate system. is often mistakenly considered the position of the camera. The position, , of the camera expressed in world coordinates is (since is a rotation matrix).
Camera calibration is often used as an early stage in computer vision.
When a camera is used, light from the environment is focused on an image plane and captured. This process reduces the dimensions of the data taken in by the camera from three to two (light from a 3D scene is stored on a 2D image). Each pixel on the image plane therefore corresponds to a shaft of light from the original scene. Camera resectioning determines which incoming light is associated with each pixel on the resulting image. In an ideal pinhole camera, a simple projection matrix is enough to do this. With more complex camera systems, errors resulting from misaligned lenses and deformations in their structures can result in more complex distortions in the final image. The camera projection matrix is derived from the intrinsic and extrinsic parameters of the camera, and is often represented by the series of transformations; e.g., a matrix of camera intrinsic parameters, a 3 × 3 rotation matrix, and a translation vector. The camera projection matrix can be used to associate points in a camera's image space with locations in 3D world space.
Camera resectioning is often used in the application of stereo vision where the camera projection matrices of two cameras are used to calculate the 3D world coordinates of a point viewed by both cameras.
Some people call this camera calibration, but many restrict the term camera calibration for the estimation of internal or intrinsic parameters only.
There are many different approaches to calculate the intrinsic and extrinsic parameters for a specific camera setup.
- Direct linear transformation (DLT) method
- A classical approach is "Roger Y. Tsai Algorithm". It is a 2-stage algorithm, calculating the pose (3D Orientation, and x-axis and y-axis translation) in first stage. In second stage it computes the focal length, distortion coefficients and the z-axis translation.
- Zhang's "a flexible new technique for camera calibration".
|This section requires expansion. (December 2008)|
Assume we have a homography that maps points on a "probe plane" to points on the image.
The circular points lie on both our probe plane and on the absolute conic . Lying on of course means they are also projected onto the image of the absolute conic (IAC) , thus and . The circular points project as
We can actually ignore while substituting our new expression for as follows:
Selby's method (for X-ray cameras)
|This section requires expansion. (October 2011)|
Selby's camera calibration method addresses the auto-calibration of X-ray camera systems. X-ray camera systems, consisting of the X-ray generating tube and a solid state detector can be modelled as pinhole camera systems, comprising 9 intrinsic and extrinsic camera parameters. Intensity based registration based on an arbitrary X-ray image and a reference model (as a tomographic dataset) can then be used to determine the relative camera parameters without the need of a special calibration body or any ground-truth data.
- Zhang's Camera Calibration and Tsai's Calibration Softwares on LGPL licence
- Zhang's 2D camera calibration: step by step (Description of the implantation)
- Zhang's Camera Calibration Method with Software
- 3DF Lapyx - automatic camera calibration utility by 3Dflow.
- C++ Camera Calibration Toolbox with source code
- Camera Calibration Toolbox for Matlab
- The DLR CalDe and DLR CalLab Camera Calibration Toolbox
- Camera Calibration - Augmented reality lecture at TU Muenchen, Germany
- Tsai's Approach
- Camera calibration (using ARToolKit)
- A Four-step Camera Calibration Procedure with Implicit Image Correction
- Free software for distortion correction
- Video on Camera Calibration with MATLAB
- Richard Hartley and Andrew Zisserman (2003). Multiple View Geometry in Computer Vision. Cambridge University Press. pp. 155–157. ISBN 0-521-54051-8.
- Z. Zhang, "A flexible new technique for camera calibration'", IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol.22, No.11, pages 1330–1334, 2000
- P. Sturm and S. Maybank, "On plane-based camera calibration: a general algorithm, singularities, applications'", In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 432–437, Fort Collins, CO, USA, June 1999
- Boris Peter Selby et al., "Patient positioning with X-ray detector self-calibration for image guided therapy", Australasian Physical & Engineering Science in Medicine, Vol.34, No.3, pages 391–400, 2011