Vanishing point

A vanishing point is a point on the image plane of a perspective rendering where the two-dimensional perspective projections of mutually parallel lines in three-dimensional space appear to converge. When the set of parallel lines is perpendicular to a picture plane, the construction is known as one-point perspective, and their vanishing point corresponds to the oculus, or "eye point", from which the image should be viewed for correct perspective geometry.^[1] Traditional linear drawings use objects with one to three sets of parallels, defining one to three vanishing points.

Italian humanist polymath and architect Leon Battista Alberti first introduced the concept in his treatise on perspective in art, De pictura, written in 1435.^[2]

Vector notation

The vanishing point may also be referred to as the "direction point", as lines having the same directional vector, say D, will have the same vanishing point. Mathematically, let $q \equiv (x, y, f)$ be a point lying on the image plane, where $f$ is the focal length (of the camera associated with the image), and let $vq ≡ (.mw-parser-output .sfrac{white-space:nowrap}.mw-parser-output .sfrac.tion,.mw-parser-output .sfrac .tion{display:inline-block;vertical-align:-0.5em;font-size:85%;text-align:center}.mw-parser-output .sfrac .num{display:block;line-height:1em;margin:0.0em 0.1em;border-bottom:1px solid}.mw-parser-output .sfrac .den{display:block;line-height:1em;margin:0.1em 0.1em}.mw-parser-output .sr-only{border:0;clip:rect(0,0,0,0);clip-path:polygon(0px 0px,0px 0px,0px 0px);height:1px;margin:-1px;overflow:hidden;padding:0;position:absolute;width:1px}⁠x/h⁠, ⁠y/h⁠, ⁠f/h⁠)$ be the unit vector associated with $q$ , where $h = \sqrt x 2 + y 2 + f 2$ . If we consider a straight line in space $S$ with the unit vector $n s \equiv (n x, n y, n z)$ and its vanishing point $v s$ , the unit vector associated with $v s$ is equal to $n s$ , assuming both point towards the image plane.^[3]

When the image plane is parallel to two world-coordinate axes, lines parallel to the axis that is cut by this image plane will have images that meet at a single vanishing point. Lines parallel to the other two axes will not form vanishing points as they are parallel to the image plane. This is one-point perspective. Similarly, when the image plane intersects two world-coordinate axes, lines parallel to those planes will meet form two vanishing points in the picture plane. This is called two-point perspective. In three-point perspective the image plane intersects the $x$ , $y$ , and $z$ axes and therefore lines parallel to these axes intersect, resulting in three different vanishing points.

Theorem

The vanishing point theorem is the principal theorem in the science of perspective. It says that the image in a picture plane $π$ of a line $L$ in space, not parallel to the picture, is determined by its intersection with $π$ and its vanishing point. Some authors have used the phrase, "the image of a line includes its vanishing point". Guidobaldo del Monte gave several verifications, and Humphry Ditton called the result the "main and Great Proposition".^[4] Brook Taylor wrote the first book in English on perspective in 1714, which introduced the term "vanishing point" and was the first to fully explain the geometry of multipoint perspective, and historian Kirsti Andersen compiled these observations.^[1]^: 244–6 She notes, in terms of projective geometry, the vanishing point is the image of the point at infinity associated with $L$ , as the sightline from $O$ through the vanishing point is parallel to $L$ .

Vanishing line

As a vanishing point originates in a line, so a vanishing line originates in a plane $α$ that is not parallel to the picture $π$ . Given the eye point $O$ , and $β$ the plane parallel to $α$ and lying on $O$ , then the vanishing line of $α$ is $β \cap π$ . For example, when $α$ is the ground plane and $β$ is the horizon plane, then the vanishing line of $α$ is the horizon line $β \cap π$ .

To put it simply, the vanishing line of some plane, say $α$ , is obtained by the intersection of the image plane with another plane, say $β$ , parallel to the plane of interest ( $α$ ), passing through the camera center. For different sets of lines parallel to this plane $α$ , their respective vanishing points will lie on this vanishing line. The horizon line is a theoretical line that represents the eye level of the observer. If the object is below the horizon line, its lines angle up to the horizon line. If the object is above, they slope down.

Properties

1. Projections of two sets of parallel lines lying in some plane $π A$ appear to converge, i.e. the vanishing point associated with that pair, on a horizon line, or vanishing line $H$ formed by the intersection of the image plane with the plane parallel to $π A$ and passing through the pinhole. Proof: Consider the ground plane $π$ , as $y = c$ which is, for the sake of simplicity, orthogonal to the image plane. Also, consider a line $L$ that lies in the plane $π$ , which is defined by the equation $ax + bz = d$ . Using perspective pinhole projections, a point on $L$ projected on the image plane will have coordinates defined as,

x' = f \cdot ⁠ x / z ⁠ = f \cdot ⁠ d - bz / az ⁠

y' = f \cdot ⁠ y / z ⁠ = f \cdot ⁠ c / z ⁠

This is the parametric representation of the image $L'$ of the line $L$ with $z$ as the parameter. When $z \to -\infty$ it stops at the point $(x', y') = (- ⁠ fb / a ⁠,0)$ on the $x'$ axis of the image plane. This is the vanishing point corresponding to all parallel lines with slope $- ⁠ b / a ⁠$ in the plane $π$ . All vanishing points associated with different lines with different slopes belonging to plane $π$ will lie on the $x'$ axis, which in this case is the horizon line.

2. Let $A$ , $B$ , and $C$ be three mutually orthogonal straight lines in space and $v A \equiv (x A, y A, f)$ , $v B \equiv (x B, y B, f)$ , $v C \equiv (x C, y C, f)$ be the three corresponding vanishing points respectively. If we know the coordinates of one of these points, say $v A$ , and the direction of a straight line on the image plane, which passes through a second point, say $v B$ , we can compute the coordinates of both $v B$ and $v C$ ^[3]

3. Let $A$ , $B$ , and $C$ be three mutually orthogonal straight lines in space and $v A \equiv (x A, y A, f)$ , $v B \equiv (x B, y B, f)$ , $v C \equiv (x C, y C, f)$ be the three corresponding vanishing points respectively. The orthocenter of the triangle with vertices in the three vanishing points is the intersection of the optical axis and the image plane.^[3]

Curvilinear and reverse perspective

A curvilinear perspective is a drawing with either 4 or 5 vanishing points. In 5-point perspective the vanishing points are mapped into a circle with 4 vanishing points at the cardinal headings N, W, S, E and one at the circle's origin.

A reverse perspective is a drawing with vanishing points that are placed outside the painting with the illusion that they are "in front of" the painting.

Single point perspective projection.
Single point perspective in photography
Double point perspective projection.
Pietro Perugino's use of perspective in the Delivery of the Keys fresco at the Sistine Chapel (1481–82) helped bring the Renaissance to Rome.

Detection

Several methods for vanishing point detection make use of the line segments detected in images. Other techniques involve considering the intensity gradients of the image pixels directly.

There are significantly large numbers of vanishing points present in an image. Therefore, the aim is to detect the vanishing points that correspond to the principal directions of a scene. This is generally achieved in two steps. The first step, called the accumulation step, as the name suggests, clusters the line segments with the assumption that a cluster will have a common vanishing point. The next step finds the principal clusters present in the scene and therefore it is called the search step.

In the accumulation step, the image is mapped onto a bounded space called the accumulator space. The accumulator space is partitioned into units called cells. Barnard^[5] assumed this space to be a Gaussian sphere centered on the optical center of the camera as an accumulator space. A line segment on the image corresponds to a great circle on this sphere, and the vanishing point in the image is mapped to a point. The Gaussian sphere has accumulator cells that increase when a great circle passes through them, i.e. in the image a line segment intersects the vanishing point. Several modifications have been made since, but one of the most efficient techniques was using the Hough Transform, mapping the parameters of the line segment to the bounded space. Cascaded Hough Transforms have been applied for multiple vanishing points.

The process of mapping from the image to the bounded spaces causes the loss of the actual distances between line segments and points.

In the search step, the accumulator cell with the maximum number of line segments passing through it is found. This is followed by removal of those line segments, and the search step is repeated until this count goes below a certain threshold. As more computing power is now available, points corresponding to two or three mutually orthogonal directions can be found.

Applications

Camera calibration: The vanishing points of an image contain important information for camera calibration. Various calibration techniques have been introduced using the properties of vanishing points to find intrinsic and extrinsic calibration parameters.^[6]
3D reconstruction: A man-made environment has two main characteristics – several lines in the scene are parallel, and a number of edges present are orthogonal. Vanishing points aid in comprehending the environment. Using sets of parallel lines in the plane, the orientation of the plane can be calculated using vanishing points. Torre^[7] and Coelho^[8] performed extensive investigation in the use of vanishing points to implement a full system. With the assumption that the environment consists of objects with only parallel or perpendicular sides, also called Lego-land, using vanishing points constructed in a single image of the scene they recovered the 3D geometry of the scene. Similar ideas are also used in the field of robotics, mainly in navigation and autonomous vehicles, and in areas concerned with object detection.

References

^ ^a ^b Kirsti Andersen (2007) Geometry of an Art, p. xxx, Springer, ISBN 0-387-25961-9
^ Wright, D. R. Edward (1984). "Alberti's De Pictura: Its Literary Structure and Purpose". Journal of the Warburg and Courtauld Institutes. 47: 52–71. doi:10.2307/751438. JSTOR 751438. S2CID 195046955.
^ ^a ^b ^c B. Caprile, V. Torre [1] "Using Vanishing Points for Camera Calibration", International Journal of Computer Vision, Volume 4, Issue 2, pp. 127-139, March 1990
^ H. Ditton (1712) Treatise on Perspective, p. 45
^ S.T. Barnard 'Interpreting Perspective Images", Artificial Intelligence 21, 1983, pp. 435 - 462
^ D. Liebowitz and A. Zisserman "Metric Rectification for perspective images of planes" ,IEEE Conf. Computer Vision and Pattern Recognition, June 1998, Santa Barbara, CA, pp. 482 -488
^ R.T. Collins, and R. Weiss "Vanishing Point Calculation as a Statistical Inference on the Unit Sphere" Proceedings of ICCV3, December, 1990
^ C. Coelho, M. Straforani, M. Campani " Using Geometrical Rules and a priori Knowledge for the Understanding of Indoor Scenes" Proceedings BMVC90, pp. 229–234 Oxford, September 1990.

External links

Vanishing point detection by three different proposed algorithms
Vanishing point detection for images and videos using open CV
A tutorial covering many examples of linear perspective
Trigonometric Calculation of Vanishing Points Brief explanation of the rationale with an easy example

[KA-1] Kirsti Andersen (2007) Geometry of an Art, p. xxx, Springer, ISBN 0-387-25961-9

[Wright-2] Wright, D. R. Edward (1984). "Alberti's De Pictura: Its Literary Structure and Purpose". Journal of the Warburg and Courtauld Institutes. 47: 52–71. doi:10.2307/751438. JSTOR 751438. S2CID 195046955.

[Using_Vanishing_Points-3] B. Caprile, V. Torre [1] "Using Vanishing Points for Camera Calibration", International Journal of Computer Vision, Volume 4, Issue 2, pp. 127-139, March 1990

[4] H. Ditton (1712) Treatise on Perspective, p. 45

[5] S.T. Barnard 'Interpreting Perspective Images", Artificial Intelligence 21, 1983, pp. 435 - 462

[Metric_Rectification-6] D. Liebowitz and A. Zisserman "Metric Rectification for perspective images of planes" ,IEEE Conf. Computer Vision and Pattern Recognition, June 1998, Santa Barbara, CA, pp. 482 -488

[7] R.T. Collins, and R. Weiss "Vanishing Point Calculation as a Statistical Inference on the Unit Sphere" Proceedings of ICCV3, December, 1990

[8] C. Coelho, M. Straforani, M. Campani " Using Geometrical Rules and a priori Knowledge for the Understanding of Indoor Scenes" Proceedings BMVC90, pp. 229–234 Oxford, September 1990.

[1]

[2]

[3]

[4]

[5]

[6]

[7]

[8]

1.	The width of the side street, W is computed from the known widths of the adjacent shops.
2.	As a vanishing point, V is visible, the width of only one shop is needed.