In graphical perspective, a vanishing point is a point in the picture plane π that is the intersection of the projections (or drawings) of a set of parallel lines in space on to the picture plane. When the set of parallels is perpendicular to the picture plane, the construction is known as one-point perspective and their vanishing point corresponds to the oculus or eye point O from which the image should be viewed for correct perspective geometry. Traditional linear drawings use objects with one to three sets of parallels, defining one to three vanishing points.
The vanishing point may also be referred to as the “Direction Point”, as lines having the same directional vector, say D, will have the same vanishing point or converge at the same vanishing points. Mathematically, Let q Ξ (x, y, f) be a point lying on the image plane, where f is the focal length, (of the camera associated with the image) and let vq Ξ (x/h, y/h, f/h) be the unit vector associated with q, where h = (x2+ y2+ f2)1/2. If we consider a straight line in space S with the unit vector ns Ξ (nx, ny, nz) and its vanishing point vs, the unit vector associated with vs is equal to ns, assuming both are assumed to point towards the image plane. 
When the image plane is parallel to two world coordinate axis, then lines parallel to the axis which is cut by this image plane, will meet at infinity i.e. at the vanishing point. Lines parallel to the other two axes, will not form vanishing points as they are parallel to the image plane. This is one-point perspective. Similarly, when the image plane intersects two world coordinate axes, then lines parallel to those planes will meet at infinity, and form two vanishing points. This is called two-point perspective. In, three-point perspective the image plane intersects the x, y, and z axes and therefore lines parallel to these axes intersect, resulting in three different vanishing points.
See also: Property 1 below.
The vanishing point theorem is the principal theorem in the science of perspective. It says that the image in a picture plane π of a line L in space, not parallel to the picture, is determined by its intersection with π and its vanishing point. Some authors have used the phrase, "the image of a line includes its vanishing point". Guidobaldo del Monte gave several verifications, and Humphry Ditton called the result the "main and Great Proposition". Brook Taylor wrote the first book in English on perspective in 1714, which introduced the term "vanishing point" and was the first to fully explain the geometry of multipoint perspective, and historian Kirsti Andersen compiled these observations She notes, in terms of projective geometry, the vanishing point is the image of the point at infinity associated with L, as the sightline from O through the vanishing point is parallel to L.
As a vanishing point originates in a line, so a vanishing line originates in a plane α that is not parallel to the picture π. Given the eye point O, and β the plane parallel to α and lying on O, then the vanishing line of α is β ∩ π. For example, when α is the ground plane and β is the horizon plane, then the vanishing line of α is the horizon line β ∩ π....only one particular vanishing line occurs, often referred to as the horizon." To put it simply, the vanishing line is obtained by the intersection of the image plane with a plane parallel to the ground plane, passing through the camera center. For different sets of parallel line, their respective vanishing points will lie on this line. The horizon line is a theoretical line that represents the eye level of the observer. If the object is below the horizon line, its vanishing lines angle up to the horizon line. If the object is above, they slope down. All vanishing lines end at the horizon line.
Properties of Vanishing Points
1. Projections of two sets of parallel lines lying in some plane πA appear to converge, i.e. the vanishing point associated with that pair, on a horizon line, or vanishing line H formed by the intersection of the image plane with the plane parallel to πA and passing through the pinhole. Proof: Consider the ground plane π, as y = c which is, for the sake of simplicity, orthogonal to the image plane. Also, consider a line L that lies in the plane π, which is defined by the equation, ax+bz=d Using perspective pinhole projections, a point on L projected on the image plane will have coordinates defined as, x'= f x/z=f (d-bz)/az y'= f y/z=f c/z This is the parametric representation of the image L’ of the line L with z as the parameter. When z→-∞ it stops at the point (x',y' ) = (-fb/a,0) on the x' axis of image plane. This is the vanishing point corresponding to all the parallel lines with slope –(b)/a in the plane π. All vanishing points associated with different lines with different slopes belonging to plane π will lie on the x' axis, which in this case is the horizon line.
2. Let A, B, and C be three mutually orthogonal straight lines in space and vA Ξ (xA, yA, f), vB Ξ (xB, yB, f), vC Ξ (xC, yC, f) be the three corresponding vanishing points respectively. If we know the coordinates of one of these points, say vA, and the direction of a straight line on the image plane, which passes through a second point, say vB, we can compute the coordinates of both vB and vC 
3. Let A, B, and C be three mutually orthogonal straight lines in space and vA Ξ (xA, yA, f), vB Ξ (xB, yB, f), vC Ξ (xC, yC, f) be the three corresponding vanishing points respectively. The orthocenter of the triangle with vertexes in the three vanishing points is the intersection of the optical axis and the image plane. 
Curvilinear and reverse perspective
A curvilinear perspective is a drawing with either 4 or 5 vanishing points, in 5-point perspective the vanishing points are mapped into a circle with 4 vanishing points at the cardinal headings N,W,S,E and one at the circle origin.
A reverse perspective is a drawing with vanishing points that are placed outside the painting with the illusion that they are "in front of" the painting.
Detection of Vanishing Points
Several methods for vanishing point detection make use of the line segments detected in images. Other techniques involve considering the intensity gradients of the image pixel directly is another approach. There are significantly large numbers of vanishing points present in an image. Therefore, the aim is to detect the vanishing points which correspond to the principal directions of a scene. This is generally achieved in two steps. The first step, called the accumulation step, as the name suggests, clusters the line segments with the assumption that a cluster will share a common vanishing point. The next step finds the principal clusters present in the scene and therefore it is also called the search step.
In the accumulation step, the image is mapped onto a bounded space, called as accumulator space. The accumulator space is partitioned into units called cells. Barnard  assumed this space to be a Gaussian sphere centered on the optical center of the camera as an accumulator space.A line segment on the image corresponds to a great circle on this sphere, and the vanishing point in the image is mapped to a point. The Gaussian sphere has accumulator cells they increase when a great circle pass through them, i.e. in the image a line segment intersects the vanishing point. Several modifications have been made since, however one of the most efficient techniques was using the Hough Transform, mapping the parameters of the line segment to the bounded space. Cascaded Hough Transforms have been applied for multiple vanishing points. The process of mapping from the image to the bounded spaces causes the loss of the actual distances between line segments and points.
In the search step, the accumulator cell with the maximum number of line segments having passed through it is found. This is followed by removal of those line segments, and the search step is repeated, till this count goes below a certain threshold. As more computing power is now available, points corresponding to two or three mutually orthogonal direction scan be found.
Applications of Vanishing Points
1. Camera calibration: Vanishing points of an image contain important information for camera calibration. Various calibration techniques have been introduced using the properties of vanishing points to find intrinsic and extrinsic calibration parameters. 
2. 3D reconstruction: A man made environment has mainly two characteristic properties – Several lines in the scene are parallel and a number of edges present are orthogonal. Vanishing points aid in comprehending the environment. Using sets of parallel lines in the plane, the orientation of the plane can be calculated using vanishing points. Torre  and Coelho  performed extensive investigation in the use of vanishing points to implement a full system. With the assumption of environment consists of objects with only parallel or perpendicular sides, also called Lego-land, using vanishing points constructed in a single image of the scene they recovered the 3D geometry of the scene. Similar ideas are also carried In the field of robotics, mainly in navigation and autonomous vehicles. It is also used in areas concerned with object detection.
- Kirsti Andersen (2007) Geometry of an Art, p. xxx, Springer, ISBN 0-387-25961-9
- B. Caprile, V. Torre  "Using Vanishing Points for Camera Calibration", International Journal of Computer Vision, Volume 4, Issue 2, pp. 127-139, March 1990
- H. Ditton (1712) Treatise on Perspective, p 45
- K. Andersen (2007) Geometry of an Art, pp 244 to 6
- K. Andersen 2007 pp 249, 503–6. "
- S.T. Barnard 'Interpreting Perspective Images", Artificial Intelligence 21, 1983, pp. 435 - 462
- D. Liebowitz and A. Zisserman "Metric Rectification for perspective images of planes" ,IEEE Conf. Computer Vision and Pattern Recognition, June 1998, Santa Barbara, CA, pp. 482 -488
- R.T. Collins, and R. Weiss "Vanishing Point Calculation as a Statistical Interference on the Unit Sphere" Proceedings of ICCV3, December, 1990
- C. Coelho, M. Straforani, M. Campani " Using Geometrical Rules and a priori Knowledge for the Understanding of Indoor Scenes" Proceedings BMVC90, p.229-234 Oxford, September 1990.
- A tutorial covering many examples of linear perspective
- Geometry of the Vanishing Point at Convergence
- Trigonometric Calculation of Vanishing Points Brief explanation of the rationale with an easy example