The Horn-Schunck algorithm assumes smoothness in the flow over the whole image. Thus, it tries to minimize distortions in flow and prefers solutions which show more smoothness.
The flow is formulated as a global energy functional which is then sought to be minimized. This function is given for two-dimensional image streams as:
where , and are the derivatives of the image intensity values along the x, y and time dimensions respectively, is the optical flow vector, and the parameter is a regularization constant. Larger values of lead to a smoother flow. This functional can be minimized by solving the associated multi-dimensional Euler-Lagrange equations. These are
where is the integrand of the energy expression, giving
where subscripts again denote partial differentiation and denotes the Laplace operator. In practice the Laplacian is approximated numerically using finite differences, and may be written where is a weighted average of calculated in a neighborhood around the pixel at location (x,y). Using this notation the above equation system may be written
which is linear in and and may be solved for each pixel in the image. However, since the solution depends on the neighboring values of the flow field, it must be repeated once the neighbors have been updated. The following iterative scheme is derived:
where the superscript k+1 denotes the next iteration, which is to be calculated and k is the last calculated result. This is in essence the Jacobi method applied to the large, sparse system arising when solving for all pixels simultaneously.
Advantages of the Horn–Schunck algorithm include that it yields a high density of flow vectors, i.e. the flow information missing in inner parts of homogeneous objects is filled in from the motion boundaries. On the negative side, it is more sensitive to noise than local methods.
- B.K.P. Horn and B.G. Schunck, "Determining optical flow." Artificial Intelligence, vol 17, pp 185–203, 1981. Manuscript available on MIT server.