Speckle imaging

From Wikipedia, the free encyclopedia
(Redirected from Image stacking)
Typical short-exposure image of a binary star (ζ Boötis) as seen through atmospheric turbulence. Each star should appear as a single point, but the atmosphere causes the images of the two stars to break up into two patterns of speckles. The speckles move around rapidly, so that each star appears as a single fuzzy blob in long exposure images.
Slow-motion speckle imaging movie, showing how a high-magnification (negative) image of a star breaks up into multiple blobs (speckles), entirely an atmospheric effect.

Speckle imaging comprises a range of high-resolution astronomical imaging techniques based on the analysis of large numbers of short exposures that freeze the variation of atmospheric turbulence. They can be divided into the shift-and-add ("image stacking") method and the speckle interferometry methods. These techniques can dramatically increase the resolution of ground-based telescopes, but are limited to bright targets.


The principle of all the techniques is to take very short exposure images of astronomical targets, and then process those so as to remove the effects of astronomical seeing. Use of these techniques led to a number of discoveries, including thousands of binary stars that would otherwise appear as a single star to a visual observer working with a similar-sized telescope, and the first images of sunspot-like phenomena on other stars. Many of the techniques remain in wide use today, notably when imaging relatively bright targets.

The resolution of a telescope is limited by the size of the main mirror, due to the effects of Fraunhofer diffraction. This results in images of distant objects being spread out to a small spot known as the Airy disk. A group of objects whose images are closer together than this limit appear as a single object. Thus larger telescopes can image not only dimmer objects (because they collect more light), but resolve objects that are closer together as well.

This improvement of resolution breaks down due to the practical limits imposed by the atmosphere, whose random nature disrupts the single spot of the Airy disk into a pattern of similarly-sized spots scattered over a much larger area (see the adjacent image of a binary). For typical seeing, the practical resolution limits are at mirror sizes much less than the mechanical limits for the size of mirrors, namely at a mirror diameter equal to the astronomical seeing parameter r0 – about 20 cm in diameter for observations with visible light under good conditions. For many years, telescope performance was limited by this effect, until the introduction of speckle interferometry and adaptive optics provided a means of removing this limitation.

Speckle imaging recreates the original image through image processing techniques. The key to the technique, found by the American astronomer David L. Fried in 1966, was to take very fast images in which case the atmosphere is effectively "frozen" in place.[1] At infrared wavelengths, coherence times τ0 are on the order of 100 ms, but for the visible region they drop to as little as 10 ms. When exposure times are shorter than τ0, the movement of the atmosphere is too sluggish to have an effect; the speckles recorded in the image are a snapshot of the atmospheric seeing at that instant. Coherence time τ0 = r0/v is a function of wavelength, because r0 is a function of wavelength.

The downside of the technique is that taking images at this short an exposure is difficult, and if the object is too dim, not enough light will be captured to make analysis possible. Early uses of the technique in the early 1970s were made on a limited scale using photographic techniques, but since photographic film captures only about 7% of the incoming light, only the brightest of objects could be viewed in this way. The introduction of the CCD into astronomy, which captures more than 70% of the light, lowered the bar on practical applications by an order of magnitude, and today the technique is widely used on bright astronomical objects (e.g. stars and star systems).

Many of the simpler speckle imaging methods have multiple names, largely from amateur astronomers re-inventing existing speckle imaging techniques and giving them new names.

Another use of the technique is in industry. By shining a laser (whose smooth wavefront is an excellent simulation of the light from a distant star) on a surface, the resulting speckle pattern can be processed to give detailed images of flaws in the material.[2]


Shift-and-add method[edit]

Lucky imaging images of Jupiter at 5 µm, using stacks of individual Gemini Observatory frames each with a relatively long 309-msec exposure time, illustrate the principle that coherence time τ0 increases with wavelength. [3] [4]

The shift-and-add method (more recently "image-stacking" method) is a form of speckle imaging commonly used for obtaining high quality images from a number of short exposures with varying image shifts.[5][6] It has been used in astronomy for several decades, and is the basis for the image stabilisation feature on some cameras. The short exposure images are aligned by using the brightest speckle and averaged to give a single output image.[7]

The method involves calculation of the differential shifts of the images. This is easily accomplished in astronomical images since they can be aligned with the stars. Once the images are aligned they are averaged together. It is a basic principle of statistics that variation in a sample can be reduced by averaging together the individual values. In fact, when using an average, the signal-to-noise ratio should be increased by a factor of the square root of the number of images. A number of software packages exist for performing this, including IRAF, RegiStax, Autostakkert, Keiths Image Stacker, Hugin, and Iris.

In the lucky imaging approach, only the best short exposures are selected for averaging. Early shift-and-add techniques aligned images according to the image centroid, giving a lower overall Strehl ratio.

Speckle interferometry[edit]

In 1970, the French astronomer Antoine Labeyrie showed that Fourier analysis (speckle interferometry) can obtain information about the high-resolution structure of the object from the statistical properties of the speckle patterns.[8] This technique was first implemented in 1971 at Palomar Observatory (200-inch telescope) by Daniel Y. Gezari, Antoine Labeyrie and Robert V. Stachnick.[9] Methods developed in the 1980s allowed simple images to be reconstructed from this power spectrum information.

One more recent type of speckle interferometry called speckle masking' involves calculation of the bispectrum or closure phases from each of the short exposures.[10] The "average bispectrum" can then be calculated and then inverted to obtain an image. This works particularly well using aperture masks. In this arrangement the telescope aperture is blocked except for a few holes which allow light through, creating a small optical interferometer with better resolving power than the telescope would otherwise have. This aperture masking technique was pioneered by the Cavendish Astrophysics Group.[11][12]

One limitation of the technique is that it requires extensive computer processing of the image, which was hard to come by when the technique was first developed. This limitation has faded away over the years as computing power has increased, and nowadays desktop computers have more than enough power to make such processing a trivial task.


Speckle imaging in biology refers to the underlabeling[clarification needed] of periodic cellular components (such as filaments and fibers) so that instead of appearing as a continuous and uniform structure, it appears as a discrete set of speckles. This is due to statistical distribution of the labeled component within unlabeled components. The technique, also known as dynamic speckle enables real-time monitoring of dynamical systems and video image analysis to understand biological processes.

See also[edit]

Example images[edit]

All of these were obtained using infrared AO or IR interferometry (not speckle imaging) and have higher resolution than can be obtained with e.g. the Hubble Space Telescope. Speckle imaging can produce images with four times better resolution than these.


  1. ^ Fried, David L. (1966). "Optical Resolution Through a Randomly Inhomogeneous Medium for Very Long and Very Short Exposures". Journal of the Optical Society of America. 56 (10): 1372. Bibcode:1966JOSA...56.1372F. doi:10.1364/JOSA.56.001372.
  2. ^ Jacquot, P.: Speckle interferometry: a review of the principal methods in use for experimental mechanics applications. Strain 44, 57–69 (2008)
  3. ^ Gemini Gets Lucky and Takes a Deep Dive Into Jupiter’s Clouds, NOIRLab press release, 2020-05-08.
  4. ^ Wong, M.H., A.A. Simon, J.W. Tollefson, I. de Pater, M.N. Barnett, A.I. Hsu, A.W. Stephens, G.S. Orton, S.W. Fleming, C. Goullaud, W. Januszewski, A. Roman, G.L. Bjoraker, S.K. Atreya, A. Adriani, and L.N. Fletcher (2020) High-resolution UV/Optical/IR Imaging of Jupiter in 2016–2019. Astrophysical Journal Supplement Series. 247: 58 (25 pp.).
  5. ^ Baba, N.; Isobe, S.; Norimoto, Y.; Noguchi, M. Stellar speckle image reconstruction by the shift-and-add method, Applied Optics (ISSN 0003-6935), vol. 24, May 15, 1985, p. 1403-1405
  6. ^ Christou, J. C., Image quality, tip-tilt correction, and shift-and-add infrared imaging, Publications of the Astronomical Society of the Pacific, vol. 103, Sept.1991, p. 1040-1048
  7. ^ Baba, N; Isobe, Syuzo; Norimoto, Youji; Noguchi, Motokazu (May 1985). "Stellar speckle image reconstruction by the shift-and-add method". Applied Optics. 24 (10): 1403–5. Bibcode:1985ApOpt..24.1403B. doi:10.1364/AO.24.001403. PMID 20440355.
  8. ^ Labeyrie, Antoine (May 1970). "Attainment of Diffraction Limited Resolution in Large Telescopes by Fourier Analysing Speckle Patterns in Star Images". Astronomy and Astrophysics. 6: 85L. Bibcode:1970A&A.....6...85L.
  9. ^ "Speckle Interferometry : Diffraction-Limited Measurements of Nine Stars with the 200-inch Telescope", Daniel Y. Gezari, Antoine Labeyrie and Robert V. Stachnik, 1972, The Astrophysical Journal, vol. 173, L1
  10. ^ Weigelt, Gerd (April 1977). "Modified astronomical speckle interferometry 'speckle masking'". Optics Communications. 21 (1): 55–59. Bibcode:1977OptCo..21...55W. doi:10.1016/0030-4018(77)90077-3.
  11. ^ Baldwin, John; Haniff, C. A.; MacKay, C. D.; Warner, P. J. (April 1986). "Closure phase in high-resolution optical imaging". Nature. 320 (6063): 595. Bibcode:1986Natur.320..595B. doi:10.1038/320595a0. S2CID 4338037.
  12. ^ Baldwin, John; MacKay, C. D.; Titterington, D. J.; Sivia, D.; Baldwin, J. E.; Warner, P. J. (August 1987). "The First Images from Optical Aperture Synthesis". Nature. 328 (6132): 694. Bibcode:1987Natur.328..694B. doi:10.1038/328694a0. S2CID 4281897.

External links[edit]

  • Hugin - open source image software with shift-and-add "image-stacking"
  • Iris - freeware astronomical images processing software
  • Autostakkert - alignment and stacking of image sequences, minimizing the influence of atmospheric distortions