Jump to content

Light field camera: Difference between revisions

From Wikipedia, the free encyclopedia
Browse history interactively
← Previous editNext edit →
Content deleted Content added
VisualWikitext
→‎Other cameras: Added reference to ASP-based cameras
m Invisible change to add this page to my watchlist (is there an easier way to do that?)
Line 24: Line 24:
[[Mitsubishi]] Electric Research Labs's (MERL) light field camera<ref name="Ashok Veeraraghavan 2007"/> is based on the principle of [[Heterodyne#Optical heterodyning|optical heterodyning]] and uses a printed film (mask) placed close to the sensor. Any hand-held camera can be converted into a light field camera using this technology by simply inserting a low-cost film on top of the sensor.<ref>http://www.umiacs.umd.edu/~aagrawal/sig08/BuildingLightFieldCamera.html.</ref> A mask-based design avoids the problem of loss of resolution, since a high-resolution photo can be generated for the focused parts of the scene.
[[Mitsubishi]] Electric Research Labs's (MERL) light field camera<ref name="Ashok Veeraraghavan 2007"/> is based on the principle of [[Heterodyne#Optical heterodyning|optical heterodyning]] and uses a printed film (mask) placed close to the sensor. Any hand-held camera can be converted into a light field camera using this technology by simply inserting a low-cost film on top of the sensor.<ref>http://www.umiacs.umd.edu/~aagrawal/sig08/BuildingLightFieldCamera.html.</ref> A mask-based design avoids the problem of loss of resolution, since a high-resolution photo can be generated for the focused parts of the scene.


Cameras built using [[angle-sensitive pixel]]s can perform single-lens, single-sensor 3D photography<ref name="ISSCC2011">[http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=5746375 A. Wang, P. Gill, and A. Molnar, "An angle-sensitive cmos imager for single-sensor 3d photography," in Solid-State Circuits Conference Digest of Technical Papers (ISSCC), 2011 IEEE International, Feb. 2011, pp. 412–414.]</ref>.
Cameras built using [[angle-sensitive pixel]]s can perform single-lens, single-sensor 3D photography<ref name="ISSCC2011">[http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=5746375 A. Wang, P. Gill, and A. Molnar, "An angle-sensitive cmos imager for single-sensor 3d photography," in Solid-State Circuits Conference Digest of Technical Papers (ISSCC), 2011 IEEE International, Feb. 2011, pp. 412–414.]</ref>.


==Light-field microscope==
==Light-field microscope==

Revision as of 15:03, 3 May 2012

Front and back of a Lytro, the first consumer light-field camera, showing the front lens and LCD touchscreen.

A light-field camera, also called a plenoptic camera, is a camera that uses a microlens array to capture 4D light field information about a scene. Such light field information can be used to improve the solution of computer graphics and vision-related problems.

Technology

The first light field camera was proposed by Gabriel Lippmann in 1908, which used integral photography as the underlying technology. In 1992, Adelson and Wang[1] proposed the design of a plenoptic camera that can be used to significantly reduce the correspondence problem in stereo matching. To achieve this, an array of microlenses is placed at the focal plane of the camera main lens. The image sensor is positioned slightly behind the microlenses. Using such images the displacement of image parts that are not in focus can be analyzed and depth information can be extracted. Potentially, this camera system can be used to refocus an image virtually on a computer after the picture has been taken, as explained by Ng et al.[2] The drawback of such a system is the low resolution that the final images have. As one microlens samples the light directions at one spatial point an increase in the number of image pixels can only be done by increasing the number of microlenses by the same amount. To overcome this limitation, Lumsdaine and Georgiev[3] describe a new design of a plenoptic camera, called focused plenoptic camera where the microlens array is positioned before or behind the focal plane of the main lens. This modification samples the light field in a different way that allows for a higher spatial resolution by having a lower angular resolution at the same time. With this design images can be refocused with a much higher spatial resolution. However, the low angular resolution can introduce some unwanted aliasing artifacts. A different design[4] using low cost printed film (mask) instead of microlens array was proposed by researchers at MERL in 2007. This design overcomes several limitations of microlens array in terms of chromatic aberrations, loss of boundary pixels, and allows higher spatial resolution photos to be captured. However, a mask based design reduces light compared to microlens arrays.

Image refocusing

In 2004, a team at Stanford University Computer Graphics Laboratory used a 16 megapixel camera with a 90,000-microlens array (meaning that each microlens covers about 175 pixels, and the final resolution is 90 kilopixels) to demonstrate that pictures can be refocused after they are taken.[2]

Stereo with plenoptic cameras

Plenoptic cameras are good for following moving objects.[5] A recording from a security camera based upon this technology could be used to produce an accurate 3D model of a suspect.[6]

Manufacturers of light field cameras

Cameras available for purchase

From 2010 on, Raytrix has sold several models of plenoptic camera for industrial and scientific applications, with resolutions starting from 1 megapixel.[7][8]

Lytro was founded by Stanford University Computer Graphics Laboratory alumnus Ren Ng to commercialize the light field camera he developed as a graduate student there. Lytro has developed a consumer light-field "digital camera capable of images using a plenoptic technique.[9]

Other cameras

The Adobe light-field camera is a prototype 100-megapixel camera that takes a three-dimensional photo of the scene in focus using 19 uniquely configured lenses. Each lens will take a 5.2 megapixel photo of the entire scene around the camera and each image can be focused later in any way.[10]

The CAFADIS camera[11] is a plenoptic camera developed by the University of La Laguna (Spain). CAFADIS stands (in Spanish) for phase-distance camera, since it can be used for distance and optical wavefront estimation. From a single shot it can produce several images refocused at different distances, depth maps, all-in-focus images and stereo pairs. A similar optical design can also be used in adaptive optics in astrophysics, in order to correct the aberrations caused by atmospheric turbulence in telescope images. In order to perform these tasks different algorithms, running on GPU and FPGA, operate on the raw image captured by the camera.

Mitsubishi Electric Research Labs's (MERL) light field camera[4] is based on the principle of optical heterodyning and uses a printed film (mask) placed close to the sensor. Any hand-held camera can be converted into a light field camera using this technology by simply inserting a low-cost film on top of the sensor.[12] A mask-based design avoids the problem of loss of resolution, since a high-resolution photo can be generated for the focused parts of the scene.

Cameras built using angle-sensitive pixels can perform single-lens, single-sensor 3D photography[13].

Light-field microscope

Stanford University Computer Graphics Laboratory has developed a light-field microscope using a microlens array similar to the one used in the light-field camera developed by the lab. The prototype is built around a Nikon Eclipse transmitted light microscope/wide-field fluorescence microscope and standard CCD cameras. Light-field capturing ability is obtained by a module containing a microlens array and other optical components placed in the light path between the objective lens and camera, with the final multifocused image rendered using deconvolution.[14][15][16] A later version of the prototype added a light-field illumination system consisting of a video projector (allowing computational control of illumination) and a second microlens array in the illumination light path of the microscope. The addition of a light-field illumination system both allowed for additional types of illumination (such as oblique illumination and quasi-dark-field) and correction for optical aberrations.[15]

See also

References

  1. ^ E. H. Adelson and J. Y. A. Wang. Single Lens Stereo with Plenoptic Camera. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 14, No. 2, pp. 99-106, February 1992.
  2. ^ a b R. Ng, M. Levoy, M. Bredif, G. Duval, M. Horowitz, and P. Hanrahan. Light Field Photography with a Hand-Held Plenoptic Camera. Stanford University Computer Science Tech Report CSTR 2005-02, April 2005.
  3. ^ Lumsdaine, A., Georgiev, T., The Focused Plenoptic Camera, ICCP, April 2009.
  4. ^ a b Ashok Veeraraghavan, Ramesh Raskar, Amit Agrawal, Ankit Mohan and Jack Tumblin. Dappled Photography: Mask Enhanced Cameras for Heterodyned Light Fields and Coded Aperture Refocusing. ACM Transactions on Graphics, Vol. 26, Issue 3, July 2007.
  5. ^ "Polydioptric" cameras, says good for following moving objects.
  6. ^ Computer scientists create a 'light field camera' that banishes fuzzy photos, Anne Strehlow. Stanford Report. November 3, 2005.
  7. ^ One Camera With 40,000 Lenses Helps Prevent Blurry Images. Popular Science May 2011.
  8. ^ The First Plenoptic Camera on the Market
  9. ^ Lytro website
  10. ^ Keats, Jonathon. "PopSci's How It Works – 100 Megapixel Camera". PopSci.com. Popular Science. Archived from the original (Adobe Flash) on 2009-01-17. Retrieved 26 July 2009. {{cite web}}: |archive-date= / |archive-url= timestamp mismatch; 2008-01-17 suggested (help); Unknown parameter |coauthors= ignored (|author= suggested) (help)
  11. ^ http://www.cafadis.ull.es
  12. ^ http://www.umiacs.umd.edu/~aagrawal/sig08/BuildingLightFieldCamera.html.
  13. ^ A. Wang, P. Gill, and A. Molnar, "An angle-sensitive cmos imager for single-sensor 3d photography," in Solid-State Circuits Conference Digest of Technical Papers (ISSCC), 2011 IEEE International, Feb. 2011, pp. 412–414.
  14. ^ Levoy M, Ng R, Adams A, Footer M, Horowitz M. 2006. Light Field Microscopy. ACM Transactions on Graphics 25(3):924–93. doi:10.1145/1141911.1141976.
  15. ^ a b Levoy M, Zhang Z, McDowall I. 2009. Recording and controlling the 4D light field in a microscope. Journal of Microscopy. 235(2):144–162. doi:10.1111/j.1365-2818.2009.03195.x.
  16. ^ Levoy M. 2008. Stanford Light Field Microscope Project (web page). Stanford Computer Graphics Laboratory.
Retrieved from "https://en.wikipedia.org/w/index.php?title=Light_field_camera&oldid=490476639"