An image sensor or imager is a sensor that detects and conveys information used to make an image. It does so by converting the variable attenuation of light waves (as they pass through or reflect off objects) into signals, small bursts of current that convey the information. The waves can be light or other electromagnetic radiation. Image sensors are used in electronic imaging devices of both analog and digital types, which include digital cameras, camera modules, medical imaging equipment, night vision equipment such as thermal imaging devices, radar, sonar, and others. As technology changes, digital imaging tends to replace analog imaging.
Early analog sensors for visible light were video camera tubes. Currently, used types are semiconductor charge-coupled devices (CCD) or active pixel sensors in complementary metal–oxide–semiconductor (CMOS) or N-type metal-oxide-semiconductor (NMOS, Live MOS) technologies. Analog sensors for invisible radiation tend to involve vacuum tubes of various kinds. Digital sensors include flat panel detectors.
In February 2018, researchers at Dartmouth College announced a new image sensing technology that the researchers call QIS, for Quanta Image Sensor. Instead of pixels, QIS chips have what the researchers call "jots." Each jot can detect a single particle of light, called a photon.
CCD vs CMOS technology
Cameras integrated in small consumer products generally use CMOS sensors, which are usually cheaper and have lower power consumption in battery powered devices than CCDs. CCD sensors are used for high end broadcast quality video cameras, and (C)MOS sensors dominate in still photography and consumer goods where overall cost is a major concern. Both types of sensor accomplish the same task of capturing light and converting it into electrical signals.
Each cell of a CCD image sensor is an analog device. When light strikes the chip it is held as a small electrical charge in each photo sensor. The charges in the line of pixels nearest to the (one or more) output amplifiers are amplified and output, then each line of pixels shifts its charges one line closer to the amplifier(s), filling the empty line closest to the amplifiers(s). This process is then repeated until all the lines of pixels have had their charge amplified and output.
A CMOS image sensor has an amplifier for each pixel compared to the few amplifiers of a CCD. This results in less area for the capture of photons than a CCD, but this problem has been overcome by using microlenses in front of each photodiode, which focus light into the photodiode that would have otherwise hit the amplifier and not be detected. Some CMOS imaging sensors also use Back-side illumination to increase the number of photons that hit the photodiode. CMOS sensors can potentially be implemented with fewer components, use less power, and/or provide faster readout than CCD sensors. They are also less vulnerable to static electricity discharges.
Another design, a hybrid CCD/CMOS architecture (sold under the name "sCMOS") consists of CMOS readout integrated circuits (ROICs) that are bump bonded to a CCD imaging substrate – a technology that was developed for infrared staring arrays and has been adapted to silicon-based detector technology. Another approach is to utilize the very fine dimensions available in modern CMOS technology to implement a CCD like structure entirely in CMOS technology: such structures can be achieved by separating individual poly-silicon gates by a very small gap; though still a product of research hybrid sensors can potentially harness the benefits of both CCD and CMOS imagers.
There are many parameters that can be used to evaluate the performance of an image sensor, including dynamic range, signal-to-noise ratio, and low-light sensitivity. For sensors of comparable types, the signal-to-noise ratio and dynamic range improve as the size increases.
There are several main types of color image sensors, differing by the type of color-separation mechanism:
- Bayer filter sensor, low-cost and most common, using a color filter array that passes red, green, and blue light to selected pixel sensors. Each individual sensor element is made sensitive to red, green, and blue by means of a color gel made of chemical dye placed over each individual element. Although inexpensive to manufacture, this technique lacks the color purity of dichroic filters. Because the color gel segment must be separated from the others by a freme (similar to stained glass windows), less of the areal density of a Bayer filter sensor is available to capture light, making the Bayer filter sensor less sensitive than other color sensors of similar size. This loss can be negated by using larger sensor size, albeit at greater cost. The most common Bayer filter matrix uses two green pixels, and one each for red and blue. This results in less resolution for red and blue colors, corresponding to the human eye's reduced sensitivity at the limits of the visual spectrum. The missing color samples may interpolated using a demosaicing algorithm, or ignored altogether by lossy compression. In order to improve color information, techniques like color co-site sampling use a piezo mechanism to shift the color sensor in pixel steps.
- Foveon X3 sensor, using an array of layered pixel sensors, separating light via the inherent wavelength-dependent absorption property of silicon, such that every location senses all three color channels. This method is similar to how color film for photography works.
- 3CCD, using three discrete image sensors, with the color separation done by a dichroic prism. The dichroic elements provide a sharper color separation, thus improving color quality. Because each sensor is equally sensitive within its passband, and at full resolution, 3-CCD sensors produce better color quality and better low light performance. 3-CCD sensors produce a full 4:4:4 signal, which is preferred in television broadcasting, video editing and chroma key visual effects.
Special sensors are used in various applications such as thermography, creation of multi-spectral images, video laryngoscopes, gamma cameras, sensor arrays for x-rays, and other highly sensitive arrays for astronomy.
While in general digital cameras use a flat sensor, Sony prototyped a curved sensor in 2014 to reduce/eliminate Petzval field curvature that occurs with a flat sensor. Use of a curved sensor allows a shorter and smaller diameter of the lens with reduced elements and components with greater aperture and reduced light fall-off at the edge of the photo.
Sensors used in digital cameras
A listing of digital camera sensors can be found here.
- Contact image sensor (CIS)
- Video camera tube
- Semiconductor detector
- Fill factor
- Full-frame digital SLR
- Image sensor format, the sizes and shapes of common image sensors
- Color filter array, mosaic of tiny color filters over color image sensors
- Sensitometry, the scientific study of light-sensitive materials
- History of television, the development of electronic imaging technology since the 1880s
- List of large sensor interchangeable-lens video cameras
- Oversampled binary image sensor
- computer vision
- "Super Sensitive Sensor Sees What You Can't". npr.org. Archived from the original on 24 March 2018. Retrieved 28 April 2018.
- "CMOS Is Winning the Camera Sensor Battle, and Here's Why". techhive.com. 2011-12-29. Archived from the original on 2017-05-01. Retrieved 2017-04-27.
- 2002-2017., Canon Europa N.V. and Canon Europe Ltd. "CCD and CMOS sensors - Canon Professional Network". Canon Professional Network. Archived from the original on 28 April 2018. Retrieved 28 April 2018.
- "CWhat is a backlit CMOS sensor?". techradar.com. 2012-07-02. Archived from the original on 2017-05-06. Retrieved 2017-04-27.
- Moynihan, Tom. "CMOS Is Winning the Camera Sensor Battle, and Here's Why". Archived from the original on 25 September 2015. Retrieved 10 April 2015.
- scmos.com Archived 2012-06-03 at the Wayback Machine., home page
- ieee.org - CCD in CMOS Archived 2015-06-22 at the Wayback Machine. Padmakumar R. Rao et al., "CCD structures implemented in standard 0.18 µm CMOS technology"
- "Deepest Ever Look into Orion". Archived from the original on 13 July 2016. Retrieved 13 July 2016.
- Steve Dent. "Sony's first 'curved sensor' photo may herald better images, cheaper lenses". Archived from the original on July 11, 2014. Retrieved July 8, 2014.
- Digital Camera Sensor Performance Summary by Roger Clark