The sensors installed in forward-looking infrared cameras, as well as those of other thermal imaging cameras, use detection of infrared radiation, typically emitted from a heat source (thermal radiation), to create an image assembled for video output.
They can be used to help pilots and drivers steer their vehicles at night and in fog, or to detect warm objects against a cooler background. The wavelength of infrared that thermal imaging cameras detect is 3 to 12 μm and differs significantly from that of night vision, which operates in the visible light and near-infrared ranges (0.4 to 1.0 μm).
Infrared light falls into two basic ranges: long-wave and medium-wave. Long-wave infrared (LWIR) cameras, sometimes called "far-infrared", operate at 8 to 12 μm and can see heat sources, such as hot engine parts or human body heat, several kilometers away. Longer-distance viewing is made more difficult with LWIR because the infrared light is absorbed, scattered, and refracted by air and by water vapor.
Some long-wave cameras require their detector to be cryogenically cooled, typically for several minutes before use, although some moderately sensitive infrared cameras do not require this. Many thermal imagers, including some forward-looking infrared cameras (such as some LWIR enhanced vision systems (EVS)) are also uncooled.
Medium-wave (MWIR) cameras operate in the 3–5 μm range. These can see almost as well, since those frequencies are less affected by water-vapor absorption, but generally require a more expensive sensor array, along with cryogenic cooling.
Many camera systems use digital image processing to improve the image quality. Infrared imaging sensor arrays often have wildly inconsistent sensitivities from pixel to pixel, due to limitations in the manufacturing process. To remedy this, the response of each pixel is measured at the factory, and a transform, most often linear, maps the measured input signal to an output level.
Some companies offer advanced "fusion" technologies that blend a visible-spectrum image with an infrared-spectrum image to produce better results than a single-spectrum image alone.
Thermal imaging cameras such as the Raytheon AN/AAQ-26 are used in a variety of applications, including naval vessels, fixed-wing aircraft, helicopters, armored fighting vehicles, and military-grade smartphones.
In warfare, they have three distinct advantages over other imaging technologies:
- The imager itself is nearly impossible to detect for the enemy, as it detects energy emitted from the target rather than sending out energy that is reflected from the target, as with radar or sonar.
- It sees radiation in the infrared spectrum, which is difficult to camouflage.
- These camera systems can see through smoke, fog, haze, and other atmospheric obscurants better than a visible light camera can.
The term "forward-looking" is used to distinguish fixed forward-looking thermal imaging systems from sideways-tracking infrared systems, also known as "push broom" imagers, and other thermal imaging systems such as gimbal-mounted imaging systems, handheld imaging systems, and the like. Pushbroom systems typically have been used on aircraft and satellites.
Sideways-tracking imagers normally involve a one-dimensional (1D) array of pixels, which uses the motion of the aircraft or satellite to move the view of the 1D array across the ground to build up a 2D image over time. Such systems cannot be used for real-time imaging and must look perpendicular to the direction of travel.
In 1956, Texas Instruments began research on infrared technology that led to several line scanner contracts and, with the addition of a second scan mirror, the invention of the first forward-looking infrared camera in 1963, with production beginning in 1966. In 1972, TI invented the Common Module concept, greatly reducing cost and allowing reuse of common components.
- Traffic video detection and monitoring
- Surveillance and/or capture of mammals
- e.g. Detection of illegal immigrants hidden in lorries/trucks
- Warning drivers about sudden road obstructions caused by deer
- Location through smoke and/or haze
- Search and rescue operations for missing persons especially in wooded areas or water
- Target acquisition and tracking by military or civil aircraft
- Drainage basin temperature monitoring and monitoring wild game habitats
- Detection of energy loss or consumption, or insulation defects
- e.g. insulation level mapping (pipes, walls, joints etc.) in order to reduce HVAC energy consumption
- Quality control for especially electrical installations (a picture can reveal if loads are higher than expected, or show bad and potentially failing joints)
- Search for drug labs and/or indoor cannabis producers (especially at night)
- Piloting of aircraft in low visibility (IMC) conditions
- Pinpoint sources of ignition during firefighting operations
- Monitoring active volcanoes
- Detecting faulty or overheating electrical joints, connections, and components
- Night driving
- Identification or visual acquirement of hostile armour in tanks
The cost of thermal imaging equipment in general has fallen dramatically after inexpensive portable and fixed infrared detectors and systems based on microelectromechanical technology were designed and manufactured for commercial, industrial, and military application. Also, older camera designs used rotating mirrors to scan the image to a small sensor. More modern cameras no longer use this method; the simplification helps reduce cost. Uncooled technology available in many EVS products have reduced the costs to fractions of the price of older cooled technology, with similar performance. EVS is rapidly becoming mainstream on many fixed wing and rotary wing operators from Cirrus and Cessna aircraft to large business jets.
In 2001, the United States Supreme Court decided in Kyllo v. United States that performing surveillance of private property (ostensibly to detect high emission grow lights used in clandestine cannabis farming) using thermal imaging cameras without a search warrant by law enforcement violates the Fourth Amendment's protection from unreasonable searches and seizures.
In the 2004 R. v. Tessling judgment, the Supreme Court of Canada determined that the use of airborne FLIR in surveillance by police was permitted without requiring a search warrant. The Court determined that the general nature of the data gathered by FLIR did not reveal personal information of the occupants and therefore was not in violation of Tessling's Section 8 rights afforded under the Charter of Rights and Freedoms (1982). Ian Binnie distinguished the Canadian law with respect to the Kyllo judgment, by agreeing with the Kyllo minority that public officials should not have to avert their senses or their equipment from detecting emissions in the public domain such as excessive heat, traces of smoke, suspicious odors, odorless gases, airborne particulates, or radioactive emissions, any of which could identify hazards to the community.
In June 2014, the Canadian National Aerial Surveillance Program DHC-8M-100 aircraft mounted with infrared sensors was instrumental in the search for Justin Bourque, a fugitive who had killed three Royal Canadian Mounted Police members in Moncton. The plane's crew used its advanced heat-sensing camera to discover Bourque's heat signature in the deep brushwoods at midnight.
During 2015 Baltimore protests, the FBI conducted 10 aerial surveillance missions between April 29 and May 3, which included "infrared and day color, full-motion FLIR video evidence" collection, according to FBI spokesman Christopher Allen. A FLIR Talon multi-sensor camera system equipped with an infrared laser pointer (which is invisible to casual observers) for illumination purposes was used to gather data at night. The American Civil Liberties Union raised concerns over the fact that new surveillance technology is implemented without judicial guidance and public discussion. According to Nathan Wessler, an ACLU attorney, "this is a dynamic we see again and again when it comes to advances in surveillance. By the time details leak out, programs are firmly entrenched, and it's all but impossible to roll them back – and very hard to put in place restrictions and oversight."
- "Night Vision & Electronic Sensors Directorate". US Army CERDEC. Archived from the original on 2014-10-04. Retrieved 2014-04-24.
- "Three-Band Video Fusion Demo : Sarnoff Corporation". Sarnoff.com. May 2008. Retrieved 2011-11-24.
- "Blackview BV9800 Pro Featuring FLIR Lepton Thermal Camera Available Now". Teledyne. January 7, 2020. Retrieved March 12, 2022.
- https://www.flirmedia.com/MMC/CVS/Traffic/IT_0002_EN.pdf[bare URL PDF]
- "Multiscale thermal refugia and stream habitat associations". Ecological Applications. 9: 301. 1999. doi:10.1890/1051-0761(1999)009[0301:MTRASH]2.0.CO;2. ISSN 1051-0761.
- Niklaus, F., Vieider, C., & Jakobsen, H. (2007, November). MEMS-based uncooled infrared bolometer arrays: a review. proceedings of SPIE - The International Society For Optical Engineering, March 2008.
- Infrared Technology and Applications XLI, 20–23 April 2015, Part of Proceedings of SPIE, Vol. 9451.
- Dr. Don Reago, Director, Night Vision & Electronic Sensors Directorate, CERDEC, U.S. Army. Current Directions in Sensor Technologies at NVESD Archived 2016-03-04 at the Wayback Machine, Keynote Presentation at SPIE DSS IR Technology & Applications XLI Conference, Baltimore, 20–23 April 2015 (Distribution Statement A: Approved for Public Release)
- Willardson, R. K., Weber, E. R., Skatrud, D. D., & Kruse, P. W. (1997). Uncooled infrared imaging arrays and systems (Vol. 47). Academic press.
- White Paper: Uncooled Infrared Detectors Achieve New Performance Levels and Cost Targets, Archived 2015-12-07 at the Wayback Machine Sofradir EC, Inc.
- "KYLLO V. UNITED STATES (99-8508) 533 U.S. 27 (2001) 190 F.3d 1041, reversed and remanded". Law.cornell.edu. Retrieved 2008-12-11.
- "R v Tessling, (2004) 3 S.C.R. 432, 2004 SCC 67". Archived from the original on 2012-04-03. Retrieved 2011-04-06.
- ctvnews.ca: "Funeral for 3 fallen RCMP officers to be held Tuesday in Moncton" 7 Jun 2014
- FBI spy planes used thermal imaging tech in flights over Baltimore after Freddie Gray unrest, The Washington Post, October 30, 2015
- Talon High Performance Multi-Sensor
- FBI Documents Reveal New Information on Baltimore Surveillance Flights, ACLU, October 30, 2015