Automotive night vision
An automotive night vision system uses a thermographic camera to increase a driver's perception and seeing distance in darkness or poor weather beyond the reach of the vehicle's headlights. Such systems are offered as optional equipment on certain premium vehicles. The technology was first introduced in the year 2000 on the Cadillac Deville. This technology is based on the night vision devices (NVD), which generally denotes any electronically enhanced optical devices operate in three modes: image enhancement, thermal imaging, and active illumination. The automotive night vision system is a combination of NVDs such as infrared cameras, GPS, Lidar, and Radar, among others to sense and detect objects.
- Instrument cluster using a high resolution liquid-crystal display (LCD), newest type
- navigation system or information screen, least expensive and with display's location further away from driver's field of vision (used exclusively by BMW, and the W212 E-class)
- windshield via head-up display, earliest type, dimmer knob can reduce brightness, display nearest to driver's line of sight
There are two types of systems, either passive or active systems, both have advantages and disadvantages when compared to the other. The passive system pertains to the technologies that detect thermal radiation emitted by humans, animals, and other objects in the road while the active systems illuminate objects as a significant distance ahead using infrared light sources.
Active systems use an infrared light source built into the car to illuminate the road ahead with light that is invisible to humans. There are two kinds of active systems: gated and non-gated. The gated system uses a pulsed light source and a synchronized camera that enable long ranges (250m) and high performance in rain and snow.
Near Infrared wavelength is 0.75–1.4 µm is smaller and can pass between the typical fog particles. Fog particles sizes are typically 10 to 15 microns and ranges is sizes from 1 to 100 microns. Far infrared has a wavelength of 15 micrometers (µm) to 1 mm. During night-time operations, police officers with range gated near infrared cameras can read license plates at a distance of up to 1.2 km. Near Infrared (NIR) cameras are available to see 50 km through fog, haze, smoke, rain.
- Pros: higher resolution image, superior picture of inanimate objects, works better in warmer conditions, smaller sensor can be mounted to rearview mirror.
- Cons: does not work as well in fog or rain, lower contrast for animals, shorter range of 150–200 meters or 500–650 feet
Night View Assist prototype was shown in 2003 on the Mercedes-Benz F500 concept.
2009: Night View Assist Plus added a pedestrian detection function calling the revised system on the redesigned Mercedes-Benz E-Class (W212) and refreshed S-class, however, the E-class uses the navigation screen's display.
2011: Night View Assist Plus with Spotlight Function premiere: the Mercedes-Benz CL-Class (C216) became the first series production car with night vision-guided pedestrian spotlighting (HID version) can flash at any pedestrians it detects in order to warn both the driver and the pedestrians. The flashing light is directed in such a way that vehicles in front and oncoming traffic are not dazzled.
In 2002 Toyota Night View was the first worldwide series production active automotive night vision system, introduced on the Toyota Landcruiser Cygnus or Lexus LX470. This system uses the headlight projectors emitting near infrared light aimed like the car's highbeam headlights and a CCD camera then captures that reflected radiation, this signal is then processed by computer which produces a black-and-white image which is projected on the lower section of the windshield.
In February 2008 the Toyota Crown Hybrid added a feature which highlights pedestrians and presents them in a box on an LCD display in front of the driver. This was the first pedestrian detection feature for an active system.
In 2009, Lexus introduced Night View on the LS, but only in Japan.
In 2012 Lexus introduced Night View worldwide, on LS and GS. The Night View system combines a windshield mounted near infra-red camera and near infra-red projectors within the headlamps with a Night View ECU to display an image of the road ahead on center console display screen. Moving the image from the driver’s instrument display to the center console offers drivers a larger display and an easier viewing angle. With the camera constantly in operation and the near infra-red projectors activating at speeds over 10 MPH to enhance system efficiency, night view will display an area up to 65 feet in front of the vehicle. This system was discontinued for 2014 in the US.
- Pros: greater range of about 300 meters or 1,000 feet, higher contrast for living objects
- Cons: grainy, lower resolution image, works poorly in warmer weather conditions, larger sensor
Night Vision Assistant was introduced in 2010 on the Audi A8. It uses a thermal imaging camera behind the four rings at the front of the car which can "see" 300 meters (984 ft) ahead. The display in the instrument cluster highlights humans with yellow markings. More importantly, the computer can determine if the person on the road moves in a way that could lead to a collision with the car. In that case the pedestrian is being marked in red color and the driver of the car receives an audible warning.
2013 update added animal detection. and Pedestrian Marker Lights: As soon as a pedestrian is detected by the Night Vision Assistant in a critical range in front of the vehicle, individual Matrix LEDs flash briefly 3 times in succession to alert that person, who is then clearly visible to the driver.
BMW Night Vision introduced in 2005 on the BMW 7 Series (E65). This system processes far infrared radiation, which minimizes non-essential information placing a greater emphasis on pedestrians and animals, allows for a range of 300 meters or nearly 1,000 feet, and avoids "dazzle" from headlights, road lights and similar intense light sources.
2008 update added pedestrian detection system on the redesigned BMW 7 Series (F01), which flashes a caution symbol on the navigation/information screen and automotive head-up display when it detects pedestrians.
2013 update added Dynamic Light Spot.
2013 update added animal detection. The system provides a real-time video image that also depicts on the Control Display persons, animals and other objects emitting heat when they are outside of the light beam and warns in the event of an impending collision. The Dynamic Light Spot is produced by a special headlight that directs the light beam onto the recognised persons or animals respectively, thus drawing the driver’s attention to possible hazards in good time. As soon as the remote infrared detects pedestrians or larger animals on course for collision in the dark, the system directs two separately controlled Dynamic Light Spots at them without creating an unpleasant glare. In the event of an acute risk, an acoustic warning signal is also sounded and the brakes are set to maximum standby. For the model year 2014, the BMW 5 Series will also have these new features.
First worldwide series production automotive night vision on 2000 Cadillac Deville: Night Vision, however it was discontinued in 2004. This system was developed with Raytheon and worked by using a passive infrared sensor camera mounted behind the vehicle's grille. Infrared radiation is picked up by the sensor, processed by computer and then displayed on the windshield using a head-up display. Information is displayed as a black-and-white image with warmer objects in white, while cooler objects appear black. Because this system outputs a standard NTSC composite video signal and the used parts are somewhat easy and inexpensive to find, it has become a popular choice for fitting thermal night vision to other vehicles. After a long hiatus, the 2016 flagship Cadillac CT6 was equipped with an improved version of the Enhanced Night Vision, in which the images are displayed and embedded in the instrument panel instead of being displayed as a reflection on the windshield.
In 2004, Honda introduced first worldwide system with pedestrian detection on redesigned Honda Legend: Intelligent Night Vision. It detected far infrared radiation. The pedestrian detection feature alerted the driver with an audio warning and visually enclosed the pedestrian in a box on the display which was presented via head-up display. The night vision system uses a separate heads up type display projected on the center bottom of the windshield. The infrared cameras do not require a light source, and the software is able to detect human like figures, surround the image with a red box and give audible caution tones.
DS Night Vision offers road visibility by night. An infrared camera in the front grill identifies objects, pedestrians and animals on the road at a distance of up to 100m. A digital instrument cluster shows the driver the area around the car in infrared, with a yellow line around any sources of potential danger. For critical danger, the line becomes red, allowing the driver to react to the situation. The DS 7 Crossback is the first DS vehicle to include Night Vision.
- 2002-2007 Lexus LX 470 (windshield)
- 2009 Lexus LS (instrument cluster)1
- 2012 Lexus LS (navigation screen)1
- 2012 Lexus GS (navigation screen)1
- 2006 Mercedes-Benz CL-Class (C216) (instrument cluster)1
- 2014 Mercedes-Benz S-Class (C217) (instrument cluster)1
- 2009 Mercedes-Benz E-Class (W212) (navigation screen)1
- 2010 Mercedes-Benz CLS-Class (W218) (navigation screen)1
- 2006 Mercedes-Benz S-Class (W221) (instrument cluster)
- 2013 Mercedes-Benz S-Class (W222) (instrument cluster)1
- 2012 Mercedes-Benz M-Class#Third generation (W166: 2011–present)1
- 2012 Mercedes-Benz GL-Class (X166)1
- 2012 Mercedes-Benz R231 SL-Class1
- 2008 Toyota Crown Hybrid (instrument cluster)1
- 2002 Toyota Landcruiser Cignus (windshield)
- 2014 Audi A8 (instrument cluster)1
- 2011 Audi A6 C7 (instrument cluster)1
- 2010-2018 Audi A8 D4
- 2010-2017Audi A7 (instrument cluster)1
- 2018-2020Audi A7 (instrument cluster)1
- 2016 Audi Q7 (instrument cluster)1
- 2005 BMW 5 Series (navigation screen)
- 2008 BMW 5 Series (navigation screen)1
- 2005 BMW 7 Series (navigation screen)
- 2008 BMW 7 Series (navigation screen)1
- 2011 BMW 6 Series (navigation screen)1
- 2013 BMW X5 (F15)(navigation screen)1
- 2014 BMW X6 (F16)(navigation screen)1
- 2009 BMW 5 Series Gran Turismo(navigation screen)1
- 2000-2004 Cadillac Deville (windshield)
- 2016-2020 Cadillac CT6 (instrument cluster)1
- 2004 Honda Legend (windshield)1
- 2017 DS 7 Crossback (instrument cluster)1
- 2018 Peugeot 508 (instrument cluster)1
- 2020 Peugeot 3008 & Peugeot 5008 (instrument cluster)1
- 1 includes pedestrian and animal detection
- Adaptive headlamp
- Automatic highbeam headlamp
- CCD camera
- Far infrared
- Infrared radiation
- Intelligent car
- Near-infrared spectroscopy
- Active infrared night vision
- Pedestrian detection
- Thermographic camera
- "What are LED taillights?". Cars.com. Archived from the original on September 22, 2008.
- Suh, Sang; Anthony, Thomas (2018). Big Data and Visual Analytics. Cham: Springer. p. 39. ISBN 9783319639154.
- Jones, Willie D. (March 2006). "Safer Driving in The Dead of Night". IEEE Spectrum. Spectrum.ieee.org. Archived from the original on 2008-07-04. Retrieved 2009-12-08.
- "Night vision enhancement systems". I-CAR Advantage Online. I-car.com. 2006-05-15. Retrieved 2009-12-08.
- Austin, Ian (October 31, 2005). "Illuminating Road Hazards That Lurk Beyond Lights". New York Times.
- Atmospheric Optics | Clouds, fog & water droplets
- Obzerv | ACTIVE RANGE-GATED Night Vision Cameras
- Ascendent Technology Group | Fog Penetrating NIR Near Infrared & Thermal Infrared Zoom Surveillance Cameras
- "Be ahead: the new Mercedes-Benz S-Class - Superlative in design and technology" (Press release). Stuttgart: Daimler. June 20, 2005. Archived from the original on March 4, 2016.
- "The 2009 Mercedes-Benz S-Class: Pacemaker in automotive development" (Press release). Stuttgart: Daimler. May 11, 2009. Archived from the original on March 4, 2016.
- "New spotlight function for Active Night View Assist Plus: Enhanced safety for pedestrians" (Press release). Stuttgart: Daimler. December 8, 2010. Archived from the original on December 29, 2014.
- "Night View Assist Plus". Mercedes Benz Tech Center. Archived from the original on 29 December 2014.
- "The new Mercedes-Benz S-Class - The aspiration: the best automobile in the world" (Press release). Stuttgart/Hamburg: Daimler. May 15, 2013. Archived from the original on December 29, 2014.
- Romans, Brent (2002-10-31). "Follow-Up Test: 2003 Lexus LX 470". Edmunds.com. Archived from the original on 2009-05-31. Retrieved 2009-12-08.
- "Safety Presentation". Toyota.Co.Jp. Archived from the original on 2008-03-25. Retrieved 2009-12-08.
- "75 Years of TOYOTA - Technical Development - Electronics Parts". TOYOTA MOTOR CORPORATION GLOBAL WEBSITE. Retrieved 6 April 2015.
- "Technology File - Night View". Toyota Global. Archived from the original on 31 December 2014. Retrieved 6 April 2015.
- Korzeniewski, Jeremy (2008-05-31). "Toyota introduces Night View on Japanese Crown Hybrid". Autoblog Green. Retrieved 2009-12-08.
- http://www.toyota.com/esq/pdf/The%202013%20LS%20Advanced%20Active%20Safety%20%282%290.pdf[permanent dead link] 2013 Lexus LS Advanced Active Safety Features
- "NEW LEXUS LS: WORLD-FIRST TECHNOLOGY AS STANDARD". October 17, 2012. Archived from the original on October 23, 2012.
- Luke Vandezande (September 26, 2013). "Lexus Drops Night Vision Tech". AutoGuide.
- "The new Audi A8" (PDF). Archived from the original (PDF) on 3 August 2017. Retrieved 17 February 2010.
- "Composure redefined – the Audi A8" (Press release). Archived from the original on 2014-12-29.
- "Audi Matrix LED". Audi. Archived from the original on 25 August 2016.
- "BMW Night Vision Available in the 5 and 6 Series as of March" (Press release). Worldcarfans.com. 2006-01-30. Archived from the original on 11 February 2013. Retrieved 2009-12-08.
- "Improved Night-Vision for next 2009 BMW 7-series". BMWBlog. 2008-12-31. Retrieved 2009-12-08.
- Keegan, Walter J (2004-11-17). "Cadillac kills passive night-vision system". Autoblog. Retrieved 2009-12-08.
- Romans, Brent (1999-01-01). "Full Test: 2000 Cadillac DeVille DTS". Edmunds.com. Archived from the original on 2005-11-25. Retrieved 2009-12-08.
- Vale, Frank (2006-12-13). "21st-Cadillac Night Vision". Vxm.com. Archived from the original on 9 January 2010. Retrieved 2009-12-08.
- "Cadillac Introduces "Night Vision" Technology" (Press release). GM. January 16, 2000. Archived from the original on 2 July 2017.
- "Video: DIY'er Fits Cadillac Thermal Image Night Vision to his C6". Corvette Online. March 25, 2014.
- "Cadillac Extends the Top of its Range with CT6". Cadillac Pressroom (Press release). 31 March 2015. Retrieved 6 April 2015.
- "Honda Develops World's First Intelligent Night Vision System Able to Detect Pedestrians and Provide Driver Cautions" (Press release). Honda Worldwide. 2004-08-24. Archived from the original on 2009-09-28. Retrieved 2009-12-08.
- "Intelligent Night Vision". Honda Worldwide. Archived from the original on 8 November 2009. Retrieved 2009-12-08.
- DS 7 CROSSBACK | DS NIGHT VISION - Technology. DS Automobiles UK. 2017-04-03. Retrieved 2018-01-11.
- "The technology behind the new Peugeot 508".
- "The new Audi Q7 – Sportiness, efficiency, premium comfort" (Press release). Archived from the original on 2015-05-01.