Acoustic camera: Difference between revisions

Content deleted Content added

Inline

Revision as of 20:26, 2 March 2020

An acoustic camera is an imaging device used to locate sound sources and to characterize them. It consists of a group of microphones, also called a microphone array, from which signals are simultaneously collected and processed to form a representation of the location of the sound sources.

Terminology

The term acoustic camera has first appeared at the end of the 19th century: A physiologist, J.R. Ewald,^[1] was investigating the function of the inner ear and introduced an analogy with the Chladni plates (a domain nowadays called Cymatics), a device enabling to visually see the modes of vibration of a plate. He called this device an acoustic camera. The term has then been widely used during the 20th century^[2]^[3]^[4] to designate various types of acoustic devices, such as underwater localization systems^[5] or active systems used in medicine.^[6] It designates nowadays any transducer array used to localize sound sources (the medium is usually the air), especially when coupled with an optical camera.

Technology

General principles

An acoustic camera generally consists of a microphone array and optionally an optical camera. The microphones – analog or digital – are acquired simultaneously or with known relative time delays to be able to use the phase difference between the signals. As the sound propagates in the medium (air, water...) at a finite known speed, a sound source is perceived by the microphones at different time instants and at different sound intensities that depend on both the sound source location and the microphone location. One popular method to obtain an acoustic image from the measurement of the microphone is to use beamforming: By delaying each microphone signal relatively and adding them, the signal coming from a specific direction $\left(\theta _{0},\phi _{0}\right)$ is amplified while signals coming from other directions are canceled. The power of this resulting signal is then calculated and reported on a power map at a pixel corresponding to the direction $\left(\theta _{0},\phi _{0}\right)$ . The process is iterated at each direction where the power needs to be computed.

While this method has many advantages – robustness, easy to understand, highly parallelizable because each direction can be computed independently, versatile (there exist many types of beamformers to include various types of hypothesis), relatively fast – it also has some drawbacks: the produced acoustic map has artifacts (also called side lobes or ghost sources) and it does not model correctly correlated sound sources. Various methods have been introduced to reduce the artifacts such as DAMAS^[7] or to take in account correlated sources such as CLEAN-SC,^[8] both at the price of a higher computational cost.

When the sound sources are near the acoustic camera, the relative intensity perceived by the different microphones as well as the waves not being any more seen as planar but spherical by the acoustic camera add new information compared to the case of sources being far from the camera. It enables to use more effective methods such as acoustic holography.

Reprojection

Results of far-field beamforming can be reprojected onto planar or non-planar surfaces.

Two-dimensional

Some acoustic cameras use two-dimensional acoustic mapping, which uses a unidirectional microphone array (e.g. a rectangle of microphones, all facing the same direction). Two-dimensional acoustic mapping works best when the surface to be examined is planar and the acoustic camera can be set up facing the surface perpendicularly. However, the surfaces of real-world objects are not often flat, and it is not always possible to optimally position the acoustic camera.^[9]

Additionally, the two-dimensional method of acoustic mapping introduces error into the calculations of the sound intensity at a point. Two-dimensional mapping approximates three-dimensional surfaces into a plane, allowing the distance between each microphone and the focus point to be calculated relatively easily. However, this approximation ignores the distance differences caused by surfaces having different depths at different points. In most applications of the acoustic camera, this error is small enough to be ignored; however, in confined spaces, the error becomes significant.^[9]

Three-dimensional

Three-dimensional acoustic cameras fix the errors of two-dimensional cameras by taking into account surface depths, and therefore correctly measuring the distances between the microphone and each spatial point. These cameras produce a more accurate picture, but require a 3-D model of the object or space being analyzed. Additionally, if the acoustic camera picks up sound from a point in space that is not part of the model, the sound may be mapped to a random space in the model, or the sound may not show up at all. 3-D acoustic cameras can also be used to analyze confined spaces, such as room interiors; however, in order to do this, a microphone array that is omnidirectional (e.g. a sphere of microphones, each facing a different direction) is required. This is in addition to the first requirement of having a 3-D model.^[9]

Applications

There are many applications of the acoustic camera, with most focusing on noise reduction. The camera is frequently applied to improve the noise emission of vehicles (such as cars, airplanes^[10]) and trains, structures—such as wind turbines.^[11]

Acoustic cameras are not only used to measure the exterior emission of products but also to improve the comfort inside cabins of cars,^[9] train or airplanes. Spherical acoustic camera are preferred in this type of application because the three-dimensional placement of the microphone allows to localize sound sources in all directions.

Troubleshooting of faults that occur in machines and mechanical parts can be accomplished with an acoustic camera. To find where the problem lies, the sound mapping of a properly functional machine can be compared to one of a dysfunctional machine.

A similar setup of the acoustic camera can be used to study the noise inside passenger carts during train operation. Alternatively, the camera can be set up outside, in an area near the train tracks, to observe the train as it goes by. This can give another perspective of the noise that might be heard inside the train. Additionally, an outside setup can be used to examine the squealing of train wheels caused by a curve in the tracks.

Challenges

Dynamic range

Low frequencies in the far-field

Computational power

The signal processing required by the acoustic camera is very intensive and needs powerful hardware and plenty of memory storage. Because of this, signal processing is frequently done after the recording of data, which can hinder or prevent the use of the camera in analyzing sounds that only occur occasionally or at varying locations. Cameras that do perform signal processing in real time tend to be large and expensive. Hardware and signal processing improvements can help to overcome these difficulties. Signal processing optimizations often focus on reduction of computational complexity, storage requirements, and memory bandwidth (rate of data consumption).^[12]

References

^ Ewald, J.R. (1898). Wiener klinische Wochenschrift. 11: 721.{{cite journal}}: CS1 maint: untitled periodical (link)
^ Whitman, R. L.; Ahmed, M.; Korpel, A. (1972). "A progress report on the laser scanned acoustic camera". Acoustical Holography. 20. Springer US: 11–32. doi:10.1007/978-1-4615-8213-7_2. ISBN 978-1-4615-8215-1.
^ US patent 3895340, "Acoustic camera apparatus"
^ Hansen, Rolf Kahrs; Andersen, Poul Arndt (1993). "3D acoustic camera for underwater imaging". Acoustical Imaging. 20. Springer US: 723–727. doi:10.1007/978-1-4615-2958-3_98. ISBN 978-1-4613-6286-9.
^ Haslett, R. W. G.; Pearce, G.; Welsh, A. W.; Hussey, K. (1966). "The underwater acoustic camera". Acta Acustica United with Acustica. 17, 4. S. Hirzel Verlag: 187–203.
^ Maginness, M. G.; Plummer, J. D.; Meindl, J. D. (1974). "An acoustic image sensor using a transmit-receive array". Acoustical Holography. Springer US: 619–631. doi:10.1007/978-1-4757-0827-1_36. ISBN 978-1-4757-0829-5.
^ Brooks, Thomas F.; Humphreys, William M. (2004). "Deconvolution Approach for the Mapping of Acoustic Sources". NASA Invention Disclosure. LAR-16907-1. NASA Langley Research.
^ Sijtsma, P. (2007). "CLEAN based on spatial source coherence". International Journal of Aeroacoustics. 6 (4): 357–374. doi:10.1260/147547207783359459.
^ ^a ^b ^c ^d Meyer, Andy, and Döbler, Dirk. "Noise source localization within a car interior using 3D-microphone arrays." Proceedings of the BeBeC (2006).
^ Leon, Brusniak; Underbrink, James R.; Stoker, Robert W. (2006). "Acoustic imaging of aircraft noise sources using large aperture phased arrays". AIAA/CEAS Aeroacoustics Conference. 12.
^ Gwang-Se, Lee; Cheong, Cheolung; Shin, Su-Hyun; Jung, Sung-Soo (2012). "A case study of localization and identification of noise sources from a pitch and a stall regulated wind turbine". Applied Acoustics. 73 8: 817–827.
^ Zimmermann, B.; Studer, C., "FPGA-based real-time acoustic camera prototype," Circuits and Systems (ISCAS), Proceedings of 2010 IEEE International Symposium on , vol., no., pp.1419,1419, May 30 2010-June 2 2010

External links

http://blog.prosig.com/2010/03/15/comparison-between-sound-intensity-probes-and-acoustic-cameras/

Manufacturer links

[first_acoustic_camera-1] Ewald, J.R. (1898). Wiener klinische Wochenschrift. 11: 721.{{cite journal}}: CS1 maint: untitled periodical (link)

[laser_scanned_ac-2] Whitman, R. L.; Ahmed, M.; Korpel, A. (1972). "A progress report on the laser scanned acoustic camera". Acoustical Holography. 20. Springer US: 11–32. doi:10.1007/978-1-4615-8213-7_2. ISBN 978-1-4615-8215-1.

[pat_us_ac-3] US patent 3895340, "Acoustic camera apparatus"

[Underwater-4] Hansen, Rolf Kahrs; Andersen, Poul Arndt (1993). "3D acoustic camera for underwater imaging". Acoustical Imaging. 20. Springer US: 723–727. doi:10.1007/978-1-4615-2958-3_98. ISBN 978-1-4613-6286-9.

[underwater_ac_first-5] Haslett, R. W. G.; Pearce, G.; Welsh, A. W.; Hussey, K. (1966). "The underwater acoustic camera". Acta Acustica United with Acustica. 17, 4. S. Hirzel Verlag: 187–203.

[active_ac-6] Maginness, M. G.; Plummer, J. D.; Meindl, J. D. (1974). "An acoustic image sensor using a transmit-receive array". Acoustical Holography. Springer US: 619–631. doi:10.1007/978-1-4757-0827-1_36. ISBN 978-1-4757-0829-5.

[DAMAS-7] Brooks, Thomas F.; Humphreys, William M. (2004). "Deconvolution Approach for the Mapping of Acoustic Sources". NASA Invention Disclosure. LAR-16907-1. NASA Langley Research.

[CLEAN-SC-8] Sijtsma, P. (2007). "CLEAN based on spatial source coherence". International Journal of Aeroacoustics. 6 (4): 357–374. doi:10.1260/147547207783359459.

[Car-9] Meyer, Andy, and Döbler, Dirk. "Noise source localization within a car interior using 3D-microphone arrays." Proceedings of the BeBeC (2006).

[aircraft_imaging-10] Leon, Brusniak; Underbrink, James R.; Stoker, Robert W. (2006). "Acoustic imaging of aircraft noise sources using large aperture phased arrays". AIAA/CEAS Aeroacoustics Conference. 12.

[wind_turbine-11] Gwang-Se, Lee; Cheong, Cheolung; Shin, Su-Hyun; Jung, Sung-Soo (2012). "A case study of localization and identification of noise sources from a pitch and a stall regulated wind turbine". Applied Acoustics. 73 8: 817–827.

[FPGA-12] Zimmermann, B.; Studer, C., "FPGA-based real-time acoustic camera prototype," Circuits and Systems (ISCAS), Proceedings of 2010 IEEE International Symposium on , vol., no., pp.1419,1419, May 30 2010-June 2 2010

[1]

[2]

[3]

[4]

[5]

[6]

[7]

[8]

[9]

[10]

[11]

[12]

@@ Line 2: / Line 2: @@
 == Terminology ==
-The term '''acoustic camera''' has first appeared at the end of the 19th century: A physiologist, J.R. Ewald,<ref name=first_acoustic_camera>{{cite journal |title=none|last=Ewald |first=J.R.|date=1898 |journal=Wiener klinische Wochenschrift |volume=11 |page=721}}</ref> was investigating the function of the inner ear and introduced an analogy with the [[Ernst Chladni|Chladni plates]] (a domain nowadays called [[Cymatics]]), a device enabling to visually see the modes of vibration of a plate. He called this device an acoustic camera. The term has then been widely used during the 20th century<ref name=laser_scanned_ac>{{cite journal |last=Whitman |first=R. L.|last2=Ahmed|first2=M. |last3=Korpel|first3=A. |date=1972 |title=A progress report on the laser scanned acoustic camera. |journal=Acoustical Holography |volume=20 |pages=11–32|publisher= Springer US}}</ref><ref name="pat_us_ac">{{ cite patent |country=US |number=3895340|title=Acoustic camera apparatus |status=patent}}</ref><ref name=Underwater>{{cite journal |last=Hansen |first=Rolf Kahrs|last2=Andersen|first2=Poul Arndt |date=1993 |title=3D acoustic camera for underwater imaging |journal=Acoustical Imaging |volume=20 |pages=723–727|publisher= Springer US|doi=10.1007/978-1-4615-2958-3_98|isbn=978-1-4613-6286-9}}</ref> to designate various types of acoustic devices, such as underwater localization systems<ref name=underwater_ac_first>{{cite journal |last=Haslett |first= R. W. G.|last2=Pearce|first2=G.|last3=Welsh|first3=A. W.|last4=Hussey|first4=K. |date=1966 |title=The underwater acoustic camera |journal=Acta Acustica United with Acustica |volume=17,4 |pages=187–203|publisher= S. Hirzel Verlag}}</ref> or active systems used in medicine.<ref name=active_ac>{{cite journal |last=Maginness |first=M. G.|last2=Plummer|first2=J. D.|last3=Meindl|first3=J. D.|date=1974 |title=An acoustic image sensor using a transmit-receive array |journal=Acoustical Holography|pages=619–631|publisher=Springer US}}</ref> It designates nowadays any transducer array used to localize sound sources (the medium is usually the air), especially when coupled with an [[camera|optical camera]].
+The term '''acoustic camera''' has first appeared at the end of the 19th century: A physiologist, J.R. Ewald,<ref name=first_acoustic_camera>{{cite journal |title=none|last=Ewald |first=J.R.|date=1898 |journal=Wiener klinische Wochenschrift |volume=11 |page=721}}</ref> was investigating the function of the inner ear and introduced an analogy with the [[Ernst Chladni|Chladni plates]] (a domain nowadays called [[Cymatics]]), a device enabling to visually see the modes of vibration of a plate. He called this device an acoustic camera. The term has then been widely used during the 20th century<ref name=laser_scanned_ac>{{cite journal |last=Whitman |first=R. L.|last2=Ahmed|first2=M. |last3=Korpel|first3=A. |date=1972 |title=A progress report on the laser scanned acoustic camera. |journal=Acoustical Holography |volume=20 |pages=11–32|publisher= Springer US|doi=10.1007/978-1-4615-8213-7_2|isbn=978-1-4615-8215-1}}</ref><ref name="pat_us_ac">{{ cite patent |country=US |number=3895340|title=Acoustic camera apparatus |status=patent}}</ref><ref name=Underwater>{{cite journal |last=Hansen |first=Rolf Kahrs|last2=Andersen|first2=Poul Arndt |date=1993 |title=3D acoustic camera for underwater imaging |journal=Acoustical Imaging |volume=20 |pages=723–727|publisher= Springer US|doi=10.1007/978-1-4615-2958-3_98|isbn=978-1-4613-6286-9}}</ref> to designate various types of acoustic devices, such as underwater localization systems<ref name=underwater_ac_first>{{cite journal |last=Haslett |first= R. W. G.|last2=Pearce|first2=G.|last3=Welsh|first3=A. W.|last4=Hussey|first4=K. |date=1966 |title=The underwater acoustic camera |journal=Acta Acustica United with Acustica |volume=17,4 |pages=187–203|publisher= S. Hirzel Verlag}}</ref> or active systems used in medicine.<ref name=active_ac>{{cite journal |last=Maginness |first=M. G.|last2=Plummer|first2=J. D.|last3=Meindl|first3=J. D.|date=1974 |title=An acoustic image sensor using a transmit-receive array |journal=Acoustical Holography|pages=619–631|publisher=Springer US|doi=10.1007/978-1-4757-0827-1_36|isbn=978-1-4757-0829-5}}</ref> It designates nowadays any transducer array used to localize sound sources (the medium is usually the air), especially when coupled with an [[camera|optical camera]].
 == Technology ==