Jump to content

Adaptive noise cancelling

Add links
From Wikipedia, the free encyclopedia

This is an old revision of this page, as edited by Kaunitzj (talk | contribs) at 07:04, 5 May 2023 (Typographical corrections, references). The present address (URL) is a permanent link to this revision, which may differ significantly from the current revision.

Adaptive noise cancelling is an unorthodox signal processing technique that is highly effective in suppressing additive interference or noise corrupting a received target signal at the main or primary sensor in certain common situations where the interference is known and is accessible but unavoidable and where the target signal and the interference are unrelated, that is, uncorrelated[1][2][3]. Examples of such situations include:

  • a microphone attempting to receive a speech near machinery or other noise sources in the environment, such as an aircraft cockpit[1]
  • a naval ship towing sonar array where the ship's own noise masks a much weaker detected target signal
  • obtaining a fetal electrocardiogram (ECG) where the presence of the mother's stronger ECG represents an unavoidable interference.[2]

Conventional signal processing techniques rely on filtering the received signal, consisting of the target signal and the corrupting interference, so as to minimise the effect of the interference. The objective of optimal filtering is to maximise the signal-to-noise ratio[4] at the receiver output or to produce the optimal estimate of the target signal in the presence of interference (Wiener Filter).

In contrast, adaptive noise cancelling relies on a second sensor, usually located near the source of the known interference, to obtain a relatively 'pure' version of the interference free from the target signal and other interference. This second version of the interference and the sensor receiving it are called the reference.[1][2][5]

The adaptive noise canceller consists of a self-adjusting adaptive filter[6][7] which automatically transforms the reference signal into an optimal estimate of the interference corrupting the target signal before subtracting it from the received signal thereby cancelling (or minimising) the effect of the interference at the noise canceller output. The adaptive filter adjusts itself continuously and automatically to minimise the residual interference affecting the target signal at its output. The power of the adaptive noise cancelling concept is that it requires no detailed a priori knowledge of the target signal or the interference. The adaptive algorithm that optimises the filter relies only on ongoing sampling of the reference input and the noise canceller output.[1][2]

Adaptive noise cancelling can be effective even when the target signal and the interference are similar in nature and the interference is considerably stronger than the target signal. The key requirement is that the target signal and the interference are unrelated, that is uncorrelated. Meeting this requirement is normally not an issue in situations where adaptive noise cancelling is used.[1][5]

Adaptive Noise Cancelling Configuration and Concept

The adaptive noise canceller configuration diagram below shows the target signal s(t) present at the primary sensor and the interference or noise source n(t) and its manifestations np(t) and  nr(t) at the primary and reference sensors respectively.[1][2][3][5]

Adaptive filter in noise cancelling configuration

As np(t) and nr(t) are the manifestations of the same interference source in different locations, these will usually differ significantly in an unpredictable fashion due to different transmission paths through the environment to the two sensors. So the reference nr(t) cannot be used directly to cancel or reduce the interference corrupting the target signal np(t). It must first be appropriately processed before it can be used to minimise, by subtraction, the overall effect of the interference at the noise canceller output.

An adaptive noise canceller is based on a self-optimising adaptive filter that has a variable transform function shaped by adjustable parameters called weights.[3][8][9] Using an iterative adaptive algorithm, the adaptive filter transforms the reference nr(t) into an optimal estimate ñp(t) of the interference np(t) corrupting the target signal and ‘cancelling’ the latter by subtraction, whilst leaving the target signal unchanged. So the output of the adaptive noise canceller shown below is:

z(t) = s(t)+np(t)-ñp(t).[1][2][5]

The power of the adaptive noise cancelling approach stems from the fact that the algorithm driving the iterative adjustment of weights in an adaptive filter is a simple fully automatic iterative process that relies only on ongoing sequence of sampling measurements of the noise canceller output and and reference r(t) = nr(t). For example the LMS (Least Means Square) algorithm in the context of the usual tapped-delay-line digital adaptive filter leads to:

Wk+1 = Wk - µzkRk = Wk -µzkNr,k

where the vector Wk represents the set of filter weights at the kth iteration and the vector R,k represents the last set of samples of the reference which are the weight inputs. The adaptation constant µ determines the rate of adaptation and the stability of the optimal configuration.

Apart from the availability of a suitable reference signal the only other essential requirement is that the target signal and the corrupting noise source are unrelated, that is uncorrelated, so that for all values of , where the bar represents time averaging.[1][5]

Adaptive noise cancelling does not require detailed a priori knowledge of the interference or the target signal.  However, the physical characteristics of the adaptive filter must be generally suitable for producing an adjustable frequency response or transfer function that will transform the reference signal nr(t) into a close estimate of the corrupting interference, ñp(t), through the iterative adjustment of the filter weights.[1][5]

Genesis

Adaptive noise cancelling evolved from the pioneering work on adaptive systems, adaptive filtering and signal processing carried out at the Information Systems Laboratories in the School of Engineering at Stanford University during the 1960’s and 70's under the leadership of Professor Bernard Widrow. [1][2]  Adaptive filters incorporate` adjustable parameters called weights, controlled by iterative adaptive algorithms, to produce a desired transfer function.

Adaptive filters were originally conceived to produce the optimal filters prescribed by optimal filter theory during a training phase[6] by adjusting the filter weights according to an iterative adaptive algorithm such as the Least-Means-Square (LMS) algorithm. During the training phase, the filter is presented with a known input and a training signal called a desired response. The filter weights are adjusted by the adaptive algorithm, which is designed to minimise the error, the difference between the adaptive filter output and the desired response.[6][7]

Adaptive Filter in Training Mode

At the completion of the training phase the adaptive filter has been optimised to produce the theoretically prescribed optimal transfer function. In its normal operating phase such an optimised adaptive filter could then be used to passively to process received signals to improve the signal-to-noise ratio at the filter output under assumed conditions. The theory and analysis of adaptive filters is largely based on this concept, model and terminology and took place before the introduction of the adaptive noise cancelling concept around 1970.

Adaptive noise cancelling[1][2][8] is an innovation that represents a fundamentally different configuration and application of adaptive filtering in those common situations where a reference signal is available by:

  1. using the training mode of the filter as the operational mode. thus continually adjusting the filter during normal operation
  2. using the reference as the adaptive filter input
  3. using the primary input, the noise canceller input containing the target signal and interference as the desired response and
  4. using the error as the noise canceller output, that is, the difference between the primary input and the output of the adaptive filter.

Whilst the discussion of adaptive noise cancelling reflects the above terminology, it is clear from the above diagrams that the two are equivalent and the previously developed extensive adaptive filter theory therefore continues to apply in both situations.

In the adaptive noise cancelling situation the received signal does not pass through the adaptive filter but instead serves as the 'desired response'. Since the adaptation process will aim to minimise the error, it follows that in the noise canceller configuration the adaptation process in effect aims to minimise the overall signal power at the noise canceller output - the 'error'. So the adaptive filtering of the reference actually strives to suppress the overall signal power at the noise canceller output.

This counterintuitive concept can be understood by keeping in mind that the target signal s(t) and the interference n(t) are uncorrelated. So, in aiming to minimise the 'error', using a reference as input, which is related only to the interference, the best the adaptive filter can do, in generating an optimal estimate of the primary input, the desired response, is to generate the optimal estimate of the interference at the primary sensor ñp(t). This will result in minimising the overall effect of the interference at the noise canceller output whilst leaving the target signal s(t) unchanged.

The iterative adaptive algorithms used in adaptive filtering require only an ongoing sequence of sampling measurements at the weight inputs and the error. As digital adaptive filters are in effect tapped delay line filters, the operation of an adaptive noise canceller requires only on an ongoing sequence of sampling measurements of the reference and the noise canceller output.

The noise cancelling approach and the proof of the concept, the first striking demonstrations that general broadband interference can be eliminated from a target signal in practical situations using adaptive noise cancelling, were set out and demonstrated in 1971-72 at the Stanford Information Systems Laboratory by Professor Widrow and John Kaunitz, an Australian doctoral student, and documented in the latter’s PhD dissertation Adaptive Filtering of Broadband signals as Applied to Noise Cancelling (1972)[1] (also available here). The work was also published as a Stanford Electronics Labs report by Kaunitz and Widrow, Noise Cancelling Filter Study (1973).[5] The initial demonstrations of the noise cancelling concept for eliminating broadband interference was carried out by means of a prototype hybrid adaptive signal processor designed and built by Kaunitz and described in a Stanford Information Systems Laboratory report General Purpose Hybrid Adaptive Signal Processor (1971). [7]

However, a 1975 paper published in the Proceedings of the IEEE by Widrow et al., Adaptive Noise Cancelling: Principles and Applications [2], is now the generally referenced introductory publication in the field. This paper sets out the basic concepts of adaptive noise cancelling and summarises subsequent early work and applications. Earlier unpublished efforts to eliminate interference using a second input are also mentioned.[2] This paper remains the main reference for the adaptive noise cancelling concept and to date has been cited by over 2800 scientific paper and 380 patents. The topic is also covered by a number of more recent books.[3][4]

Original Proof of Concept Demonstrations

The first practical demonstration of the adaptive noise cancelling concept, typical of general practical situations involving broadband signals, was carried out in 1971 at the Stanford School of Electrical Engineering Information Systems Laboratory. The ambient noise from the output of a microphone used by a speaker (the primary sensor) in a very noisy room was largely eliminated using adaptive noise cancellation.

A triangular signal, representing a typical broadband signal, emitted by a loudspeaker situated in the room, was used as the interfering noise source. A second microphone situated near this loudspeaker served to provide the reference input. The output of the noise canceller was channelled to the earphones of a listener outside the room.[1][5]

The adaptive filter used in these experiments was a hybrid adaptive filter consisting of a preprocessor of 16 RC-filter circuits which provided the inputs to 16 digitally controlled analogue amplifiers as weights that were summed as a linear combiner produce the adaptive filter output. This linear combiner[3] interfaced to a small HP2126 digital computer that ran a version of the LMS algorithm.[7]

The experimental arrangement used by Kaunitz in the photo below shows the loudspeaker emitting the interference, the two microphones used to provide the primary and reference signals, the equipment rack, containing the hybrid adaptive filter and the digital interface, and the HP 2116B minicomputer on the right of the picture. (only some of the equipment in the photo is part of the adaptive noise cancelling demonstration).[1][5]

Adaptive Noise Cancelling Demonstration by John Kaunitz at the Adaptive Systems Laboratory, Stanford University in 1971[1][5]

The noise canceller effectively reduced the ambient noise overlaying the speech signal from an initially almost overwhelming level to barely audible and successfully re-adapted to the change in frequency of the triangular noise source and to changes in the environment when people moved around in the room. Recordings of these demonstrations are still available here and here.

The second application of this original noise canceller was to process ECGs from heart transplant animals studied by the pioneering heart transplant team at the Stanford Medical Centre at the time led by Dr Norman Shumway. Data was provided by Drs Eugene Dong and Walter B Cannon in the form of a multi-track magnetic tape recording[1][5] of electrocardiograms.

In heart transplant recipients the part of the heart stem that contains the recipient’s pacemaker (called the sinoatrial or SA node) remains in place and continues to fire controlled by the brain and the nervous system. Normally this pacemaker controls the rate at which the heart is beating by triggering the atrioventricular (AV) nodes and thus controlling heart rate to respond to the demands of the body. (See diagram below). In normal patients this represents a feedback loop, but in transplant patients the connection between the remnant SA node and the implanted AV nodes is not reestablished and the remnant pacemaker and the implanted heartbeat independently, at differing rates.

The behavior of the remnant pacemaker in the open loop situation of a heart transplant patient was of considerable interest to researchers, but studying the ECG of the pacemaker (the p-wave) was made difficult because the weaker signal from the pacemaker was swamped by the signal from the implanted heart even when a bipolar catheter sensor (primary sensor) is inserted through the jugular vein close to the SA-node. (See the third trace from top in the diagram below). The noise cancelling arrangement to eliminate the effect of the donor heart from the ECG of the p-wave is shown below.[1][5]

A reference signal was obtained through a limb-to-limb ECG of the patient (See top trace in the diagram below), which provided the main ECG of the donor heart largely free from the pacemaker p-wave. Adaptive noise cancelling was used to transform the reference into an estimate of the donor heart signal present at the primary input (see second trace from top) and used to substantially reduce the effect of the donor heart from the primary ECG (third trace), providing a substantially cleaned up version of the p-wave at the noise canceller output (see bottom trace) suitable for further study and analysis.[1][3]

Extracting Remnant Pacemaker Signal from Heart transplant ECG
Extracting Remnant Pacemaker Signal from Heart transplant ECG[1][5]

Applications

Adaptive noise cancelling techniques have found use in a wide range of situations, including the following:

  • Eliminating ambient noise from the speech signals of a microphone situated in a noisy environment by using a second microphone situated near the noise source as the reference signal.[1][10] ( see proof of concept above)
  • Eliminating the self-noise of a naval ship towing a sonar array searching for a target signal, by using a reference signal of the towing ship’s own noise which can be readily obtained.
  • Some noise cancelling headphones utilise adaptive noise cancelling techniques. The effects of ambient ambient noise which penetrates inside the earphone can be minimised by using the version of the ambient noise from a small microphone situated on the headset as the reference signal.
  • The extraction of the remnant recipient pacemaker signal from a heart transplant animal from an ECG which also included the stronger ECG signal of the donor heart.[1] (see proof of concept above)
  • Similarly fetal electrocardiograms are received in the presence of the mother’s stronger ECG and can be extracted using adaptive noise cancelling to reduce the effect of the mother’s ECG.[2][11]
  • Adaptive noise cancelling has also been used to eliminate patient motion artifacts during general ECG measurements[12]
  • Adaptive noise cancelling techniques can also been used in the context of Active Noise Control to reduce acoustic noise in a physical space[13]
  • Adaptive noise cancelling has also been used in rail surface defect detection.[14]
  • Elimination of ambient noise by adaptive noise cancelling in the process of measuring lightning electric field signals[15]
  • Cancelling noise in underground mine powerline carrier communication[16]
  • Reducing the effect of noise in speech recognition systems[17]
  • Improving beam control for the linear collider at the SLAC (Stanford Linear Accelerator Centre)[18]

In these situations a suitable reference signal can be readily obtained by placing a sensor near the source of the interference or by other means (e.g. a version of the interfering ECG free from the target signal).

Adaptive noise cancelling can be effective even when the target signal and the interference are similar in nature and the interference is considerably stronger than the target signal. Apart from the availability of a suitable reference signal the only other critical requirement is that the target signal and the corrupting noise source are unrelated, that is uncorrelated, so thatfor all values of , where the bar represents time averaging.[1]

Adaptive noise cancelling does not require detailed a priori knowledge of the interference or the target signal.  However, the characteristics of the adaptive filter must be generally suitable for producing an adjustable frequency response or transfer function that is able to transform the reference signal nr(t) into an estimate of the corrupting interference, ñp(t), through the iterative adjustment of the filter weights. The interference in the above examples are usually irregular repetitive signals. Although the theory of adaptive filtering does not rely on this as an assumption, in practice this characteristic is very helpful as it limits the need for the adaptive filter to compensate for time shifts between the versions of the interference at the primary and reference sensors to appropriately compensating for phase shifts.[1][2]

Adaptive Noise Cancelling and Active Noise Control

Adaptive Noise Cancelling is not to be confused with Active Noise Control. These terms refer to different areas of scientific investigation in two different disciplines and the term "noise" has a different meaning in the two contexts.

Active Noise Control is a method in acoustics to reduce unwanted sound in physical spaces and an area of research that preceded the development of adaptive noise cancelling. The term noise is used here with its common meaning of unwanted audible sound.

As explained above, Adaptive Noise Cancelling is a technique used in communication and control to reduce the effect of additive interference corrupting an electric or electromagnetic target signal. In this context 'noise' refers to such interference and the two terms are used interchangeably. In the book by Widrow and Stearns [3] the relevant chapter is in fact entitled "Adaptive Interference Cancelling". Although in retrospect this would have been the preferable terminology, "adaptive noise cancelling" is the term that prevailed and is now in common usage.

However, after its development in signal processing, the adaptive noise-cancelling approach was also adopted in active noise control, for example in some (but not all), noise-cancelling headphones. So the two areas in fact intersect. Nevertheless, active noise control is just one of the many applications of adaptive noise cancelling and, conversely, adaptive noise cancelling is just a part of the field of active noise control.

References

  1. ^ a b c d e f g h i j k l m n o p q r s t u v w Kaunitz, J. (August 1972), "Adaptive Filtering of Broadband Signals as Applied to Noise Cancelling," Stanford Electronics Laboratories Rep. SU-SEL-3-038, Stanford University, Stanford, California, (Ph.D. dissertation) OCLC 15201972
  2. ^ a b c d e f g h i j k l Widrow, B., Glover, J., R. McCool, J. M., Kaunitz, J., Williams, C. S., Hearn, R. H., Zeidler, J. R., Dong E. JR, and Goodlin, R. C. (December 1975) "Adaptive Noise Cancelling: Principles and Applications," Proc. IEEE, Vol. 63, DOI: 10.1109/PROC.1975.10036
  3. ^ a b c d e f g Widrow, B. and Stearns S. D. (1985) "Adaptive Signal Processing," Pearson Education, Inc. ISBN 9780130040299, 0130040290 OCLC 11159524
  4. ^ a b Alexander, T. S. (2012). Adaptive Signal Processing: Theory and Applications. Springer Science and Business Media.
  5. ^ a b c d e f g h i j k l m Kaunitz, J. and Widrow, B. (October 1973). "Noise Subtracting Filter Study," Stanford California: Stanford Electronics Laboratories., Ft. Belvoir Defense Technical Information Centre
  6. ^ a b c Widrow, B. (Dec 1966). Adaptive Filters I: Fundamentals. Stanford Electronics Laboratories.
  7. ^ a b c d Kaunitz, J. (April 1971) "General Purpose Hybrid Adaptive Signal Processor," Stanford Electronics Laboratories, Stanford, California, SU-SEL-71-023, TR No. 6793-2
  8. ^ a b Clarkson, P. M. (1993), Optimal and Adaptive Signal Processing, Routledge, doi:10.1201/9780203744925-4, ISBN 978-0-203-74492-5
  9. ^ Davisson, D. L. (2014). Adaptive Signal Processing. Springer Wien. ISBN 978-3-7091-2840-4. OCLC 1076234012.
  10. ^ Mendiratta, Arnav; Jha, Devendra (January 2014). "Adaptive Noise Cancelling for audio signals using Least Mean Square algorithm". International Conference on Electronics, Communication and Instrumentation (ICECI): 1–4. doi:10.1109/ICECI.2014.6767380. ISBN 978-1-4799-3983-1. S2CID 19241199.
  11. ^ Thakor, N.V.; Zhu, Y.-S. (Aug 1991). "Applications of adaptive filtering to ECG analysis: noise cancellation and arrhythmia detection". IEEE Transactions on Biomedical Engineering. 38 (8): 785–794. doi:10.1109/10.83591. PMID 1937512. S2CID 11271450.
  12. ^ Raya, M.A.D.; Sison, L.G. (2002). "Adaptive noise cancelling of motion artifact in stress ECG signals using accelerometer". Proceedings of the Second Joint 24th Annual Conference and the Annual Fall Meeting of the Biomedical Engineering Society] [Engineering in Medicine and Biology. 2. Houston, TX, USA: IEEE: 1756–1757. doi:10.1109/IEMBS.2002.1106637. ISBN 978-0-7803-7612-0. S2CID 61203370.
  13. ^ Tuma, Jiri; Strambersky, Radek; Guras, Radek (2020-10-27). "The Efficiency of Adaptive Filters to Noise-Suppression Inside a Small Cavity". 2020 21th International Carpathian Control Conference (ICCC). High Tatras, Slovakia: IEEE: 1–5. doi:10.1109/ICCC49264.2020.9257219. ISBN 978-1-7281-1951-9. S2CID 227064650.
  14. ^ Liang, B; Iwnicki, S.; Ball, A.; Young, E.A. (March 2015). "Adaptive noise cancelling and time-frequency techniques for rail surface defect detection" (PDF). Mechanical Systems and Signal Processing. 54–55: 41–51. Bibcode:2015MSSP...54...41L. doi:10.1016/j.ymssp.2014.06.012 – via Science Direct.
  15. ^ Li, Yun; Shi, Lihua; Qiu, Shi; Wang, Tao (October 2017). "Adaptive noise canceling for lightning electric field signals". 2017 IEEE 5th International Symposium on Electromagnetic Compatibility (EMC-Beijing). Beijing: IEEE: 1–4. doi:10.1109/EMC-B.2017.8260475. ISBN 978-1-5090-5184-7. S2CID 37945009.
  16. ^ Shaoliang Wei; Jialin Cao; Yimin Chen; Fengyu Cheng; Deming Nie; Hengwen Li (August 2008). "A Canceling Noise Research for Underground Mine Powerline Carrier Communication Based on Adaptive Theory". 2008 Workshop on Power Electronics and Intelligent Transportation System. Guangzhou, China: IEEE: 345–348. doi:10.1109/PEITS.2008.12. ISBN 978-0-7695-3342-1. S2CID 16842396.
  17. ^ Jie, Yang; Zhenli, Wang (August 2009). "On the application of variable-step adaptive noise cancelling for improving the robustness of speech recognition". 2009 ISECS International Colloquium on Computing, Communication, Control, and Management. 2: 419–422. doi:10.1109/CCCM.2009.5267458. ISBN 978-1-4244-4247-8. S2CID 24998249.
  18. ^ Himel, T.; Allison, S.; Grossberg, P.; Hendrickson, L.; Sass, R.; Shoaee, H. (1993). "An adaptive noise cancelling system used for beam control at the Stanford Linear Accelerator Center". [1993] Proceedings of the IEEE Workshop on Real-Time Applications. New York, NY, USA: IEEE Comput. Soc. Press: 212–215. doi:10.1109/RTA.1993.263084. ISBN 978-0-8186-4130-5. S2CID 1965179.

Main sources

  • J. Kaunitz, "Adaptive Filtering of Broadband Signals as Applied to Noise Cancelling," Stanford Electronics Laboratories, Stanford University, Stanford, California, Rep. SU-SEL-3-038, August 1972 (Ph.D. dissertation) OCLC 15201972
  • B. Widrow, J. R. Glover JR, J. M. McCool, J. Kaunitz, C. S. Williams, R. H. Hearn, J. R. Zeidler, E. Dong JR. and R. C. Goodlin, "Adaptive Noise Cancelling: Principles and Applications," Proc. IEEE, Vol. 63, December 1975
  • B. Widrow and S. D. Stearns, "Adaptive Signal Processing," Pearson Education, Inc.
Retrieved from "https://en.wikipedia.org/w/index.php?title=Adaptive_noise_cancelling&oldid=1153265810"