A bell-like sound generated by additive synthesis of 21 inharmonic partials
|Problems playing this file? See media help.|
The timbre of musical instruments can be considered in the light of Fourier theory to consist of multiple harmonic or inharmonic partials or overtones. Each partial is a sine wave of different frequency and amplitude that swells and decays over time.
Additive synthesis most directly generates sound by adding the output of multiple sine wave generators. Alternative implementations may use pre-computed wavetables or the inverse Fast Fourier transform.
- 1 Definitions
- 2 Additive analysis/resynthesis
- 3 Applications
- 4 Implementation methods
- 5 History
- 6 Discrete-time equations
- 7 See also
- 8 References
- 9 External links
Harmonic additive synthesis is closely related to the concept of a Fourier series which is a way of expressing a periodic function as the sum of sinusoidal functions with frequencies equal to integer multiples of a common fundamental frequency. These sinusoids are called harmonics, overtones, or generally, partials. In general, a Fourier series contains an infinite number of sinusoidal components, with no upper limit to the frequency of the sinusoidal functions and includes a DC component (one with frequency of 0 Hz). Frequencies outside of the human audible range can be omitted in additive synthesis. As a result only a finite number of sinusoidal terms with frequencies that lie within the audible range are modeled in additive synthesis.
A waveform or function is said to be periodic if
for all and for some period .
The Fourier series of a periodic function is mathematically expressed as:
Being inaudible, the DC component, , and all components with frequencies higher than some finite limit, , are omitted in the following expressions of additive synthesis.
The simplest harmonic additive synthesis can be mathematically expressed as:
where is the synthesis output, , , and are the amplitude, frequency, and the phase offset, respectively, of the th harmonic partial of a total of harmonic partials, and is the fundamental frequency of the waveform and the frequency of the musical note.
|Example of harmonic additive synthesis in which each harmonic has a time-dependent amplitude. The fundamental frequency is 440 Hz.
Problems listening to this file? See Media help
More generally, the amplitude of each harmonic can be prescribed as a function of time, , in which case the synthesis output is
Additive synthesis can also produce inharmonic sounds (which are aperiodic waveforms) in which the individual overtones need not have frequencies that are integer multiples of some common fundamental frequency. While many conventional musical instruments have harmonic partials (e.g. an oboe), some have inharmonic partials (e.g. bells). Inharmonic additive synthesis can be described as
where is the constant frequency of th partial.
|Example of inharmonic additive synthesis in which both the amplitude and frequency of each partial are time-dependent.
Problems listening to this file? See Media help
In the general case, the instantaneous frequency of a sinusoid is the derivative (with respect to time) of the argument of the sine or cosine function. If this frequency is represented in hertz, rather than in angular frequency form, then this derivative is divided by . This is the case whether the partial is harmonic or inharmonic and whether its frequency is constant or time-varying.
In the most general form, the frequency of each non-harmonic partial is a non-negative function of time, , yielding
Additive synthesis has been used as an umbrella term for the class of sound synthesis techniques that sum simple elements to create more complex timbres, even when the elements are not sine waves. For example, F. Richard Moore listed additive synthesis as one of the "four basic categories" of sound synthesis alongside subtractive synthesis, nonlinear synthesis, and physical modelling. In this broad sense, pipe organs, which also have pipes producing non-sinusoidal waveforms, can be considered as additive synthesizers. Summation of principal components and Walsh functions have also been classified as additive synthesis.
It is possible to analyze the frequency components of a recorded sound giving a "sum of sinusoids" representation. This representation can be re-synthesized using additive synthesis. One method of decomposing a sound into time varying sinusoidal partials is Fourier Transform-based McAulay-Quatieri Analysis.
By modifying the sum of sinusoids representation, timbral alterations can be made prior to resynthesis. For example, a harmonic sound could be restructured to sound inharmonic, and vice versa. Sound hybridisation or "morphing" has been implemented by additive resynthesis.
Additive analysis/resynthesis has been employed in a number of techniques including Sinusoidal Modelling, Spectral Modelling Synthesis (SMS), and the Reassigned Bandwidth-Enhanced Additive Sound Model. Software that implements additive analysis/resynthesis includes: SPEAR, LEMUR, LORIS, SMSTools, ARSS.
New England Digital Synclavier had a resynthesis feature where samples could be analyzed and converted into ”timbre frames” which were part of its additive synthesis engine. Technos acxel, launched in 1987, utilized the additive analysis/resynthesis model, in an FFT implementation.
Also a vocal synthesizer, Vocaloid have been implemented on the basis of additive analysis/resynthesis: its spectral voice model called Excitation plus Resonances (EpR) model is extended based on Spectral Modeling Synthesis (SMS), and its diphone concatenative synthesis is processed using spectral peak processing (SPP) technique similar to modified phase-locked vocoder (an improved phase vocoder for formant processing). Using these techniques, spectral components (formants) consisting of purely harmonic partials can be appropriately transformed into desired form for sound modeling, and sequence of short samples (diphones or phonemes) constituting desired phrase, can be smoothly connected by interpolating matched partials and formant peaks, respectively, in the inserted transition region between different samples.
Additive synthesis is used in electronic musical instruments.
In linguistics research, harmonic additive synthesis was used in 1950s to play back modified and synthetic speech spectrograms. Later, in early 1980s, listening tests were carried out on synthetic speech stripped of acoustic cues to assess their significance. Time-varying formant frequencies and amplitudes derived by linear predictive coding were synthesized additively as pure tone whistles. This method is called sinewave synthesis.
Modern-day implementations of additive synthesis are mainly digital. (See section Discrete-time equations for the underlying discrete-time theory)
Oscillator bank synthesis
Additive synthesis can be implemented using a bank of sinusoidal oscillators, one for each partial.
In the case of harmonic, quasi-periodic musical tones, wavetable synthesis can be as general as time-varying additive synthesis, but requires less computation during synthesis. As a result, an efficient implementation of time-varying additive synthesis of harmonic tones can be accomplished by use of wavetable synthesis.
Group additive synthesis is a method to group partials into harmonic groups (of differing fundamental frequencies) and synthesize each group separately with wavetable synthesis before mixing the results.
Inverse FFT synthesis
An inverse Fast Fourier transform can be used to efficiently synthesize frequencies that evenly divide the transform period or "frame". By careful consideration of the DFT frequency-domain representation it is also possible to efficiently synthesize sinusoids of arbitrary frequencies using a series of overlapping frames and the inverse Fast Fourier transform.
Harmonic analysis was discovered by Joseph Fourier, who published an extensive treatise of his research in the context of heat transfer in 1822. The theory found an early application in prediction of tides. Around 1876, Lord Kelvin constructed a mechanical tide predictor. It consisted of a harmonic analyzer and a harmonic synthesizer, as they were called already in the 19th century. The analysis of tide measurements was done using James Thomson's integrating machine. The resulting Fourier coefficients were input into the synthesizer, which then used a system of cords and pulleys to generate and sum harmonic sinusoidal partials for prediction of future tides. In 1910, a similar machine was built for the analysis of periodic waveforms of sound. The synthesizer drew a graph of the combination waveform, which was used chiefly for visual validation of the analysis.
Georg Ohm applied Fourier's theory to sound in 1843. The line of work was greatly advanced by Hermann von Helmholtz, who published his eight years worth of research in 1863. Helmholtz believed that the psychological perception of tone color is subject to learning, while hearing in the sensory sense is purely physiological. He supported the idea that perception of sound derives from signals from nerve cells of the basilar membrane and that the elastic appendages of these cells are sympathetically vibrated by pure sinusoidal tones of appropriate frequencies. Helmholtz agreed with the finding of Ernst Chladni from 1787 that certain sound sources have inharmonic vibration modes.
In Helmholtz's time, electronic amplification was unavailable. For synthesis of tones with harmonic partials, Helmholtz built an electrically excited array of tuning forks and acoustic resonance chambers that allowed adjustment of the amplitudes of the partials. Built at least as early as in 1862, these were in turn refined by Rudolph Koenig, who demonstrated his own setup in 1872. For harmonic synthesis, Koenig also built a large apparatus based on his wave siren. It was pneumatic and utilized cut-out tonewheels, and was criticized for low purity of its partial tones. Also tibia pipes of pipe organs have nearly sinusoidal waveforms and can be combined in the manner of additive synthesis.
In 1938, with significant new supporting evidence, it was reported on the pages of Popular Science Monthly that the human vocal cords function like a fire siren to produce a harmonic-rich tone, which is then filtered by the vocal tract to produce different vowel tones. By the time, the additive Hammond organ was already on market. Most early electronic organ makers thought it too expensive to manufacture the plurality of oscillators required by additive organs, and began instead to built subtractive ones. In a 1940 Institute of Radio Engineers meeting, the head field engineer of Hammond elaborated on the company's new Novachord as having a “subtractive system” in contrast to the original Hammond organ in which “the final tones were built up by combining sound waves”. Alan Douglas used the qualifiers additive and subtractive to describe different types of electronic organs in a 1948 paper presented to the Royal Musical Association. The contemporary wording additive synthesis and subtractive synthesis can be found in his 1957 book The electrical production of music, in which he categorically lists three methods of forming of musical tone-colours, in sections titled Additive synthesis, Subtractive synthesis, and Other forms of combinations.
A typical modern additive synthesizer produces its output as an electrical, analog signal, or as digital audio, such as in the case of software synthesizers, which became popular around year 2000.
The following is a timeline of historically and technologically notable analog and digital synthesizers and devices implementing additive synthesis.
|Research implementation or publication||Commercially available||Company or institution||Synthesizer or synthesis device||Description||Audio samples|
|1900||1906||New England Electric Music Company||Telharmonium||The first polyphonic, touch-sensitive music synthesizer. Implemented sinuosoidal additive synthesis using tonewheels and alternators. Invented by Thaddeus Cahill.||no known recordings|
|1933||1935||Hammond Organ Company||Hammond Organ||An electronic additive synthesizer that was commercially more successful than Telharmonium. Implemented sinusoidal additive synthesis using tonewheels and magnetic pickups. Invented by Laurens Hammond.||Model A (help·info)|
|1950 or earlier||Haskins Laboratories||Pattern Playback||A speech synthesis system that controlled amplitudes of harmonic partials by a spectrogram that was either hand-drawn or an analysis result. The partials were generated by a multi-track optical tonewheel.||samples|
|1958||ANS||An additive synthesizer that played microtonal spectrogram-like scores using multiple multi-track optical tonewheels. Invented by Evgeny Murzin. A similar instrument that utilized electronic oscillators, the Oscillator Bank, and its input device Spectrogram were realized by Hugh Le Caine in 1959.||1964 model (help·info)|
|1963||MIT||An off-line system for digital spectral analysis and resynthesis of the attack and steady-state portions of musical instrument timbres by David Luce.|
|1964||University of Illinois||Harmonic Tone Generator||An electronic, harmonic additive synthesis system invented by James Beauchamp.||samples (info)|
|1974 or earlier||1974||RMI||Harmonic Synthesizer||The first synthesizer product that implemented additive synthesis using digital oscillators. The synthesizer also had a time-varying analog filter. RMI was a subsidiary of Allen Organ Company, which had released the first commercial digital church organ, the Allen Computer Organ, in 1971, using digital technology developed by North American Rockwell.||1 2 3 4|
|1974||EMS (London)||Digital Oscillator Bank||A bank of digital oscillators with arbitrary waveforms, individual frequency and amplitude controls, intended for use in analysis-resynthesis with the digital Analysing Filter Bank (AFB) also constructed at EMS. Also known as: DOB.||in The New Sound of Music|
|1976||1976||Fairlight||Qasar M8||An all-digital synthesizer that used the Fast Fourier Transform to create samples from interactively drawn amplitude envelopes of harmonics.||samples|
|1977||Bell Labs||Digital Synthesizer||A real-time, digital additive synthesizer that has been called the first true digital synthesizer. Also known as: Alles Machine, Alice.||sample (info)|
|1979||1979||New England Digital||Synclavier II||A commercial digital synthesizer that enabled development of timbre over time by smooth cross-fades between waveforms generated by additive synthesis.||Jon Appleton - Sashasonjon (help·info)|
In digital implementations of additive synthesis, discrete-time equations are used in place of the continuous-time synthesis equations. A notational convention for discrete-time signals uses brackets i.e. and the argument can only be integer values. If the continuous-time synthesis output is expected to be sufficiently bandlimited; below half the sampling rate or , it suffices to directly sample the continuous-time expression to get the discrete synthesis equation. The continuous synthesis output can later be reconstructed from the samples using a digital-to-analog converter. The sampling period is .
Beginning with (3),
and sampling at discrete times results in
- is the discrete-time varying amplitude envelope
- is the discrete-time backward difference instantaneous frequency.
This is equivalent to
- for all 
- Julius O. Smith III. "Additive Synthesis (Early Sinusoidal Modeling)". Retrieved 14 January 2012. "The term "additive synthesis" refers to sound being formed by adding together many sinusoidal components"
- Gordon Reid. "Synth Secrets, Part 14: An Introduction To Additive Synthesis". Sound On Sound (January 2000). Retrieved 14 January 2012.
- Smith III, Julius O.; Serra, Xavier (2005). "Additive Synthesis". PARSHL: An Analysis/Synthesis Program for Non-Harmonic Sounds Based on a Sinusoidal Representation. CCRMA, Department of Music, Stanford University. Retrieved 9 January 2012. (online reprint)
- Smith III, Julius O. (2011). "Additive Synthesis (Early Sinusoidal Modeling)". Spectral Audio Signal Processing. CCRMA, Department of Music, Stanford University. ISBN 978-0-9745607-3-1. Retrieved 9 January 2012.
- Roads, Curtis (1995). The Computer Music Tutorial. MIT Press. p. 134. ISBN 0-262-68082-3.
- Moore, F. Richard (1995). Foundations of Computer Music. Prentice Hall. p. 16. ISBN 0-262-68082-3.
- Roads, Curtis (1995). The Computer Music Tutorial. MIT Press. pp. 150–153. ISBN 0-262-68082-3.
- McAulay, R. J.; Quatieri, T. F. (1988). "Speech Processing Based on a Sinusoidal Model". The Lincoln Laboratory Journal 1 (2): 153–167.
- McAulay, R. J.; Quatieri, T. F. (Aug 1986). "Speech analysis/synthesis based on a sinusoidal representation"". IEEE Transactions on Acoustics, Speech, Signal Processing ASSP-34: 744–754.
- "McAulay-Quatieri Method".
- Serra, Xavier (1989). A System for Sound Analysis/Transformation/Synthesis based on a Deterministic plus Stochastic Decomposition (Ph.D. thesis). Stanford University. Retrieved 13 January 2012.
- Smith III, Julius O.; Serra, Xavier. "PARSHL: An Analysis/Synthesis Program for Non-Harmonic Sounds Based on a Sinusoidal Representation". Retrieved 9 January 2012.
- Fitz, Kelly (1999). The Reassigned Bandwidth-Enhanced Method of Additive Synthesis (Ph.D. thesis). Dept. of Electrical and Computer Engineering, University of Illinois at Urbana-Champaign. CiteSeerX: 10.1.1.10.1130.
- SPEAR Sinusoidal Partial Editing Analysis and Resynthesis for MacOS X, MacOS 9 and Windows
- Loris Software for Sound Modeling, Morphing, and Manipulation
- SMSTools application for Windows
- ARSS: The Analysis & Resynthesis Sound Spectrograph
- Bonada, J.; Celma, O.; Loscos, A.; Ortola, J.; X. Serra, Y. Yoshioka, H. Kayama, Y. Hisaminato, H. Kenmochi (2001). "Singing voice synthesis combining Excitation plus Resonance and Sinusoidal plus Residual Models". Proc. of ICMC. CiteSeerX: 10.1.1.18.6258. (PDF)
- Loscos, A. (2007). Spectral processing of the singing voice (Ph.D thesis). Barcelona, Spain: Pompeu Fabra University. (PDF).
See "Excitation plus resonances voice model" (p. 51)
- Loscos 2007, p. 44, "Spectral peak processing"
- Loscos 2007, p. 44, "Phase locked vocoder"
- Bonada, Jordi; Loscos, Alex (2003). 6. Concatenating Samples (p. 441). "Sample-based singing voice synthesizer by spectral concatenation". Proc. of SMAC 03: 439–442.
- "The interconversion of audible and visible patterns as a basis for research in the perception of speech". Proc. Natl. Acad. Sci. U.S.A. 37 (5): 318–25. May 1951. doi:10.1073/pnas.37.5.318. PMC 1063363. PMID 14834156.
- Remez, R.E.; Rubin, P.E.; Pisoni, D.B.; Carrell, T.D. (1981). "Speech perception without traditional speech cues". Science (212): 947–950.
- Rubin, P.E. (1980). "Sinewave Synthesis Instruction Manual (VAX)". Internal memorandum (Haskins Laboratories, New Haven, CT).
- Robert Bristow-Johnson (November 1996). "Wavetable Synthesis 101, A Fundamental Perspective".
- Julius O. Smith III. "Group Additive Synthesis". CCRMA, Stanford University. Archived from the original on 6 June 2011. Retrieved 12 May 2011.
- P. Kleczkowski (1989). "Group additive synthesis". Computer Music Journal 13 (1): 12–20.
- B. Eaglestone and S. Oates (1990). "Analytical tools for group additive synthesis". Proceedings of the 1990 International Computer Music Conference, Glasgow. Computer Music Association.
- Rodet, X.; Depalle, P. (1992). "Spectral Envelopes and Inverse FFT Synthesis". Proceedings of the 93rd Audio Engineering Society Convention. CiteSeerX: 10.1.1.43.4818.
- Prestini, Elena (2004) [Rev. ed of: Applicazioni dell'analisi armonica. Milan: Ulrico Hoepli, 1996]. The Evolution of Applied Harmonic Analysis: Models of the Real World. trans. New York, USA: Birkhäuser Boston. pp. 114–115. ISBN 0-8176-4125-4. Retrieved 6 February 2012.
- Fourier, Jean Baptiste Joseph (1822). Théorie analytique de la chaleur [The Analytical Theory of Heat] (in French). Paris, France: Chez Firmin Didot, père et fils.
- Miller, Dayton Clarence (1926) [First published 1916]. The Science Of Musical Sounds. New York: The Macmillan Company. pp. 110, 244–248.
- The London, Edinburgh and Dublin philosophical magazine and journal of science (Taylor & Francis) 49: 490. 1875.
- Thomson, Sir W. (1878). "Harmonic analyzer". Proceedings of the Royal Society of London (Taylor and Francis) 27: 371–373. JSTOR 113690.
- Cahan, David (1993). Cahan, David, ed. Hermann von Helmholtz and the foundations of nineteenth-century science. Berkeley and Los Angeles, USA: University of California Press. pp. 110–114, 285–286. ISBN 978-0-520-08334-9.
- Helmholtz, von, Hermann (1863). Die Lehre von den Tonempfindungen als physiologische Grundlage für die Theorie der Musik [On the sensations of tone as a physiological basis for the theory of music] (in German) (1st ed.). Leipzig: Leopold Voss. pp. v.
- Christensen, Thomas Street (2002). The Cambridge History of Western Music. Cambridge, United Kingdom: Cambridge University Press. pp. 251, 258. ISBN 0-521-62371-5.
- von Helmholtz, Hermann (1875). On the sensations of tone as a physiological basis for the theory of music. London, United Kingdom: Longmans, Green, and co. pp. xii, 175–179.
- Russell, George Oscar (1936). Year book - Carnegie Institution of Washington (1936). Carnegie Institution of Washington: Year Book 35. Washington: Carnegie Institution of Washington. pp. 359–363.
- Lodge, John E. (April 1938). "Odd Laboratory Tests Show Us How We Speak: Using X Rays, Fast Movie Cameras, and Cathode-Ray Tubes, Scientists Are Learning New Facts About the Human Voice and Developing Teaching Methods To Make Us Better Talkers". In Brown, Raymond J. Popular Science Monthly (New York, USA: Popular Science Publishing) 132 (4): 32–33.
- Comerford, P. (1993). "Simulating an Organ with Additive Synthesis". Computer Music Journal 17 (2): 55–65. doi:10.2307/3680869.
- "Institute News and Radio Notes". Proceedings of the IRE 28 (10): 487–494. 1940. doi:10.1109/JRPROC.1940.228904.
- Douglas, A. (1948). "Electrotonic Music". Proceedings of the Royal Musical Association 75: 1–12. doi:10.1093/jrma/75.1.1.
- Douglas, Alan Lockhart Monteith (1957). The Electrical Production of Music. London, UK: Macdonald. pp. 140, 142.
- Pejrolo, Andrea; DeRosa, Rich (2007). Acoustic and MIDI orchestration for the contemporary composer. Oxford, UK: Elsevier. pp. 53–54.
- Weidenaar, Reynold (1995). Magic Music from the Telharmonium. Lanham, MD: Scarecrow Press. ISBN 0-8108-2692-5.
- Moog, Robert A. (October/November 1977). "Electronic Music". Journal of the Audio Engineering Society (JAES) 25 (10/11): 856.
- Olsen, Harvey (14 December 2011). "Leslie Speakers and Hammond organs: Rumors, Myths, Facts, and Lore". In Brown, Darren T. The Hammond Zone. Hammond Organ in the U.K. Retrieved 20 January 2012.
- Holzer, Derek (22 February 2010). "A brief history of optical synthesis". Retrieved 13 January 2012.
- Vail, Mark (1 November 2002). Eugeniy Murzin's ANS — Additive Russian synthesizer. Keyboard Magazine. p. 120.
- Young, Gayle. "Oscillator Bank (1959)".
- Young, Gayle. "Spectrogram (1959)".
- Luce, David Alan (1963). Physical correlates of nonpercussive musical instrument tones. Cambridge, Massachusetts, U.S.A.: Massachusetts Institute of Technology. hdl:1721.1/27450.
- Beauchamp, James (17 November 2009). "The Harmonic Tone Generator: One of the First Analog Voltage-Controlled Synthesizers". Prof. James W. Beauchamp Home Page.
- Beauchamp, James W. (October 1966). "Additive Synthesis of Harmonic Musical Tones". Journal of the Audio Engineering Society 14 (4): 332–342.
- "RMI Harmonic Synthesizer". Synthmuseum.com. Archived from the original on 9 June 2011. Retrieved 12 May 2011.
- Reid, Gordon. "PROG SPAWN! The Rise And Fall Of Rocky Mount Instruments (Retro)". Sound On Sound (December 2001). Retrieved 22 January 2012.
- Flint, Tom. "Jean Michel Jarre: 30 Years Of Oxygene". Sound On Sound (February 2008). Retrieved 22 January 2012.
- "Allen Organ Company". fundinguniverse.com.
- Cosimi, Enrico (20 May 2009). "EMS Story - Prima Parte" [EMS Story - Part One]. Audio Accordo.it (in Italian). Retrieved 21 January 2012.
- Hinton, Graham (2002). "EMS: The Inside Story". Electronic Music Studios (Cornwall).
- The New Sound of Music (TV). UK: BBC. 1979. Includes a demonstration of DOB and AFB.
- Leete, Norm. "Fairlight Computer – Musical Instrument (Retro)". Sound On Sound (April 1999). Retrieved 29 January 2012.
- Twyman, John (1 November 2004). (inter)facing the music: The history of the Fairlight Computer Musical Instrument (pdf) (Bachelor of Science (Honours) thesis). Unit for the History and Philosophy of Science, University of Sydney. Retrieved 29 January 2012.
- Street, Rita (8 November 2000). "Fairlight: A 25-year long fairytale". Audio Media magazzine. IMAS Publishing UK. Archived from the original on 8 October 2003. Retrieved 29 January 2012.
- "Computer Music Journal" (JPG). 1978. Retrieved 29 January 2012.
- Leider, Colby (2004). "The Development of the Modern DAW". Digital Audio Workstation. McGraw-Hill. p. 58.
- Joel, Chadabe (1997). Electric Sound. Upper Saddle River, N.J., U.S.A.: Prentice Hall. pp. 177–178, 186. ISBN 978-0-13-303231-4.