Computer music is the application of computing technology in music composition, to help human composers create new music or to have computers independently create music, such as with algorithmic composition programs. It includes the theory and application of new and existing computer software technologies and basic aspects of music, such as sound synthesis, digital signal processing, sound design, sonic diffusion, acoustics, electrical engineering and psychoacoustics. The field of computer music can trace its roots back to the origins of electronic music, and the first experiments and innovations with electronic instruments at the turn of the 20th century.
Musical melodies were first generated by the computer originally named the CSIR Mark 1 (later renamed CSIRAC) in Australia in 1950. There were newspaper reports from America and England (early and recently) that computers may have played music earlier, but thorough research has debunked these stories as there is no evidence to support the newspaper reports (some of which were obviously speculative). Research has shown that people speculated about computers playing music, possibly because computers would make noises, but there is no evidence that they actually did it.
The world's first computer to play music was the CSIR Mark 1 (later named CSIRAC), which was designed and built by Trevor Pearcey and Maston Beard from the late 1940s. Mathematician Geoff Hill programmed the CSIR Mark 1 to play popular musical melodies from the very early 1950s. In 1950 the CSIR Mark 1 was used to play music, the first known use of a digital computer for the purpose. The music was never recorded, but it has been accurately reconstructed. In 1951 it publicly played the "Colonel Bogey March" of which only the reconstruction exists. However, the CSIR Mark 1 played standard repertoire and was not used to extend musical thinking or composition practice, as Max Mathews did, which is current computer-music practice.
The first music to be performed in England was a performance of the British National Anthem that was programmed by Christopher Strachey on the Ferranti Mark 1, late in 1951. Later that year, short extracts of three pieces were recorded there by a BBC outside broadcasting unit: the National Anthem, "Baa, Baa, Black Sheep", and "In the Mood"; this is recognised as the earliest recording of a computer to play music as the CSIRAC music was never recorded. This recording can be heard at the this Manchester University site. Researchers at the University of Canterbury, Christchurch declicked and restored this recording in 2016 and the results may be heard on SoundCloud.
Two further major 1950s developments were the origins of digital sound synthesis by computer, and of algorithmic composition programs beyond rote playback. Amongst other pioneers, the musical chemists Lejaren Hiller and Leonard Isaacson worked on a series of algorithmic composition experiments from 1956-9, manifested in the 1957 premiere of the Illiac Suite for string quartet. Max Mathews at Bell Laboratories developed the influential MUSIC I program and its descendants, further popularising computer music through a 1963 article in Science. The first professional composer to work with digital synthesis was James Tenney, who created a series of digitally synthesized and/or algorithmically composed pieces at Bell Labs using Mathews' MUSIC III system, beginning with Analog #1 (Noise Study) (1961). After Tenney left Bell Labs in 1964, he was replaced by composer Jean-Claude Risset, who conducted research on the synthesis of instrumental timbres and composed Computer Suite from Little Boy (1968).
In Japan, experiments in computer music date back to 1962, when Keio University professor Sekine and Toshiba engineer Hayashi experimented with the TOSBAC [jp] computer. This resulted in a piece entitled TOSBAC Suite, influenced by the Illiac Suite. Later Japanese computer music compositions include a piece by Kenjiro Ezaki presented during Osaka Expo '70 and "Panoramic Sonore" (1974) by music critic Akimichi Takeda. Ezaki also published an article called "Contemporary Music and Computers" in 1970. Since then, Japanese research in computer music has largely been carried out for commercial purposes in popular music, though some of the more serious Japanese musicians used large computer systems such as the Fairlight in the 1970s.
Early computer-music programs typically did not run in real time, although the first experiments on CSIRAC and the Ferranti Mark 1 did operate in real time. From the late 1950s, with increasingly sophisticated programming, programs would run for hours or days, on multimillion-dollar computers, to generate a few minutes of music. One way around this was to use a 'hybrid system' of digital control of an analog synthesiser and early examples of this were Max Mathews' GROOVE system (1969) and also MUSYS by Peter Zinovieff (1969).
Until now partial use has been exploited for musical research into the substance and form of sound (convincing examples are those of Hiller and Isaacson in Urbana, Illinois USA; Iannis Xenakis in Paris and Pietro Grossi in Florence, Italy).
In May 1967 the first experiments in computer music in Italy were carried out by the S 2F M studio in Florence in collaboration with General Electric Information Systems Italy. Olivetti-General Electric GE 115 (Olivetti S.p.A.) is used by Grossi as a performer: three programmes were prepared for these experiments. The programmes were written by Ferruccio Zulian  and used by Pietro Grossi for playing Bach, Paganini, and Webern works and for studying new sound structures.
In the late 1970s these systems became commercialised, notably by systems like the Roland MC-8 Microcomposer, where a microprocessor-based system controls an analog synthesizer, released in 1978. John Chowning's work on FM synthesis from the 1960s to the 1970s allowed much more efficient digital synthesis, eventually leading to the development of the affordable FM synthesis-based Yamaha DX7 digital synthesizer, released in 1983. In addition to the Yamaha DX7, the advent of inexpensive digital chips and microcomputers opened the door to real-time generation of computer music. In the 1980s, Japanese personal computers such as the NEC PC-88 came installed with FM synthesis sound chips and featured audio programming languages such as Music Macro Language (MML) and MIDI interfaces, which were most often used to produce video game music, or chiptunes. By the early 1990s, the performance of microprocessor-based computers reached the point that real-time generation of computer music using more general programs and algorithms became possible.
Interesting sounds must have a fluidity and changeability that allows them to remain fresh to the ear. In computer music this subtle ingredient is bought at a high computational cost, both in terms of the number of items requiring detail in a score and in the amount of interpretive work the instruments must produce to realize this detail in sound.
Advances in computing power and software for manipulation of digital media have dramatically affected the way computer music is generated and performed. Current-generation micro-computers are powerful enough to perform very sophisticated audio synthesis using a wide variety of algorithms and approaches. Computer music systems and approaches are now ubiquitous, and so firmly embedded in the process of creating music that we hardly give them a second thought: computer-based synthesizers, digital mixers, and effects units have become so commonplace that use of digital rather than analog technology to create and record music is the norm, rather than the exception.
There is considerable activity in the field of computer music as researchers continue to pursue new and interesting computer-based synthesis, composition, and performance approaches. Throughout the world there are many organizations and institutions dedicated to the area of computer and electronic music study and research, including the ICMA (International Computer Music Association), C4DM (Centre for Digital Music), IRCAM, GRAME, SEAMUS (Society for Electro Acoustic Music in the United States), CEC (Canadian Electroacoustic Community), and a great number of institutions of higher learning around the world.
Music composed and performed by computers
Later, composers such as Gottfried Michael Koenig and Iannis Xenakis had computers generate the sounds of the composition as well as the score. Koenig produced algorithmic composition programs which were a generalisation of his own serial composition practice. This is not exactly similar to Xenakis' work as he used mathematical abstractions and examined how far he could explore these musically. Koenig's software translated the calculation of mathematical equations into codes which represented musical notation. This could be converted into musical notation by hand and then performed by human players. His programs Project 1 and Project 2 are examples of this kind of software. Later, he extended the same kind of principles into the realm of synthesis, enabling the computer to produce the sound directly. SSP is an example of a program which performs this kind of function. All of these programs were produced by Koenig at the Institute of Sonology in Utrecht in the 1970s. In the 2000s, Andranik Tangian developed a computer algorithm to determine the time event structures for rhythmic canons and rhythmic fugues, which were then "manually" worked out into harmonic compositions Eine kleine Mathmusik I and Eine kleine Mathmusik II performed by computer; for scores and recordings see.
Computer-generated scores for performance by human players
Computers have also been used in an attempt to imitate the music of great composers of the past, such as Mozart. A present exponent of this technique is David Cope, whose computer programs analyse works of other composers to produce new works in a similar style. Cope's best-known program is Emily Howell.
Melomics, a research project from the University of Málaga (Spain), developed a computer composition cluster named Iamus, which composes complex, multi-instrument pieces for editing and performance. Since its inception, Iamus has composed a full album in 2012, appropriately named Iamus, which New Scientist described as "the first major work composed by a computer and performed by a full orchestra". The group has also developed an API for developers to utilize the technology, and makes its music available on its website.
Computer-aided algorithmic composition
Computer-aided algorithmic composition (CAAC, pronounced "sea-ack") is the implementation and use of algorithmic composition techniques in software. This label is derived from the combination of two labels, each too vague for continued use. The label computer-aided composition lacks the specificity of using generative algorithms. Music produced with notation or sequencing software could easily be considered computer-aided composition. The label algorithmic composition is likewise too broad, particularly in that it does not specify the use of a computer. The term computer-aided, rather than computer-assisted, is used in the same manner as computer-aided design.
Machine improvisation uses computer algorithms to create improvisation on existing music materials. This is usually done by sophisticated recombination of musical phrases extracted from existing music, either live or pre-recorded. In order to achieve credible improvisation in particular style, machine improvisation uses machine learning and pattern matching algorithms to analyze existing musical examples. The resulting patterns are then used to create new variations "in the style" of the original music, developing a notion of stylistic reinjection. This is different from other improvisation methods with computers that use algorithmic composition to generate new music without performing analysis of existing music examples.
Statistical style modeling
Style modeling implies building a computational representation of the musical surface that captures important stylistic features from data. Statistical approaches are used to capture the redundancies in terms of pattern dictionaries or repetitions, which are later recombined to generate new musical data. Style mixing can be realized by analysis of a database containing multiple musical examples in different styles. Machine Improvisation builds upon a long musical tradition of statistical modeling that began with Hiller and Isaacson's Illiac Suite for String Quartet (1957) and Xenakis' uses of Markov chains and stochastic processes. Modern methods include the use of lossless data compression for incremental parsing, prediction suffix tree, string searching and more. Style mixing is possible by blending models derived from several musical sources, with the first style mixing done by S. Dubnov in a piece NTrope Suite using Jensen-Shannon joint source model. Later the use of factor oracle algorithm (basically a factor oracle is a finite state automaton constructed in linear time and space in an incremental fashion) was adopted for music by Assayag and Dubnov and became the basis for several systems that use stylistic re-injection.
The first implementation of statistical style modeling was the LZify method in Open Music, followed by the Continuator system that implemented interactive machine improvisation that interpreted the LZ incremental parsing in terms of Markov models and used it for real time style modeling developed by François Pachet at Sony CSL Paris in 2002. Matlab implementation of the Factor Oracle machine improvisation can be found as part of Computer Audition toolbox. There is also an NTCC implementation of the Factor Oracle machine improvisation.
OMax is a software environment developed in IRCAM. OMax uses OpenMusic and Max. It is based on researches on stylistic modeling carried out by Gerard Assayag and Shlomo Dubnov and on researches on improvisation with the computer by G. Assayag, M. Chemillier and G. Bloch (a.k.a. the OMax Brothers) in the Ircam Music Representations group. One of the problems in modeling audio signals with factor oracle is the symbolization of features from continuous values to a discrete alphabet. This problem was solved in the Variable Markov Oracle (VMO) available as python implementation, using an information rate criteria for finding the optimal or most informative representation.
Live coding (sometimes known as 'interactive programming', 'on-the-fly programming', 'just in time programming') is the name given to the process of writing software in realtime as part of a performance. Recently it has been explored as a more rigorous alternative to laptop musicians who, live coders often feel, lack the charisma and pizzazz of musicians performing live.
- Acousmatic music
- Adaptive music
- Comparison of audio synthesis environments
- Digital audio workstation
- Digital synthesizer
- Electronic music
- Emily Howell
- Fast Fourier transform
- Human–computer interaction
- List of music software
- Module file
- Music information retrieval
- Music Macro Language
- Music notation software
- Music sequencer
- New Interfaces for Musical Expression
- Physical modeling synthesis
- Programming (music)
- Sampling (music)
- Sound and music computing
- Video game music
- Curtis Roads,The Computer Music Tutorial, Boston: MIT Press, Introduction
- Andrew J. Nelson, The Sound of Innovation: Stanford and the Computer Music Revolution, Boston: MIT Press, Introduction
- "Algorhythmic Listening 1949–1962 Auditory Practices of Early Mainframe Computing". AISB/IACAP World Congress 2012. Archived from the original on 7 November 2017. Retrieved 18 October 2017.
- Doornbusch, Paul (9 July 2017). "MuSA 2017 – Early Computer Music Experiments in Australia, England and the USA". MuSA Conference. Retrieved 18 October 2017.
- Doornbusch, Paul (2017). "Early Computer Music Experiments in Australia and England". Organised Sound. Cambridge University Press. 22 (2): 297–307 . doi:10.1017/S1355771817000206.
- Fildes, Jonathan (17 June 2008). "Oldest computer music unveiled". BBC News Online. Retrieved 18 June 2008.
- Doornbusch, Paul (March 2004). "Computer Sound Synthesis in 1951: The Music of CSIRAC". Computer Music Journal. 28 (1): 11–12. doi:10.1162/014892604322970616. S2CID 10593824.
- Doornbusch, Paul. "The Music of CSIRAC". Melbourne School of Engineering, Department of Computer Science and Software Engineering. Archived from the original on 18 January 2012.
- "First recording of computer-generated music – created by Alan Turing – restored". The Guardian. 26 September 2016. Retrieved 28 August 2017.
- "Restoring the first recording of computer music – Sound and vision blog". British Library. 13 September 2016. Retrieved 28 August 2017.
- Lejaren Hiller and Leonard Isaacson, Experimental Music: Composition with an Electronic Computer (New York: McGraw-Hill, 1959; reprinted Westport, Connecticut: Greenwood Press, 1979). ISBN 0-313-22158-8.[page needed]
- Bogdanov, Vladimir (2001). All Music Guide to Electronica: The Definitive Guide to Electronic Music. Backbeat Books. p. 320. ISBN 978-0-87930-628-1. Retrieved 4 December 2013.
- Tenney, James. (1964) 2015. “Computer Music Experiences, 1961–1964.” In From Scratch: Writings in Music Theory. Edited by Larry Polansky, Lauren Pratt, Robert Wannamaker, and Michael Winter. Urbana: University of Illinois Press. 97–127.
- Wannamaker, Robert, The Music of James Tenney, Volume 1: Contexts and Paradigms (University of Illinois Press, 2021), 48–82.
- Shimazu, Takehito (1994). "The History of Electronic and Computer Music in Japan: Significant Composers and Their Works". Leonardo Music Journal. MIT Press. 4: 102–106 . doi:10.2307/1513190. JSTOR 1513190. S2CID 193084745. Retrieved 9 July 2012.
- Cattermole, Tannith (9 May 2011). "Farseeing inventor pioneered computer music". Gizmag. Retrieved 28 October 2011.
In 1957 the MUSIC program allowed an IBM 704 mainframe computer to play a 17-second composition by Mathews. Back then computers were ponderous, so synthesis would take an hour.
- Mathews, Max (1 November 1963). "The Digital Computer as a Musical Instrument". Science. 142 (3592): 553–557. Bibcode:1963Sci...142..553M. doi:10.1126/science.142.3592.553. PMID 17738556.
The generation of sound signals requires very high sampling rates.... A high speed machine such as the I.B.M. 7090 ... can compute only about 5000 numbers per second ... when generating a reasonably complex sound.
- Parolini, Giuditta (2016). "Pietro Grossi's Experience in Electronic and Computer Music by Giuditta Parolini".
- Gaburo, Kenneth (Spring 1985). "The Deterioration of an Ideal, Ideally Deteriorized: Reflections on Pietro Grossi's 'Paganini AI Computer'". Computer Music Journal. 9 (1): 39–44. JSTOR 4617921.
- "Music without Musicians but with Scientists Technicians and Computer Companies". 2019.
- Giomi, Francesco (1995). "The Work of Italian Artist Pietro Grossi: From Early Electronic Music to Computer Art". Leonardo. 28 (1): 35–39. doi:10.2307/1576152. JSTOR 1576152. S2CID 191383265.
- Dean, Roger T. (2009). The Oxford Handbook of Computer Music. Oxford University Press. p. 20. ISBN 978-0-19-533161-5.
- Dean 2009, p. 1
- Dean 2009, pp. 4–5: "... by the 90s ... digital sound manipulation (using MSP or many other platforms) became widespread, fluent and stable."
- Loy, D. Gareth (1992). "Notes on the implementation of MUSBOX...". In Roads, Curtis (ed.). The Music Machine: Selected Readings from 'Computer Music Journal'. MIT Press. p. 344. ISBN 978-0-262-68078-3.
- Doornbusch, Paul. "3: Early Hardware and Early Ideas in Computer Music: Their Development and Their Current Forms". In Dean (2009), pp. 44–80. doi:10.1093/oxfordhb/9780199792030.013.0003
- Berg, Paul (1996). "Abstracting the future: The Search for Musical Constructs". Computer Music Journal. MIT Press. 20 (3): 24–27 . doi:10.2307/3680818. JSTOR 3680818.
- Tangian, Andranik (2003). "Constructing rhythmic canons" (PDF). Perspectives of New Music. 41 (2): 64–92. Retrieved 16 January 2021.
- Tangian, Andranik (2010). "Constructing rhythmic fugues (unpublished addendum to Constructing rhythmic canons)". IRCAM, Seminaire MaMuX, 9 February 2002, Mosaïques et pavages dans la musique (PDF). Retrieved 16 January 2021.
- Tangian, Andranik (2002–2003). "Eine kleine Mathmusik I and II". IRCAM, Seminaire MaMuX, 9 February 2002, Mosaïques et pavages dans la musique. Retrieved 16 January 2021.
- Leach, Ben (22 October 2009). "Emily Howell: the computer program that composes classical music". The Daily Telegraph. Retrieved 6 October 2017.
- Cheng, Jacqui (30 September 2009). "Virtual Composer Makes Beautiful Music and Stirs Controversy". Ars Technica.
- Ball, Philip (1 July 2012). "Iamus, classical music's computer composer, live from Malaga". The Guardian. Archived from the original on 25 October 2013. Retrieved 15 November 2021.
- "Computer composer honours Turing's centenary". New Scientist. 5 July 2012.
- Christopher Ariza: An Open Design for Computer-Aided Algorithmic Music Composition, Universal-Publishers Boca Raton, Florida, 2005, p. 5
- Mauricio Toro, Carlos Agon, Camilo Rueda, Gerard Assayag. "GELISP: A Framework to Represent Musical Constraint Satisfaction Problems and Search Strategies", Journal of Theoretical and Applied Information Technology 86, no. 2 (2016): 327–331.
- Shlomo Dubnov, Gérard Assayag, Olivier Lartillot, Gill Bejerano, "Using Machine-Learning Methods for Musical Style Modeling", Computers, 36 (10), pp. 73–80, October 2003. doi:10.1109/MC.2003.1236474
- Dubnov, S. (1999). "Stylistic randomness: About composing NTrope Suite." Organised Sound, 4(2), 87–92. doi:10.1017/S1355771899002046
- Jan Pavelka; Gerard Tel; Miroslav Bartosek, eds. (1999). Factor oracle: a new structure for pattern matching; Proceedings of SOFSEM'99; Theory and Practice of Informatics. Springer-Verlag, Berlin. pp. 291–306. ISBN 978-3-540-66694-3. Retrieved 4 December 2013.
Lecture Notes in Computer Science 1725
- "Using factor oracles for machine improvisation", G. Assayag, S. Dubnov, (September 2004) Soft Computing 8 (9), 604–610 doi:10.1007/s00500-004-0385-4
- "Memex and composer duets: computer-aided composition using style mixing", S. Dubnov, G. Assayag, Open Music Composers Book 2, 53–66
- G. Assayag, S. Dubnov, O. Delerue, "Guessing the Composer's Mind : Applying Universal Prediction to Musical Style", In Proceedings of International Computer Music Conference, Beijing, 1999.
- ":: Continuator". Archived from the original on 1 November 2014. Retrieved 19 May 2014.
- Pachet, F., The Continuator: Musical Interaction with Style Archived 14 April 2012 at the Wayback Machine. In ICMA, editor, Proceedings of ICMC, pages 211–218, Göteborg, Sweden, September 2002. ICMA.
- Pachet, F. Playing with Virtual Musicians: the Continuator in practice Archived 14 April 2012 at the Wayback Machine. IEEE MultiMedia,9(3):77–82 2002.
- M. Toro, C. Rueda, C. Agón, G. Assayag. "NTCCRT: A concurrent constraint framework for soft-real time music interaction." Journal of Theoretical & Applied Information Technology, vol. 82, issue 1, pp. 184–193. 2015
- "The OMax Project Page". omax.ircam.fr. Retrieved 2 February 2018.
- Guided music synthesis with variable markov oracle C Wang, S Dubnov,, Tenth Artificial Intelligence and Interactive Digital Entertainment Conference, 2014
- S Dubnov, G Assayag, A Cont, "Audio oracle analysis of musical information rate", IEEE Fifth International Conference on Semantic Computing, 567–557, 2011 doi:10.1109/ICSC.2011.106
- Collins, N.; McLean, A.; Rohrhuber, J.; Ward, A. (2004). "Live coding in laptop performance". Organised Sound. 8 (3): 321–330. doi:10.1017/S135577180300030X. S2CID 56413136.
- Wang G. & Cook P. (2004) "On-the-fly Programming: Using Code as an Expressive Musical Instrument", In Proceedings of the 2004 International Conference on New Interfaces for Musical Expression (NIME) (New York: NIME, 2004).
- Collins, Nick (2003). "Generative Music and Laptop Performance". Contemporary Music Review. 22 (4): 67–79. doi:10.1080/0749446032000156919. S2CID 62735944.
- Ariza, C. 2005. "Navigating the Landscape of Computer-Aided Algorithmic Composition Systems: A Definition, Seven Descriptors, and a Lexicon of Systems and Research." In Proceedings of the International Computer Music Conference. San Francisco: International Computer Music Association. 765–772.
- Ariza, C. 2005. An Open Design for Computer-Aided Algorithmic Music Composition: athenaCL. PhD Dissertation, New York University.
- Boulanger, Richard, ed. (6 March 2000). The Csound Book: Perspectives in Software Synthesis, Sound Design, Signal Processing, and Programming. MIT Press. p. 740. ISBN 978-0-262-52261-8. Archived from the original on 2 January 2010. Retrieved 3 October 2009.
- Chadabe, Joel. 1997. Electric Sound: The Past and Promise of Electronic Music. Upper Saddle River, New Jersey: Prentice Hall.
- Chowning, John. 1973. "The Synthesis of Complex Audio Spectra by Means of Frequency Modulation". Journal of the Audio Engineering Society 21, no. 7:526–534.
- Collins, Nick (2009). Introduction to Computer Music. Chichester: Wiley. ISBN 978-0-470-71455-3.
- Dodge, Charles; Jerse (1997). Computer Music: Synthesis, Composition and Performance. Thomas A. (2nd ed.). New York: Schirmer Books. p. 453. ISBN 978-0-02-864682-4.
- Doornbusch, P. 2015. "A Chronology / History of Electronic and Computer Music and Related Events 1906–2015"
- Heifetz, Robin (1989). On the Wires of Our Nerves. Lewisburg, Pennsylvania: Bucknell University Press. ISBN 978-0-8387-5155-8.
- Dorien Herremans; Ching-Hua Chuan; Elaine Chew (November 2017). "A Functional Taxonomy of Music Generation Systems". ACM Computing Surveys. 50 (5): 69:1–30. arXiv:1812.04186. doi:10.1145/3108242. S2CID 3483927.
- Manning, Peter (2004). Electronic and Computer Music (revised and expanded ed.). Oxford Oxfordshire: Oxford University Press. ISBN 978-0-19-517085-6.
- Perry, Mark, and Thomas Margoni. 2010. "From Music Tracks to Google Maps: Who Owns Computer-Generated Works?". Computer Law & Security Review 26: 621–629.
- Roads, Curtis (1994). The Computer Music Tutorial. Cambridge: MIT Press. ISBN 978-0-262-68082-0.
- Supper, Martin (2001). "A Few Remarks on Algorithmic Composition". Computer Music Journal. 25: 48–53. doi:10.1162/014892601300126106. S2CID 21260852.
- Xenakis, Iannis (2001). Formalized Music: Thought and Mathematics in Composition. Harmonologia Series No. 6. Hillsdale, New York: Pendragon. ISBN 978-1-57647-079-4.