Sound and music computing (SMC) is a research field that studies the whole

sound In physics, sound is a vibration that propagates as an acoustic wave, through a transmission medium such as a gas, liquid or solid. In human physiology and psychology, sound is the ''reception'' of such waves and their ''perception'' by the ...

and

music Music is generally defined as the art of arranging sound to create some combination of form, harmony, melody, rhythm or otherwise expressive content. Exact definitions of music vary considerably around the world, though it is an aspect ...

communication chain from a multidisciplinary point of view. By combining scientific, technological and artistic methodologies it aims at understanding, modeling and generating sound and music through computational approaches.

History

The Sound and Music Computing research field can be traced back to the 1950s, when a few experimental composers, together with some engineers and scientists, independently and in different parts of the world, began exploring the use of the new digital technologies for music applications. Since then the SMC research field has had a fruitful history and different terms have been used to identify it.

Computer Music Computer music is the application of computing technology in music composition, to help human composers create new music or to have computers independently create music, such as with algorithmic composition programs. It includes the theory and ap ...

and Music Technology might be the terms that have been used the most, "Sound and Music Computing" being a more recent term. In 1974, the research community established the

International Computer Music Association The International Computer Music Association (ICMA) is an international affiliation of individuals and institutions involved in the technical, creative, and performance aspects of computer music. It serves composers, engineers, researchers and musi ...

and the

International Computer Music Conference The International Computer Music Conference (ICMC) is a yearly international conference for computer music researchers and composers. It is the annual conference of the International Computer Music Association (ICMA). History In 1986, the Inst ...

. In 1977 the

Computer Music Journal ''Computer Music Journal'' is a peer-reviewed academic journal that covers a wide range of topics related to digital audio signal processing and electroacoustic music. It is published on-line and in hard copy by MIT Press. The journal is accompa ...

was founded. The

Center for Computer Research in Music and Acoustics (CCRMA) Stanford University has many centers and institutes dedicated to the study of various specific topics. These centers and institutes may be within a department, within a school but across departments, an independent laboratory, institute or center ...

Stanford University Stanford University, officially Leland Stanford Junior University, is a private research university in Stanford, California. The campus occupies , among the largest in the United States, and enrolls over 17,000 students. Stanford is consider ...

was created in the early 1970s and the Institute for Research and Coordination Acoustic/Music (IRCAM) in

Paris Paris () is the capital and most populous city of France, with an estimated population of 2,165,423 residents in 2019 in an area of more than 105 km² (41 sq mi), making it the 30th most densely populated city in the world in 2020. S ...

in the late 1970s. The Sound and Music Computing term was first proposed in the mid 1990s and it was included in the ACM Computing Classification System. Using this name, in 2004 the

Sound and Music Computing Conference The Sound and Music Computing (SMC) Conference is the forum for international exchanges around the core interdisciplinary topics of Sound and music computing, Sound and Music Computing. The conference is held annually to facilitate the exchange of i ...

was started and also in 2004 a roadmapping initiative was funded by the

European Commission The European Commission (EC) is the executive of the European Union (EU). It operates as a cabinet government, with 27 members of the Commission (informally known as "Commissioners") headed by a President. It includes an administrative body o ...

that resulted in the SMC Roadmap and in the Sound and Music Computing Summer School. With increasing research specialization within the SMC field, a number of focused conferences have been created. Particularly relevant are the

International Conference on Digital Audio Effects The annual International Conference on Digital Audio Effects or DAFx Conference is a meeting of enthusiasts working in research areas on Digital audio, audio signal processing, acoustics, and music related disciplines, who come together to present a ...

, established in 1998, the International Conference on Music Information Retrieval (ISMIR), established in 2000, and the International Conference on New Interfaces for Musical Expression (NIME), established in 2001.

Subfields

The current SMC research field can be grouped into a number of subfields that focus on specific aspects of the sound and music communication chain. * ''Processing of sound and music signals'': This subfield focuses on audio signal processing techniques for the analysis, transformation and resynthesis of sound and music signals. * ''Understanding and modeling sound and music'': This subfield focuses on understanding and modeling sound and music using computational approaches. Here we can include

Computational musicology Computational musicology is an interdisciplinary research area between musicology and computer science. Computational musicology includes any disciplines that use computers in order to study music. It includes sub-disciplines such as mathematical m ...

, Music information retrieval, and the more computational approaches of Music cognition. * ''Interfaces for sound and music'': This subfield focuses on the design and implementation of computer interfaces for sound and music. This is basically related to

Human Computer Interaction Humans (''Homo sapiens'') are the most abundant and widespread species of primate, characterized by bipedalism and exceptional cognitive skills due to a large and complex brain. This has enabled the development of advanced tools, culture, an ...

. * ''Assisted sound and music creation'': This subfield focuses on the development of computer tools for assisting Sound design and

Music composition Musical composition can refer to an original piece or work of music, either vocal or instrumental, the structure of a musical piece or to the process of creating or writing a new piece of music. People who create new compositions are called c ...

. Here we can include traditional fields like Algorithmic composition.

Areas of application

SMC research is a field driven by applications. Examples of applications are: * ''Digital music instruments'': This application focuses on musical sound generation and processing devices. It encompasses simulation of traditional instruments, transformation of sound in recording studios or at live performances and musical interfaces for augmented or collaborative instruments. * ''Music production'': This application domain focuses on technologies and tools for music composition. Applications range from music modeling and generation to tools for music post–production and audio editing. * ''Music information retrieval'': This application domain focuses on retrieval technologies for music (both audio and symbolic data). Applications range from music audio–identification and broadcast monitoring to higher–level semantic descriptions and all associated tools for search and retrieval. * ''Digital music libraries'': This application places particular emphasis on preservation, conservation and archiving and the integration of musical audio content and meta–data descriptions, with a focus on flexible access. Applications range from large distributed libraries to mobile access platforms. * ''Interactive multimedia systems'': These are for use in everyday appliances and in artistic and entertainment applications. They aim to facilitate music–related human–machine interaction involving various modalities of action and perception (e.g. auditory, visual, olfactory, tactile, haptic, and all kinds of body movements) which can be captured through the use of audio/visual, kinematic and bioparametric (skin conduction, temperature) devices. * ''Auditory interfaces'': These include all applications where non–verbal sound is employed in the communication channel between the user and the computing device. Auditory displays are used in applications and objects that require monitoring of some type of information. Sonification is used as a method for data display in a wide range of application domains where auditory inspection, analysis and summarisation can be more efficient than traditional visual display.

Sonic interaction design Sonic interaction design is the study and exploitation of sound as one of the principal channels conveying information, meaning, and aesthetic/emotional qualities in interactive contexts. Sonic interaction design is at the intersection of interacti ...

emphasizes the role of sound in interactive contexts. * ''Augmented action and perception'': This refers to tools that increase the normal action and perception capabilities of humans. The system adds virtual information to a user's sensory perception by merging real images, sounds, and haptic sensation with virtual ones. This has the effect of augmenting the user's sense of presence, and of making possible a symbiosis between her view of the world and the computer interface. Possible applications are in the medical domain, manufacturing and repair, entertainment, annotation and visualization, and robot tele-operation.