HOME

TheInfoList



OR:

A networked music performance or network musical performance is a real-time interaction over a
computer network A computer network is a set of computers sharing resources located on or provided by network nodes. The computers use common communication protocols over digital interconnections to communicate with each other. These interconnections are ...
that enables musicians in different locations to perform as if they were in the same room. These interactions can include performances, rehearsals, improvisation or jamming sessions, and situations for learning such as
master classes A master class is a class given to students of a particular discipline by an expert of that discipline—usually music, but also science, painting, drama, games, or on any other occasion where skills are being developed. "Masterclass" is also ...
. Participants may be connected by "high fidelity multichannel audio and video links" as well as
MIDI MIDI (; Musical Instrument Digital Interface) is a technical standard that describes a communications protocol, digital interface, and electrical connectors that connect a wide variety of electronic musical instruments, computers, and ...
data connections and specialized collaborative software tools. While not intended to be a replacement for traditional live stage performance, networked music performance supports musical interaction when co-presence is not possible and allows for novel forms of music expression. Remote audience members and possibly a conductor may also participate.


History

One of the earliest examples of a networked music performance experiment was the 1951 piece: “ Imaginary Landscape No. 4 for Twelve Radios” by composer John Cage. The piece “used radio transistors as a musical instrument. The transistors were interconnected thus influencing each other.” In the late 1970s, as personal computers were becoming more available and affordable, groups like the League of Automatic Music Composers began to experiment with linking multiple computers, electronic instruments, and analog circuitry to create novel forms of music. The 1990s saw several important experiments in networked performance. In 1993, The
University of Southern California , mottoeng = "Let whoever earns the palm bear it" , religious_affiliation = Nonsectarian—historically Methodist , established = , accreditation = WSCUC , type = Private research university , academic_affiliations = , endowment = $8.1 ...
Information Sciences Institute began experimenting with networked music performance over the Internet.
The Hub (band) The Hub is an American "computer network music" ensemble formed in 1986 consisting of John Bischoff, Tim Perkis, Chris Brown, Scot Gresham-Lancaster, Mark Trayle and Phil Stone. "The Hub was the first live computer music band whose members were ...
, which was formed by original members of The League of Automatic Composers, experimented in 1997 with sending MIDI data over ethernet to distributed locations. However, “ it was more difficult than imagined to debug all of the software problems on each of the different machines with different operating systems and CPU speeds in different cities”. In 1998, there was a three-way audio-only performance between musicians in
Warsaw Warsaw ( pl, Warszawa, ), officially the Capital City of Warsaw,, abbreviation: ''m.st. Warszawa'' is the capital and largest city of Poland. The metropolis stands on the River Vistula in east-central Poland, and its population is officia ...
,
Helsinki Helsinki ( or ; ; sv, Helsingfors, ) is the capital, primate, and most populous city of Finland. Located on the shore of the Gulf of Finland, it is the seat of the region of Uusimaa in southern Finland, and has a population of . The city ...
, and
Oslo Oslo ( , , or ; sma, Oslove) is the capital and most populous city of Norway. It constitutes both a county and a municipality. The municipality of Oslo had a population of in 2022, while the city's greater urban area had a population ...
dubbed “Mélange à trois”. The early distributed performances all faced problems such as network delay, issues synchronizing signals, echo, and troubles with the acquisition and rendering of non-immersive audio and video. The development of high-speed internet over provisioned backbones, such as
Internet2 Internet2 is a not-for-profit United States computer networking consortium led by members from the research and education communities, industry, and government. The Internet2 consortium administrative headquarters are located in Ann Arbor, Mi ...
, made high quality audio links possible beginning in the early 2000s. One of the first research groups to take advantage of the improved network performance was the SoundWIRE group at Stanford University's
CCRMA Stanford University has many centers and institutes dedicated to the study of various specific topics. These centers and institutes may be within a department, within a school but across departments, an independent laboratory, institute or center ...
. That was soon followed by projects such as the Distributed Immersive Performance experiments, SoundJack, and DIAMOUSES.


Awareness in musical performance

Workspace awareness in a face-to-face situation is gathered through consequential communication, feedthrough, and intentional communication. A traditional music performance setting is an example of very tightly-coupled, synergistic collaboration in which participants have a high level of workspace awareness. “Each player must not only be conscious of his or her own part, but also of the parts of other musicians. The other musicians' gestures, facial expressions and bodily movements, as well as the sounds emitted by their instruments reclues to meanings and intentions of others”. Research has indicated that musicians are also very sensitive to the acoustic response of the environment in which they are performing. Ideally a networked music performance system would facilitate the high level of awareness that performers experience in a traditional performance setting.


Technical issues in networked music performance

Bandwidth demand, latency sensitivity, and a strict requirement for audio stream synchronization are the factors that make networked music performance a challenging application. These factors are described in more detail below.


Bandwidth

High definition audio streaming, which is used to make a networked music performance as realistic as possible, is considered to be one of the most bandwidth-demanding uses of today's networks.


Latency

One of the major issues with networked music performance is that latency is introduced into the audio as it is processed by a participant's local system and sent across the network. For interaction in a networked music performance to feel natural, the latency generally must be kept below 30 milliseconds, the bound of human perception. If there is too much delay in the system, it will make performance very difficult since musicians adjust their playing to coordinate the performance based on the sounds they hear created by other players. However, the characteristics of the piece being played, the musicians, and the types of instruments used ultimately define the tolerance. Synchronization cues may be used in a network music performance system that is designed for long latency situations.


Audio stream synchronization

Both end systems and networks must synchronize multiple audio streams from separate locations to form a consistent presentation of the music. This is a challenging problem for today's systems.


Objectives of a networked music performance system

The objectives of a networked music performance can be summarized as: * It should allow musicians and possibly audience members and/or a conductor to collaborate from remote locations * It should create a realistic immersive virtual space for synchronous, interactive performance * It should support workspace awareness that allows participants to be aware of the actions of others in the virtual workspace and facilitate all forms of communication


Current research


SoundWIRE at CCRMA, Stanford University

The SoundWIRE research group explores several research areas in the use of networks for music performance including: multi-channel audio streaming, physical models and virtual acoustics, the sonification of network performance, psychoacoustics, and networked music performance practice. The group has developed a software system, JackTrip, that supports multi-channel, high quality, uncompressed streaming audio for networked music performance over the internet.


The Sonic Arts Research Centre

The Sonic Arts Research Centre (SARC) at Queen’s University Belfast has been a major player in carrying out network performances since 2006 and has been active in the use of networks as both collaborative and performance tools. The network team at SARC is led by Prof Pedro Rebelo and Dr Franziska Schroeder with varying set-ups of performers, instruments and compositional strategies. A group of artists and researchers has emerged around this field of distributed creativity at SARC and this has helped create a broader knowledge base and focus for activities. As a result, since 2007 SARC has a dedicated team of staff and students with knowledge and experience of network performance, which SARC refers to as “Distributed Creativity”. Regular performances, workshops and collaborations with institutions such as SoundWire, CCRMA Stanford University, and RPI, led by composer and performer Pauline Oliveros, as well as with the University of São Paulo, have helped strengthen this emerging community of researchers and practitioners. The field is related to research on distributed creativity.


Distributed Immersive Performance (DIP) experiments

The Distributed Immersive Performance project is based at the Integrated Media Systems Center at the University of Southern California. Their experiments explore the challenges of creating a seamless environment for remote, synchronous collaboration. The experiments use 3D audio with correct spatial sound localization as well as HD or DV video projected onto wide screen displays to create an immersive virtual space. There are interaction sites set up at various locations on the University of Southern California campus and at several partner locations such as the New World Symphony in Miami Beach, Florida.


DIAMOUSES

The DIAMOUSES project is coordinated by the Music Informatics Lab at the Technological Education Institution of Crete in Hellas. It supports a wide range of networked music performance scenarios with a customizable platform that handles the broadcasting and synchronization of audio and video signals across a network.


Wireless Music Studio (WeMUST)

The A3Lab team at Università Politecnica delle Marche conducts research on the use of the wireless medium for uncompressed audio networking in the NMP context. A mix of open source software, ARM platforms and dedicated wireless equipment have been documented, especially for outdoor use, where buildings of historical importance or difficult environments (e.g. sea) can be explored for the performance. A premiere of the system have been conducted with musicians playing a Stockhausen composition on different boats over the coast in Ancona, Italy. The project also aims at shifting music computing from laptops to embedded devices.


See also

*
Internet band An Internet band, also called an online band, is a musical group whose members collaborate online through broadband by utilizing a content management system and local digital audio workstations. The work is sometimes released under a Creative Com ...
*
CSCW Computer-supported cooperative work (CSCW) is the study of how people utilize technology collaboratively, often towards a shared goal. CSCW addresses how computer systems can support collaborative activity and coordination. More specifically, the ...
* CELT and
Opus ''Opus'' (pl. ''opera'') is a Latin word meaning "work". Italian equivalents are ''opera'' (singular) and ''opere'' (pl.). Opus or OPUS may refer to: Arts and entertainment Music * Opus number, (abbr. Op.) specifying order of (usually) publicatio ...
codecs designed for these applications *
Computer music Computer music is the application of computing technology in music composition, to help human composers create new music or to have computers independently create music, such as with algorithmic composition programs. It includes the theory and ...
*
Jamulus Jamulus is open source (GPL) networked music performance software that enables live rehearsing, jamming and performing with musicians located anywhere on the internet. Jamulus is written by Volker Fischer and contributors using C++. The Software ...
* RTP-MIDI * Comparison of Remote Music Performance Software
SoundJack


References

{{Reflist


External links


Network Music Bibliography at Mendeley
Computer networking