Artificial intelligence and music (AIM) is a common subject in the

International Computer Music Conference The International Computer Music Conference (ICMC) is a yearly international conference for computer music researchers and composers. It is the annual conference of the International Computer Music Association (ICMA). History In 1986, the Inst ...

, the Computing Society Conference and the

International Joint Conference on Artificial Intelligence The International Joint Conference on Artificial Intelligence (IJCAI) is the leading conference in the field of Artificial Intelligence. The conference series has been organized by the nonprofit IJCAI Organization since 1969, making it the oldest p ...

. The first International Computer Music Conference (ICMC) was held in 1974 at

Michigan State University Michigan State University (Michigan State, MSU) is a public university, public Land-grant university, land-grant research university in East Lansing, Michigan. It was founded in 1855 as the Agricultural College of the State of Michigan, the fi ...

. Current research includes the application of AI in

music composition Musical composition can refer to an original piece or work of music, either vocal or instrumental, the structure of a musical piece or to the process of creating or writing a new piece of music. People who create new compositions are called c ...

performance A performance is an act of staging or presenting a play, concert, or other form of entertainment. It is also defined as the action or process of carrying out or accomplishing an action, task, or function. Management science In the work place ...

, theory and digital

sound processing Audio signal processing is a subfield of signal processing that is concerned with the electronic manipulation of audio signals. Audio signals are electronic representations of sound waves—longitudinal waves which travel through air, consisti ...

. A key part of this field is the development of

music software This is a list of software for creating, performing, learning, analyzing, researching, broadcasting and editing music. This article only includes software, not services. For streaming services such as iHeartRadio, Pandora, Prime Music, and Spotify, ...

programs which use AI to produce music. As with applications in other fields, AI in music also simulates mental tasks. A prominent feature is the capability of an AI algorithm to learn based on past data, such as in computer accompaniment technology, wherein the AI is capable of listening to a human performer and performing accompaniment. Artificial intelligence also drives interactive composition technology, wherein a computer composes music in response to a live performance. There are other AI applications in music that cover not only music composition, production, and performance but also how music is marketed and consumed. Several music player programs have also been developed to use voice recognition and natural language processing technology for music voice control.

History

In 1960, Russian researcher Rudolf Zaripov published worldwide first paper on algorithmic music composing using the " Ural-1" computer. In 1965, inventor

Ray Kurzweil Raymond Kurzweil ( ; born February 12, 1948) is an American computer scientist, author, inventor, and futurist. He is involved in fields such as optical character recognition (OCR), text-to-speech synthesis, speech recognition technology, and e ...

premiered a piano piece created by a computer that was capable of pattern recognition in various compositions. The computer was then able to analyze and use these patterns to create novel melodies. The computer debuted on the quiz show

I've Got a Secret ''I've Got a Secret'' is an American panel game show produced by Mark Goodson and Bill Todman for CBS television. Created by comedy writers Allan Sherman and Howard Merrill, it was a derivative of Goodson-Todman's own panel show, ''What's My Line ...

, and stumped the hosts until film star

Henry Morgan Sir Henry Morgan ( cy, Harri Morgan; – 25 August 1688) was a privateer, plantation owner, and, later, Lieutenant Governor of Jamaica. From his base in Port Royal, Jamaica, he raided settlements and shipping on the Spanish Main, becoming wea ...

guessed Ray's secret. In 1997, an artificial intelligence program named Experiments in Musical Intelligence (EMI) appeared to outperform a human composer at the task of composing a piece of music to imitate the style of

Bach Johann Sebastian Bach (28 July 1750) was a German composer and musician of the late Baroque period. He is known for his orchestral music such as the '' Brandenburg Concertos''; instrumental compositions such as the Cello Suites; keyboard w ...

Software applications

Interactive scores

Multimedia Scenarios in interactive scores are represented by temporal objects, temporal relations, and interactive objects. Examples of temporal objects are sounds, videos and light controls. Temporal objects can be triggered by interactive objects (usually launched by the user) and several temporal objects can be executed simultaneously. A temporal object may contain other temporal objects: this hierarchy allows us to control the start or end of a temporal object by controlling the start or end of its parent. Hierarchy is ever-present in all kinds of music: Music pieces are often hierarchized by movements, parts, motives, measures, among other segmentations.

Computer Accompaniment (Carnegie Mellon University)

The Computer Music Project at CMU develops computer music and interactive performance technology to enhance human musical experience and creativity. This interdisciplinary effort draws on

Music Theory Music theory is the study of the practices and possibilities of music. ''The Oxford Companion to Music'' describes three interrelated uses of the term "music theory". The first is the "rudiments", that are needed to understand music notation (ke ...

, Cognitive Science,

Artificial Intelligence Artificial intelligence (AI) is intelligence—perceiving, synthesizing, and inferring information—demonstrated by machines, as opposed to intelligence displayed by animals and humans. Example tasks in which this is done include speech re ...

and

Machine Learning Machine learning (ML) is a field of inquiry devoted to understanding and building methods that 'learn', that is, methods that leverage data to improve performance on some set of tasks. It is seen as a part of artificial intelligence. Machine ...

Human Computer Interaction Humans (''Homo sapiens'') are the most abundant and widespread species of primate, characterized by bipedalism and exceptional cognitive skills due to a large and complex brain. This has enabled the development of advanced tools, culture, an ...

Real-Time Systems Real-time computing (RTC) is the computer science term for hardware and software systems subject to a "real-time constraint", for example from event to system response. Real-time programs must guarantee response within specified time constrai ...

Computer Graphics Computer graphics deals with generating images with the aid of computers. Today, computer graphics is a core technology in digital photography, film, video games, cell phone and computer displays, and many specialized applications. A great de ...

and Animation,

Multimedia Multimedia is a form of communication that uses a combination of different content forms such as text, audio, images, animations, or video into a single interactive presentation, in contrast to tradition ...

Programming Languages A programming language is a system of notation for writing computer programs. Most programming languages are text-based formal languages, but they may also be graphical. They are a kind of computer language. The description of a programming ...

, and

Signal Processing Signal processing is an electrical engineering subfield that focuses on analyzing, modifying and synthesizing ''signals'', such as audio signal processing, sound, image processing, images, and scientific measurements. Signal processing techniq ...

ChucK

Developed at Princeton University by Ge Wang and Perry Cook, ChucK is a text-based, cross-platform language that allows real-time synthesis, composition, performance, and analysis of music. It is used by

SLOrk A laptop orchestra (lork or LO) or laptop ensemble (LE) is a chamber music ensemble consisting primarily of laptops. Education based laptop orchestras include BLOrk (University of Colorado Boulder Laptop Orchestra), CLOrk (Concordia Laptop Orc ...

(Stanford Laptop Orchestra) and

PLOrk A laptop orchestra (lork or LO) or laptop ensemble (LE) is a chamber music ensemble consisting primarily of laptops. Education based laptop orchestras include BLOrk (University of Colorado Boulder Laptop Orchestra), CLOrk (Concordia Laptop Orch ...

(Princeton Laptop Orchestra).

Jukedeck

Jukedeck was a website that let people use artificial intelligence to generate original, royalty-free music for use in videos. The team started building the music generation technology in 2010, formed a company around it in 2012, and launched the website publicly in 2015. The technology used was originally a rule-based

algorithmic composition Algorithmic composition is the technique of using algorithms to create music. Algorithms (or, at the very least, formal sets of rules) have been used to compose music for centuries; the procedures used to plot voice-leading in Western counterpoin ...

system, which was later replaced with

artificial neural networks Artificial neural networks (ANNs), usually simply called neural networks (NNs) or neural nets, are computing systems inspired by the biological neural networks that constitute animal brains. An ANN is based on a collection of connected unit ...

. The website was used to create over 1 million pieces of music, and brands that used it included

Coca-Cola Coca-Cola, or Coke, is a carbonated soft drink manufactured by the Coca-Cola Company. Originally marketed as a temperance drink and intended as a patent medicine, it was invented in the late 19th century by John Stith Pemberton in Atlanta ...

Google Google LLC () is an American multinational technology company focusing on search engine technology, online advertising, cloud computing, computer software, quantum computing, e-commerce, artificial intelligence, and consumer electronics. ...

UKTV UKTV Media Limited, simply known as UKTV, is a British multi-channel broadcaster, which, since 2019, has been wholly owned by BBC Studios (formerly BBC Worldwide), a commercial subsidiary of the BBC. It was formed on 1 November 1992 through ...

, and the

Natural History Museum, London The Natural History Museum in London is a museum that exhibits a vast range of specimens from various segments of natural history. It is one of three major museums on Exhibition Road in South Kensington, the others being the Science Museum an ...

. In 2019, the company was acquired by

ByteDance ByteDance Ltd. () is a Chinese internet technology company headquartered in Beijing and incorporated in the Cayman Islands. Founded by Zhang Yiming, Liang Rubo and a team of others in 2012, ByteDance developed the video-sharing social networking ...

MorpheuS

MorpheuS is a research project by Dorien Herremans and Elaine Chew at

Queen Mary University of London , mottoeng = With united powers , established = 1785 – The London Hospital Medical College1843 – St Bartholomew's Hospital Medical College1882 – Westfield College1887 – East London College/Queen Mary College , type = Public researc ...

, funded by a Marie Skłodowská-Curie EU project. The system uses an optimization approach based on a

variable neighborhood search Variable neighborhood search (VNS), proposed by Mladenović & Hansen in 1997, is a metaheuristic method for solving a set of combinatorial optimization and global optimization problems. It explores distant neighborhoods of the current incumbent sol ...

algorithm to morph existing template pieces into novel pieces with a set level of tonal tension that changes dynamically throughout the piece. This optimization approach allows for the integration of a pattern detection technique in order to enforce long term structure and recurring themes in the generated music. Pieces composed by MorpheuS have been performed at concerts in both Stanford and London.

AIVA

Created in February 2016, in

Luxembourg Luxembourg ( ; lb, Lëtzebuerg ; french: link=no, Luxembourg; german: link=no, Luxemburg), officially the Grand Duchy of Luxembourg, ; french: link=no, Grand-Duché de Luxembourg ; german: link=no, Großherzogtum Luxemburg is a small lan ...

, AIVA is a program that produces soundtracks for any type of media. The algorithms behind AIVA are based on deep learning architectures AIVA has also been used to compose a Rock track called ''On the Edge'', as well as a pop tune ''Love Sick'' in collaboration with singer

Taryn Southern Taryn Southern is a storyteller, artist, speaker and brand strategist who works with emerging technologies. She was formerly known for her work as a TV host, actress and YouTuber. Early life Southern grew up in Wichita, Kansas and landed her firs ...

, for the creation of her 2018 album "I am AI".

Google Magenta

Google's Magenta team has published several AI music applications and technical papers since their launch in 2016. In 2017 they released the NSynth algorithm and dataset, and an

open source Open source is source code that is made freely available for possible modification and redistribution. Products include permission to use the source code, design documents, or content of the product. The open-source model is a decentralized sof ...

hardware musical instrument, designed to facilitate musicians in using the algorithm. The instrument was used by notable artists such as

Grimes Claire Elise Boucher (; born March 17, 1988), known professionally as Grimes, is a Canadian musician, singer, songwriter, and record producer. Her early work has been described as extending from "lo-fi R&B" to futuristic dance-pop, and has in ...

and

YACHT A yacht is a sailing or power vessel used for pleasure, cruising, or racing. There is no standard definition, though the term generally applies to vessels with a cabin intended for overnight use. To be termed a , as opposed to a , such a pleasu ...

in their albums. In 2018, they released a piano improvisation app called Piano Genie. This was later followed by Magenta Studio, a suite of 5 MIDI plugins that allow music producers to elaborate on existing music in their DAW. In 2023, their machine learning team published a technical paper on Github that described MusicLM, a private text-to-music generator developed.

Riffusion

Copyright

The question of who owns the copyright to AI music outputs remain uncertain. When AI is used as a collaborative tool as a function of the human creative process, current US copyright laws are likely to apply. However, music outputs solely generated by AI are not granted copyright protection. In the Compendium of U.S. Copyright Office Practices, the Copyright Office has stated that it would not grant copyrights to “works that lack human authorship” and “the Office will not register works produced by a machine or mere mechanical process that operates randomly or automatically without any creative input or intervention from a human author.” In February 2022, the Copyright Review Board rejected an application to copyright AI-generated artwork on the basis that it "lacked the required human authorship necessary to sustain a claim in copyright."

References

External links

The Music Informatics Research Group
* ttps://web.archive.org/web/20190330070355/http://www.leeds.ac.uk/icsrim/ Interdisciplinary Centre for Research in Musicbr>OpenDream
{{DEFAULTSORT:Music And Artificial Intelligence Artificial intelligence art Cognitive musicology Computer music