麻豆村

AI can write songs, but still has a way to go before matching the creativity of tunes made by people, according to 麻豆村 research.听

An interdisciplinary team examined what's missing when algorithms replace human experience, finding that AI-assisted music was slower, used fewer notes and was judged by listeners as less creative.

Generative AI tools use large language models (LLMs), systems that learn from text and can create things 鈥� like stories, answers, or even music 鈥� based on user instructions.

鈥淲e鈥檙e trying to understand how these tools shape music and if they can support creative ideation when composing songs,鈥� said Jose Oros, who is working toward a doctorate degree in information systems from the听.

Oros worked with听, Trustees Professor of Information Systems at Heinz College, and听Richard Randall(opens in new window), associate professor of music theory in the听 in the听College of Fine Arts(opens in new window).听

Oros initiated a study where 140 musically trained participants created a 15-second melody with a small piano keyboard. Randomly selected participants were given access to a generative-AI platform called Udio, which they could use to generate tunes from text prompts for inspiration, while others wrote their own melodies without AI assistance.

Then, the melodies were all judged by another group based on creativity, enjoyment and musicality.

鈥淎 lot of studies on the effect of AI focus on productivity, but creativity and novelty are central outcomes that we care about in music and the arts in general,鈥� Oros said. 鈥淭hese tools are being developed with the promise of improving creativity or having a social benefit, so if these tools are not helping, then that has important implications. If these tools are helping, then we may want to enable their development.鈥�

How is AI already being incorporated into music?

Music generated by AI has already been making headlines. An R&B avatar, Xania Monet, earned enough airplay to听. AI-generated indie rock band Velvet Sundown released two albums and听 on Spotify. AI-generated country acts Cain Walker and Breaking Rust have听.

However, singer-songwriter Teddy Swims听 his use of AI tools, touting how they can save artists time, and how he considered reworking a song generated with AI to sound like him. Similarly, Harvey Mason Jr., CEO of the Recording Academy, which hosts the Grammy Awards, recently听 nominations for music created with AI would be eligible for the honors, with consideration in the right categories.

At Carnegie Mellon, researchers have developed a new kind of听text-to-music artificial intelligence interface(opens in new window), helped听 and听.

, assistant professor in the听 in the听 at 麻豆村, discussed his work on a recent episode of the SCS podcast听听

Donahue, with a background in computer science and music, leads the听 and has developed tools such as PianoGenie听 with Google AI and rock band The Flaming Lips.

He oversaw the creation of听, a tool meant to allow people to collaborate with AI to write songs. The platform allows someone to upload images, text or audio and transform it into musical chord progressions.

Donahue said he hopes his work allows for more innovation in both fields.听

鈥淚 do believe at some point AI systems will be able to generate a waveform that evokes the same kinds of captivating interests that human-created music currently does,鈥� he said on the podcast. 鈥淯ltimately, it鈥檚 still human intentionality driving those systems that is going to continue to be the focus of the foreground of the human music experience.鈥�

What makes music human?

In the future, as with other technological advances such as the radio, vinyl records or digital streaming, Randall said AI will affect how and when listeners engage with music.听

鈥淗umans create music out of their own personal experiences and inspirations, and that resonates with some people, creating a relationship between the music, the artist and the listener,鈥� he said.

Randall leads the听 at Carnegie Mellon, which seeks to understand the essential role music plays in our lives. His research is multidisciplinary and investigates not only how music is produced and performed, but also how it is understood by listeners.

鈥淢usic is a verb. It鈥檚 not a noun. It鈥檚 not a thing sitting on a table. It鈥檚 something we do and we can express this 鈥榙oing鈥� in a lot of different ways, and music takes a lot of different activities to make it happen,鈥� Randall said. 鈥淚t's all part of the musical ecosystem.鈥�

How could AI become a music industry disruptor?

Yet, tools such as Udio, capable of producing radio-ready tracks from just a few words, increase overall accessibility to creating music. Want an 鈥�80s-style rock anthem about monkeys on the moon? Just type in.听

鈥淕enerative AI is so evident as a disruptor in music,鈥� Oros said. 鈥淚t lowers the bar for people with low musical knowledge to get into creating music.鈥澨�

When it comes to where the LLM draws from to create those tunes, Telang said these music-generation platforms have ethical questions to consider about copyright infringement and compensation similar to those surrounding how OpenAI鈥檚 ChatGPT听.

鈥淗ow do they create the tunes? They have to train their model on some sort of corpus,鈥� he said. 鈥淭he accusation 鈥� and I鈥檓 using the word 鈥榓ccusation鈥� without being specific 鈥� by the music, book and movie publishers is that these platforms are training the data on copyrighted content without compensation.鈥�

Oros, who in the past interned with both Spotify and Pandora, pointed out that AI companies claim that the LLM is only doing what a human is doing: integrating a lot of knowledge and generating something new from it.

What could happen if AI-generated songs 鈥� cheap to produce and easy to distribute 鈥� flood the market?

鈥淲hat happens to the human creators?鈥� Oros said. 鈥淚n this way, this new technology is having a large impact on both the production and consumption of music.鈥�

Randall said some consumers are trying to combat this by spending more time seeing live music, however, ticket prices have been rising in a way that discourages others.

鈥淟ive performance is the ground truth of the music process, largely everything recorded is a reflection of that,鈥� he said. 鈥淲e really have to make it clear what鈥檚 at stake for people to understand that live music is important.鈥�

Could inspiration from AI create better music?

The researchers agreed this is only the start of examining these topics that could eventually inform policymakers on how to tackle these questions. And the collaborative, interdisciplinary approach at Carnegie Mellon makes it the perfect place to help answer them.

鈥淭here isn鈥檛 any knowledge about this yet,鈥� Randall said. 鈥淲e don鈥檛 know how AI is affecting human creativity, especially musical creativity, so this is a watershed paper that is very granular, good, basic research beginning a mode of inquiry I hope will continue.鈥�

Oros presented the work as a poster at the Conference on Digital Experimentation at the Massachusetts Institute of Technology in November and will defend his thesis in May.

Future research could more closely examine the demand for and perceptions of AI-generated music, such as if it changes people鈥檚 enjoyment of the music. For now, though, Telang said using these music-generating platforms for inspiration could be more beneficial than considering them for overall creation.

鈥淎ll I鈥檓 doing is giving it an idea to explore or experiment with,鈥� he said. 鈥淭his ideation then allows the human being to create music that is better, or that is beneficial to society.鈥�

Music and technology will continue to evolve, but the inherent ingenuity and innovation necessary to create it will endure, Randall said.

鈥淚 don鈥檛 think there鈥檚 a limit to human creativity,鈥� he said. 鈥淭he ways humans shape pitches, not just how they combine them, but how they shape the sounds of them, how they organize them in time, the rhythmic pullbacks, delays and pushes, that someone adds 鈥� it鈥檚 not formulaic.鈥�

On the other hand, there is a limit to AI-generated music.

鈥淚t鈥檚 always going to be derivative in some way, it鈥檚 always going to be playing it safe,鈥� he said. 鈥淗umans are not constrained by that.鈥�