IE 11 is not supported. For an optimal experience visit our site on another browser.

DARPA Wants to Make a Jazz-Playing Robot That Can Jam With Humans

Jazz-playing computers and robots could soon yield clues about how to help people collaborate with machines.
Get more newsLiveon

Jazz-playing computers and robots could soon yield clues about how to help people collaborate with machines, researchers say.

The new project, called MUSICA (short for Musical Improvising Collaborative Agent), aims to develop a musical device that can improvise a jazz solo in response to human partners, just as real jazz musicians improvise alongside one another.

MUSICA is part of a new program from the Defense Advanced Research Projects Agency (DARPA), the branch of the U.S. military responsible for developing new technologies. The project is designed to explore new ways that people can interact with computers and robots. [Super-Intelligent Machines: 7 Robotic Futures]

"There is definitely a desire for more natural kinds of communications with computational systems as they grow in their ability to be intelligent," Ben Grosser, an assistant professor of new media at the University of Illinois at Urbana-Champaign, told Live Science. "A lot of us are familiar with various methods of interacting with computers, such as text-based and touch-based interfaces, but language-based interfaces such as Siri or Google Now are extremely limited in their capabilities."

Grosser and his colleague Kelland Thomas, an associate professor of music at the University of Arizona, are developing MUSICA to explore how people can communicate with one another without language. "That could make interactions between humans and machines a lot deeper," said Grosser, who himself is a jazz trumpeter. "When it comes to jazz, you feel the music as much as you hear and think about it — you react instinctively to things that are going on."

Related: Robotic Drumming Prosthesis Gives Musician an Extra Hand

To develop a machine capable of playing improvisational jazz, the researchers will create a database of jazz solos from a variety of musicians and have computers analyze the recordings to figure out the various processes that come into play when a musician improvises. The researchers will then develop a performance system to analyze the components of human jazz performances, including the beat, pitch, harmony and rhythm. The system will also consider what it has learned about jazz solos to communicate and respond musically in real time.

Related: Hover Band: Flying Drones Play Classical Music Medley

"Our goal is to by next summer present a 'call and answer' system to DARPA, where I can play a line of music, and the system will analyze that line and give an answer as close to real time as possible," Grosser said.

This is a condensed version of a report from Live Science. Read the full report. Follow Live Science @livescience, Facebook & Google+.

More from Live Science

Copyright 2015 LiveScience, a Purch company. All rights reserved. This material may not be published, broadcast, rewritten or redistributed.