Toscanini gestural computer interface controls music-making and more

[From MIT’s Technology Review TechSpecs blog; a 1:08 minute video is available here]

A Minority Report Interface for the Rest of Us

You don’t have to be rich like Tom Cruise to rock a gestural interface.

John Pavlus 11/16/2010

Gestural computing: ever since a be-gloved Tom Cruise blew everyone’s minds in Minority Report, interface dorks have been trying hard to bring it into the real world. But here’s the problem: who actually wants to spend their whole workday wildly waving their arms around?

Well, musicians and dancers just might. That’s the idea behind Toscanini, a gestural computer interface named after the famously gesticulative Italian conductor.

And here’s the best part: unlike those room-sized setups you’ve seen on TED talks, Toscanini fits a ramen-noodle-sized budget. The free software runs on Texas Instruments’ “Wireless Watch Development Tool” — an accelerometer-equipped, programmable sports watch that costs just $50.

So what the hell does it do? Basically, it provides a bridge between your movements and digital instruments like synthesizers and keyboards — or anything else you can control from your computer through a MIDI connection. Think of it like Microsoft Kinect, but for making weird performance art instead of playing Xbox.

“Currently it acts like a MIDI keyboard, except you can control the knobs with your movements,” says Lindsey Mysse, who co-created Toscanini during a 24-hour hacking contest. “But it doesn’t have to make music. It can control a mouse. You just put it on your wrist and make something happen.”

Granted, you’ll have to be something of a hacker to truly take advantage of Toscanini’s power — the software is in alpha and uses a visual programming language called Max/MSP. But that’s the whole point, says co-creator Robby Grodin: “Unlike Kinect or Wii, this is intended to be hacked. You can record your movements as musical ‘macros’, or build your own apps.”

Mysse thinks Toscanini will appeal to artsy types who wish to add an element of “true randomness” to their digital creations. “Gestural expression puts your personal imprint on the data,” he says. “It’s random, but it’s also you. 500 people can play three notes on a piano and not sound much different, but with our watch it will always sound very different.”

Mysse and Grodin are considering building a product ecosystem around the watch, including paid apps and musical accessories produced via 3D printing. But their near-term goal is appropriately bohemian: “We want to hook up with a dance company,” says Grodin. “That’s our dream.”

Read more at the Toscanini homepage.

This entry was posted in Presence in the News. Bookmark the permalink. Both comments and trackbacks are currently closed.
  • Find Researchers

    Use the links below to find researchers listed alphabetically by the first letter of their last name.

    A | B | C | D | E | F| G | H | I | J | K | L | M | N | O | P | Q | R | S | T | U | V | W | X | Y | Z