Mind-Blowing Multi-Touch Interface Video
My brother Jeremy sends along a link to a truly mind-blowing video that demonstrates a multi-touch interface screen similar to the multi-touch table I blogged here a while back, but with far more interesting widgets on display. I want, and that’s putting it mildly. Developed by a group at the NYU Media Lab led by a fellow named Jefferson Han, this thing looks really powerful in the video. A wide variety of interface modes are on display — dragging and resizing not only objects but interface elements, animating drawings in 2D, rotating objects in 3D, zooming into maps and cruising through topographical information from what I think is the NASA World Wind project, scratching records, mixing music, play games — whew. I’m not sure how “live” some of these applications are or whether they’re just interface mock-ups for the demo, but they’re damn impressive, and could turn 3D navigation and content creation into a whole new and more tactile experience. [UPDATE: Forgot to mention how cool the soundtrack is.]
Some details:
Our technique is force-sensitive, and provides unprecedented resolution and scalability, allowing us to create sophisticated multi-point widgets for applications large enough to accommodate both hands and multiple users. The drafting table style implementation shown here measures 36″x27″, is rear-projected, and has a sensing resolution of better than 0.1″ at 50Hz. Stroke event information is sent to applications using the lightweight OSC protocol over UDP.
The Recent Projects section of Jeff’s site has some awfully cool stuff as well.
Feeds
How soon before this becomes a commercial reality? What’s the hardware behind it?
I’ve always enjoyed when some far-flung, advanced technology later gets used in children’s toys. To me, it is the epitomy of just how accessible something has become. I remember beginning to see “play laptops” with very simple LCDs turn into more advanced ones, and I also think of how tactile busyboxes are today compared to two decades ago. Well, imagine a busybox incorporating *this*!
Back when I was involved in electronic music, a prevailing hope was that Ableton Live software would eventually become malleable enough to mesh on a screen and be touch-played. http://www.ableton.de for more info if you’re not familiar, and taking a gander instantly shows why it’s the audio geek equivalent of a “Web 2.0″ interface.
Mark aka Walker, I saw 3pointD get Scoblelized! WTG! :D
Getting Scobleized, Torley, is almost as nice as seeing your name in the comments here :)
There’s also another touch type electronic synth around called Reactable, it works with building blocks, quite extraordinary :)
Stuart
Electronic Music Forums
@Torley - have you seen Lemur?
http://www.jazzmutant.com/lemur_overview.php