TBH I still kinda want one. 🙂
Category Archives: Multitouch
Google taps (heh) Project Jacquard to improve accessibility
It’s always cool to see people using tech to help make the world more accessible to everyone:
This research inspired us to use Jacquard technology to create a soft, interactive patch or sleeve that allows people to access digital, health and security services with simple gestures. This woven technology can be worn or positioned on a variety of surfaces and locations, adjusting to the needs of each individual.Â
We teamed up with Garrison Redd, a Para powerlifter and advocate in the disability community, to test this new idea.Â
CTRL+Console: iPad control for Lightroom & Premiere Pro
Check out Jeff Chow’s (now funded) Kickstarter project:
What do you think? It’s great-looking, but I remain a bit skeptical about using touchscreens (which obviously lack the physical variation of a keyboard or dedicated hardware controller) in this way. If you’re a Photoshop user with an iPad, are you using Adobe Nav–and if not, why not? I suspect the problem is that one has to keep glancing over at a touch screen, whereas one can navigate a keyboard (or physical jog wheel, etc.) simply by feel. Yet the concept remains alluring, so I’m curious about others’ assessment.
[Via James Cox]
New demo of the Leap motion tracker
Can. Not. Wait.
Check out more info from the MIT Technology Review, and from the product site.
[Via Mausoom Sarkar]
Wacom Cintiq goes multitouch
I can’t wait to see what Adobe tools can do with multitouch plus a super high precision stylus that pays attention to pressure, tilt, and rotation.
This bad boy costs $3699 and will be available in early August.
(T)ether: A spatially-aware system for animation & annotation
Hey, it’s the return of my (not at all) beloved Nintendo Power Glove!
Cynical take: “Oh, you were bitching that UIs requiring you to lift your hands & touch a screen would make you tired? Wait’ll you have to hold up an iPad in one hand just so you can re-create Lawnmower Man! You’ll be built like Jeff Fahey in no time, tuffy!”
Actual take: Cool!
Check out the project site for more info.
[Via Dave Simons]
Touching—sort of—across time & space
In high school I had my first long-distance girlfriend. My dad would roll his eyes at our pre-Net attempts to connect. “Oh, you’re probably eating a cheese sandwich as 6pm, because Jeanne said she’d eat a cheese sandwich at 6pm…”  He was kidding (and wrong), but there’s much to be said for synchronicity across space.
Enter Marco Triverio’s concept “Feel Me.” As Fast Company puts it,
When a friend is typing, you can see where they’re touching on your own screen. And when your fingers match up, from halfway across the world, haptic feedback can allow you to serendipitously touch. In a text-me-later culture, Feel Me enables communication that’s transient and visceral.
I think it’s rather brilliant. And as for Jeanne, sometimes I now see her across space, hobnobbing with Mitt Romney. Funny old world.
LEAP Motion promises object-tracking UI breakthroughs
If this thing ($70?!) works even remotely as advertised, we’re in for an exciting future:
[Reader Pierre-Etienne Courtejoie quips, “I just shudder about the possible single-finger gestures to force quit software.” (Hmm, seems very John Gruber-positive.)]
Turn any rigid surface into a multitouch UI
Ehhh, what? But yes, it’s apparently real. Read more here.
[Via]
An enormous multitouch display with stylus input
Jeff Han & Perceptive Pixel blew everyone’s minds with their multitouch demo a year before the iPhone debuted. Six (!) years later he demonstrates their 82″ (!!) multitouch display featuring pen input:
Here’s hoping we see more pen-enabled goodness & lay that “If you see a stylus, it means they blew it” dogma to rest. [Via]
iOS 5 for tots: Quick pro/con
I want Robert Shaw from Jaws to describe my morning as he would a shark attack: “Up comes a reminder on the iPad and the Netflix stops streamin’, and then… ah then you hear that terrible high-pitched screamin’…” Yeah, it got ugly. (Sorry, other conference call participants.)
Good news, though: You can now go into Settings->Notifications, find the Calendar app, and set the notification type from Alert (which interrupts the video) to Banner. Â Now our guys can watch their morning Mighty Machines without going ballistic when it pauses.
On the downside, here’s an intriguing little bit of usability research: Finn is often generating four-finger “swipes” (new in iOS 5 for switching apps) when simply trying to drag on the screen. While coloring in lines in the aforementioned Harold, he’d push hard and his little knuckles would register as multitouch swipes. Â Thus he’d start switching apps, bringing up the list of apps, etc. Â Who knew?
As always, I pine for Apple to introduce multi-user support in iOS. Â Now in the kids’ profile I’ll add “disabling global swipe gestures” to “making it harder to exit the app via the Home button,” “disallow scary stuff on YouTube,” etc.
Update: Double who-knew: BubCap home button covers “are just rigid enough to keep toddlers from pressing the home button, yet flexible enough that adults can activate the button with a firm push.” [Via Iván Cavero Belaunde]
New Wacom tablets add wireless, multitouch
Use multitouch gestures to prototype a design
Adobe Proto captures, I think, the real spirit of tablets: be fun, fresh, immediate, and playful. Here’s a demo from PM Devin Fernandez:
Like Photoshop Touch, it’s coming soon for Android & iOS.
Introducing Photoshop Touch
Combine, Edit, Share. I’m delighted to introduce Adobe Photoshop Touch, a new tablet app for creative imaging. With PS Touch we’re bringing Photoshop fun & power not only to new platforms, but to a whole new audience.
Here’s my brief overview:
To see the app in action, check out Russell Brown’s 10-minute feature tour:
So, when can you get it, and what does it cost?
We plan to release Photoshop Touch for Android shortly, after which we plan to bring it to iOS. When we talk about reaching new audiences, we’re not kidding: Photoshop Touch is priced at just $9.99.
So (to anticipate an inevitable question), why Android first? Many Adobe apps (Adobe Carousel, Ideas, Photoshop Express, Eazel, Color Lava, Nav) have already been released on iOS first, and it’s good to support customers across platforms. We’re busily coding for iOS as well, so I wouldn’t make too much of this particular detail. No matter what tablet(s) you use, we can’t wait to get Photoshop Touch into your hands.
One last thought for now: We’re still very, very early in the evolution of mobile devices for creative work, and Photoshop Touch–along with the many other Adobe touch apps announced today–is just a beginning. We’re eager to hear what you think, and I’m looking forward to hearing ideas & questions here and on Twitter (@PhotoshopTouch). (Today I’ll be largely offline, showing the app in person at Adobe MAX, so I apologize in advance if I’m slow to respond.)
Beautiful Kinect Graffiti
Jean-Christophe Naour uses the motion-sensing gaming platform to paint with light, using his whole body:
[Via]
I’ve had a somewhat similar idea: use the gyroscope a smartphone (or multiple phones) to capture a person’s gestures in space, then use the resulting paths to do 3D painting & animation. That work could happen on the phone itself, or the paths could be imported into After Effects & other apps (think MotionSketch.next.), or even run interactively in Flash, WebGL, etc. Maybe the idea’s too esoteric to have legs, but I’d love to see it tried.
Do-it-yourself huge multitouch
Is it or is it not a great time to be alive?
Check out Seth’s site for more info. [Via]
Huge multitouch wall at the World's Fair
The Wall of Chile  at the 2010 Shanghai World’s Fair features a 4-by-1.2 meter (13-by-4 foot) display wall that enables visitors to access more than six hours of high-definition video and thousands of photographs.
Here are more info & more projects from the creators.
Interesting multitouch ideas: 10/GUI & BumpTop
Speaking of multitouch, the folks at 10/GUI have some interesting ideas on how to make multitouch practical on the desktop. If nothing else the ergonomic observations are spot on.
[Via]
Then there’s BumpTop, which has been around for a few years & which is now available for download. It’s cool, but as I’ve written previously, I have a hard time imagining it’ll get widely adopted. Here’s the demo:
[Via]
Multitouch comes to Flash
I’ve gotten quite a few inquiries over the years asking when Flash Player would support multitouch inputs. The answer: right now! Here’s a quick video demo:
For more info on multitouch, hardware decoding, etc., check out these interviews with the FP engineers. [Via]
Vector graphics software… from 1963
JFK was in office, and yet the app Sketchpad (from then-25-year-old Ivan Sutherland) offered multitouch input, auto-correction of vector strokes, and even reusable symbols (a la Flash, Illustrator, etc.). Very cool:
Apparently Dr. Sutherland once employed–you guessed it–John Warnock, seen here introducing Adobe Illustrator in 1987. [Via]
Cool interface demos o' the day
- SLAP Widgets are “real live plastic and silicone objects that are used in conjunction with a multi-touch table to allow users to control interface values through physical push buttons, sliders, knobs, keypads and keyboards.” Here’s a very cool (albeit slow-loading) video of the system in action*. (Can Slap Chop integration be far behind?)
- Fontplore is “an interactive application designed for searching and exploring font databases… It does all that on an interactive table, using tangible objects to navigate and control actions.” The site includes a brief video demo.
I keep wanting to see great font exploration & management built into Adobe apps. TypeDNA offers a cool Photoshop-plug-in, using optical character recognition to determine a given font’s name, suggesting font harmonies, and more. I’d like to see these concepts taken even farther, offering browsing, comparison, activation, and purchase in all Suite apps via Flash panels.
* Who knew that Frustrated Total Internal Reflection is a multitouch technology & not just the story of my teenage years (okay, most of my years).
Multitouch coolness o' the day: WiiSpray.com
I don’t have a lot of background on the project, but WiiSpray.com–using a Nintendo Wii controller + Flash to enable collaborative graffiti painting–caught my eye:
The site is light on info, but you can see a few photos of the spray can controller. I particularly like the idea of controlling a stencil with one hand while spraying paint with the other.
Previously in a similar vein:
- Dr. Woohoo has combined WiiFlash + Papervision3d + Flash Panels + Photoshop CS4 Extended
- BLITZ Agency built a Flash Interactive Holographic Wall for Adobe MAX (details).
Optional plug-in disables trackpad rotation
During the CS4 development cycle, the Photoshop and Bridge teams worked closely with Apple* to support the multitouch gestures supported on MacBook Air and newer MacBook Pro systems. As a result you can zoom and rotate documents using three-finger combinations.
The rub is that especially on the latest systems (with the enormous trackpads), it can be too easy to zoom or rotate accidentally. Unfortunately Photoshop doesn’t ship with a preference that would govern the behavior. Therefore we’ve released an optional plug-in that will disable zooming and rotating via the keyboard if you’d like. Just drop it into your Plug-Ins folder, restart Photoshop, and you’ll be set.
* Next time you hear someone start in with a bunch of “Adobe doesn’t care about the Mac” crap, I’d like you to think of this. People here go the extra mile because they do care. Deeply.
Flash-based multitouch coolness
Christian Moore & the folks at the NUI Group have created Lux, an open-source framework for creating multitouch-savvy applications. Check out the video demo & a short interview with Christian on how they’ve used Flash to prototype a very cool implementation. I’d love to see it updated to take advantage of the GPU hardware acceleration in the upcoming Flash Player 10 (just posted in preview form on Adobe Labs). Oh, and how about this running in a Smart Object on the Photoshop canvas? (Hey, I’m just thinking aloud, not dropping any near-term.) [Via Jerry Harris]
Interesting related bits:
- Gizmodo features a short recent interview with Jeff Han, the guy whose multitouch work really lit a fire under the whole area two years ago.
- Macworld’s Dan Frakes provides a video tour of MultiClutch, a free utility for extending the multitouch features in the latest MacBook Pro & MacBook Air notebooks. (I was bummed to discover that my wife’s brand new MacBook doesn’t offer the same support. She’s just happy to have two-finger scrolling, something missing from her deceased PowerBook.)
- I need to pull together a category for multitouch; in the meantime, past interesting bits are here.
Leather + multitouch = foxy
Ooh, now that’s nice: student Nedzad Mujcinovic has crafted “Livre,” a concept for a leather-wrapped, multitouch-aware electronic book. Check out the photos as well as the overview. Could a large e-ink screen, organic materials, gesture-based navigation, and a minimum of button clutter change the game and make e-books widespread? It would be fun to find out. [Via]
In other cool device news:
- Small format:
- Like sketching ideas on cocktail napkins, but wish they were more expensive and susceptible to water damage? Then perhaps you’d like the Napkin PC. Naw, the concept is cooler than that–especially if you could combine multiple Napkin PCs into a single work area. [Via Jana Sedivy]
- Inchworm brings sketching and painting to the Nintendo DS. It was created by Bob Sabiston, the developer of the “Rotoshop” software used to create Waking Life and A Scanner Darkly. [Via Greg Geisler]
- Nokia envisions a future full of shape-shifting phones; peep the video for their Morph concept.
- Multitouch:
- Web developers Cynergy have built a Minority Report-style multitouch interface.
- Meanwhile Mary Jo Foley discusses some of the latest developments in Microsoft’s multitouch Surface project. (This one’s still not setting my hair on fire.)
- In a related vein, Dell showed off their multitouch laptop design. [Via Jerry Harris]
- And, as you almost certainly know already, Apple has brought their multitouch trackpad to the full line of new MacBooks. Wouldn’t it be cool if Adobe apps could take advantage of those gestures?
- CNET reports on startup company CeeLite (note: not the singer from Gnarls Barkley) creating flexible sheets of light, useful for wrapping on buses, poles, and other objects.
- Researchers at Stanford have revealed details on their plenoptic camera work.
- Alienware offers a cool, curved display for widescreen gaming. I wonder how well it would work for design & photo editing.
- Art Lebedev’s Photoshop-savvy Optimus Maximus OLED keyboard (mentioned previously) has started shipping. You can see it being set up, or you can watch the droll Art himself work his geek-fu on a real live girl. :-) [Via Jesse Zibble]
Multitouch, holograms, & other next-gen I/O
- A team at USC has built a holographic “360° Light Field Display” using a spinning mirror, and the resulting video is pretty amazing. Note: Do not attempt to make out with images depicted this way. (I do wonder if you can sing “Iron Man” into it, as you would an oscillating fan.)
- Italian design firm V12 Design+Engineering has come up with an interesting proposal: the Canova dual-display touch-screen notebook computer. Here are additional images, including a mockup of the device running Photoshop. [Via Rob Corell]
- The Ecko LCD bus shelter is designed to let passersby scribble graffiti via Bluetooth-enabled cell phones; here’s a slightly larger image. I’m having trouble finding more on the topic, making me wonder whether it ever got out of the concept phase.
- Helsinki’s CityWall collaborative social space “is a large mutli-touch display installed in a central location in Helsinki which acts as a collaborative and playful interface,” enabling navigation of specially tags media from Flickr & YouTube. [Via]
- The crew at Minimaforms has brought SMS-driven laser writing on smoke to Bristol’s OFFLOAD festival. [Via]
- CNET has posted additional images & details on the Microsoft Surface touch-sensitive screen.
- My old colleague Noah Mittman offers a useful clarification regarding “haptic interfaces”: “For an interface to be haptic, touch must be its output”–not just the input. He points out a crazy haptic glove shown this year at SIGGRAPH. See also this CAD interface that simulates sculpting.
- For more info on how these things have evolved & where they might be going, see Robert Cravotta’s history of gesture interfaces. [Via]
Multitouch, holograms, & other next-gen I/O
- A team at USC has built a holographic “360° Light Field Display” using a spinning mirror, and the resulting video is pretty amazing. Note: Do not attempt to make out with images depicted this way. (I do wonder if you can sing “Iron Man” into it, as you would an oscillating fan.)
- Italian design firm V12 Design+Engineering has come up with an interesting proposal: the Canova dual-display touch-screen notebook computer. Here are additional images, including a mockup of the device running Photoshop. [Via Rob Corell]
- The Ecko LCD bus shelter is designed to let passersby scribble graffiti via Bluetooth-enabled cell phones; here’s a slightly larger image. I’m having trouble finding more on the topic, making me wonder whether it ever got out of the concept phase.
- Helsinki’s CityWall collaborative social space “is a large mutli-touch display installed in a central location in Helsinki which acts as a collaborative and playful interface,” enabling navigation of specially tags media from Flickr & YouTube. [Via]
- The crew at Minimaforms has brought SMS-driven laser writing on smoke to Bristol’s OFFLOAD festival. [Via]
- CNET has posted additional images & details on the Microsoft Surface touch-sensitive screen.
- My old colleague Noah Mittman offers a useful clarification regarding “haptic interfaces”: “For an interface to be haptic, touch must be its output”–not just the input. He points out a crazy haptic glove shown this year at SIGGRAPH. See also this CAD interface that simulates sculpting.
- For more info on how these things have evolved & where they might be going, see Robert Cravotta’s history of gesture interfaces. [Via]
Interactive Adobe video wall comes to NYC
According to an article in today’s NYT,
Adobe will unveil an interactive wall of projected animation [see video] this morning in Union Square, along the 14th Street side of the Virgin Megastore. As pedestrians walk past the wall, infrared sensors will lock on to the person closest to the wall, who will then be able to control a projected slider button at the bottom of the wall. As the selected pedestrian continues walking and moves the slider along, the wall will start displaying colorful animation and playing music, effects that will grow or recede at the pace that the person advances or retreats.
Measuring 95 square feet, and created by Goodby Silverstein working with animators at Brand New School and video peeps Obscura Digital,
the wall is meant to offer “a single and multiuser experience simultaneously.” Gizmodo wants to see multitouch interactivity added to the project, saying “Sure, you’d probably wind up with more than a few obscene renderings, but it’s New York, people can handle it.” (Yes, but could Adobe Corporate*? ;-))
I hope to get photos and videos from the unveiling to share. If you know of any, please pass ’em along. [Update: Gothamist has posted a bit more info.]
*Then again, Bruce is from Brooklyn, so I imagine him remaining unfazed.
Multitouch, real & imagined
- MIT’s Technology Review features multi-touch UI pioneer Jeff Han in a new video. He talks about ways these screens can get around the "thin straw" of keyboard mouse input; the potential for better storyboarding applications; and more.
- Mark Coleran has carved out what seems to be a pretty cool gig, designing computer interfaces shown in movies. His design for a table in The Island resembles the Microsoft Surface concept. [Via] Mark’s work reminds me of the time we visited the set of one of the CSI shows and met the folks responsible for those Director-powered graphics–you know, the ones that convince average viewers that computers can read The Iliad reflected off the head of a pin. Thanks a lot for that, guys. 😉
- Meanwhile the interface of the iPhone I picked up on Saturday remains a completely imaginary one: thanks to AT&T, I can’t activate the damn thing with my corporate cell number, which means I can’t get past the welcome screen. Note to self: the whole sequence of
- Get all excited, buy lovely, seductive gizmo
- Figure out whether said gizmo can actually be used with phone number, work email, etc.
should actually be reversed. Gah. This would be that bleeding edge I’ve heard so much about. (It does feel great in one’s hand, however. ;-P)
Multitouch, real & imagined
- MIT’s Technology Review features multi-touch UI pioneer Jeff Han in a new video. He talks about ways these screens can get around the "thin straw" of keyboard mouse input; the potential for better storyboarding applications; and more.
- Mark Coleran has carved out what seems to be a pretty cool gig, designing computer interfaces shown in movies. His design for a table in The Island resembles the Microsoft Surface concept. [Via] Mark’s work reminds me of the time we visited the set of one of the CSI shows and met the folks responsible for those Director-powered graphics–you know, the ones that convince average viewers that computers can read The Iliad reflected off the head of a pin. Thanks a lot for that, guys. 😉
- Meanwhile the interface of the iPhone I picked up on Saturday remains a completely imaginary one: thanks to AT&T, I can’t activate the damn thing with my corporate cell number, which means I can’t get past the welcome screen. Note to self: the whole sequence of
- Get all excited, buy lovely, seductive gizmo
- Figure out whether said gizmo can actually be used with phone number, work email, etc.
should actually be reversed. Gah. This would be that bleeding edge I’ve heard so much about. (It does feel great in one’s hand, however. ;-P)
Multitouch: $2 or $10,000?
The folks at Medallia claim to have devised a multitouch user input device using two dollars’ worth of dye and Ziploc bags. Hmm–interesting clip, but doesn’t it seem they’ve pretty much mashed up a couple seconds of new footage (producing colored blobs) with chunks of other people’s demos (the chess demo from Tactiva, etc.)? Beyond the technology, I’m struck by the number of comments below the video that boil down to "hah hah u pwned those fat-cats lolz!!" Man are there some credulous people in the world. [Via Tom Attix]
Speaking of pwning Microsoft, however, this parody of the recently-announced, $10,000-a-pop Surface project is pretty damn funny. I can’t wait to get tanked with my friends, using a device the size of a small car. [Via]
Multi-touch photo editing demo
I don’t have much context for this video, but I’m passing it along as it’s an interesting demo of image editing using a multi-touch screen. The pie menus look useful (is that a Healing Brush icon I see?), though to compete against a keyboard and mouse, I think it would need to be much faster and more fluid.
Sidenote: I like imagining that the choice of bloopy, electro-spacey music may not just be a video editing choice, and that it’s actually emitted by the multi-touch monitors themselves (see also the Jeff Han origin of the genre). "Hey man, cool screen, but why does it keep playing the pseudo-Moby?"
Multi-touch UI: New video & interview
Jefferson Han is the NYU researcher whose research into multi-touch interfaces–and accompanying super-cool video–exploded onto the Web this time last year. He’s been on many folks’ brains since last week, when Apple demoed multi-touch features on the forthcoming iPhone. Now Fast Company has posted a feature on Jeff, along with an new video. The profile is just a tad breathless ("The scope of the projects he’s involved in is a testament to the sheer wattage of his brain" makes me think there’s a Trapper Keeper with "I [Heart] JH!!!" on it), but it’s fun to learn about a very bright dude with a huge passion for just getting it done. (Hey, how many 12-year-olds build a laser?)
Multi-touch UI: New video & interview
Jefferson Han is the NYU researcher whose research into multi-touch interfaces–and accompanying super-cool video–exploded onto the Web this time last year. He’s been on many folks’ brains since last week, when Apple demoed multi-touch features on the forthcoming iPhone. Now Fast Company has posted a feature on Jeff, along with an new video. The profile is just a tad breathless ("The scope of the projects he’s involved in is a testament to the sheer wattage of his brain" makes me think there’s a Trapper Keeper with "I [Heart] JH!!!" on it), but it’s fun to learn about a very bright dude with a huge passion for just getting it done. (Hey, how many 12-year-olds build a laser?)