I was at a Lunch 2.0 on Friday where someone showed me VNSea, an iPhone app that allows you to remotely control any computer running a VNC-compliant server (e.g. Apple’s own Remote Desktop).
Since Apple is officially opening the iPhone to outside developers next month, this presents a huge opportunity. If we augmented VNSea with a TUIO daemon, we could instantly turn any iPhone/iPod touch into a desktop multitouch pad. Granted, the iPhone’s resolution is only 480x320, but its huge install base allows us to lower the bar for multitouch development. If done properly, anyone with an iPhone could join our community without having to first build an FTIR board. It also enables direct manipulation without having to purchase a projector.
Rather than looking to localhost for TUIO events, the remote software would listen to the iPhone. VNC would be used to show the iPhone user what he is manipulating.
If nothing else, this could bring a lot of attention to our community. I imagine a video of an iPhone controlling a desktop computer with full multitouch would create a lot of buzz.
It would be pretty trivial for someone familiar with both frameworks to translate CocoaTouch to TUIO. Any takers?
