View gsoc temp



Touchlib

  • Mac OSX and Linux support - Port the existing codebase and techniques to more operating systems, and also easy to install downloadable bins for each OS. Package everything in an installer, and distribute packages in some linux distributions repositories.
  • Enhance Setup GUI - Create more detailed interface for setup and configuration of the vision engine and offer a more dynamic calibration system.
  • Wii Remote support for object/finger recognition/tracking - Wii Remote support so we could use the wii-remote as an input device, we are looking for Windows, Linux and Mac versions
  • Add multi-camera support - Implement stereo vision techniques and algorithms. Have tools for camera alignment and calibration.
  • Physical Object Tracking - Work on tag (fidicual) recognition, create a separate library which can be shared with Touchlib/OpenTouch and other project or merge existing library (reactivision) into Touchlib


OpenTouch

  • Screen Calibration - Write multitouch screen calibration module or port it from touchlib.
  • Rewrite OpenTouch in Objective-C - For tight integration with Mac OS X frameworks and Cocoa. Utilize Core Image, Core Video for filters on USB or Firewire video feeds.
  • Create GUI for OpenTouch in Cocoa - Use Interface Builder to create a configuration frontend for OpenTouch have adjustable variables for video and blob tracking settings.


Multi-Touch Enabled Clients (Touchlib Demos)

  • Touch OS - A rapid prototyping environment for testing multi-modal applications (Flash/WPF)
  • Touch UI - A framework for multitouch oreinted components and objects.
  • Touch API - A standardized communication layer (XML/Binary Socket or Internal)
  • Touch Web - A multitouch web browser in Adobe AIR or using the Mozilla codebase.
  • Touch Earth- A multitouch web browser in Adobe AIR or using the Mozilla codebase.
  • Touch Gestures - A multitouch web browser in Adobe AIR or using the Mozilla codebase.
  • Touch App - A multitouch web browser in Adobe AIR or using the Mozilla codebase.



iPhone

  • iTUIO- Write TUIO simulator for iPhone (sending TUIO events from your iPhone to Desktop computer using WiFi)
  • iTUIO- propose innovative multitouch iPhone application
  • Gesture Implementation- Write multitouch gesture recognition library for iPhone (defining your own gestures)
  • iTUIO- write innovative iPhone application with heavy gestures support



Other

  • ~collab - multisite collaboration using multitouch screens
  • work on MtLib multitouch Windows library
  • work on TUIO Simulator
  • write new TUIO Simulator with timeline support and support for gestures (look how iPhone Simulator works with gestures as an example)
  • work on libavg project - add TUIO support, FTIR screens support, GUI
  • create a framework for writing multitouch applications such as interactive whiteboard using WiiMote under Mac OS X, write some example applications
  • Work on WiiMote Whiteboard project, create new example application, port WiiMote Whiteboard to Linux and Mac
  • improve blob detection and tracking algorithms (write library to handle that so it can be used with different projects in future ex. touchlib, opentouch)
  • propose new innovative multitouch application you would like to work on (interaction in 3d environment, creating scenes, documents etc)
  • work on WiiMoteTUIO project
  • propose a project for automatic projector calibration
  • write multitouch gesture recognition library with support for gestures that could consist of several strokes like /\ + - = A
  • propose and write multitouch application for Mac OS X, using TUIO protocol for events and new Leopard graphic frameworks like Core Animation
  • write Firefox TUIO extension which maps TUIO events to JavaScript events and add gestures support in Firefox using same JavaScript extensions used in WebKit/Safari introduced in iPhone SDK
  • research multicomputer use for image processing (distributed blob detection and tracking), dividing computation between many machines, this would be really useful for big installations like multitouch walls, test your solution and integrate with OpenTouch or touchlib
  • Write a multitouch 2D physics sandbox application (look at project Phun to see how it should work with mouse, http://phun.at/) - you can use existing open source physics libraries and TUIO for multitouch events



Related Resources

  • httptouchlib.com
  • http
  • http://www.cs.cmu.edu/People/johnny/projects/wii/
  • http://www.wiimoteproject.com/
  • https://sourceforge.net/projects/wiiwhiteboard/


More Ideas...

cmoore tmp