EHCI- Enhanced Human Computer Interface

NUI Group in collaboration with Google Summer of Code & Daniel Lélis Baggio introduce the EHCI project.

Project Overview

This application is a webcam image processing library on top of OpenCV intended to generate events from user’s head, hand and body movements. This library is also intended to track objects so that augmented reality can be made. In order to enhance human computer interaction, the application is going to use a single webcam, without the needs to use FTIR or Diffused Illumination techniques. Besides tracking positions, this library will also be able to provide higher level events and gestures like get 3d user position, and open hand gestures. Collision with virtual objects is also considered in augmented reality. Might cover topics such as: 2d/3d head tracking, hand/finger tracking, body tracking, gesture recognition, fiducial marks, motion velocity, augmented reality object tracking.


Aligned with Natural User Interface idea of benefiting artistic and educational applications, this library’s use could range from helping people severely paralyzed or afflicted with diseases such as ALS (Lou Gehrig’s disease) to revolutionary user interface paradigms. 3d head-tracking can create an environment so that Internet browser contents could be zoomed in and out as well as visualize 3d models from user perspective of view. Hand and finger tracking can be used in eye-toy like games as well as scrolling book pages or photos from distance, as when showing photos to friends or in Slideshow presentations. Similar functionalities like Touchlib’s could also be used. Augmented reality can bring a brand new revolutionary paradigm of user interface through an unexplored mix of virtual and real objects for never seen interaction mechanisms. Library demo applications like these should be included. An interesting trait of this library is that users won’t need to wear any equipment!

Great job to Pawel Solyga for mentoring this project and managing all of the NUI Group’s administration for GSoC… it is truly appreciated.

EHCI Preview - Join the Discussion


YAY! I was wondering what had been going on at GSoc.  We will try this today at Purple Spheres.  Thank you Nuiman

Leave a response

Click here to register an account.