Hi,

I’m starting this thread to let you know about my undergraduate project. It is called iDisplay.

iDisplay is a computer-vision based solution to retrofit regular flat displays into interactive surfaces. It provides a low cost and simple hardware setup.

The hardware prototype includes only a regular off-the-shelf webcam and a regular LCD monitor. No expensive sensors and No IR methods are used.

The main interaction method of iDisplay is the Pinching Gesture. It can also identify circular tangible objects and their colors.

More infomation can be found here.

Really looking forward to know your comments and feedback.
Regards,
-Lahiru.

I really liked the neave imagination app. Do you know where I can download it?

nice work lahiru !

Great work Lahiru. Are you using ofxTouch as the base? Reminds me of some of the stuff Microsoft was doing, but you’ve taken it a step farther nicely. Keep it up and make sure to share your progress with us

Hey great stuff Lahiru! Love the idea… Keep up the great work!

Thanks a lot for the feedback!!!

It still a research prototype… hoping to do more improvements in the future.

Thanks again!!!

Nawid - 21 June 2009 02:59 PM

I really liked the neave imagination app. Do you know where I can download it?

I downloaded that app from here. But it’s not a multitouch application… I did some modifications and add TUIO support.
I can send you the modified source code, anyway it was really easy.

Thanks!

Seth (cerupcat) - 21 June 2009 06:13 PM

Great work Lahiru. Are you using ofxTouch as the base? Reminds me of some of the stuff Microsoft was doing, but you’ve taken it a step farther nicely. Keep it up and make sure to share your progress with us

Thanks a lot!

Yes, I’m using OpenFrameworks with (modified) ofxTouch and some other addons.

Microsoft has done a project called PlayAnywhere which is bit similar, but with very expensive hardware.

Hoping to do more improvements in future and will share the progress for sure!

Thanks!

I’d love to get the modified source code. And could you also send me the full app with TUIO support?
It’s really cool

Yeah, I wasn’t thinking of ‘play anywhere’ as much as this one:

What you’ve done is definitely a better implementation and of course more feature rich Have you thought about using the rotation of the hand pinch shape to manipulate things (like Andy does in the video)?

Yeah. this project is called TAFFI… and this is where I adapted the pinching gesture.

Couldn’t implement that rotation thingy… but I’m hoping to improve the pinch gesture recognition algo :D may be I can add tht feature, too.

Thanks!

First of all great work, and secondly all that rotation thing is checking the angle that’s created between the 2 pinches and then extrapolates those angles into rotation just think of right angled triangle… where your pitches are located on the 2 ends of the hypotenuse of the right angled triangle and alpha and beta are angles at their respective points each of those pinches has a ID and X_Pos and Y_Pos from that you can easily calculate the angle, where any changes to the X_Pos and Y_Pos of the of either or both pinches will change those angles. and from that we can get the rotation. hope this helps

Taha - 22 June 2009 02:25 PM

First of all great work, and secondly all that rotation thing is checking the angle that’s created between the 2 pinches and then extrapolates those angles into rotation just think of right angled triangle… where your pitches are located on the 2 ends of the hypotenuse of the right angled triangle and alpha and beta are angles at their respective points each of those pinches has a ID and X_Pos and Y_Pos from that you can easily calculate the angle, where any changes to the X_Pos and Y_Pos of the of either or both pinches will change those angles. and from that we can get the rotation. hope this helps

Thanks a lot! I’ll look into this and try to add that feature.

Thanks again! all the comments and feedback means a lot!

Hi!

I’m really happy to say that today, iDisplay won the Academic Excellence Award for the Best Project @ “Cutting Edge” Exhibition. :D

It’s an annual exhibition organized by my institute, IIT.

Thanks!
-Lahiru.

Hi !

Great work !

Just a question :
Which openCV function do you use for detecting circles ?
Thanks,

jyg - 28 June 2009 10:22 AM

Hi !

Great work !

Just a question :
Which openCV function do you use for detecting circles ?
Thanks,

Hi,

Thanks a lot!

I’m using the contour finder comes with ofxTouch. Therefore sometimes it can’t detect the pinching gesture properly. I’m currently working on improvements.

-Lahiru.