1 of 10
1
Dual IR Laser, Firefly MV, TouchLib running @ 112fps + TouchLib Speed/CPU Fix !!! ** UPDATED **
Posted: 14 June 2008 03:24 AM   [ Ignore ]
Avatar
RankRankRank
Joined  2008-05-08
Total Posts:  342
Administrator

Today I got the Firefly MV B/W camera from PGR. I also added second IR laser to my original setup. This eliminates finger occlusions that were present in my previous single laser setup.
I took some videos of this setup running demo apps, so I thought I showcase it here.

The TouchLib was modified (for fast blob processing) so that now runs synchronously to the camera capture rate. It also outputs current blob processing frame rate.

Here is the OSC app:

Here is the Fire demo:

Here is the Photo app:

Here is the Wall Pong app:

Here is the Puzzle app:

Here is the Ripples app:

Here is the Smoke app:

*** UPDATED ***

Dual IR laser blobs (camera view):

Calibration process (here I use ROI feature of the Firefly MV camera @ 320x240 frame size):

Many of you asked about my version of TouchLib with speed/CPU fix shown above. You can get it below and test it for yourself. Please note that I am using DSVideoLib as the input capture filter. The library was tested and it functions properly with this filter only. With other filters (such as VideoWrapper) the CPU usage may be very high, so please use it at your own risk.

Enjoy!

~Alex

File Attachments
TouchLib.part1.rar  (File Size: 977KB - Downloads: 2911)
TouchLib.part2.rar  (File Size: 977KB - Downloads: 3118)
TouchLib.part3.rar  (File Size: 190KB - Downloads: 2287)
 Signature 

Computing is not about computers any more.  It is about living!

Code Laboratories
CL Studio Live - Video like never before
CL Eye Platform SDK

Profile
 
 
Posted: 14 June 2008 04:57 AM   [ Ignore ]   [ # 1 ]
Avatar
RankRankRank
Joined  2007-09-22
Total Posts:  263
Sr. Member

Great work Alex , your laser setup is really fast and precise.Smoke app was just incredible , you can really tell the diference of tracking and processing.
Any chance you’d release your modified version of touchlib?

Profile
 
 
Posted: 14 June 2008 06:35 AM   [ Ignore ]   [ # 2 ]
Rank
Joined  2008-05-05
Total Posts:  86
New Member

nice work, thanks for sharing, can you tell us what kind of laser you used? and how did you set it up?

I was wondering how did you spread the beam over the surface? and where can I get a IR laser? I can only find lasers that burn stuff online....

thanks

Profile
 
 
Posted: 14 June 2008 08:58 AM   [ Ignore ]   [ # 3 ]
Avatar
RankRankRank
Joined  2007-09-22
Total Posts:  263
Sr. Member

Oh just saw that it was running at .
Alex could you post your config.xml here.I’ve seen there are alot of people using MTMini with 320x240 asking for a config calibrated for that resolution.
Could you please post yours here so i can respond to their threads.

Profile
 
 
Posted: 14 June 2008 11:17 AM   [ Ignore ]   [ # 4 ]
Avatar
RankRankRank
Joined  2007-09-13
Total Posts:  333
Sr. Member

Very impressive, Alex.

What are you using to connect Touchlib to the FireflyMV? VideoWrapper, CMU or DirectShow?

Profile
 
 
Posted: 14 June 2008 12:46 PM   [ Ignore ]   [ # 5 ]
Avatar
RankRankRankRankRankRank
Joined  2007-04-08
Total Posts:  2539
Dedicated

Alex, nice work. If the changes are confirmed to be needed, would you be willing to commit them to the touchlib svn if we can get you access? Touchlib has gone unoptimized for a while now, with little changes, so any updates I would think are welcome and needed.

On a side not, Why does the smoke application looks like the video is sped up a lot?

 Signature 

MTmini, MTbiggie, & Audiotouch creator & Community Core Vision Co-founder

Follow on:
My Blog | Facebook | Twitter | Youtube

Profile
 
 
Posted: 14 June 2008 02:42 PM   [ Ignore ]   [ # 6 ]
RankRank
Joined  2008-04-16
Total Posts:  183
Member

AlexP, you must either have a good amount of money or are doing this for a company, because you’ve got some high dollar fancy stuff! First those lasers, now a Firefly MV. I’m envious! As I understand it the Firefly costs <$200, but you have to order at least 5 at once.

Amazing results man, I don’t think I’ve ever seen a homebrew MT set up that runs that well. I think you’ve helped this community immensely with your work, there is no question at least in my mind about using IR lasers (LLP) vs. other methods.

 Signature 

Visit my research blog at:
http://cs.unk.edu/~webb/

Profile
 
 
Posted: 15 June 2008 05:48 AM   [ Ignore ]   [ # 7 ]
Rank
Joined  2008-04-01
Total Posts:  27
New Member

Excellent work Alex!

Very nice to see that it can actually get this fast.

Did you ever run into problems with the limitations of the Flash XMLsocket connection when sending so many frames per second? When we speed up our setup this can be a problem when we reach more than 15 fingers at the same time.

Anyway, great effort, really inspiring! Keep it up!

 Signature 

canTouch tangible interfaces - Amsterdam - http://www.cantouch.nl

Profile
 
 
Posted: 15 June 2008 07:25 AM   [ Ignore ]   [ # 8 ]
Rank
Joined  2007-10-23
Total Posts:  87
New Member

@Erik2003, a few of us including myself are working on a tcp binary socket implementation that you might be interested in. We’re still testing things out but so far I have had great results. I think the limit for me now is about 40 blobs, and I think this was down to touchlib not being able to cope rather than flash. Anyway the thread is http://nuigroup.com/forums/viewthread/1987

Profile
 
 
Posted: 15 June 2008 10:02 AM   [ Ignore ]   [ # 9 ]
Rank
Joined  2007-02-13
Total Posts:  41
New Member

That’s really impressive! How much CPU usage does it require? Have you tried 640x480 @ 60 fps? And how much did you pay for the camera?

Wish I had your budget. LOL

Profile
 
 
Posted: 15 June 2008 10:55 AM   [ Ignore ]   [ # 10 ]
Avatar
RankRankRankRank
Joined  2008-02-12
Total Posts:  1111
Member

This is amazing, but like cerupcat said, did you modify smoke, in some way because it seems to have been sped up

great work btw

Taha

 Signature 

Company Website - Knode Research and Development
My Youtube

Profile
 
 
Posted: 16 June 2008 02:53 AM   [ Ignore ]   [ # 11 ]
Avatar
RankRankRank
Joined  2008-05-08
Total Posts:  342
Administrator
h4t - 14 June 2008 02:42 PM

AlexP, you must either have a good amount of money or are doing this for a company, because you’ve got some high dollar fancy stuff! First those lasers, now a Firefly MV. I’m envious! As I understand it the Firefly costs <$200, but you have to order at least 5 at once.

Amazing results man, I don’t think I’ve ever seen a homebrew MT set up that runs that well. I think you’ve helped this community immensely with your work, there is no question at least in my mind about using IR lasers (LLP) vs. other methods.

Thank you h4t…
I don’t have high budget or a lot of money, I am just passionate about this MT stuff. I also realize that sometimes in order to get great results, modifying and tweaking the code will only get you so far. That said TouchLib has a lot of space for improvements and I will create a list of the top five things that could be fixed and the performance gains. Regarding the Firefly MV camera, it is not true that you have to buy 5 minimum. I called them and they sold me only one.

~Alex

 Signature 

Computing is not about computers any more.  It is about living!

Code Laboratories
CL Studio Live - Video like never before
CL Eye Platform SDK

Profile
 
 
Posted: 16 June 2008 03:00 AM   [ Ignore ]   [ # 12 ]
Avatar
RankRankRank
Joined  2008-05-08
Total Posts:  342
Administrator

@cerupcat
@Taha

I would be willing to help out and commit my fixes if I get the svn access, sure. Currently I’m using DSVideoLib in my config file and changes that I made pertain to this input method.
Regarding the smoke app, I didn’t make any changes there, but being a native windows app that links the touchlib, I think that the faster blob processing somehow affects the smoke app speed. Maybe the fact that I removed the SLEEP(32) from the touchlib resulted in smoke rendering speedup, I’d have to look into this.
But one thing is sure, the touch response if definitely way faster than before.

~Alex

 Signature 

Computing is not about computers any more.  It is about living!

Code Laboratories
CL Studio Live - Video like never before
CL Eye Platform SDK

Profile
 
 
Posted: 16 June 2008 03:21 AM   [ Ignore ]   [ # 13 ]
Avatar
RankRankRankRank
Joined  2008-02-12
Total Posts:  1111
Member

ohh ok… in anycase great work.

Taha

 Signature 

Company Website - Knode Research and Development
My Youtube

Profile
 
 
Posted: 16 June 2008 03:33 AM   [ Ignore ]   [ # 14 ]
Avatar
RankRankRankRank
Joined  2008-01-04
Total Posts:  676
Moderator

WOW! Adding the extra laser was a definite must, and the results of the combination of both laser and camera are fantastic. Well done Alex.

Looking forward to more wink

 Signature 

Get Sparked at sparkon.net
ORION Multi-Touch Display (blog)
My YouTube

Profile
 
 
Posted: 16 June 2008 09:22 AM   [ Ignore ]   [ # 15 ]
RankRank
Joined  2008-05-20
Total Posts:  219
Member

hi,

issit possible you can show a video of the calibration process? as i’m doing a setup of a similar scale.

thanks

Profile
 
 
   
1 of 10
1