1 of 2
1
Surface Vision System explained by Microsoft
Posted: 18 September 2009 03:49 PM   [ Ignore ]
RankRankRankRank
Joined  2007-07-14
Total Posts:  819
Elite

Very interesting video about Surface’s vision system (how it works). They even show the camera and ir led.
http://blogs.msdn.com/surface/archive/2009/09/18/the-dream-in-infrared-made-real.aspx

 Signature 

HID Multitouch driver for Windows 7 http://multitouchvista.codeplex.com/

Profile
 
 
Posted: 18 September 2009 06:36 PM   [ Ignore ]   [ # 1 ]
Avatar
RankRankRankRankRankRank
Joined  2007-04-08
Total Posts:  2539
Dedicated

Thanks for posting that Daniel. It’s a good overall insight to the system.

 Signature 

MTmini, MTbiggie, & Audiotouch creator & Community Core Vision Co-founder

Follow on:
My Blog | Facebook | Twitter | Youtube

Profile
 
 
Posted: 18 September 2009 06:58 PM   [ Ignore ]   [ # 2 ]
Avatar
RankRank
Joined  2007-08-19
Total Posts:  212
Member

very nice.
-great find . thanx for posting

 Signature 

"And crawling on the planets face. Some insects called the human race.
Lost in time, And lost in space and meaning… “

Profile
 
 
Posted: 18 September 2009 08:12 PM   [ Ignore ]   [ # 3 ]
Avatar
RankRank
Joined  2009-04-16
Total Posts:  127
Member

brilliant link thanks for posting

 Signature 

http://www.crearedesign.co.uk/
http://www.creare.co.uk/
video jigsaw http://nuigroup.com/forums/viewthread/6429/

Profile
 
 
Posted: 18 September 2009 10:10 PM   [ Ignore ]   [ # 4 ]
RankRank
Joined  2008-05-07
Total Posts:  173
Member

Awesome Video . . . I had a setup that probably is very similar to theirs—using 4 3W IR (850nm) power LEDs as IR light source. Did not try to do fiducial detection/recognition, but that seems a good hack/"free time programming” to match what are shown in Video grin

Are there any object detection program already?

Profile
 
 
Posted: 18 September 2009 10:54 PM   [ Ignore ]   [ # 5 ]
Avatar
RankRankRankRankRankRank
Joined  2007-04-08
Total Posts:  2539
Dedicated
pylin - 18 September 2009 10:10 PM

Are there any object detection program already?

Object or fiducial (symbol) detection? Reactivision, trackmate, and dtouch libraries all do fiducial tracking.

 Signature 

MTmini, MTbiggie, & Audiotouch creator & Community Core Vision Co-founder

Follow on:
My Blog | Facebook | Twitter | Youtube

Profile
 
 
Posted: 19 September 2009 06:21 AM   [ Ignore ]   [ # 6 ]
Avatar
RankRank
Joined  2008-06-26
Total Posts:  243
Member

Hey Pylin,

may i ask you how do you are diffusing the spot created by the LEDs? Are you using some optical approach to do that? Usually the powerfull LEDs are creating very focussed spot…

Cheers,

Sandor

pylin - 18 September 2009 10:10 PM

Awesome Video . . . I had a setup that probably is very similar to theirs—using 4 3W IR (850nm) power LEDs as IR light source. Did not try to do fiducial detection/recognition, but that seems a good hack/"free time programming” to match what are shown in Video grin

Are there any object detection program already?

 Signature 

Sandor Rozsa
--
http://www.xtuio.com - home of uniTUIO: bringing MultiTouch in the 3’rd dimension
http://www.cd-cologne.de - my company homepage

Profile
 
 
Posted: 19 September 2009 09:08 AM   [ Ignore ]   [ # 7 ]
RankRank
Joined  2008-05-07
Total Posts:  173
Member

These IR leds, I think, are “uni-directional”, so there is supposedly no focused spot. Anyways, I did not diffuse it, that setup is rear DI with a sanded acrylics as top. With CCV’s ability to do background substraction, it is able to detect blobs. However, it is not very good setup, as you said, blob detection is not very good around those “hot” spots—sanded surface is not even, so some reflection occur.

I used to have quite a few lenses for high power Luxeon leds, I think I can use them on these high power IR leds. Then it would be like shining flashlights on the surface. I will try that when I find these lenses.

Profile
 
 
Posted: 19 September 2009 09:15 AM   [ Ignore ]   [ # 8 ]
Avatar
RankRank
Joined  2008-06-26
Total Posts:  243
Member

pylin,

as you can see it in the movie, MS is not orienting the leds directly towards the projection surface. More likely the LED is shining horizontally and there is a glass-type plate in the front of the LED. I’m not sure, but i am quessing that the plate is a lens for scattering the light…

pylin - 19 September 2009 09:08 AM

I did not diffuse it, that setup is rear DI with a sanded acrylics as top. With CCV’s ability to do background substraction, it is able to detect blobs. However, it is not very good setup, as you said, blob detection is not very good around those “hot” spots.

I used to have quite a few lenses for high power Luxeon leds, I think I can use them on these high power IR leds. The it would be like shining flashlights on the surface. I will try that when I find these lenses.

 Signature 

Sandor Rozsa
--
http://www.xtuio.com - home of uniTUIO: bringing MultiTouch in the 3’rd dimension
http://www.cd-cologne.de - my company homepage

Profile
 
 
Posted: 19 September 2009 09:19 AM   [ Ignore ]   [ # 9 ]
RankRank
Joined  2008-05-07
Total Posts:  173
Member

Yes, I also thought about using EndLighten acrylics and power IR leds to get evenly diffused IR source. In EndLighten document, they recommended to place light source every foot as poster background. So I think if we put those power IR leds every 6 inches, it should be OK.

Profile
 
 
Posted: 19 September 2009 09:23 AM   [ Ignore ]   [ # 10 ]
RankRank
Joined  2008-05-07
Total Posts:  173
Member

Another setup is to use IR led strips, but instead of using expensive EndLighten acrylics, just use some material used for LCD backlight. So the setup would be, place these long strips (in my setup, 24 inches long) every two inches apart, glue them on the same surface as the camera, put the diffusion material on top of these led strips.

Profile
 
 
Posted: 19 September 2009 09:44 AM   [ Ignore ]   [ # 11 ]
RankRank
Joined  2008-05-07
Total Posts:  173
Member

Seth, where can I get Reactivision source code? Thank.

Profile
 
 
Posted: 19 September 2009 09:51 AM   [ Ignore ]   [ # 12 ]
Avatar
RankRank
Joined  2008-06-26
Total Posts:  243
Member

pylin,

http://reactivision.sourceforge.net/
http://www.tuio.org

pylin - 19 September 2009 09:44 AM

Seth, where can I get Reactivision source code? Thank.

 Signature 

Sandor Rozsa
--
http://www.xtuio.com - home of uniTUIO: bringing MultiTouch in the 3’rd dimension
http://www.cd-cologne.de - my company homepage

Profile
 
 
Posted: 19 September 2009 01:06 PM   [ Ignore ]   [ # 13 ]
RankRank
Joined  2008-05-07
Total Posts:  173
Member

I see, it is using adjacent graph tree to recognise fiducial, not feature point detection (which is computationally more expensive). Does Reactivision recognise arbitrary objects? I mean, can we train it to recognize any objects?

Profile
 
 
Posted: 19 September 2009 01:43 PM   [ Ignore ]   [ # 14 ]
RankRank
Joined  2007-09-10
Total Posts:  139
Member
sandor - 19 September 2009 09:15 AM

pylin,

as you can see it in the movie, MS is not orienting the leds directly towards the projection surface. More likely the LED is shining horizontally and there is a glass-type plate in the front of the LED. I’m not sure, but i am quessing that the plate is a lens for scattering the light…

The plate is a simple piece of glass and has no special optical properties. The LED is oriented towards the surface and titled slightly outwards. However, it seems to me that Microsoft didn’t show one of the most important parts of the LED assembly in this video, which is a special mirror to focus the light on the four quadrants of the projection surface.

surfaceled.jpg

Profile
 
 
Posted: 19 September 2009 02:01 PM   [ Ignore ]   [ # 15 ]
RankRank
Joined  2008-05-07
Total Posts:  173
Member

Hmmm, thanks for the info. I believe if I use collimator (lens), I could do the same, but shining from bottom to top. Gee, I got to find those collimators.

Profile
 
 
   
1 of 2
1
 
‹‹ Capacitive Touch      LLP ››