Relative Depth Tracking With Single PS3eye Camera
Posted: 24 April 2011 07:07 PM   [ Ignore ]
Joined  2008-11-28
Total Posts:  122

Hello again NUI community. I took a break from MT application programming to try my hand at a custom tracker based on the PS3eye camera. I got the DLL’s working in BlitzBasic some time ago and just recently decided on creating an idea I’ve had for a while now: A depth-based tracking system while relies on a single light source (IR or just a plain light bulb) behind the camera. The jpeg diagram attached shows the concept behind the idea.

In principle, the camera looks for differences in gray pixels and maps the changes onto a 3D mesh which can show relative (obviously not absolute) depth. The video below demonstrates the application in it’s working order.

Now, obviously, as with any mono-camera based system, there are drawbacks such as occlusion, black/white color interference, FOV, and etc. This is just a proof-of-concept, though, and I hope you all enjoyed it as much as I enjoyed making it. Let me know if anyone wants the *.Exe/Paint demo app…

Image Attachments
Posted: 25 April 2011 01:11 AM   [ Ignore ]   [ # 1 ]
Joined  2008-11-22
Total Posts:  529

very impressive and nice done.I’m off from kinect world and don’t have enough info about Depth Tracking but i said wow when i saw the video.
keep up working , we will see more improvement later i believe.


my 19” LCD setup ----> turned into new look
my 60” FTIR setup (old video)

Posted: 25 April 2011 03:03 AM   [ Ignore ]   [ # 2 ]
Joined  2007-04-08
Total Posts:  2539

Great work as usual Hillbilly! This is an interesting technique and I’m sure it’d be useful especially for those on a budget and who don’t need full depth. Keep it up!


MTmini, MTbiggie, & Audiotouch creator & Community Core Vision Co-founder

Follow on:
My Blog | Facebook | Twitter | Youtube

‹‹ MT4j Android      [Vision] DepthTracker Beta ››