1 of 4
1
CCV with Kinect(both CLNUIPlatform driver and OpenNI’s driver could use)
Posted: 07 January 2011 09:19 AM   [ Ignore ]
Avatar
Rank
Joined  2009-03-23
Total Posts:  33
New Member

a very simple demo. adapted from CCV1.2, use AlexP’s CL NUI Platform driver, do threshold on the depth data. the rgb image is only for display

i’m sorry but in my country youtube and vimeo is blocked. so please visit http://v.youku.com/v_show/id_XMjM1MzE2MTY0.html to watch the video if you are interested.

attached is the relative codes.

1) install kinect’s driver
i’m using AlexP’s CL NUI Platform(version: CL-NUI-Platform-1.0.0.1121 (see the attachment below), it doesn’t work for the later version). After installation, run CLNUIDeviceTest.exe to see if kinect works correctly.

2) check out CCV from http://nuicode.svnrepository.com/svn/tbeta/trunk/tbeta/Windows
i’m using revision 210.

3) modify CCV following steps below:
3.1) put ofxKinectCLNUI under addons
3.2) put CLNUIDevice.dll under other\dlls
3.3) substitute ofxNCoreVision.h and ofxNCoreVision.cpp under addons\ofxNCore\src\Modules
3.4) substitute config.xml under apps\addonsExamples\VS2008\bin\data
3.5) substitute calibration.xml under apps\addonsExamples\VS2008\bin\data
3.6) substitute Community Core Vision.vcproj under apps\addonsExamples\VS2008

about the calibration, since we are doing kind of “air-touch”, i think it’s not necessary to do CCV’s original precise calibration point by point. so i manyally modified the calibration.xml, just map the four corners, i.e.
image screen
0,0 0,0
camWidth,0 1,0
camWidth,camHeight 1,1
0,camHeight 0,1

feedbacks and comments are welcome~

=======kinect-CCV with OpenNI driver========
since lots of people are using openni’s driver, below is the kinect-CCV with OpenNI’s driver.

1)install kinect driver
1.1)Uninstall all the old kinect drivers.
1.2)Install OpenNI: OpenNI-Bin-Win32-v1.0.0.25.exe download here:http://www.openni.org/downloadfiles/openni-binaries/21-stable
1.3)Install Sensor: SensorKinect-Win32-5.0.0.exe download here:http://dl.dbank.com/c059av7eg5
1.4)Install NITE:NITE-Win32-1.3.0.17.exe download here:http://www.openni.org/downloadfiles/openni-compliant-middleware-binaries/34-stable
CD-KEY:  0KOIk2JeIBYClPWVnMoRKn5cdY4=

the following steps are almost the same like the one with CLNUIPlatform’s driver.

2) check out CCV from http://nuicode.svnrepository.com/svn/tbeta/trunk/tbeta/Windows
i’m using revision 210.

3) modify CCV following steps below:
3.1) put ofxKinectOpenNI under addons
3.2) substitute ofxNCoreVision.h and ofxNCoreVision.cpp under addons\ofxNCore\src\Modules
3.3) substitute config.xml under apps\addonsExamples\VS2008\bin\data
3.4) substitute calibration.xml under apps\addonsExamples\VS2008\bin\data
3.5) substitute Community Core Vision.vcproj under apps\addonsExamples\VS2008

the attached file “kinect_openni_touch.rar” contains all the necessary file(src and exe). it should work if you directly put the exe with CCV1.2
enjoy~~~

Image Attachments
1-2011-01-07 22-17-37.jpg
File Attachments
CCV-kinect.rar  (File Size: 160KB - Downloads: 2530)
CL-NUI-Platform-1.0.0.1121.rar  (File Size: 702KB - Downloads: 2158)
kinect_openni_touch.rar  (File Size: 644KB - Downloads: 2039)
 Signature 

http://www.cnblogs.com/yangyangcv/

Profile
 
 
Posted: 07 January 2011 10:19 AM   [ Ignore ]   [ # 1 ]
Rank
Joined  2010-02-13
Total Posts:  22
New Member

its cool .....
you used the original CCV or you made some changes on it ?

Profile
 
 
Posted: 07 January 2011 02:11 PM   [ Ignore ]   [ # 2 ]
Avatar
RankRankRankRank
Joined  2006-11-09
Total Posts:  1499
Administrator

Wow this is really awesome yaya… Could you share some on how you are getting the image from driver to CCV? Would love to get this in mainline build. There is a lot of potential here with mixing CCV+Kinect… smile

Cheers, Christian

 Signature 

~

Profile
 
 
Posted: 07 January 2011 03:45 PM   [ Ignore ]   [ # 3 ]
Avatar
RankRank
Joined  2009-04-07
Total Posts:  146
Member

This is great. Share with us.

 Signature 

AirControl MultiTouch Game: http://nuigroup.com/forums/viewthread/11178/
My MT table: http://nuigroup.com/forums/viewthread/11565/

Profile
 
 
Posted: 07 January 2011 07:56 PM   [ Ignore ]   [ # 4 ]
Avatar
RankRankRank
Joined  2009-11-09
Total Posts:  489
Sr. Member

woohooo finally!!!

 Signature 

My DSI Project:

DSI Table
Proj.Surface: 7D006 on top
2x PS3 Camera from Peau with 850BF & 3.6mm lense
Endlightend XXL (10mm)with 850nm LED strip

Projector: SANYO DWL100 ~ 950€

PC:
Core i5, 8GB Ram, HD5850

Profile
 
 
Posted: 07 January 2011 09:29 PM   [ Ignore ]   [ # 5 ]
Avatar
Rank
Joined  2009-03-23
Total Posts:  33
New Member
the dark prince - 07 January 2011 10:19 AM

its cool .....
you used the original CCV or you made some changes on it ?

just some minor changes on CCV:
1) read image from kinect
2) threshold on the depth image to get a black/white image
3) copy black/white image into CCV’s processedImg
then the original CCV will take care all the other things.

 Signature 

http://www.cnblogs.com/yangyangcv/

Profile
 
 
Posted: 07 January 2011 09:34 PM   [ Ignore ]   [ # 6 ]
Avatar
Rank
Joined  2009-03-23
Total Posts:  33
New Member
Christian Moore - 07 January 2011 02:11 PM

Wow this is really awesome yaya… Could you share some on how you are getting the image from driver to CCV? Would love to get this in mainline build. There is a lot of potential here with mixing CCV+Kinect… smile

Cheers, Christian

wow, so pround that you appreciate this. i would definitely share the code. just need some time to clean the codes

 Signature 

http://www.cnblogs.com/yangyangcv/

Profile
 
 
Posted: 07 January 2011 11:24 PM   [ Ignore ]   [ # 7 ]
Avatar
RankRankRankRank
Joined  2006-11-09
Total Posts:  1499
Administrator

@Yaya

Take your time, please let us know if you need any help testing or when your ready to release and we’ll help spread the word. I think it will be rather easy to create some controls to adjust the depth calibration like in this video: http://nuigc.com/kinectdepth

Is it ok if I put your kinect video on youtube? I will link to your original post and include video at top of this thread (Youku is rather slow in US)

A big thanks for taking the initiative on this I am sure it will help many members learn about Computer Vision with Depth Data. Its a honor to work with members like yourself and all the passionate people within the community.

PS Great avatar with panda wink

 Signature 

~

Profile
 
 
Posted: 08 January 2011 05:06 AM   [ Ignore ]   [ # 8 ]
Avatar
Rank
Joined  2009-03-23
Total Posts:  33
New Member
Christian Moore - 07 January 2011 11:24 PM

@Yaya

Take your time, please let us know if you need any help testing or when your ready to release and we’ll help spread the word. I think it will be rather easy to create some controls to adjust the depth calibration like in this video: http://nuigc.com/kinectdepth

Is it ok if I put your kinect video on youtube? I will link to your original post and include video at top of this thread (Youku is rather slow in US)

A big thanks for taking the initiative on this I am sure it will help many members learn about Computer Vision with Depth Data. Its a honor to work with members like yourself and all the passionate people within the community.



PS Great avatar with panda wink

well, youtube is blocked in my country. although i use VPN, it’s very very slow. so sadlly i can only watch the very first part of the video on http://nuigc.com/kinectdepth

about the depth calibration, do you mean letting the program adjust the depth threshold automatically? in my version i use two double values:kineticLowBound and kineticUpBound in the config file. i have some preliminary ideas about the automatic adjusting. i.e., in the initialization phase, people stand right before kinect and stick their two hands, the program increase the threshold from, say 1, to 1000, and record the value when there are two blobs(corresponding to the two hands), and also the value when there are only a big blob(corresponding to the whole body) and then use these two values to determine the final threshold. i think microsoft do this thing in XBox’s setup step.

p.s. feel free to put the video on youtube. i’m very happy to share with people

 Signature 

http://www.cnblogs.com/yangyangcv/

Profile
 
 
Posted: 08 January 2011 05:30 AM   [ Ignore ]   [ # 9 ]
Avatar
RankRank
Joined  2009-04-07
Total Posts:  146
Member

You can use proxy for you tube.
Can you put automatic and manual.

You are making big move.

 Signature 

AirControl MultiTouch Game: http://nuigroup.com/forums/viewthread/11178/
My MT table: http://nuigroup.com/forums/viewthread/11565/

Profile
 
 
Posted: 08 January 2011 05:44 AM   [ Ignore ]   [ # 10 ]
Avatar
Rank
Joined  2009-03-23
Total Posts:  33
New Member
filip911 - 08 January 2011 05:30 AM

You can use proxy for you tube.
Can you put automatic and manual.

You are making big move.

well, proxy is still slow…
anyway, you can try this beta version in my first post to see if there’s any bugs
automatic is the second step lol

 Signature 

http://www.cnblogs.com/yangyangcv/

Profile
 
 
Posted: 10 January 2011 03:35 PM   [ Ignore ]   [ # 11 ]
Rank
Joined  2009-11-18
Total Posts:  60
New Member

The video looks great! I don’t have a kinect yet but I will definitely by one to try this out!

Do you think that is possible to run two versions of CCV at the same time with a PS3 eye and a kinect? The one with the PS3 eye could use TUIO UDP with accurate calibration to use the Multitouch vista driver and Windows 7 touch events. The one with Kinect would use FLASH XML for scaling, rotating and zooming functions in flash applications.

Regards

Profile
 
 
Posted: 10 January 2011 08:25 PM   [ Ignore ]   [ # 12 ]
Avatar
Rank
Joined  2009-03-23
Total Posts:  33
New Member
Fike - 10 January 2011 03:35 PM

The video looks great! I don’t have a kinect yet but I will definitely by one to try this out!

Do you think that is possible to run two versions of CCV at the same time with a PS3 eye and a kinect? The one with the PS3 eye could use TUIO UDP with accurate calibration to use the Multitouch vista driver and Windows 7 touch events. The one with Kinect would use FLASH XML for scaling, rotating and zooming functions in flash applications.

Regards

well, i don’t have a PS3, so i tried with kinect and a video file. one CCV run with kinect and sends FLASH, the other CCV runs with a video file and sends OSC. for this case, it works. so i think for you case, it should also work.

 Signature 

http://www.cnblogs.com/yangyangcv/

Profile
 
 
Posted: 10 January 2011 08:31 PM   [ Ignore ]   [ # 13 ]
Avatar
RankRankRankRank
Joined  2008-02-12
Total Posts:  1120
Member

could you upload a compiled version also.

 Signature 

Company Website - Knode Research and Development
My Youtube

Profile
 
 
Posted: 10 January 2011 08:53 PM   [ Ignore ]   [ # 14 ]
Avatar
Rank
Joined  2009-03-23
Total Posts:  33
New Member

well, here is a compiled version for CCV with kinect

File Attachments
CCV-kinect-win32.rar  (File Size: 8060KB - Downloads: 2178)
 Signature 

http://www.cnblogs.com/yangyangcv/

Profile
 
 
Posted: 10 January 2011 09:46 PM   [ Ignore ]   [ # 15 ]
Rank
Joined  2009-11-18
Total Posts:  60
New Member

Thanks a lot! That is great news. I will buy a kinect asap to try it out and report the results!

Profile
 
 
   
1 of 4
1