1 of 2
1
Cocoa OSC and TUIO questions
Posted: 21 July 2008 04:09 AM   [ Ignore ]
New Member
Avatar
Rank
Total Posts:  83
Joined  2008-03-23

Hello all,

I am in the midst of developing up a cocoa implementation of multitouch stuff.  I was originally going to just build the framework and then build some apps on top of that (bypassing the TUIO stuff) but there has been enough interesting in a TUIO solution that I have redirected my efforts.

Anyway, 2 things:

1) i have implemented a mostly Cocoa-only OSC sender/listener ‘framework’ (it isnt a framework yet, just a bunch of source files).
It does all the bit-level ordering and decoding of OSC datagrams. It is a connectionless UDP implementation (which seems to be the going thing for OSC).  The only big note at the moment is that if you are going to use it to dispatch messages for your own code (and i hope you do) you will need to develop your own dispatch code.  BBOSC will receive the packets and decode them into bundle and message objects, so that is all done, but you would need to add your own code to make the “/osc/command arg1 arg2 arg3” do anything besides log to the console.  I plan to add a nice callback registry for all that stuff, but i wanted to get the TUIO working in BBTouch first.

anyhow, what is there seems to be working dandy.  you can get the code here:

http://code.google.com/p/bbosc/

and some notes here

http://benbritten.com/blog/2008/07/21/osc-now-with-more-cocoa/

2) the second thing is my question:  I am new to the TUIO/OSC bandwagon.  Implementing the protocol wont be too bad, but I will need to test it against something that is TUIO capable.  So what out there is TUIO capable that runs on the mac?  (that is preferably free and or open source) I can write my own, but that doesnt really test whether my stuff is compatible with other people’s stuff grin

I vaguely remember reading about some flash apps that should work (i do actually have flash 3, so i wouldn’t have to buy that) but i couldn’t seem to find them in my various searches on the forums.  any help would be greatly appreciated!

cheers!
-panda

 Signature 

http://benbritten.com/blog/category/multitouch/

Profile
 
 
Posted: 21 July 2008 04:39 AM   [ Ignore ]   [ # 1 ]
New Member
Avatar
Rank
Total Posts:  24
Joined  2008-06-16

Hello,
a proper OSC and TUIO Framework for Cocoa would be great.
I am willing to help you with the effort, since I am interested to maintain a uniform API across platforms and programming languages.
Did you have a look at the latest C++ TUIO client implementation already (1.4pre1 or from CVS) ?

You can use the TUIO Simulator on the Mac and try it with the Java or C++ TUIO Client examples.
All that should be working fine on the mac.

best,
Martin.K

 Signature 

reacTIVision framework: http://reactivision.sf.net/
TUIO protocol specification: http://reactable.iua.upf.edu/?tuio
reacTIVision & TUIO CVS: http://sourceforge.net/projects/reacTIVision

Profile
 
 
Posted: 21 July 2008 05:01 AM   [ Ignore ]   [ # 2 ]
New Member
Avatar
Rank
Total Posts:  83
Joined  2008-03-23

Hey Martin!

thanks for that, i think the TUIO_flash app is what i am looking for.  I feel like a bit of an idiot, i was all over the reactivision site earlier and somehow managed to miss all those files that were right under my nose.. ahh well.. sometimes i am dumb..

Cheers!
-panda

and to answer your question I am working to make my stuff compatible with the TUIO spec as outlined on the reactivision website grin

 Signature 

http://benbritten.com/blog/category/multitouch/

Profile
 
 
Posted: 21 July 2008 05:16 AM   [ Ignore ]   [ # 3 ]
New Member
Avatar
Rank
Total Posts:  24
Joined  2008-06-16

Hello again,
of course the TUIO spec from our web site is a good starting point,
what I meant is the TUIO client callback and polling API I introduced with the reacTIVision 1.4 release.
best,
Martin.K

 Signature 

reacTIVision framework: http://reactivision.sf.net/
TUIO protocol specification: http://reactable.iua.upf.edu/?tuio
reacTIVision & TUIO CVS: http://sourceforge.net/projects/reacTIVision

Profile
 
 
Posted: 21 July 2008 06:38 AM   [ Ignore ]   [ # 4 ]
New Member
Avatar
Rank
Total Posts:  83
Joined  2008-03-23

Hey Martin,

i will definitely get that source and have a look, thanks for that!

cheers!
-panda

 Signature 

http://benbritten.com/blog/category/multitouch/

Profile
 
 
Posted: 21 July 2008 08:57 AM   [ Ignore ]   [ # 5 ]
Jr. Member
Avatar
RankRank
Total Posts:  179
Joined  2008-06-04

Thanks Panda. I have been eagerly following BBtouch. I will try out some of the new code later this evening. Cant wait for that TUIO implementation! 

Also i have tried touchlib, i can tell you that bbtouch’s blob regognition is much more powerfull in dection of faint blobs it work v well! : )

 Signature 

}---)))@

Profile
 
 
Posted: 21 July 2008 07:42 PM   [ Ignore ]   [ # 6 ]
New Member
Avatar
Rank
Total Posts:  83
Joined  2008-03-23

thanks for the compliment ajlovegrove!

i hope it works well for you! I am just glad that other people are able to make use of my silly code grin

Cheers!
-panda

 Signature 

http://benbritten.com/blog/category/multitouch/

Profile
 
 
Posted: 22 July 2008 02:35 AM   [ Ignore ]   [ # 7 ]
Jr. Member
Avatar
RankRank
Total Posts:  179
Joined  2008-06-04

Not at all, i’ve been waiting patiently for a way to get bbtouch to comunicate with other stuff, im gunna see if it will talk to Quartz Comp through the TUIO patch i found at reactivision. Keep up the good work!

 Signature 

}---)))@

Profile
 
 
Posted: 23 July 2008 04:47 AM   [ Ignore ]   [ # 8 ]
New Member
Avatar
Rank
Total Posts:  83
Joined  2008-03-23

Hey AJ

the TUIO QC patch may only work with fiducials.  In which case it wont work with BBtouch (since BBtouch only generates TUIO cursor events)

Anyhow, i may be wrong about that, but i think that is the case grin

In any case, more QC integration is on my list of things to get to (eventually grin so there is that grin

-p

 Signature 

http://benbritten.com/blog/category/multitouch/

Profile
 
 
Posted: 23 July 2008 07:01 AM   [ Ignore ]   [ # 9 ]
Jr. Member
Avatar
RankRank
Total Posts:  179
Joined  2008-06-04

Cheers Panda,

The new improved BBtouch works great, I’ve had no camera errors with my DV cam it just works smile.  Your right about the fiducial only support for the patch from reactivision but Larky found another from Kineme which i downloaded, However still no joy.  Is there a simple way to view the packets created by the TUIO generation?

 Signature 

}---)))@

Profile
 
 
Posted: 23 July 2008 07:06 AM   [ Ignore ]   [ # 10 ]
New Member
Avatar
Rank
Total Posts:  24
Joined  2008-06-16

Hello,
I already have a new TUIO_Quartz client, which I am planning to release with the next reacTIVision 1.4pre2.
This will have TuioObject + TuioCursor support and will go be more flexible to configure.

The code also includes some C++ top Objective C wrappers, since it is based on my C++ TUIO client.
best,
Martin.K

 Signature 

reacTIVision framework: http://reactivision.sf.net/
TUIO protocol specification: http://reactable.iua.upf.edu/?tuio
reacTIVision & TUIO CVS: http://sourceforge.net/projects/reacTIVision

Profile
 
 
Posted: 23 July 2008 07:24 AM   [ Ignore ]   [ # 11 ]
New Member
Avatar
Rank
Total Posts:  83
Joined  2008-03-23

Martin,

excellent!  i will definitely check that out grin

AJ,

there are a bunch of TUIO clients and servers on the reactivision website (those guys are great grin I used the OSC dump program for testing as well as the processing one (since that is all free and everything).  you can fairly easily see the TUIO command output from either of those.
I went to the Kineme website and all i could find were other links to the original QC patch from reactivision (ie fiducials only) I know that Pawel was talking about a QC patch that he had worked on (might be the same one?) that may have cursor support. 

In the meantime, if you want, I could ‘fake’ fiducial events from bbtouch (ie generate a fiducial for each blob, there would be no rotational info or any of teh other nice fiducial stuff, but it might make the QC stuff work for the time being, at least until the stuff martin is working on is available?

The big problem with faking it is that you would have to ignore the fiducial ID, since there is no good way to identify a blob. i would probably just have to make up some arbitrary ID for every fake fiducial.  Anyhow, this would not be the best route to go for future development, but might get you testing out your stuff quicker… (especially since i do want to add fiducial support to BBTouch in the future)

anyway, just thinking out loud here grin

cheers!
-panda

 Signature 

http://benbritten.com/blog/category/multitouch/

Profile
 
 
Posted: 23 July 2008 09:53 AM   [ Ignore ]   [ # 12 ]
Jr. Member
Avatar
RankRank
Total Posts:  179
Joined  2008-06-04

Panda thanks for the help, At the momement i am not to fussed about fiducial intergration as i have a FTIR setup.  But i think for you to intergrate that would be good but only if the app doesnt suffer because of it. For me just using blobs to do things is great because ultimatley i think fiducial type interfaces are over complicated. ( only my opinion dont burn me on a stake! ) Although the reactible is fantastic!  Some shape recognition would be good. Congrats on your efforts so far.

 Signature 

}---)))@

Profile
 
 
Posted: 23 July 2008 11:41 AM   [ Ignore ]   [ # 13 ]
New Member
Avatar
Rank
Total Posts:  24
Joined  2008-06-16

Hello,
I just took the time and quickly updated my TUIO Quartz Composer patch and added it to the TUIO/reacTIVision CVS on sourceforge.
As I said before, this is based on the latest TUIO C++ client with some minor Objective C wrappers in order to embed it into the Quartz Composer plugin.
If any more experienced Cocoa programmer has some suggestions, please let me know, since I did that rather quickly some time ago for a group of students.

have fun,
Martin.K

 Signature 

reacTIVision framework: http://reactivision.sf.net/
TUIO protocol specification: http://reactable.iua.upf.edu/?tuio
reacTIVision & TUIO CVS: http://sourceforge.net/projects/reacTIVision

Profile
 
 
Posted: 23 July 2008 12:13 PM   [ Ignore ]   [ # 14 ]
Jr. Member
Avatar
RankRank
Total Posts:  179
Joined  2008-06-04

As Mr Burns would say “ Excellent! “ and know rub hands coily!

 Signature 

}---)))@

Profile
 
 
Posted: 23 July 2008 12:28 PM   [ Ignore ]   [ # 15 ]
Jr. Member
RankRank
Total Posts:  231
Joined  2008-02-01

@allovegrove, you had no luck with the new Quartz patch?  It works fine here, are you putting it in the correct place?  The patches don’t go in the place they used to, I think off the top of my head they go in Mac HD/Library/GRaphics/Quartz Composer Patches… put it in there.

Ignore me if you already know this. smile

 Signature 

fingerpuk.tumblr.com

Profile
 
 
   
1 of 2
1