It would be nice to have a discussion on the major performance bottlenecks in Touchlib / Flash / Flosc - the main issues to improve the performance of the system.

My (unprioritised) top list:
1. Flash using XMLSocket to read Flosc’s xml data
2. The fact we repackage OSC’s TUIO messages in XML in Flosc at all
3. Sleep functions in CTouchScreen and OSC that mean that camera processing is out of sync
4. Permute2 recursive function for tracking the blobs

What do you think? And are there other issues?

E.

Hey just found this thread, and it seams at least 3 of the 4 major bottlenecks are being or have been fixed recently. Good news?!

Great list Erik I will take note of it.

Luckily weyforth is helping take care of many of these issues.

Also Flash 10 SHOULD support UDP protocol which would REALLY remove the need to convert from UDP to TCP (XML)

Yeah i am checking out Toxy and it looks really promising, can;t wait to run it on our setup.

The UDP fix on Flash 10, does that also mean you can listen to a socket directly or is still the XML socket needed?

Cheers
Erik

We also shouldn’t forget AlexP for working on touchlib itself. I hadn’t heard about UDP in Flash 10, that should be cool. It also shouldn’t be too hard to make the classes I’ve written work with it. Can anyone elaborate on this UDP support in Flash 10?

http://justin.everett-church.com/index.php/2008/05/16/rtmfp-in-flash-player-10-beta/

To enable RTMFP and the UDP transport, authorization from a future server-based technology such as Adobe Flash Media Server will be required.

I guess that udp will be included only as part of new RTMF protocol, so basically someone should reverse engineere the protocol and then send data in such way
that flash 10 can understand it.

I was thinking the same thing jet-plane

http://justin.everett-church.com/index.php/2008/05/16/rtmfp-in-flash-player-10-beta/
“To enable RTMFP and the UDP transport, authorization from a future server-based technology such as Adobe Flash Media Server will be required.”

Will we need FMS running? if so could we use Red 5?

Toxy does work fine with our setup, speedup is quite remarkable, so good work there guys!

With Toxy working, do you still regard this Flash connection as a bottleneck?

Cheers,
Erik