1 of 13
1
Windows 7: WM_TOUCH to TUIO interface (Dell XT, HP TX2, Lenovo X200, etc. running NUI Group multitouch apps)…
Posted: 12 January 2009 11:36 AM   [ Ignore ]
Avatar
Rank
Joined  2009-01-07
Total Posts:  49
New Member

For Dell XT AND HP TX2, windows 7 and n trig beta multitouch drivers, I made a small applet to translate windows TOUCH events to TUIO, enabling all those nice flash etc multitouch applications to run on current multitouch PC/tablets.
EDIT 26 JAN: Slightly improved version, cf post on page 3.
EDIT 4 FEB: small update, now the Q key quits, and Esc key hides the application correctly.
EDIT 14 FEB: it also runs on HP TX2 (probably requires some more work to calibrate. cf http://nuigroup.com/forums/viewreply/27497/
EDIT 21 JULY: posted a beta that supports calibration, now under development(cf http://nuigroup.com/forums/viewreply/39661/ )
Attached is a preliminary version of the W2TUIO application (made in c#, .Net). Approximately 50 downloads were registered until now (keeps clearing when I update the document)

INSTALLATION
Simple: by extracting the zip archive. (EDIT: Now only 1 executable.)
Make sure to have some MT client applications that run with TUIO. I will attach a zip archive of the standard flash demos+ FLOSC app. in one subsequent post. EDIT: could not upload the files, please find them the “Demos\Flash Demos” folder of http://nuispace.com/ss/MTmini%20package%20v1.zip
other installs:
* Windows 7 beta
* N-Trig beta MT drivers (http://www.n-trig.com/Content.aspx?Page=Multi_Touch )

RUN
0. when running flash MT apps: first start the FLOSC application. (EDIT: in the folder “Touchlib_Tracking_Software\flosc” in the zip file mentioned above)
1. run your favorite MT application - it should NOT run in fullscreen, but maximize instead.
2. go to the W2TUIO folder and double click the application W2TUIO
3. PLAY!
4. quit (keypress “q” or use popup menu on tray icon)

NICE MULTITOUCH APPLICATIONS
http://nuispace.com/ss/MTmini%20package%20v1.zip / mtmini standard demos (cf. subfolders above)
http://mtsimpledesktop.googlecode.com/files/SimpleDesktop_binaries_r0.3.zip mt simple desktop (featured in the youtube movie from Touchmaster below)
http://nuigroup.com/forums/viewthread/5831/ Community Earth - a 3D earth viewing app (aero theme should be selected in my case).

KNOWN BUG: on exit, the mouse cursor is sometimes lost: 
RESOLUTION: on a text editor (email, word whatever) touch somewhere to get a on-screen tip icon.

¨¨
Currently the application is calibrated for a Dell XT, taskbar at the bottom of the screen. Soon, I will work on multiple options/hands-on calbiration.
Request: please post your use of this application - I am curious what you think....

File Attachments
W2TUIO.zip  (File Size: 15KB - Downloads: 4130)
Profile
 
 
Posted: 12 January 2009 10:34 PM   [ Ignore ]   [ # 1 ]
RankRankRank
Joined  2008-04-30
Total Posts:  321
Sr. Member

Pics or it didn’t happen. Not really but it would be cool to see what you are working on and it might give us more insight into what you got going on. The Microsoft lurker has already commented and told us that he will make sure that anything about their multi-touch stuff is seen by the right people at Microsoft.

 Signature 

I’m bad about monitoring posts so if you have a question regarding something I’ve said, then just send me a PM.

Profile
 
 
Posted: 13 January 2009 08:40 AM   [ Ignore ]   [ # 2 ]
Avatar
Rank
Joined  2007-06-17
Total Posts:  98
New Member

Dell Xt Multi Touch applications

Dell xt tablet
Windows 7 build7000
ntrig win7 beta drivers
SimpleDesktop
WM_touch to TUIO

 Signature 

Touchmaster
Multi-Touch Development Inc.
Project:
CompuTable
http://twitter.com/computable
YouTube: http://www.youtube.com/user/CompuTable78
Blog: http://computouch.blogspot.com/

Profile
 
 
Posted: 13 January 2009 08:56 AM   [ Ignore ]   [ # 3 ]
Avatar
Rank
Joined  2009-01-07
Total Posts:  49
New Member

BTW I got the flash tuio clients working - found standalone players in the mtmultitouch package (so I answered my own question number 1). All run pretty well, although my transparent window solution seems to interfere with flash redraws - resulting in weird grey blocks.
I attached two snapshots to this message - don’t want to spend time to figure out to post inline images....

@Touchmaster: I used example code from this c# project: http://employees.claritycon.com/kmarshall/DollarMultiTouch.zip full description: http://blogs.claritycon.com/blogs/kevin_marshall/archive/2008/11/21/beginning-multi-touch-on-windows-7-amp-basic-gesture-recognition.aspx
Have a look at WMTouchForm.cs and in particular the functions wndProc() and DecodeTouch(). This module also has WM_TOUCH* constants and structs inline.
I basically connected this to the Wiimotetui C# TUIO package to sent UDP packets.

Image Attachments
dell multitouch trial 1 - fire.jpgdell multitouch trial 1 - closeup.jpg
Profile
 
 
Posted: 13 January 2009 09:14 AM   [ Ignore ]   [ # 4 ]
Avatar
Rank
Joined  2007-06-17
Total Posts:  98
New Member

Very nice.  What programing language do I need to know, flash?  or c++.  I use C# and silverlight not sure about flash.

 Signature 

Touchmaster
Multi-Touch Development Inc.
Project:
CompuTable
http://twitter.com/computable
YouTube: http://www.youtube.com/user/CompuTable78
Blog: http://computouch.blogspot.com/

Profile
 
 
Posted: 13 January 2009 09:33 AM   [ Ignore ]   [ # 5 ]
Avatar
Rank
Joined  2009-01-07
Total Posts:  49
New Member

@touchmaster: C# is fine, you might not want to use the TUIO intermediate stuff and immediately adapt the code sample I indicated (c# already native windows).
Also have a look at the C# subforum, http://nuigroup.com/forums/viewforum/39/

Profile
 
 
Posted: 16 January 2009 08:38 AM   [ Ignore ]   [ # 6 ]
Avatar
Rank
Joined  2009-01-07
Total Posts:  49
New Member

I plan to upload this W2TUIO application this weekend. Although not all issues have been solved it runs sufficiently well to check out MT clients like the flash demos.
Did not receive that much responses, so will not put too much effort in this…

Profile
 
 
Posted: 16 January 2009 03:10 PM   [ Ignore ]   [ # 7 ]
Rank
Joined  2008-11-06
Total Posts:  9
New Member

I am extremely interested in this subject. However, I am not planning to install the WM7 beta and probably neither do others. This may be the reason that you did not receive that much responses.

If you can make al these beautiful multitouch applications possible on my Dell XT running Vista Ultimate, I will be your greatest fan wink

Profile
 
 
Posted: 16 January 2009 04:42 PM   [ Ignore ]   [ # 8 ]
Rank
Joined  2008-10-31
Total Posts:  37
New Member

I am actually interested in making sure that any TUIO capable senders will be able to work natively with the Win7 applications. Like I can make sure that my table moves notepad around.

Profile
 
 
Posted: 16 January 2009 05:09 PM   [ Ignore ]   [ # 9 ]
RankRank
Joined  2008-08-10
Total Posts:  181
Member

This is awesome! I can’t wait… I will try the app!

Are you able to turn on all the improved touch UX across windows?
(examples: drag “destination menus” up, from the taskbar icons, scrolling “bumps” window when list scroll reaches max, etc?)
I saw videos of all this on, and there is no comparison with anything made on Vista before (because it is supported at a low level)…
In Windows 7, multitouch is not just seen as a mouse (or mice). The interaction is improved.

Don’t go thinking that noone is interested

smile

Profile
 
 
Posted: 16 January 2009 06:53 PM   [ Ignore ]   [ # 10 ]
Avatar
Rank
Joined  2007-06-17
Total Posts:  98
New Member

I have the windows 7 beta install but am reluctant installing ntrig bete drivers due to the problems I was having with the last win7 build.  I would get intermittent false touches with the beta ntrig drivers installed.  Is this fixed with the 7000 build?

 Signature 

Touchmaster
Multi-Touch Development Inc.
Project:
CompuTable
http://twitter.com/computable
YouTube: http://www.youtube.com/user/CompuTable78
Blog: http://computouch.blogspot.com/

Profile
 
 
Posted: 18 January 2009 04:55 AM   [ Ignore ]   [ # 11 ]
Avatar
Rank
Joined  2009-01-07
Total Posts:  49
New Member

@Touchmaster and all interested in the n-trig drivers and native multitouch support: check out the video review of rob bushway of the new betas (both w7 and ntrig drivers have improved a lot) http://www.gottabemobile.com/2009/01/14/gbm-inkshow-windows-7-beta-1-multi-touch-video/
I can attest that all the effects are working correctly in w7, for example the inertia scrolling. However, not all apps support this.

the simple w2tuio bridge has its shortcomings, for example I cannot yet pass touch events to fullscreen-only apps (like the XNA-based games from of http://nuigroup.com/forums/viewthread/4121/).  However, all flash apps run swell (with a minor calibration error, will fix this later).

For reasons of compatibility (??), I am also not able to run the NASA worldwind plugins so no true MT earth app..... Help would be appreciated!
will finalize the app tonight.
-jouke

Profile
 
 
Posted: 18 January 2009 12:32 PM   [ Ignore ]   [ # 12 ]
RankRank
Joined  2008-08-10
Total Posts:  181
Member

On Vista, I had to turn off UAC and DEP (2 important security features - love them or hate them) for Touch NASA WW to work and load online images (virtual earth)
Not sure if this is the same issue

thanks for the hard work! I cant wait to try smile

Profile
 
 
Posted: 18 January 2009 06:33 PM   [ Ignore ]   [ # 13 ]
Avatar
Rank
Joined  2009-01-07
Total Posts:  49
New Member

EDIT: COPIED THIS + ATTACHMENT TO Original Post.
Attached is a preliminary version of the W2TUIO application, which runs on windows 7 beta. EDIT: a small bug was fixed (cf. post ToucMaster on page 2)

INSTALLATION
Simple: by extracting the zip archive.
Make sure to have some MT client applications that run with TUIO. I will attach a zip archive of the standard flash demos+ FLOSC app. in one subsequent post. EDIT: could not upload the files, please find them the “Demos\Flash Demos” folder of http://nuispace.com/ss/MTmini%20package%20v1.zip
other installs:
* .NET The application was made with .NET -> you might have to install/download some .NET frameworks (not sure, did not have to do this myself).
* N-Trig beta MT drivers (http://www.n-trig.com/Content.aspx?Page=Multi_Touch )

RUN
0. when running flash MT apps: first start the FLOSC application. (EDIT: in the folder “Touchlib_Tracking_Software\flosc” in the zip file mentioned above)
1. run your favorite MT application - it should NOT run in fullscreen, but maximize instead.
2. go to the W2TUIO folder and double click the application W2TUIO
3. PLAY!
4. quit (keypress “q” or use popup menu on tray icon)

KNOWN BUG: on exit, the mouse cursor is sometimes lost: 
RESOLUTION: on a text editor (email, word whatever) touch somewhere to get a on-screen tip icon.

Plans:
When >3 people can run it, I’ll put it on the showcase forum and send it to some other reviewers. After some code cleanup, I’ll put the sources on codeplex or thelike....

Profile
 
 
Posted: 19 January 2009 03:47 AM   [ Ignore ]   [ # 14 ]
Avatar
RankRankRankRankRankRank
Joined  2008-09-12
Total Posts:  2225
Dedicated

Ok so Im trying to understand what you have accomplished here....?  Basically you’ve taken the windows 7 ability to work with multitouch and combined it with the TUIO interface (FLOSC server, etc) and thus allowed existing touch devices like laptops to work with the same interaction that we have been doing with the constructed MT tables around here.  AND/OR, you’ve created a way for the MT tables around here that use the TUIO interface to control windows 7, just like we were one of the special people at CES this year demoing our new MT device that was running windows 7.  Thus meaning that you have created a way for windows 7 to be the MT OS that has native multi-touch interaction built in that we can manipulate with our MT tables here, without having to buy a new multitouch screen when M$ finally puts out a product worth using over vista.

 Signature 

MT Website - A Collection of the Most Relevant Multitouch Info From These Forums
Multitouch Blog
Multitouch Parts Store - Buy Infrared Touch Frames (No Camera Needed!), Complete Modified Cameras and DIY Upgrade Kits, m12/CS Mounts, m12/CS Lenses, Infrared Lasers, LEDs, etc

Profile
 
 
Posted: 19 January 2009 05:02 AM   [ Ignore ]   [ # 15 ]
Avatar
RankRankRankRank
Joined  2006-11-09
Total Posts:  1493
Administrator

great work joukev look forward to trying this out!

 Signature 

~

Profile
 
 
   
1 of 13
1