1 of 3
1
MTmini Package - How To Setup Touchlib for use with a MTmini
Posted: 09 May 2008 10:07 PM   [ Ignore ]
Avatar
RankRankRankRankRankRank
Joined  2007-04-08
Total Posts:  2539
Dedicated

<div style="padding:15px; background-color:#FFA26F; border:1px solid #C3C3C3; padding-top:0px">
How to Setup Touchlib and Run Multitouch Demos on a MTmini - Software Thread
</div>

digg this MTmini How To Here

<center>
Hardware Thread can be found here: http://nuigroup.com/forums/viewthread/1731/
</center>

This is the main MTmini Software Tutorial and Help thread for getting started. Please post questions or comments in this thread. Any answered questions will be added to the help post below. Either download the Getting Started PDF from the MTmini Package - or continue reading through this thread.

<center>

*New* Software - Tbeta
*New* Mouse Driver for tbeta

*Old Software* Download MTmini Software Package v1 (includes guide below)
*Old Software* Download Getting Started PDF
</center>

<div style="padding:15px; background-color:#FFA26F; border:1px solid #C3C3C3; padding-top:0px">
Table of Contents
</div>

<div style="padding:15px; background-color:#EEEEEE; border:1px solid #C3C3C3; padding-top:0px">
-Table of Contents (Post 1)
-Getting Started – Requirements (Post 1)
-Setup (Post 2)
-Running The Demos (Post 3)
-Help (Post 4)
</div>

<div style="padding:15px; background-color:#FFA26F; border:1px solid #C3C3C3; padding-top:0px">
Getting Started - Requirements
</div>
Software Requirements:

<div style="padding:15px; background-color:#EEEEEE; border:1px solid #C3C3C3; padding-top:0px">
Flash Player 9 (only required if running swf Flash Demos)
Java runtime 1.6+ (only required if running swf Flash Demos)
Visual Studio 2005 SP1 x86 redistributable package (At Optional downloads)

1.  Download the latest version of MTmini Package from http://ssandler.wordpress.com/MTmini
2.  Open the zip file and extract the contents to your preferred location.
</div>

Hardware Requirements:

<div style="padding:15px; background-color:#EEEEEE; border:1px solid #C3C3C3; padding-top:0px">
A prebuilt MTmini (multitouch pad) or front Illumination Multitouch Table.

or:

Quickly Build a MTmini with (video link):

o Cardboard Box
o Transparent/clear material
o Paper
o Webcam
</div>
<center>

 Signature 

MTmini, MTbiggie, & Audiotouch creator & Community Core Vision Co-founder

Follow on:
My Blog | Facebook | Twitter | Youtube

Profile
 
 
Posted: 10 May 2008 01:00 AM   [ Ignore ]   [ # 1 ]
Avatar
RankRankRankRankRankRank
Joined  2007-04-08
Total Posts:  2539
Dedicated

<div style="padding:15px; background-color:#FFA26F; border:1px solid #C3C3C3; padding-top:0px">
Setup
</div>

Configuration – The Touchlib Configapp

<div style="padding:15px; background-color:#EEEEEE; border:1px solid #C3C3C3; padding-top:0px">
1.  Start (double click) Configuration.bat in the main folder.
2.  A Property Sheet dialog box will open that asks for camera configuration.
3.  Choose a setting that works well with your camera and click ‘Ok.’
note: A higher Frame Rate will work better than a higher resolution (Output Size).
</div>
<center>
config1be5.jpg
Figure 1. Configuration Startup and Property Sheet Dialog Box
</center>

<div style="padding:15px; background-color:#EEEEEE; border:1px solid #C3C3C3; padding-top:0px">
4.  Multiple windows will open with images from the camera (see Figure 2).
note: if only grey windows (no image) open or the wrong camera is displayed, skip to the help section at the end of this guide.
5.  Adjust the sliders until the rectify window only has blobs coming from your fingers (no background noise, etc).
6.  When the rectify window is set well, press “ESC” to quit.
7.  The configapp will save your settings in Touchlib_Tracking_Software/config.xml.
</div>
<center>
image006gi1.jpg
Figure 2. Touchlib Configapp
</center>
<div style="padding:15px; background-color:#EEEEEE; border:1px solid #C3C3C3; padding-top:0px">
Capture (1) - is the raw video input (from the camera) window.
Mono (2) - turns the source image into a grey scale image.
Invert (3) - inverts the image Mono2 image.
BackgroundRemove (4) - subtracts the background from the current scene.
Simplehighpass (5) –lets only the brightest spots in the image through.
Scaler (6) – amplifies (bright spots become brighter) the output of the previous filter.
Rectify (7) – the final image that is used for blob tracking.
</div>
<center>

Please visit http://ssandler.wordpress.com/MTmini for future MTmini package updates.

Thank you and enjoy your multitouch device!
</center>

 Signature 

MTmini, MTbiggie, & Audiotouch creator & Community Core Vision Co-founder

Follow on:
My Blog | Facebook | Twitter | Youtube

Profile
 
 
Posted: 10 May 2008 01:01 AM   [ Ignore ]   [ # 2 ]
Avatar
RankRankRankRankRankRank
Joined  2007-04-08
Total Posts:  2539
Dedicated

<div style="padding:15px; background-color:#FFA26F; border:1px solid #C3C3C3; padding-top:0px">
Running The Demos
</div>

Once configuration is complete, it is recommended to first test out Smoke Demo to make sure everything is working properly.

Smoke Demo:
<div style="padding:15px; background-color:#EEEEEE; border:1px solid #C3C3C3; padding-top:0px">
1.  Start (double click) Smoke_Demo.bat in the Demos/C++ Demos folder.
2.  The same Property Sheet dialog box from configapp will load. Select the same settings as before and press ‘Ok.’
3.  A ‘Demo Smoke’ window will load. Touching the multitouch pad should create colored smoke.
4.  Press ‘F’ for full screen and ‘Q’ to quit. If there’s noise (false touches), press ‘B’ at any time to recapture the background and clear the noise.
</div>
<center>
image009lt0.jpg
Figure 3. Smoke Demo windows (left), C++ Demos folder (bottom right), CMD window (top right)
</center>

Windows Mousedriver:
<div style="padding:15px; background-color:#EEEEEE; border:1px solid #C3C3C3; padding-top:0px">
caution: Only use the Windows Mousedriver on a stable setup.

1.  Start (double click) Windows_Mousedriver.bat in the Demos/C++ Demos folder.
2.  The same Property Sheet dialog box from configapp will load. Select the same settings as before and press ‘Ok.’
3.  Once the word ‘recap’ is displayed in the CMD window the multitouch pad will be ready to act as a mouse.
4.  A finger down performs a ‘click’; a double tap performs a ‘double click.’
</div>

Flash Applications:
<div style="padding:15px; background-color:#EEEEEE; border:1px solid #C3C3C3; padding-top:0px">
Steps:

1) Start Server.bat
2) Start Gateway.bat
3) Start Flash Application

Step1) Server.bat
<div style="padding:15px; background-color:#DFEEFF; border:1px solid #C3C3C3; padding-top:0px">
1.  Start (double click) Server.bat in the Main folder.
2.  The same Property Sheet dialog box from configapp will load. Select the same settings as before and press ‘Ok.’
3.  A grey ‘Touch Listener’ window will open (no image will show).
4.  Pressing on the multitouch pad should display “Blob Detected” in the CMD window.
</div>
<center>
image013ez0.jpg
Figure 4. Server.bat (open OSC.exe), Touch Listener (grey window), Blobs detected (CMD window)
</center>

Step2) Gateway.bat

<div style="padding:15px; background-color:#DFEEFF; border:1px solid #C3C3C3; padding-top:0px">
note: Java runtime 1.6+ is required for this step

1.  Start (double click) Gateway.bat in the Main folder.
2.  A FLOSC 2.0 dialog box will load.
3.  Press ‘Start’.
4.  The CMD window should say ‘server started,’ if not, make sure Java runtime 1.6+ is installed.
</div>

<center>
image015tm2.jpg
Figure 5. Gateway.bat connected and ‘server started’
</center>

Step2) Flash Application
<div style="padding:15px; background-color:#DFEEFF; border:1px solid #C3C3C3; padding-top:0px">
1.  Go to the Demos/Flash Demos folder and open any Flash application (exe) file to start the application.
</div></div>

Extras:
<div style="padding:15px; background-color:#EEEEEE; border:1px solid #C3C3C3; padding-top:0px">
More Demos, as well as source code can be found on http://touchlib.googlecode.com and http://www.nuigroup.com on the NUIgroup (Natural User Interface Group) forum.

Developers (C++, .NET/Silverlight/WPF, Flash/Flex/AS3, Obj-C, Processing, PureData/Max MSP) can find more information on developing multitouch applications by visiting http://www.nuigroup.com and checking the NUIgroup (Natural User Interface Group) forum.
</div>
<center>
Please visit http://ssandler.wordpress.com/MTmini for future MTmini package updates.

Thank you and enjoy your multitouch device!
</center>

 Signature 

MTmini, MTbiggie, & Audiotouch creator & Community Core Vision Co-founder

Follow on:
My Blog | Facebook | Twitter | Youtube

Profile
 
 
Posted: 10 May 2008 01:04 AM   [ Ignore ]   [ # 3 ]
Avatar
RankRankRankRankRankRank
Joined  2007-04-08
Total Posts:  2539
Dedicated

<div style="padding:15px; background-color:#FFA26F; border:1px solid #C3C3C3; padding-top:0px">
Help
</div>

Do you have grey screens or the wrong camera loading? Here’s how to fix it:

<div style="padding:15px; background-color:#EEEEEE; border:1px solid #C3C3C3; padding-top:0px">
1.  Go to the Utilities Folder and launch GraphEdit. 
2.  Using GraphEdit, locate your capture source: Graphs-> Insert Filters-> Video Capture Sources
3.  Write down the name of your device exactly. Mine is “Philips SPC900NC PC Camera.”
note: this name can change when you reboot/plug unplug your camera

<center>
image023bv4.jpg
Figure 6. Graphedit Video Capture Sources window
</center>

4.  Go to the “Touchib_Tracking_Software“ Folder and open the DVSL_config.xml file with Notepad. 
5.  Add a friendly_name="Name_of_Your_Camera” attribute to the camera tag like this:

<camera show_format_dialog="true" friendly_name="Philips SPC900NC PC Camera” frame_width="320" frame_height="240" frame_rate="30.0" show_format_dialog= "true">


6.  Your DSVL_config.xml should now look something like this: 

<?xml version="1.0" encoding="UTF-8"?> 
<!--Sample XML file generated by XMLSpy v2005 rel3 U(http://www.altova.com) -->   
   
<dsvl_input xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"  xsi:noNamespaceSchemaLocation="DsVideoLib.xsd">    

<
camera input_device="WDM_CAP" friendly_name="Name of Your Camera"  frame_width="320" frame_height="240" frame_rate="30.0" show_format_dialog="true">
      
<
pixel_format>
<
RGB24/>
</
pixel_format>

</
camera>
    
</
dsvl_input>

</div<<br<<br<

Is your camera flipped the wrong way?<br<

<div style="padding:15px; background-color:#EEEEEE; border:1px solid #C3C3C3; padding-top:0px">
If your camera is flipped the wrong way in Touchlib, first go into your camera settings and see if there’s an option for ‘mirroring’ or ‘flipping’ your camera. If there is, try this option and restart Touchlib Configapp.

If there is no option to flip your camera, then open Configapp and press ‘enter’ to calibrate (once the sliders have been adjusted).

1.  This will launch the Configapp in full screen mode and you’ll see a grid of points (green pluses).
2.  Press ‘c’ to start calibrating.
3.  The current point should turn red. Press on your multitouch pad where the point is (starting on the top left of your pad).
4.  Continue through until all points are calibrated.
5.  When you are all done, you can press ‘ESC’ to quit.
6.  All your changes (slider adjustments and calibration points) are now saved. Now when you run any Touchlib application it will be calibrated (and the image will be flipped the correct way).
</div>

Found a Flash Demo (swf) on NUIgroup and it’s not receiving touch events?

<div style="padding:15px; background-color:#EEEEEE; border:1px solid #C3C3C3; padding-top:0px">
In order to run the swf AS3 applications with touch input (touchlib, TUIO simulator, opentouch, etc.), you need to allow flashplayer’s global security permission to access the file.

There are two methods to do this:

1.  Go here to Flash Global Security Settings and click ‘Always Allow.’ Where it says ‘Always trust files in these locations:’, click ‘Edit Locations’. Navigate to the folder you have your swf files and add either each swf file individually or the whole directory to the locations list.

2.  You can also get to the global security settings page by opening the swf file you want access to, right-click- > Settings. From settings, click on Privacy tab -> Advanced. This will load up the webpage from method 1. Follow the same directions for adding locations as method 1.
</div>

<center>
Please visit http://ssandler.wordpress.com/MTmini for future MTmini package updates.

Thank you and enjoy your multitouch device!
</center>

 Signature 

MTmini, MTbiggie, & Audiotouch creator & Community Core Vision Co-founder

Follow on:
My Blog | Facebook | Twitter | Youtube

Profile
 
 
Posted: 17 June 2008 04:20 PM   [ Ignore ]   [ # 4 ]
Rank
Joined  2008-06-17
Total Posts:  5
New Member

How can I do the touchlib package for Linux capture the negative(the shadows), to use the miniMT?
with the light it is working!

thanks

Profile
 
 
Posted: 17 June 2008 04:35 PM   [ Ignore ]   [ # 5 ]
Avatar
RankRankRankRankRankRank
Joined  2007-04-08
Total Posts:  2539
Dedicated

If you have touchlib working on linux, add the config.xml file from the MTmini package to the one in your touchlib folder in linux.

 Signature 

MTmini, MTbiggie, & Audiotouch creator & Community Core Vision Co-founder

Follow on:
My Blog | Facebook | Twitter | Youtube

Profile
 
 
Posted: 17 June 2008 04:43 PM   [ Ignore ]   [ # 6 ]
Rank
Joined  2008-06-17
Total Posts:  5
New Member

ok, I’ll try it.
Post the result soon

thanks

Profile
 
 
Posted: 17 June 2008 04:48 PM   [ Ignore ]   [ # 7 ]
Rank
Joined  2008-06-17
Total Posts:  5
New Member

not working… all the screens get black!

santo

Profile
 
 
Posted: 17 June 2008 05:01 PM   [ Ignore ]   [ # 8 ]
Rank
Joined  2008-06-17
Total Posts:  5
New Member

got it… I opened the two config files and copied the things that didn t have in the one at miniMT package.
Not very stable but very fine, it’s good bye windows.

thank you, very much, so simple but needed some one to talk it to me

Profile
 
 
Posted: 18 June 2008 10:59 PM   [ Ignore ]   [ # 9 ]
Rank
Joined  2008-06-18
Total Posts:  8
New Member

I have a problem with the flash programs on linux. The programs don’t get any touch input. The smoke program works. I have tried different flash players, fixed the flash global security settings. I have tried toxy, found in this thread http://nuigroup.com/forums/viewthread/1987/ and a tcp-test.swf program. And it works, getting touch input. But Puzzlegame, Multikeyv2 and those programs don’t work :( .
Thanks in advance.

Profile
 
 
Posted: 18 June 2008 11:44 PM   [ Ignore ]   [ # 10 ]
Avatar
RankRankRankRankRankRank
Joined  2007-04-08
Total Posts:  2539
Dedicated

Do you have java 1.6+? Make sure you start osc, then FLOSC (make sure it says it’s connected), and lastly the flash file.

 Signature 

MTmini, MTbiggie, & Audiotouch creator & Community Core Vision Co-founder

Follow on:
My Blog | Facebook | Twitter | Youtube

Profile
 
 
Posted: 19 June 2008 02:46 AM   [ Ignore ]   [ # 11 ]
Rank
Joined  2008-06-18
Total Posts:  8
New Member

I’m running java 1.6+ (java version “1.6.0_06")
and I started everything in the correct order. Still no response.

Edit: Now it works. I don’t know why but FLOSC didn’t recieve any information from osc because of compiz. Strange. :S

Profile
 
 
Posted: 29 June 2008 05:47 PM   [ Ignore ]   [ # 12 ]
Rank
Joined  2008-06-29
Total Posts:  2
New Member

I completed the hardware setup but I’m having problems with the software setup. I tried using two cameras.

Creative Labs NX Pro
- Gray screens, even after adding a Friendly Name
- Does “Video Standard” matter? The screenshot shows “None”, but mine always shows up as “NTSC”

D-Link Webcam (DSB-C110)
- When I run Configuration.bat I only see the top 4 screens (1-4), but 5-7 have nothing.

I’ve downloaded all required software as well.

Any help would be appreciated.

Profile
 
 
Posted: 29 June 2008 05:54 PM   [ Ignore ]   [ # 13 ]
Avatar
RankRankRankRankRankRank
Joined  2007-04-08
Total Posts:  2539
Dedicated

Hi mictorl,

On the one where the 1-4 screens show up. Try pressing “b” once it starts up and see if things appear in the 5-7 screens. Sometimes it takes a while for the camera to fully load and so you have to recapture the background (by pressing ‘b’wink.

I’ll have to look into the friendly name one for the other camera. Did you have both camera’s plugged in at the same time?

 Signature 

MTmini, MTbiggie, & Audiotouch creator & Community Core Vision Co-founder

Follow on:
My Blog | Facebook | Twitter | Youtube

Profile
 
 
Posted: 29 June 2008 06:43 PM   [ Ignore ]   [ # 14 ]
Rank
Joined  2008-06-29
Total Posts:  2
New Member

I got it to work. I had to adjust some sliders, but now the issue is lighting. My box is letting in too much light.

Profile
 
 
Posted: 01 July 2008 05:22 AM   [ Ignore ]   [ # 15 ]
Rank
Joined  2008-07-01
Total Posts:  1
New Member

Hi! I have some problems with software! Configuration works fine! the final wiev from the camera looks like in your manual but the problem is when i start programs(c++ demos) they don’t work! Any idea?!

Profile
 
 
   
1 of 3
1