NUI Group - Open Source Interface

Official MultiTouchVista Thread

2008-02-22T17:52:45Z

Finaly I made a video of multitouch shell I’m working on.
On this video you can see a normal windows applications that can be rotated and moved in “multitouch"-style.

[youtube]1jejZDzB0mU[/youtube]
[youtube]jIxQZo96LTM[/youtube]
[youtube]SqvFTbQASeA[/youtube]

Microsoft Windows Phone 7 multitouch on TX2

2010-03-19T03:40:40Z

http://www.youtube.com/watch?v=Bllyh9FEURo

It’s the emulator thats why its kinda slow
but m impressed really i didnt think it would be this good

quick TUIO Bridge that works with Win7 and dell sx2210t

2010-03-06T01:18:30Z

with many thanks to ChrisLott and his NWToTUIO script, i was able to kludge together a decent working TUIO Bridge that works on windows 7 and the dell sx2210t touch screen. I had no luck getting any of the other windows 7 NW touch or any of the other NextWindow bridges to work.

(In theory this bridge will work with any touch enabled windows system, but I havent tested it. (and it is a hack anyhow))

Chris’s quick script was just a tuio sender glued to the sample code from NextWindow, and that was 95% perfect for what I wanted. It worked. Mostly.

The big problem with that script was that the TUIO stream was only updated when there was touch data coming in from the monitor. This works as long as there is always a touch on the screen. (which isnt very practical) turns out when you take your finger off the screen, there is no longer any touch data and the TUIO stream does not get updated with an empty set of touches so the last touch just lingers there forever. Note: this is a problem with the Nextwindow sample code.

Anyhow I took Chris’s code and added a timer to it so that updates the TUIO stream at a constant rate and properly updates when there are no touches present.

Attached is the code and the binary. With some caveats: I am NOT a windows programmer. I haven’t done any serious windows work since windows NT. In order to get this running I grabbed VS Express and just waded in. I probably did a crap job, and I would love for someone to come in and clean up the code and do it properly.

source can be found here:
https://benbritten.s3.amazonaws.com/NWToTuio_BB_SRC.zip

possibly working binary can be found here:
https://benbritten.s3.amazonaws.com/NWToTUIO_BB.zip

A Carousel / Pack of Cards - Custom Control on Surface

2010-03-10T07:31:38Z

Hello everybody,

I could really use the benefit of your expertise (again). I am trying to design a custom control for a surface application in C#/WPF. The effect I’m after is like a carousel of cards which can be rotated, but also individual cards can be drawn out and used (as scatterview items). I have attached a picture of our mockup (for four simultaneous users).

So far I have created a custom class called Card which is derived from ScatterViewItem. I have the rotation and position maths in place so I can operate the wheel using, at the moment, a surfaceSlider control and linking up its value.

So what I am thinking is, when a touch event is fired from the scatterviewitems, I can mark it as handled, then calculate whether the drag gesture is radial or orthoganal (not sure on terms - I mean either alond the circumference = rotate wheel, or radially outward = drag card out of pack).

When the card is dragged out, i’d like it to be used like a normal scatterview item.

Can you advise me on how best to acheive this, - it’s a little out of my (limited) range of expertise.

Many Thanks in advance,

Ricky

Multitouch on Windows book

2010-03-01T16:43:12Z

I’m writing a Manning book called Multitouch on Windows - NUI development with WPF and Silverlight. I thought that you guys would be interested in it.

The Manning Early Access Program, or MEAP, of my book launched last week. That means if you pre-order the eBook or printed book, you also get the MEAP and can read chapters as I write them. Current chapters 1 and 4 are up, but they send MEAP subscribers new PDFs every time I post a new chapter or make an update. Chapter 1 is also available for free at the link below.

There is a special deal available right now for 35% off until March 3rd. Order the MEAP+eBook or MEAP+eBook+print book through this link and use coupon code m335 when checking out.

If any of you get a chance to read chapter 1 or the MEAP, I’d appreciate any feedback positive or negative. You can post here or in the Author Online forum linked from the book page.

multitouchvista issue with CCV 1.3A and Windows 7

2009-12-22T18:40:42Z

So i dont know what i am doing wrong. I am using CCV 1.3A
I went ahead and downloaded the Second Release of multitouchvista driver http://multitouchvista.codeplex.com/Release/ProjectReleases.aspx?ReleaseId=28979

In the Driver Directory there was an installdriver executable.

I ran it and clicked accept and install anyway option.

Then according to video you should disable the driver and then re-enable it. I did this.
I then went to Service Console and ran it and no errors.

Then I launch the configurator and select TUIO

I launch CCV 1.3A and i select TUIO UDP

I then try and select the “Start” button but nothing happens. I watched the videos and tutorials, am i missing something? I am stress testing my box, but i am wondering does Windows 7 needs to be restarted after this?

What am i missing?

MIRIA now supporting Windows 7 / Silverlight 3 multitouch

2009-08-05T21:00:33Z

MIRIA now supports multitouch devices through standard SL3/W7 multitouch API.
By using MIRIA for developing your multitouch Silverlight 3 applications you can:
- control your applications by multiple input devices at the same time (standard Windows 7 multitouch, mouse, TUIO mt)
- design your application to handle multitouch events and still make it capable to be controlled by mouse with no extra event handling / coding
- accurate gestures recognition engine (hold, tap, rotate, translate, slide up/east/west/north/nw/ne/sw/se, scale)
- easily track fingers its coordinates, angle, length and acceleration

For a complete list of features and explaination of how it work you can check MIRIA homepage at http://www.generoso.info/miria . The homepage is still to be updated so no infos about new features ia available yet.

All online examples from MIRIA home page have been rebuilt with the new release and now work both with TUIO devices and/or any Windows 7 PC with multitouch display (i.e. HP TouchSmart IQ 500 and IQ 800 series).

You can download MIRIA 0.9.1 beta from : http://miria.codeplex.com

Brief examples of MIRIA usage:

using MIRIA.MultiTouch;
    using MIRIA.Gestures;
 
   [...]

    private TouchListener _touchlistener;
    private Interpreter _gestureinterpreter;
    [...]
    public MainPage()
    {
        InitializeComponent();
        [...]
        _touchlistener = new TouchListener(LayoutRoot);
        _touchlistener.CursorAdd += new TouchListener.CursorAddHandler(_touchlistener_CursorAdd);
        _touchlistener.CursorRemove += new TouchListener.CursorRemoveHandler(_touchlistener_CursorRemove);
        _touchlistener.CursorUpdate += new TouchListener.CursorUpdateHandler(_touchlistener_CursorUpdate);
        _gestureinterpreter = new Interpreter(LayoutRoot);
        _gestureinterpreter.Hold += new Interpreter.GestureHold(_gestureinterpreter_Hold);
        _gestureinterpreter.Release += new Interpreter.GestureRelease(_gestureinterpreter_Release);
        _gestureinterpreter.Rotate += new Interpreter.GestureRotateHandler(_gestureinterpreter_Rotate);
        _gestureinterpreter.Translate += new Interpreter.GestureTranslateHandler(_gestureinterpreter_Translate);
        _gestureinterpreter.Tap += new Interpreter.GestureTapHandler(_gestureinterpreter_Tap);
        _gestureinterpreter.Scale += new Interpreter.GestureScaleHandler(_gestureinterpreter_Scale);
        _gestureinterpreter.GestureDetected += new Interpreter.GestureDetectedHandler(_gestureinterpreter_GestureDetected);
    }
    [...]
    void _gestureinterpreter_Scale(double scale)
    {
        // scale > 1 => zoom in
        // scale < 1 => zoom out
        [...]
    }
    void _gestureinterpreter_Tap(Point p)
    {
        // p => coordinates where tapped
    }
    void _gestureinterpreter_GestureDetected(Interpreter.Gestures gesture, object parameter)
    {
        switch (gesture)
        {
            case Interpreter.Gestures.SLIDE_WEST:
                [...]
                break;
            case Interpreter.Gestures.SLIDE_EAST:
                [...]
                break;
            case Interpreter.Gestures.SLIDE_NORTH:
                [...]
                break;
            case Interpreter.Gestures.SLIDE_SOUTH:
                [...]
                break;
            [...]
        }
    }
    [...]

Enjoy,
Gene.

WPF4 + how to acces the touch points array?

2010-02-25T04:46:13Z

Hi,

I am quite new to WPF and I can’t really find how to get the number of current touches on the touchscreen in WPF4.
thanks
Greg

Custom Maps and Tours on Surface

2010-02-03T10:20:20Z

Hello All,

I need the benefit of your experience and intelligence!

I am a final year HCI PhD student, and my background is in psychology, not programming. Still, I am about to develop an application on the Surface for planning a day’s activities in a City. What I am trying to do is have a map with some interesting sights highlighted (selected by the user in a previous screen). Then I would like to have them click (touch) on the one’s that they want to visit that day and have the map generate a route for those sights. I have had a look at Google’s City Tours application (citytours.googlelabs.com) but there doesn’t seem to be an API yet, so I am having difficulty seeing how to create the interactivity I need. I would like to be able to, when the user has pressed the sights they want, to be able to take those selections and print off some pre-prepared notes about those sights.

I could do all this manually - i.e. by creating a custom control with a fixed map of the city - but then I don’t know how I’d get the functionality of plotting routes etc.

I’m sure you could think of a thousand ingenious ways of doing this, so I put it out there as a scintillating puzzle.

Best,

Ricky

Reactivision crashing problem..

2010-02-10T02:44:55Z

Hi.

We are developing a Reactivision based game using the fiducials using C# Visual Studio 2008 Professional.
When we move a fiducial around quickly on the glass top, the program crashes/stops responding.
When we have a look at the debug screen area, there are 2 messages that keep getting repeated. The first message comes up any thing from 3 to 8 times then the second message a few times. This repeats itself till it stops working.

“A first chance exception of type ‘System.ArgumentException’ occurred in mscorlib.dll”

“An item of the same key has already been added”

Sample of the code used below.

public void addTuioObject(TuioObject o)
{
    lock (oSync)
        {
            objectList.Add(o.getSessionID(), new reactible(o));
        } 
}

public void updateTuioObject(TuioObject o)
{
    lock (oSync)
    {
        objectList[o.getSessionID()].update(o);
        foreach (reactible r in objectList.Values)
        {
            r.updateRoLocation();
        }
    }            
}

public void removeTuioObject(TuioObject o)
{
    lock (oSync)
    {
        objectList.Remove(o.getSessionID());
    }           
}

Any ideas?

Thanks
Trev.