iPod Touch/iPhone as a multitouch pad under Windows. 
Posted: 19 October 2008 01:44 PM   [ Ignore ]
Avatar
Rank
Joined  2008-06-05
Total Posts:  92
New Member

http://www.generoso.info/gene/demos/miria_mig/mig01/MIG08.swf
(interation with standard widnows apps)

http://www.generoso.info/gene/demos/miria_mig/mig02/untitled2.swf
(interaction with online silverlight sample game using accelerometer)

http://www.generoso.info/gene/demos/miria_mig/mig03/untitled3.swf
(comfortable experience with multitouch-pad and CoolIris mozzilla plugin)

You can download the application here:
http://www.generoso.info/gene/miria/MIG08b_setup.exe

In order to use it with your iPod/iPhone, you have to install OSCemote http://lux.vu/blog/oscemote/.
Using other OSC devices is also possible.

Enjoy,
G.

File Attachments
MIG08b_setup.zip  (File Size: 949KB - Downloads: 427)
Profile
 
 
Posted: 19 October 2008 02:02 PM   [ Ignore ]   [ # 1 ]
Avatar
RankRankRankRankRankRank
Joined  2007-04-08
Total Posts:  2539
Dedicated

Looks awesome. Does this also send TUIO so we can use it with already written MT apps?

 Signature 

MTmini, MTbiggie, & Audiotouch creator & Community Core Vision Co-founder

Follow on:
My Blog | Facebook | Twitter | Youtube

Profile
 
 
Posted: 19 October 2008 02:25 PM   [ Ignore ]   [ # 2 ]
Avatar
Rank
Joined  2008-06-05
Total Posts:  92
New Member
cerupcat - 19 October 2008 02:02 PM

Looks awesome. Does this also send TUIO so we can use it with already written MT apps?

Josh’ OSCemote allows your iPod touch/iPhone sends TUIO to a given IP address so you just need OSCemote to interact with your MT apps if these understand TUIO.

My application (MIG) does the other job =) (gestures interpreting and standard input mapping are shown in the example).
To understand better what it does you can look the originary project home page (Living Silver Desk http://www.generoso.info/livingsilverdesk). Anyway, the new project name is going to be MIRIA (Multi Input for Rich Internet Applications) but I didn’t finish the new home page of the project though, even if the new version is a bit different, the concept is still the one explained in the old documentation.

G.

Profile
 
 
Posted: 19 October 2008 03:21 PM   [ Ignore ]   [ # 3 ]
Avatar
RankRankRankRank
Joined  2008-02-12
Total Posts:  1120
Member

Nice work

 Signature 

Company Website - Knode Research and Development
My Youtube

Profile
 
 
Posted: 19 October 2008 05:36 PM   [ Ignore ]   [ # 4 ]
Avatar
RankRankRankRank
Joined  2008-01-04
Total Posts:  676
Moderator

Excellent Job Gene! Going to test this out soon…

 Signature 

Get Sparked at sparkon.net
ORION Multi-Touch Display (blog)
My YouTube

Profile
 
 
Posted: 19 October 2008 07:47 PM   [ Ignore ]   [ # 5 ]
RankRank
Joined  2007-06-06
Total Posts:  157
Member

Unfortunately the version of OSCemote I got from the app store does not transmit compliant TUIO (he says hell fix it in the next version), I whipped up a quick app to translate it to workable TUIO for current mt apps, you can find it here:

http://nuigroup.com/forums/viewthread/2991/

Your app looks great, checking this out in a bit.

Profile
 
 
Posted: 20 October 2008 12:44 PM   [ Ignore ]   [ # 6 ]
Avatar
Rank
Joined  2008-06-05
Total Posts:  92
New Member

which version of OSCemote are you running?

G.

AdmiralUD - 19 October 2008 07:47 PM

Unfortunately the version of OSCemote I got from the app store does not transmit compliant TUIO (he says hell fix it in the next version), I whipped up a quick app to translate it to workable TUIO for current mt apps, you can find it here:

http://nuigroup.com/forums/viewthread/2991/

Your app looks great, checking this out in a bit.

Profile
 
 
Posted: 21 October 2008 09:22 AM   [ Ignore ]   [ # 7 ]
Avatar
Rank
Joined  2008-06-05
Total Posts:  92
New Member

Hey guys,

I’m going to add a flag to enable MIG sending compliant XMLSocket messages so that it could be used with Flash apps as well.
Can someone give support to test it with flash or suggest me a quick way to test myself? I don’t have any working flash/flosc app.
All I know is that the messages has to be forwarder to port 3000 and they must consist of a complete, zero terminated, XML envelope like this:

<OSCPACKET ADDRESS="127.0.0.1" PORT="3333" TIME="0">
       <
MESSAGE NAME="/osc/address">
          <
ARGUMENT TYPE="i" VALUE="2"/>
          <
ARGUMENT TYPE="f" VALUE="3.0"/>
       </
MESSAGE>
</
OSCPACKET>

If of any interest the next version of MIG will add:
- clients and osc devices manager
- surface input scaling and translation
- generic OSC input mapping to custom actions by plugins (the first one will be an X10 controller =) ) or standard system events (mouse, keystrokes,application launching,...)
- OSC macros recording/playback.

Cheers,
G.

Profile
 
 
Posted: 21 October 2008 04:10 PM   [ Ignore ]   [ # 8 ]
Avatar
Rank
Joined  2008-06-05
Total Posts:  92
New Member

Hello I uploaded the new version of MIG 0.81 beta:

- fixed dual mode socket issue under Windows XP
- added forwarding to Flash clients (XMLSocket) =) using FLOSC compatible XML
- added builtin policy server for Flash web clients

IPhone OSCemote accelerometer values are forwarded using the following XML formatting:

<OSCPACKET ADDRESS="127.0.0.1" PORT="3000" TIME="0">
    <
MESSAGE NAME="/acceleration/xyz">
        <
ARGUMENT TYPE="f" VALUE="0.132"/>
        <
ARGUMENT TYPE="f" VALUE="0.763"/>
        <
ARGUMENT TYPE="f" VALUE="-0.881"/>
    </
MESSAGE>
</
OSCPACKET>

Where the float arguments are x,y and z acceleration values.

I succesfully tested it with the following FLOSC based apps:
- Simulator Example from the thread http://nuigroup.com/forums/viewthread/1495/
- MultiKeyV2 (http://ssandler.wordpress.com/my-software/)
- AudioshapeSequencer (running from a web page) (http://ssandler.wordpress.com/my-software/).

MIG 0.81b Download link:
http://www.generoso.info/gene/miria/MIG081b_setup.exe

Enjoy,
G.

MIG081b.jpg MIG081bw.jpg MIG081bi.jpg

Image Attachments
MIG081b.jpgMIG081bi.jpgMIG081bw.jpg
Profile