Open Source Interface

Java and OpenCv

2008-11-13T13:00:38-05:00

Hi, i’ve a problem to running open cv in java.
i downloaded all necessary following this guide: http://ubaa.net/shared/processing/opencv/
and under processing it works (but installing opencv 1.0 instead the latest version).
Now i want to use it in pure java environment, so i created a project under netbeans, i took the processing.core library, copied opencv.dll in OpenCv/bin directory and run the two examples with no error.
The problem is that i obtain a frame with black screen (webcam led is however on) and nothing is showed.

do you have any idea?

thanks in advance

Processing sketches

2008-11-21T11:43:51-05:00

here goes a few sketches of my learning process.
i hope they will be usefull for a starting point .
Launch osc.exe, then the sketches in Processing.
I tried to comment the codes in a helpful way ...

For now all the sketches only managed direct inputs from TUIO.
TODO : implement a class that handles the inputs ( distance between points, dynamic objects ...)

the Paint is still buggy , there is opengl bug when opening it that i still don’t fix so
if you find a solution ,let me know !

[vimeo]2300781[/vimeo]

I failed in uploading the .rar archive here,but meanwhile you can get the sketches here

Processing and OSCP5 library

2008-11-09T14:48:12-05:00

I’ve been fooling around with processing lately and I’m trying to get build18er’s work to run:

http://nuigroup.com/forums/viewthread/161/

I keep getting a missing library error.

Maybe I’m confused where to put the library exactly?

In my preferences my sketchbook location is ~/Documents/Processing, so I unzipped oscP5.zip here ~/Documents/Processing/libraries/

leaving me with ~/Documents/Processing/libraries/oscP5

Is this right? Is it possible that this library doesn’t work with Processing 154 or 155? Or am I just putting these in the wrong place?

An Open Source JAVA/ C++ Gesture Recognition framework.

2008-11-07T16:18:46-05:00

Hello Multi-touch Fans!

We are Announcing Sparsh UI, an open source multi-touch API that works across devices and
platforms.

The Multi-Touch Lab at Iowa State University has released the open-source codebase Sparsh UI (v1.0b), which allows easy development of multi-touch
applications that work across devices (e.g. FTIR touch table, Stantum, IR bezels, cardboard box touch devices) and across platforms (Java, C++; Mac,
Windows, Linux).

Here is what Sparsh UI offers!
-- Includes gestures (don’t need to program them),
-- Includes a Multi-touch Simulator so you can develop apps without the multi-touch device connected (Windows only for now)
-- Does not depend on hardware(An adapter for TouchLib enabled devices is provided alongwith)

Coming soon:
—Support for UserIDs for collaboration on the same multi-touch device [to identify different users on the same device]
—Support for Static Gestures.

Download and try it out at http://code.google.com/p/sparsh-ui/
Find documentation on our wiki and sample applications on our home page, discuss it on our
Google Group [ http://groups.google.com/group/sparsh-ui]

Feel free to contact us for any questions!

--The Sparsh UI Team
Virtual Reality Applications Center
Iowa State University

Anyone using (or used) Java for multitouch?

2008-06-27T17:05:21-05:00

Is anyone using or has anyone used Java for a multitouch app? Particularly using the open-table.org software?

Processing + Java + blobDetection = Question?XD

2008-07-06T18:19:46-05:00

Hi there, i’m new on this forum and also new to the MT technology. Its been 4 days that I do nothing more than just watch movies, pdf, tutorials, etc.. and today i’ve started coding with Java and I got this question.. I’m using processing libs and a lib called blobDetection from http://www.v3ga.net/processing/BlobDetection/, there is a project called lowres that makes blob tracking and also creates osc messages...I’ve been studying that code and ended up making one of my for tracking blobs… and the question is how can i send the x and y infos for multikey for example...i know that it works with touchlib and so i thought if i create a osc message equal to the ones created in touchlib than the flash app multikey would work too...am I thinking correctly? if you like i can post all the code here but it’s still at the begining....

Thanks all and I really LOVE all the work you all do here with all the projects!!! :D

TUIO Processing: Accessing x, y pos from the CursorList

2008-06-01T03:27:14-05:00

So I am hoping to use a multi-touch table I built with a classmate in a show on Wednesday. I have the great examples from picturetunes as well as the Demo from the TUIO website. They both run perfectly. My question is: How can I access the array of x and y positions of all the cursors from the main draw() function? If i have to create a whole program inside of the draw function of the TuioCursor class I guess I will...but Id rather not =P. Thanks a lot! Any suggestions would be helpful as I am a beginner at dealing with reading TUIO in Processing.

import processing.opengl.*;
import tuio.*;
TuioClient client;
TuiCursorList cursorList;
void setup()
{
size(1024,768, OPENGL);
client = new TuioClient(this); // the TuioClient receives the information from Touchlib
cursorList = new TuiCursorList(); //this is your little helper who handles all the cursors for you
frameRate(30);
}

void draw()
{
cursorList.draw(); //draw the cursors
smooth();
noStroke();
}

/*
based on:::::::::::::::::::::::::::::::::::::::::::::::
TUIO processing demo - part of the reacTIVision project
http://mtg.upf.es/reactable
by Martin Kaltenbrunner
(see bottom of page for details)
modified by::::::::::::::::::::::::::::::::::::::::::::
picturetunes (http://christoph.picturetunes.at)
*/

//***************************//
// PREDEFINED TUIO FUNCTIONS //
//***************************//

////the redraw functions are no longer needed because we use a constant framerate
// called after each message bundle
void refresh() {
//redraw();
}
// called when a cursor appears the scene
void addTuiCursor(Integer s_id) {
System.out.println("add cursor “+s_id);
cursorList.add(s_id);
//redraw();
}

// called when a cursor is removed from the scene
void removeTuiCursor(Integer s_id) {
System.out.println("remove cursor “+s_id);
cursorList.remove(s_id);
//redraw();
}

// called when a cursor is moved
void updateTuiCursor (Integer s_id, Float xpos, Float ypos) {
//System.out.println("update cursor “+s_id+” “+xpos+” “+ypos);
float xsize =width;
float ysize =height;
//the following lines of code could be probably improved
// the position values are read and casted to float
// the values should (but strangely do not precicesly) start at 0 and end at 1 so you have to multiply them by the screensize to map them to the screen
// the calculated values are subtracted from the screensize to mirror the coordinates
cursorList.update(s_id,(float)xsize-((xsize*xpos.floatValue())),ysize-((float)(ysize*ypos.floatValue())));
//redraw();
}
//****************//
// LITTLE HELPERS //
//****************//

//this class stores all the cursors…
class TuiCursorList {
java.util.Hashtable cursorList;

TuiCursorList() {
//...in this java hastable
cursorList = new Hashtable();
}
//call the draw method of the cursors (just for testing to see what is happening)
void draw() {
Enumeration e = cursorList.elements();
while (e.hasMoreElements()) {
TuioCursor cursorPoint = (TuioCursor)e.nextElement();
cursorPoint.draw();
}
}
//create new cursor instance
void add(Integer s_id) {
//Vector pointList = new Vector();
TuioCursor cursorPoint = new TuioCursor();
cursorList.put(s_id,cursorPoint);
}
//remove cursor
void remove(Integer s_id) {
cursorList.remove(s_id);
}
//update cursor position
void update(Integer s_id, float xpos, float ypos) {
// println("number of cursors in cursor list:"+cursorList.size());
// that is a nasty little detail: for some reason updateTuiCursor() is called before add addTuiCursor()
// which causes the programm to behave strangly. to avoid that you want to check if the object you want ot update is already there
if(cursorList.containsKey(s_id)){
TuioCursor cursorPoint = (TuioCursor)cursorList.get(s_id);
cursorPoint.update(xpos,ypos);
}
}
}
// this is the class for the cursors. it doesn`t do pretty much yet but of course you can extend it!
class TuioCursor{
public float x,y;

TuioCursor(){
//println("hello i am a tuio cursor");

}

void update(float px, float py){
// println("hurray somebody updates my position x:"+px+" y"+y);
this.x=px;
this.y=py;
}

void draw(){

//this comes handy for testing - you get visual response from your cursors
//println("hurray somebody draws me");
fill(0,50);
ellipse(x, y, 16, 16);
fill(250,50);
rect(0,0,width, height);
}

}

Newish Processing OpenCV library

2008-07-24T23:38:33-05:00

I downloaded a fairly newish OpenCV Processing and Java library found at :

http://www.ubaa.net/shared/processing/opencv/

and looked at the (less than 100 LOC) blobs example using my development FTIR mini-table. I have played with this for less than 5 minutes but wanted to share because I think this is pretty cool. If you take a look at the screenshot I took, you can see that my table is pretty “dirty” looking with an old and bubbly layer of SORTA-Clear but blob detection was pretty resilient. I should have played around with the threshold some more but again, too excited and eager to share with y’all.

The top two images are the same raw output from the camera. The bottom left image is used for background subtraction and the bottom right is the money shot with blob detection. Pressing down on the acrylic causes the camera to see the FTIR from my bubbly SORTA-Clear (I guess my poor hardware setup shows the resiliency of the blob detection algorithm).

OT : Also check out the face detection sample, it worked pretty well for me out of the box. I am thinking that if a camera were positioned correctly, with the aid of a face detection algorithm, you could effectively track eye movement. Shining IR at someone’s face, the pupils become like blobs that can be tracked? It would be cool to do eye tracking . . . but I digress, too many multi-touch app. ideas floating in my head . . . need to start integrating this with the Processing TUIO library or straight to Flash (http://processing.org/discourse/yabb_beta/YaBB.cgi?board=Integrate;action=display;num=1115427973). Again, need to some leg work before coding.

Anyway, hopefully someone finds this useful.

Working Blobtracking with JMyron. testers wanted, source code available.

2008-07-16T07:35:35-05:00

Hello everyone

I have made this processing sketch with my own fixed version of JMyron (blob-center tracking binding was borked in JMyron)

it is only a very simple example, but it shows how easy this can be done in processing with my fix of JMyron
It looks for blobs and finds their centers, then uses the combined data of the blobs to generate a sound
(up/down = pitch, left/right = detune)

i would be happy if some of you would like to test it out and tell me what you think.

in the attached.rar file, you will find executables for Windows, Linux and Mac (although i am not sure wether or not it will work in mac and linux, use at your own risk!)
along with source code in .java and processing .pde sketch, accompanied by the libraries i have used.

quick manual :
When the application starts, hit the webcam settings button, and tune the saturation all the way down, so your picture is black and white.
the two sliders on the left controll the colour-blob tracking. (yes, these are mouse operated, not touch operated!)
The top slider controlls the grayscale colour that the application will try to track, and the bottom slider controlls the tracking tolerance.
You might have to play with these a little to find a setting that will work for you.

if you use FTIR or comparable, track for light colours, if you use a MTMini, track for dark colours.

Want to know more about the JMyron errors?
http://nuigroup.com/forums/viewthread/1818/

Please let me know how well it works.

Processing only - JMyron blob tracking

2008-05-09T06:27:07-05:00

Hello there!

I’m fairly new on the forum so sorry if this question has already been raised. Was wondering if anyone else has had luck doing blob tracking using the JMyron computer vision library? I’ve got it working on my system but instead of reinventing the wheel i thought i’d check if anyone’s already gone down this road and found it useful/terrible?

cheers let me know!
-christopher