1 of 4
1
SenseWall
Posted: 26 April 2010 06:16 PM   [ Ignore ]
Avatar
Rank
Joined  2008-05-13
Total Posts:  45
New Member

SenseWall is a Laser Light Plane (LLP) multi-touch wall with a display area of 2.8m x 1.05m for the Computer Engineering Department of Coimbra University, Portugal.
Its purpose is to let pupils learn new HCI concepts and highlight their creativity by giving them the tool to develop interesting applications.
We called it SenseWall because we wanted to create a platform that would have more senses than solely touch. So we added 2 cameras above the display for computer vision applications, a microphone for sound input, speakers for sound output and an RFID reader.

The task was pretty challenging because we didn’t have that much space available. Check the following photo and sketches.

BEFORE

before.jpg

MEASURES

SenseWall5.jpg

MEASURES

medidas_pormenorizadas.png

We designed this structure to hold a massive 3x1.40m 10mm thick acrylic and tempered glass.

STRUCTURE

4243602271_4e707f1b8d_o.jpg

FRAME

4243602721_8f9ecfe7a2_o.jpg

Behind it we closed the narrow space with three aluminum doors for easy access.

3 REAR DOORS

4243603293_161999b976_o.jpg

The frame holds a facing acrylic, a rear tempered glass for robustness and in between them is a Rosco Black projection screen.
In the frame rails we reserved some space to hold the laser mounts.

LASER SPACINGS

4243603773_cb40376ac3_o.jpg

LASER SPACINGS

4244376798_5eb07d97e3_o.jpg

LASER SPACINGS

4244377172_156149547a_o.jpg

After that we covered the front with glossy black glass for style wink

FRONT COVER

4244378094_302007a367_o.jpg

Here you can see the tempered glass.

TEMPERED GLASS

4243605723_c27f12af3a_o.jpg

TEMPERED GLASS

4244378774_9491a5cc80_o.jpg

TEMPERED GLASS

4243606381_0a8f6ba6ee_o.jpg

Applied the Rosco Black projection screen to it.

TEMPERED GLASS WITH ROSCO BLACK

4243606635_128f0e66ef_o.jpg

The acrylic you see standing at the right will be facing outside.

TEMPERED GLASS WITH ROSCO BLACK

4244379890_60611e70da_o.jpg

SCREEN IN PLACE

4244380144_6c108d2bb2_o.jpg

We designed 8 laser mounts to hold the 850nm IR lasers. This way it’s much simpler to calibrate them in place with 8 small screws.

LASER MOUNTS

Picture%201.png

LASER MOUNTS

Picture%202.png

LASER MOUNTS

3945101555_e7c144de64_b.jpg

LASER MOUNTS

3945887684_4c14b0aec3_b.jpg

LASER MOUNTS

3974976232_a893eb8606_b.jpg

LASER MOUNTS

4069311419_7e2b929c5b_b.jpg

LASER MOUNTS

4070075332_fa0867c371_b.jpg

and we placed 4 of them in each corner and 4 in the middle (2 at the top and 2 below at 45º):

MIDDLE TOP

4244384564_ca652e8623_o.jpg

MIDDLE BOTTOM

4244383994_7ee8fec60c_o.jpg

CORNERS

4244383604_3daa812a41_o.jpg CORNERS

4243610607_d0a00c06d7_o.jpg

Check the video below to better understand how to properly calibrate the lasers.
Use some paper at the other side to make sure the laser light plane is hitting it parallel to the surface and as close as possible to it.

Now we needed to test the tracking so we installed 2 PS3Eye cameras modified with 850nm band-pass filters (the lasers wavelength) and 2 Hitachi ED-A100 shortthrow projectors.
Check the bottom of this article for the links on where to buy everything.

850nm BANDPASS FILTERS

3238508153_ec99d7464c_o.jpg

PS3Eye with 850nm BANDPASS FILTER

3920293337_cdb6378f24_b.jpg

PS3Eye with 850nm BANDPASS FILTER

3921077986_28a61043c0_b.jpg

2 PS3Eye Cameras & 2 Hitachi ED-A100

4244385668_8fde974105_o.jpg

2 PS3Eye Cameras & 2 Hitachi ED-A100

4244385810_77b7b4d14f_o.jpg

2 PS3Eye Cameras & 2 Hitachi ED-A100

4244386170_19f3e3327b_o.jpg

2 PS3Eye Cameras & 2 Hitachi ED-A100

4243615783_8d52840c87_o.jpg

2 PS3Eye Cameras & 2 Hitachi ED-A100

4243616691_218fc66603_o.jpg

then started calibrating them with Community Core Vision (CCV):

COMMUNITY CORE VISION

4244389750_1556159c7f_o.jpg

COMMUNITY CORE VISION

4244389876_a8147a6f5f_o.jpg

... and voila:

AFTER smile (pyMT Paint app)

4263646306_6edc2ca64f_b.jpg

Hardware:

2x PS3Eye cameras
2x Hitachi ED-A100 projectors
8x 850nm 28mw IR Lasers
8x 120º laser line generator
2x BandPass filters
2x PS3Eye lens holder
2x 6 lens pack

CPU Intel Core i7 860
3Gb DDR3 1600Mhz
NVIDIA Geforce GTX 260 768Mb DDR3

Software:

Community Core Vision
pyMT

More references:

Multitouch R&D photos
Multitouch workshops photos

SenseBloom

Image (zip format)

 Signature 

HCI videos
and photos

Profile
 
 
Posted: 26 April 2010 06:28 PM   [ Ignore ]   [ # 1 ]
Avatar
RankRankRankRankRankRank
Joined  2007-04-08
Total Posts:  2539
Dedicated

Lookin’ great! Nice writeup.

 Signature 

MTmini, MTbiggie, & Audiotouch creator & Community Core Vision Co-founder

Follow on:
My Blog | Facebook | Twitter | Youtube

Profile
 
 
Posted: 26 April 2010 09:10 PM   [ Ignore ]   [ # 2 ]
Avatar
RankRankRank
Joined  2008-10-28
Total Posts:  274
Sr. Member

This is very awesome! Great work on all the image documentation. Very inspirational as well!

 Signature 

Flash files and tutorial[s] available at:

cyancdesign Tutorial Blog Posts
and
http://wiki.nuigroup.com/Documents_and_tutorials

Profile
 
 
Posted: 26 April 2010 09:28 PM   [ Ignore ]   [ # 3 ]
RankRankRankRank
Joined  2009-08-21
Total Posts:  561
Elite

Simply w0w !!! Great work !! Thanks for sharing the photos and documentation !!!

 Signature 

~~Amit~~

Website - Twitter - Facebook

Profile
 
 
Posted: 26 April 2010 09:36 PM   [ Ignore ]   [ # 4 ]
Avatar
Rank
Joined  2009-05-26
Total Posts:  41
New Member

Great post. Well executed. What kind of rails did you use for the mount? Also, 2, 6mm lenses>>

 Signature 

http://www.lcdmt.com

Profile
 
 
Posted: 26 April 2010 11:14 PM   [ Ignore ]   [ # 5 ]
Avatar
RankRank
Joined  2008-11-20
Total Posts:  102
Member

The projector setup looks swell smile

 Signature 

blog log

Profile
 
 
Posted: 27 April 2010 12:11 AM   [ Ignore ]   [ # 6 ]
RankRankRank
Joined  2010-01-28
Total Posts:  332
Sr. Member

Great setup.

 Signature 

MARS New Creations
My twitter account
47 inch pure design multitouch
Info & Zo - YouTube

Profile
 
 
Posted: 27 April 2010 03:40 AM   [ Ignore ]   [ # 7 ]
Avatar
RankRank
Joined  2008-04-27
Total Posts:  150
Member

Did you stitch the 2 PS3 camera images together to send to CCV to process as a single image?  And what did you use to stitch/blend the projector images together?

 Signature 

Pissed Right Off Genetically Engineered Nerd
ProgenLabs.com

Profile
 
 
Posted: 27 April 2010 10:35 AM   [ Ignore ]   [ # 8 ]
Avatar
RankRankRank
Joined  2008-12-27
Total Posts:  262
Moderator

That’s SO nice !

 Signature 

Kivy | PyMT | Movid

Profile
 
 
Posted: 27 April 2010 06:15 PM   [ Ignore ]   [ # 9 ]
Avatar
Rank
Joined  2010-01-03
Total Posts:  28
New Member

awesome! I want one!

could you share info on the stitching of the cameras?
and the blending of projectors?

are you processing the images-to-tuio and running the apps all from one computer?
what are the specs of this one computer?

Profile
 
 
Posted: 27 April 2010 06:41 PM   [ Ignore ]   [ # 10 ]
Avatar
Rank
Joined  2009-09-15
Total Posts:  91
New Member

Nice laser mounts!

Profile
 
 
Posted: 28 April 2010 06:30 PM   [ Ignore ]   [ # 11 ]
Avatar
Rank
Joined  2010-01-03
Total Posts:  28
New Member

why did you choose 850nm lasers when 780nm lasers are much cheaper?

Profile
 
 
Posted: 02 May 2010 11:22 AM   [ Ignore ]   [ # 12 ]
Avatar
Rank
Joined  2008-05-13
Total Posts:  45
New Member
Progen - 27 April 2010 03:40 AM

Did you stitch the 2 PS3 camera images together to send to CCV to process as a single image?  And what did you use to stitch/blend the projector images together?

We didn’t need to since the CCV svn code already has multi-cam support.

 Signature 

HCI videos
and photos

Profile
 
 
Posted: 02 May 2010 11:30 AM   [ Ignore ]   [ # 13 ]
Avatar
RankRank
Joined  2008-04-27
Total Posts:  150
Member

You mean the CCV-1.2Fid version of CCV?  or do you mean CCV1.3?

 Signature 

Pissed Right Off Genetically Engineered Nerd
ProgenLabs.com

Profile
 
 
Posted: 02 May 2010 04:45 PM   [ Ignore ]   [ # 14 ]
Avatar
RankRankRank
Joined  2008-05-08
Total Posts:  342
Sr. Member

The CCV 1.3 has built-in PS3Eye stitching capabilities.

 Signature 

Computing is not about computers any more.  It is about living!

Code Laboratories
CL Studio Live - Video like never before
CL Eye Platform SDK

Profile
 
 
Posted: 03 May 2010 06:36 AM   [ Ignore ]   [ # 15 ]
Avatar
Rank
Joined  2008-05-13
Total Posts:  45
New Member
mobius - 27 April 2010 06:15 PM

awesome! I want one!

could you share info on the stitching of the cameras?
and the blending of projectors?

We didn’t blend both projections. The software we found to do projection blending was proprietary so we just hand calibrated the projections extra carefully wink
Is anyone aware of opensource hardware/software to do this?

mobius - 27 April 2010 06:15 PM

awesome! I want one!

are you processing the images-to-tuio and running the apps all from one computer?
what are the specs of this one computer?

We are running everything from a single computer. I just updated the post with the machine specs.

Thanks for the nice replies everyone.

 Signature 

HCI videos
and photos

Profile
 
 
   
1 of 4
1