Build Your Own Multitouch Surface Computer
Posted 04/07/09 at 12:00:00 AM by Alex Castle
Comments
Print
Email
Software
So now we’ve completed the hardware section. The process of building a multi-touch computer is far from over, though, we need to get the software installed and configured so that we can actually use the thing.
The central software that powered our rig is Touchlib, an open source library which takes the visual data received by the camera and parses it into touch events, which can be used by other programs to provide multi-touch control. Some programs implement this library directly, allowing for standalone multi-touch apps, while others, such as those written in ActionScript, require an extra software layer to allow the program to receive touch input. In this section, we’ll explain how we got both up and running.
But, there’s something else we had to take care of first. The PS3 Eye, as we mentioned earlier, is a fantastic fit for this project because of its high resolution, impressive framerate, and ease of modification. There’s just one problem: it’s meant to be used on a PlayStation 3, not a computer.
Fortunately, PC users are famously unconcerned with what things are “meant to” do, and enterprising multi-toucher Alex Popovich has written a driver that allows the PS3 eye to be used with a computer. To get it working, we followed these steps:
1. Download the PS3EyeSetup file here. The download link is a ways down the page, in red, just above the comments section.
2. Make sure that the modified PS3 Eye isn’t plugged into the computer, and then run the executable. Plug the PS3 Eye back in. If the Windows found new hardware wizard pops up, tell it to search for drivers manually, and point it to the folder we installed the drivers in (C:/Program Files/AlexP/Drivers).
3. Now, we’ll want to test to make sure that the drivers are working and that our computer can see the PS3 Eye. To do this, run the PS3Eye Test App included with the driver. Because we’ve already modified the camera, you probably won’t see anything on the screen unless we point the camera at a source of infrared light, such as a light bulb or a sunny window.
4. Now that we know the camera works, we need to check to see that the DirectShow filter works, which will allow other programs to access the PS3 Eye. There’s another program called AmCap installed with the drivers. Run it, and if the preview view shows what the camera is seeing, we’re golden. If it doesn’t, try unplugging the PS3 Eye and plugging it back in, as well as rebooting your computer. For reasons unknown, the first time we tried, we got stuck at this stage. For us, running the uninstall program, then installing the drivers again fixed the problem.
Now we'd gotten our PS3Eye up and running. Next, we had to get Touchlib set up to handle our touch detection. Touchlib can be found here, and doesn’t need to be installed. We simply extracted the files to C:/Multitouch.
We had to replace certain Touchlib files with ones specifically designed to work well with the PS3 Eye. We downloaded these files here, then extracted them to C:/Multitouch/touchlib, overwriting when we were prompted to do so.
Now, at long last, we’ll get to see how our surface actually works. We ran ConfigApp.exe from C:/Multitouch/Touchlib. This program launches a total of eight windows, six of which are the video stream from the PS3 Eye, at different stages of processing. It’s a little over whelming the first time, but it’s actually not that hard to use these to get Touchlib properly configured to do touch recognition on our setup.
The most important window is the one in the bottom right, with the slider marked “Rectify” is the one that’s most significant. This window displays the “blobs” that will get passed as touch events. When the touch surface is working properly, this window will be entirely black until we touch the screen, at which point a white blob will appear, hopefully without flickering. Starting with the window in the bottom left, and moving right, we adjusted all the sliders so that we got the clearest blobs when you touch the screen. Generally, we accomplished this by playing with each slider until we started to get background noise on the Rectify window, then scaled it back slightly. Once you’re happy with the sensitivity of your screen, it’s time to calibrate.
Calibration is necessary to sync up the projected image and the touch surface. To calibrate, we first pressed the Enter key. This enables full screen mode, and displays a grid of green crosses. To begin calibration, we pressed the ‘c’ key. One of the crosses on the display turns red. By pressing on the dot, Touchlib is able to map that point in projector space to a point in camera space. The next cross will turn red, and this continues until all crosses have been pressed. We learned the hard way that when you’re done calibrating Touchlib, you must press the escape key. If you close the program any other way, it won’t update the config file with your changes.
Now our surface had been be properly configured (at least until we moved the camera or projector, or the lighting conditions changed significantly). To test it out, we ran the smoke.exe app in the Touchlib folder. With everything calibrated properly, colored “smoke” particle effects were displayed on our surface everywhere we touched.
However, we didn’t let ourselves celebrate for too long, because many apps written for the multi-touch surface are coded in the ActionScript language used by Adobe Flash. These programs are not set up to natively use multi-touch data, so we had to use a software layer to allow the flash-based apps to work properly. This is a three step process:
1. Change Flash’s global security settings to allow the flash apps access to the touch data. Go to this page and click the “Edit locations…” dropdown box, then select “Add Location,” then “Browse for folders.” Browse to the folder containing the flash programs you want to run, which by default is C:/Multitouch/Clients. This only has to be done once.
2. Run OSC.exe from the touchlib folder. This is an implementation of a protocol called OpenSound Control, which was originally designed to allow musical instruments to interface with computers, but can also be used to (among other things) allow programs to access multi-touch input data. This needs to be run any time you want to use a multi-touch flash app.
3. Run FlashOSCv2.jar (requires the Java runtime environment) from C:/Multitouch/Clients/flosc. And press the “start” button on the window that pops up. This program simply allows flash programs to access OSC data. This also has to be run every time you run multi-touch flash apps.
With that done, we were finally ready to try out the whole array of apps that have been written for DIY multi-touch tables. There aren’t a ton of apps available right, but we were able to find enough to have a good time with the table. Some apps come with Touchlib, in the C:/Multitouch/Clients folder, and we also recommend the AudioTouch apps, available at Seth Sandler's blog and the Multitouch Media App, by Laurence Muller.
Next Page: Conclusion and Bonus Gallery
Would it be possible to do
Submitted by ethereal_fire on Sat, 11/14/2009 - 4:04pm
Would it be possible to do this with a projector like this one:
http://www.costco.ca/Browse/Product.aspx?Prodid=10322635&search=Pocket%20projector&topnav=&Mo=0&cm_re=1_en-_-Top_Left_Nav-_-Top_search&lang=en-CA&Nr=P_CatalogName:BCCA&N=0&whse=BCCA&Dx=mode%20matchallpartial&Ntk=Text_Search&Dr=P_CatalogName:BCCA&Ne=4000000&D=Pocket%20projector&Ntt=Pocket%20projector&No=0&Nty=1&Ntx=mode%20matchallpartial
Submitted by girhadi on Sat, 11/14/2009 - 3:02am
we know that we'll be forced to pay feescanlı sohbet to broadcasters for the first timezonguldak sohbet odaları
andistanbul sohbet odalarıunfortunately our customers will have to foot the billchat
As a small cable operator, programming issohbet odalarıour already largest expense by far, and we simply cannot absorb any moreamasya sohbet odalarıincreases in our carriage fees.voip serviceerkeklerle sohbet
This includes the importance of human rationality, individual property rights, free marketsadana sohbet odaları natural rights, the protection of civil liberties, constitutional limitation of government, and individual freedomsohbet siteleri
iskameralı sohbet
fikralarla türkiye
Submitted by adyrcz on Mon, 11/09/2009 - 3:10pm
What was the part number for the LED's you purchased from Digi-Key?
Submitted by adeletwo6789 on Tue, 09/29/2009 - 10:56am
"The conduct described in the claims that RealNetworks seeks leave to
assert reflects a concerted and unlawful effort on the part of the
Studio Defendants and the DVD CCA to eliminate.dissertation | dissertations |
dissertation
writing | buy
dissertation | custom
dissertation | dissertation
help | online
dissertation
How all to connect??
Submitted by matroska on Wed, 09/16/2009 - 12:15am
Greetings to all))) People, huge requests... Who can help with this question I will is grateful.
Please, who did this project?? Help me!!!
There is any circuit of assemblage of this device? How all to connect?? Many gathered, please help!!!!
Who agrees to me to help, write, here e-mail Vera.krylova@mail.ru
In advance thanks (In advance I apologise - English language I know not so well)
Submitted by Riiich on Thu, 08/13/2009 - 10:41am
PLEEASE post some pictures of inside the box, im having real trouble on where to place the webcam, mirror and projector. or if anyone else knows of any good websites that show this please let me know! Email: AceRiiich@hotmail.com
MS version
Submitted by DOS_equis on Wed, 08/05/2009 - 12:01pm
Well it looks like microsoft has a version of this as a prize in a mobile app contest.
Check it out here:
http://www.mobilethisdeveloper.com/?CR_CC=100185013&CR_ID=P100023634799621#meteor=1R7qhtiY4W5
I wonder if someone in Redmond saw this article and copied it for this contest. Looks like a more polished version of the one MPC did.
Submitted by willcapellaro on Tue, 08/04/2009 - 6:51pm
Tell me why you didn't just sand the acrylic?
Submitted by s3kShUn7 on Wed, 07/22/2009 - 10:29am
I'm 15, and after looking for a multi-touch monitor solution and coming up empty, i remembered that I had seen this article's title, and thought I might be able to find a little more info. Now, thanks to you, I have the funding (from my parents) to complete the project. And, I thought I might put up my used parts list, so that other people may get a handle on more compatible divices, and find a solution that works well for them.
Toshiba TDP-ET10U Projector. $375 on Amazon
- Playstation Eye Camera. $40 at bestbuy
- Table Material= Dark Stained Plywood, 3/8in thick. Table Height=2.5ft.
- Acrylic, Laser Cut, Dimensions=33.85in.x19.35in. (16:9 ration matches projector). $62
- Laminated Vellum, from local Art Supply Store.
- Caulk Gun, From Ace Hardware≈ $12
- Narrow Dimmable LED Ribbon Flex by the 5-meter reel (High Density Infared 850nm). $207 from environmentallights.com
- 60 Watt 12 VDC Power Supply. $49.99 at environmentallights.com
- A DEEP Alluminum Shower Door Channel from local store, (midered to make a good frame).≤$100
- A good deal of patience, and roughly $850 available.
- Over 50 hours of thourough research.
Hope this helps some people who weren't sure exactly what to get, or what to do to make it work well. My best advice: Choose the Projector First, and base your table off of it's abilities.
Submitted by matroska on Sat, 09/12/2009 - 12:15am
You couldn't help me? I write from a far city of Almaty, not so well I know English language.
You have written that have collected this device. And how you have arranged chambers? And the Mirror? If not difficultly you can answer here this address vera.krylova@mail.ru
Submitted by argniest on Sat, 07/18/2009 - 12:18am
I have been following the Microsoft Surface computer for a while now. I cant believe you all built this thing in the garage!
Can you please post more specific instructions. I will pay you 100's of dollars if you will do that. And I am sure lots of other people will too.
I want to build one this summer, but I need more detailed, pretty much, step by step instructions. A detailed parts list, sequence to build it, a video of putting each portion of the system together, and more detailed information about the software loading side of thngs.
I have built pc's for a long time. But nothing like this.
This is THE COOLEST THING I HAVE ever seen. I loved the microsoft surface, but what you have done blows that away because of the cost of how you have gone about it.
Submitted by sitting on Fri, 06/26/2009 - 11:56am
WOW awesome! I will make one of those for my school project. But I wounder how it look like inside the box, make possble to show some pic inside?
Submitted by oceania68 on Sun, 06/21/2009 - 7:47am
This is definately the way of the future in technology. I have been saying this for years... the prospects are almost limitless... Consider space craft... no keyboards no mice less weight, but with all the familars of a computer at home without the bulk.. A star trek initiative. Give it time and incentives from goverments and businesses to developing this kind technology, we could see plenty of these in homes and cars etc... Couple with voice activation recognition software... whoa the ideas flood... You can have all this already .... for a price.... and thats typical... But building your, gives you satisfaction of accomplishment and pride... and when it works, enthusiam. I am going to build one, using the guide shown here, but with my own mods.... for example.. an old video game table (remember the first space invaders machine, something like that would be good.
I shall give it a go and see what happens...
cheers guys and thanks for the information
Submitted by perceptee09 on Fri, 06/19/2009 - 3:54am
It very informative and nice to read
Submitted by Boyobejaminhere on Sun, 06/07/2009 - 8:11pm
Hi,
Im going to build one of these this summer and im a little stuck. As other people have said, this article is vague in some parts and detailed in others. What is missing that i desperatly need are pictures. I need pictures that easily show what goes where, the only diagrams I see show pieces of this device and not where they go. Something else that is missing is (like in other How to articles) the materials guide. After reading it a few times I've got an idea of what I need but im pretty sure there is an item or two missing from my list. So if those could be posted or added in that would be awesome =D
Thanks,
Boyo
Otherwise this is an excellent article and I'm trying to get my school to let us (students) build a few of these for ourselves and for the school =D
Submitted by jameyscott on Wed, 05/20/2009 - 2:06pm
i would so buy one of these please sell them or make kits for us to make them on our own i want one so bad
Very good
Submitted by carlosmessi on Sun, 05/17/2009 - 7:33am
Very good and very long article. I like it but unfortunately I don't have time and money to try it. I think if you opt to buy materials online for that project you can find them on Shop Carefully. Good luck in building the table.
Carlos Messi
www.shopcarefully.com baby.
Submitted by patjam on Sat, 05/16/2009 - 10:04am
Hello!
Can you show some photos of inside of this computer?
Yours sincerely
Patryk
Submitted by szore on Tue, 05/05/2009 - 1:47pm
You see a little eye candy and you all cream your pants
Submitted by Boyobejaminhere on Mon, 06/08/2009 - 9:06am
Hey man show some respect. These guys spent two weeks on building this machine (probably even more to plan it all out) and they ended up with a kickass machine. Sure you could probably use some of the aplications on a tablet pc but where is all the fun in that? Why go out to buy a small tablet pc for 3000 freakn dollars when you can build a kickass multitouch surface computer for about $350 plus an old computer? I say this is worth the time, worth the effort (especially when you convince someone to give you community service hours for school to build one of these =D), deserves some respect, and a couple thank yous while your at it
btw: thanks for makin this kickass article =D
Submitted by bmjones66 on Wed, 04/29/2009 - 7:21pm
Are there any pictures of inside the cabinent all put together? I would like to see the mounting of the camera along with the projector/mirror.
so i did some (okay maybe a
Submitted by nsk chaos on Thu, 04/30/2009 - 2:32pm
so i did some (okay maybe a lot) of researching and found most of the parts i needed and a pretty good guide to go along with the project: http://www.instructables.com/id/SCR2H4QF3ER7VQK/ the most valuable part of this guide are the pictures (the catch is a 15 sec registration).
enjoy!!! and good luck too =)
Submitted by nsk chaos on Wed, 04/29/2009 - 6:49pm
i am very curious how you guys managed to get a l * w * 3/8... all i could find was a 24*48*0.220
please help thx!
website for the one i found: http://www.thegreathardwarestore.com/Plaskolite-24x48x-220-Acrylic-Sheet-1AG2196A-p/196843.htm
P.S.: when they say u must order in X4 is this 4 for $54.13 total or 4 for $54.13 each?
P.S.S.: what color led works best? im thinking blue but idk if it matters though...
Blue Wont Work
Submitted by nsvander on Mon, 06/01/2009 - 1:29pm
You have to use IR LEDs, they are the only ones that will work.
Submitted by linkmaster6 on Tue, 04/28/2009 - 4:27am
Hey Alex Castle why not do a full article in Max PC some issue and answer some of the questions we've got about this.
Submitted by qryptiq on Mon, 04/27/2009 - 12:07pm
These LED's may be by far the easiest to install
http://www.oznium.com/led-flex-strips
Submitted by qryptiq on Mon, 04/27/2009 - 11:14am
From what i understand and on TED.com the Wii remote is infrared ready and cost $39 dollars...
Alex, do you think this would work fine?
Submitted by famiccomputers on Sun, 04/26/2009 - 3:38am
I'm currently studying electronics and think this is a great project. I have read through it 3 times and get most of it apart from one bit in two sections; 1. Where on earth do you get a table of that size made in that same way? Am I meant to build it from scratch? and 2. I don't get where you put the Infra-red leds, do they get soldered and stuck to wood like in p.2 or stuck to a metal strip like on p1 and the bottom of p2? Thanks.
Submitted by drmitch on Mon, 04/20/2009 - 5:40am
LEDs in series-parallel with no resistor? That's bad juju
Submitted by xRadeon on Mon, 04/20/2009 - 6:36pm
What do you mean? I'm not good at all with resistors and things like that. I really think I'm going to make one of these, what kind of resistor would I need and why?
Submitted by radrat on Sat, 04/18/2009 - 5:37pm
I found some simular diodes fo a whole lot cheaper.
here is the link
http://www.newark.com/vishay-semiconductor/vsmg3700-gs08/ir-emitter/dp/31M2973?_requestid=250017
Submitted by xRadeon on Mon, 04/20/2009 - 6:03pm
Good job, I spent so long trying to find good priced IR LEDs, thanks, and I'm pretty sure these will work just fine too. Thanks. Pretty sure at these prices you could have IR LEDs touching each other around the whole edge and not even brake your pocket change.
Submitted by QuadCoreAbe on Thu, 04/16/2009 - 10:40am
....Nerdgasm....
by the way, it would be great to have a checklist of parts and components so that we dont have to read the whole article fifteen times before going to home depot. Thanks
Submitted by comptech08 on Tue, 04/14/2009 - 7:44pm
I am looking at parts and I have a question. Could I use a pico projector? I notice they have low lumens, is that going to be a big facter if the lights in the room have to be on or off?
Submitted by s3kShUn7 on Wed, 07/22/2009 - 9:55am
Go with the TDP ET-10u. Extremely Short Throw Projector
Submitted by I8NY on Sat, 04/11/2009 - 4:33am
This is fantastic! Thanks MaximumPC. I have an 11 year old non-verbal Down's son who is slowly learning to use a touch screen on a conventional PC, but his motor skills are poor and it is still difficult and he gets frustrated. This large format may be just the ticket for him. My three year old Daughter would freak, too! I think I have enough skills to build this if I can manager to scrape up the $ for all the parts.
I also rely on MaxPC for the best of the best freeware - you guys are awesome! Thanks again.
Submitted by Mr_Gone on Fri, 04/10/2009 - 7:42pm
After falling in love with this video... i was wondering can i mix/match methos of doing this?
i want to mix the LLP method with LLP and RDI (FDI) methods.. (laser lights VS rear or front diffusion)
but would that even work..
Submitted by jeremfromfrance on Fri, 04/10/2009 - 2:12pm
I guys ! I'm trying to build that wonderfull stuff with one of my friend ! it's just awesome!
could it be possible to run 3 or 4 or much tables with only one OS?
Submitted by s3kShUn7 on Wed, 07/22/2009 - 9:57am
Submitted by lbclofy on Thu, 04/09/2009 - 8:17pm
would you be able to use a rear projection screen tv instead of a projector?
Submitted by Devansh on Thu, 04/09/2009 - 7:59pm
Hey ppl. i must thank Maximum PC for their efforts on this remarkable machine. I am planning to make it as my Final year project at School. Can you guys tell me where you got the applications you have shown in the video as well as the bonus section?? thanks a ton. and once again, a great job!!
Submitted by MAJORzer0 on Thu, 04/16/2009 - 12:43am
The links are included into the article.
This is a great bit of fun. I wish I had the time to tinker with it.
~No one said it would be easy....they just said it was worth it...~
Submitted by linkmaster6 on Thu, 04/09/2009 - 9:50am
Love the idea of this project and so do the guys I work with but I've noticed a couple things that are missing that would be nice to see.
First would be how the LEDs are connected to the acrylic. Looking at the steps I see the LEDs being soldered together from in hole in a board but a in later shots of the acrylic it looks like they are embedded or stuck to it.
Second would be the position of the camera. Call me stupid but is it suppose to be set like the leds? underneath looking up at the acrylic?
Third would how the projector is mounted, where the mirror is set. Is it hung dead center looking down at the mirror? A model of the projector would be nice, that way others would know what to look for.
Fourth. More specs on the computer used would be nice, such as OS, videocard used, PSU Wattage
Well thats the end of my rant. My boss has been looking to do something likes this for our store.
Submitted by robtom on Thu, 04/09/2009 - 7:51am
no that is using it as something else it doesn't link to your computer as a camera it becomes an HID which is Human Interface Device. I did that project too.
Submitted by nsk chaos on Wed, 04/08/2009 - 5:45pm
i think i had an orgasm when i first read this lol =) its good to know that DIY touch screen is within my budget hahahaha.
great article ++rep to MPC
What about the Wii Remote?
Submitted by winmaster on Wed, 04/08/2009 - 2:52pm
You guys went through a lot of trouble to build a touch screen when you could have just used the camera on a Wii Remote and an IR light source. You don't even have to actually buy a Wii, you can just connect the Wii Remote to the PC using Bluetooth. More info here:http://www.youtube.com/watch?v=5s5EvhHy7eQ.
--------------------------------------------------------------------------------------------------
The quick brown fox jumps over the lazy dog.
Submitted by ccshou on Wed, 04/08/2009 - 11:30am
I think I would need one whole year to build one for myself lol.
Hope to see it on market with reasonable price soon.
Submitted by robtom on Wed, 04/08/2009 - 6:26am
Actually with FTIR it works quite well. There is also a way to do it without using custom IR LED strands. IR lasers are possible one of the neatest ways to do it. My friend made one and with it you don't really have to worry as much about the room being dark and having no lights on. The lasers are so bright that they pretty much block the effects of ambient lighting.
Submitted by Paulfo on Wed, 04/08/2009 - 6:49am
That's cool. Do you have a link to the laser parts used?
Thks!
Paul
wotudo.net
Submitted by Paulfo on Wed, 04/08/2009 - 6:07am
I recently showed my mutli-touch machine at Maker Faire UK.
Rather than using FTIR I used the rear IR diffused method. This required no custom electronics because I used the CCTV IR illuminators as my IR source. I then modified an Xbox Live Camera to have a IR Band filter and then it was just the table I had to build. I did the whole thing for less then £90 (so about $140) because I had the Xbox camera (but almost any web cam will do) and I borrowed a projector from work!
I made a video of it, you can see how I put it all together at http://www.youtube.com/watch?v=izwb_uCitxU
I also used an multitouch application built by members of the NUIGroup with XNA. This gives a great user experience - very Surface like :-)
Its all in the video so please take a look! My blog has more details - I'd be happy to help others looking at doing this sort of thing so ping me if you need help!
Paul
wotudo.net
Must Read Articles
Feature
Review
Feature
Feature
Feature
Most Popular Articles
This Month's Issue
FEATURE How to Get FREE Programs, Services, Software & MoreFEATURE Digital Photo Printer RoundupHOW TOBuild a 3D CameraFEATUREDIY Arcade PCWHITE PAPERHow TRIM Works
Technology News
Computer Cooling Fans
Computer Cases
PC Game Controllers
PC Games
Computer Hardware
Headphones
MP3 Players
Stream Video
Computer Mouse
Monitors
Motherboards
NAS Storage
Networking
Laptop Computers
DVD Burner
Digital Cameras
Portable Storage
Computer Accessories
Smartphone
Antivirus Software
Sound Cards
Speakers
Computer Systems
Thumb Drives
Video Cameras
Video Card Reviews
Water Cooling
Gadgets
- Keyboards
© 2009 Future US, Inc. All Rights Reserved.