cool video - realtime projection screen tracking and mapping

[back_ache]

This a cool little six-minute video, a magician holding a white canvas and having a projector project only on it (and him for illumination purposes), in real-time.

 

Not sure how many real applications there are, but defiantly a fun projection technology, and he says hes going to eventually open-source it(which is always cool).

 

Its fun to guess how he may of done it, my guess is he used an infrared camera and ir emitters on the corner of the canvas (and his pen) to act as tracking dots.

 

[callumb]

This guy used a Wii remote to do this: http://johnnylee.net/projects/wii/

[ImagineerTom]

Marco's very open about EXACTLY how its done and has put out plenty of video's demonstrating the technology.

 

He also created "multivid" which is an amazing app that enables you to turn iphone/pad/pod into media servers and syncronise them perfectly enabling you to do the big sexy media server stuff on a tiny budget.

 

 

[the kid]

This guy used a Wii remote to do this: http://johnnylee.net/projects/wii/

 

 

It is more like this project of his with new tech implemented.

[dbuckley]

Augmented Rality is here today, and has many useful applications.

 

My guess is that the board he is holding up has markers on it, visible under IR light, and the AR software just (just - ha!) tracks the markers and puts the augment over the top using nothing more complex that a camera that can see IR. Like this

 

Here's a video from HitLabNZ (New Zealand - where else!), who do lots of this sort of stuff. When the vid starts, note the image of a sheep on a sheet of paper on the desk. The sheep is the marker. A camera photgraphs the scene, and calculates where the sheep is in three dimensional space. The software then then arranges the augmented object (a steam engine) to match the paper, as you see when he picks the paper up.

 

There are some other pieces on the showcase page.

[back_ache]

Johnny Lee is very cool, I remember him demonstrating multi-touch long before the iphone was a twinkle in Steve Job's eye.

 

Turns out I was bang-on with my guess about how it was gone, the IR camera is a PS3 eyetoy running at 120fps., the software called "Magic projection" is based on the open-source "OpenCV" computer vision library and the projector is a bog standard data projector.

 

The following link explains how it was done and has a video of Marco demonstrating it in Japanese!

 

http://createdigitalmotion.com/2009/12/augmented-projection-magic-projection-creates-elegant-moving-screens/

http://en.wikipedia.org/wiki/PlayStation_Eye