The Multi Light Tracker project originated from a wish to investigate true multi-user interaction on shared surfaces. Kaj Grønbæk informed on a prototype where colored leds were tracked in free space. Jesper Nielsen came up with the idea to use a back-projected setup together with a back-mounted camera for tracking colored led pens - very simpel and yet very novel.

By using eyesWeb Jesper and I made a patch that could descriminate the different color pens and send their position and color over a network. After a bit of work we had a simple proof of concept running as seen on the images to the right.

Later Søren Boll implemented a mlt-listener to notify on position, color, pen-up and pen-down events - and by great help from Michael Bang a calibration package was developed that can relate the camera space to the projection space. Kaspar Rosengreen and I developed the patch and the flash application giving multiple users access to a shared table display. We improved the setup to run on only 40% processor load with four different pens at 15 fps.

See a quick video of the MLT system in use here (9mb)