IDEO Multitouch API

With Kyle Doerksen for IDEO · Created to enable designers to explore multitouch interactions quickly and easily, this package includes all requisite software to build a lightweight multitouch system.

This package is comprised of two parts:

Multitouch Client — A multitouch API for Flash including support for extensible touch actions, arbitrarily sized displays, and a limitless number of active fingers. Software simulated touch events are also supported to allow for software to be tested and developed on computers lacking multitouch hardware. The Multitouch Client API is built in ActionScript 2 and communicates with the Multitouch Server via network socket connection.

Multitouch Server — A camera-based computer vision system that optically recognizes multitouch input, serializing it for transmission to the Multitouch Client. It has an interactive calibration routine to effectively overcome camera alignment and fisheye lens distortion. Implemented in Processing, it uses open source libraries and Processing's net library.