Interactive surfaces provide novel ways of interactions by closely replicating the familiar hands-on experience of everyday object manipulation. It is much more enjoyable and efficient than using a mouse and keyboard. However, most of the currently available interactive surfaces are based on infrared sensing and projection. Thus, those are very expensive and require a higher engineering knowledge to setup.
The purpose of this project is to avoid those expensive infrared sensing techniques and provide a computer-vision based solution to retrofit existing flat displays into interactive surfaces. Furthermore, the proposed solution is cost effective and requires minimum engineering knowledge to setup, as it uses a small number of hardware devices.
This project is submitted in partial fulfillment of the requirements for the BSc (Hons) Software Engineering degree. The Hardware prototype of iDisplay includes minimum number of devices. It doesn't use any expensive sensors and Infrared based techniques.
The Sensing System of iDisplay is implemented using C++ with OpenCV as the image processing library. openFrameworks is used as the main application framework. openFrameworks wraps OpenCV and OpenGL providing an easy and simple development environment for wide range of applicaitons. Several suitable image processing techniques, including background subtraction and skin colour detection are empliyed to identify the user input.
Pinching gesture is used as the main interaction method and the system is capable of identifying circular tangible objects and their colours.
iDisplay uses TUIO to send touch events to client applications. Therefore, existing multitouch applications, which are developed using TUIO, can also be integrated with the same hardware prototype.
|iDisplay RGB||iDisplay RGB PlayIT|
Lahiru Lakmal Priyadarshana | M: +94 (0) 777 561 914 | llahiru AT gmail DOT com