Intuitive Cursor Control using Optical Processing Software

Cheaper, more accesible touchscreens...

Gallery:

Product demo:

Image gallery:


Team
Left to right: Afanasie Tamciuc, Pascal Ruetten, Ioannis Mariggis.





Setup
The initial setup: two webcameras attached on either side of the screen, at a distance
far enough to capture the whole screen area. The two captured images are then processed
Using the software written in MATLAB.



ePen
Demonstration of the product implementation using an ePen (most important feature is that
there is a source of light at the tip).




Laser
Demonstration of the product implementation using an laser (with green beam). We can see
that the laser trail is followed quite accurately.




Minesweeper
Testing the operativity of the laser implementation with a game of minesweeper.





Screenshot
Screenshot showing the plot of the intensity function (blue) and the intensity function after
filtering with a moving average filter (red) averaging 7 sample points. The filtered function is
used to obtain the position of the pen tip.



Screenshot
Screenshot showing the regressed path (green) from the points registered to represent the
pen, along which the intensity function is created. The intersection of the horizontal and vertical
red lines is the position of the detected pen-tip.



Screenshot
Screenshot showing the intermediate steps for pen tip localization. Red points are possible
positions where the pen is seen. Yellow points (after noise reduction) are used to process the
coordinates of the tip by fitting a straight line.