Eye Tracking

From ESE497 Wiki
Jump to navigationJump to search

The Eye tracker project is a research effort to enable people, who are suffering from Amyotrophic Lateral Sclerosis (ALS), to write using their eyes by tracking the movement of the pupil. The project will be implemented in two main phases:

First Phase : development of the software for pupil tracking Second Phase : building the hardware necessary to capture the images of the eye and transfer the images to a processing unit

First Phase: In this phase of the project, we focus on software development. We will use an infrared camera to capture the images of a human eye using Labview. We employ template matching methods to locate the center of the pupil, where we will use a small patch of dark pixels as a template. We will propose an adaptive search methods, in which we choose the search space in each frame based on the estimates of the pupil location from the previous frames. The proposed adaptive search will greatly reduces the computational complexity of the algorithm, which is essential for the real time tracking. We will also work on developing hybrid methods that use template matching along with feature selection to develop robust and computationally inexpensive algorithms that are insensitive to noise in the images and orientation of the camera that is used to obtain the images.

Second Phase: In the second phase of the project, we will build the hardware system, that can record the images using a camera mounted on a pair of sunglasses. We will port the software that we develop during the first phase on to a suitable microcontroller, which does the processing and generates the control signal which can be used to move the prosthetic limbs. We will also develop hardware to transmit the recorded images to the micro-controller wirelessly.