FingerSpark
Overview
FingerSpark, our product, will be a program that will allow a camera to track a user’s hand and individual fingers. The user will wear a glove with different colored fingers, making it easier for the camera to pinpoint the two-dimensional location of each finger. The camera will also utilize a Raspberry Pi B+ CPU, which will run our program and gather the data from the camera, forming an integrated system that will be mounted on a tripod for the user’s convenience.
To achieve this, we plan to use an image processing program to process individual frames from the camera’s video feed which we will analyze to determine the coordinates of each of the user’s fingers. Once this is done, we hope to write a program to interpret human gestures using this data.
Objective
Our goal in creating FingerSpark is to work towards eliminating the barriers to perfectly natural user control of electronics. We believe that our product will be an essential next step in developing three-dimensional operating systems, creating robots that can flawlessly mimic the fine motor skills of humans, and producing interactive augmented reality technologies.
Budget
- Raspberry Pi B+ - $29.95
- Raspberry Pi Camera Module - $24.99
- Set of comfortable black gloves: ~$10
- Something to color the finger tips: ~$5
- Misc: ~$25
TOTAL: $95
Gant Chart
Task Name Week of 2/15 Week of 2/22 Week of 2/29 Week of 3/7 Week of 3/14 Week of 3/21 Week of 3/28 Week of 4/5 Week of 4/12 Week of 4/19 Week of 4/26 Week of 5/4 Find Documentation for OpenCV Bring images from camera into processing program Adapt OCV.lib to track point(s) of highest color intesity in images Test with one finger first, then expand to five fingers Record coordinate pairs over time and remove noise Create program to interpret human gestures from this data
- If previous step is successfully excuted** Create simple visual interface
Resources Needed Room with controlled lighting, Raspberry Pi B+, Rasp. Pi Camera Module Computer with C++/Python IDE, Black gloves with colored fingertips
Partners Working on Task Connor Goggins David Battel
