Difference between revisions of "FingerSpark"

From ESE205 Wiki
Jump to navigation Jump to search
Line 32: Line 32:
 
''Gant Chart''
 
''Gant Chart''
  
{| {{table}}
+
Task Name Week of 2/15 Week of 2/22 Week of 2/29 Week of 3/7 Week of 3/14 Week of 3/21 Week of 3/28 Week of 4/5 Week of 4/12 Week of 4/19 Week of 4/26 Week of 5/4
| align="center" style="background:#f0f0f0;"|'''Task Name'''
+
Find Documentation for OpenCV
| align="center" style="background:#f0f0f0;"|'''Week of 2/15'''
+
Bring images from camera into processing program
| align="center" style="background:#f0f0f0;"|'''Week of 2/22'''
+
Adapt OCV.lib to track point(s) of highest color intesity in images
| align="center" style="background:#f0f0f0;"|'''Week of 2/29'''
+
Test with one finger first, then expand to five fingers
| align="center" style="background:#f0f0f0;"|'''Week of 3/7'''
+
Record coordinate pairs over time and remove noise
| align="center" style="background:#f0f0f0;"|'''Week of 3/14'''
+
Create program to interpret human gestures from this data
| align="center" style="background:#f0f0f0;"|'''Week of 3/21'''
+
**If previous step is successfully excuted** Create simple visual interface
| align="center" style="background:#f0f0f0;"|'''Week of 3/28'''
+
| align="center" style="background:#f0f0f0;"|'''Week of 4/5'''
+
Resources Needed Room with controlled lighting, Raspberry Pi B+, Rasp. Pi Camera Module
| align="center" style="background:#f0f0f0;"|'''Week of 4/12'''
+
Computer with C++/Python IDE, Black gloves with colored fingertips
| align="center" style="background:#f0f0f0;"|'''Week of 4/19'''
+
| align="center" style="background:#f0f0f0;"|'''Week of 4/26'''
+
Partners Working on Task
| align="center" style="background:#f0f0f0;"|'''Week of 5/4'''
+
Connor Goggins
|-
+
David Battel
| Find Documentation for OpenCV||||||||||||||||||||||||
 
|-
 
| Bring images from camera into processing program||||||||||||||||||||||||
 
|-
 
| Adapt OCV.lib to track point(s) of highest color intesity in images||||||||||||||||||||||||
 
|-
 
| Test with one finger first, then expand to five fingers||||||||||||||||||||||||
 
|-
 
| Record coordinate pairs over time and remove noise||||||||||||||||||||||||
 
|-
 
| Create program to interpret human gestures from this data||||||||||||||||||||||||
 
|-
 
| **If previous step is successfully excuted** Create simple visual interface||||||||||||||||||||||||
 
|-
 
| ||||||||||||||||||||||||
 
|-
 
| Resources Needed||||Room with controlled lighting, Raspberry Pi B+, Rasp. Pi Camera Module||||||||||||||||||||
 
|-
 
| ||||||||Computer with C++/Python IDE, Black gloves with colored fingertips||||||||||||||||
 
|-
 
| ||||||||||||||||||||||||
 
|-
 
| Partners Working on Task||||||||||||||||||||||||
 
|-
 
| Connor Goggins||||||||||||||||||||||||
 
|-
 
| David Battel||||||||||||||||||||||||
 
|}
 

Revision as of 20:00, 12 February 2016

FingerSpark


Overview

FingerSpark, our product, will be a program that will allow a camera to track a user’s hand and individual fingers. The user will wear a glove with different colored fingers, making it easier for the camera to pinpoint the two-dimensional location of each finger. The camera will also utilize a Raspberry Pi B+ CPU, which will run our program and gather the data from the camera, forming an integrated system that will be mounted on a tripod for the user’s convenience.

To achieve this, we plan to use an image processing program to process individual frames from the camera’s video feed which we will analyze to determine the coordinates of each of the user’s fingers. Once this is done, we hope to write a program to interpret human gestures using this data.


Objective

Our goal in creating FingerSpark is to work towards eliminating the barriers to perfectly natural user control of electronics. We believe that our product will be an essential next step in developing three-dimensional operating systems, creating robots that can flawlessly mimic the fine motor skills of humans, and producing interactive augmented reality technologies.


Budget

  • Set of comfortable black gloves: ~$10
  • Something to color the finger tips: ~$5
  • Misc: ~$25

TOTAL: $95


Gant Chart

Task Name Week of 2/15 Week of 2/22 Week of 2/29 Week of 3/7 Week of 3/14 Week of 3/21 Week of 3/28 Week of 4/5 Week of 4/12 Week of 4/19 Week of 4/26 Week of 5/4 Find Documentation for OpenCV Bring images from camera into processing program Adapt OCV.lib to track point(s) of highest color intesity in images Test with one finger first, then expand to five fingers Record coordinate pairs over time and remove noise Create program to interpret human gestures from this data

    • If previous step is successfully excuted** Create simple visual interface

Resources Needed Room with controlled lighting, Raspberry Pi B+, Rasp. Pi Camera Module Computer with C++/Python IDE, Black gloves with colored fingertips

Partners Working on Task Connor Goggins David Battel