Hand Gesture Recognition

Emma Persky storyteller, geek, believer, etc

Why Recognise Gestures?

New Models of Interaction

Accessibility!

Parameters of Recognition

How Does it Work?

Find the Hand (not my problem!) Find Interesting Regions on Hand Track Interesting Points Compare Hand Path / Relative Position

Interesting Points
Edge Detection Corner Detection Regions of High Gradient of Change Brightness / Colour Histogram

Tracking Points

Iterative Lucas - Kanade Method Pyramid Feature Outputs New Points and Probabilities

Tracking the Hand

Flock of points Cull outliers Median (x and y) of Points is Centre of

Hand

Recognising Gestures

Relative Position of Hands from Start Trace Path of Hand Centre

Applications

TV Control Ubiquitous Systems Control Games (Johnny Lee Eat Your Heart
Out)!

Demo!