Welcome to Scribd, the world's digital library. Read, publish, and share books and documents. See more
Download
Standard view
Full view
of .
Save to My Library
Look up keyword
Like this
2Activity
0 of .
Results for:
No results containing your search query
P. 1
2013_FG_xjchai_Sign Language Recognition and Translation With Kinect

2013_FG_xjchai_Sign Language Recognition and Translation With Kinect

Ratings: (0)|Views: 345|Likes:
Published by Vlad Andriescu
2013_FG_xjchai_Sign Language Recognition and Translation With Kinect
2013_FG_xjchai_Sign Language Recognition and Translation With Kinect

More info:

Categories:Types, Research
Published by: Vlad Andriescu on Jul 23, 2013
Copyright:Attribution Non-commercial

Availability:

Read on Scribd mobile: iPhone, iPad and Android.
download as PDF, TXT or read online from Scribd
See more
See less

02/03/2014

pdf

text

original

 
Sign Language Recognition and Translation withKinect
Xiujuan Chai, Guang Li, Yushun Lin, Zhihao Xu,Yili Tang, Xilin Chen
Key Lab of Intelligent Information Processingof Chinese Academy of Sciences (CAS),Institute of Computing Technology, CASBeijing, China{xiujuan.chai, guang.li, yushun.lin, zhihao.xu,yili.tang, xilin.chen}vipl.ict.ac.cn
Ming Zhou
Microsoft Research AsiaBeijing, Chinamingzhou@microsoft.com
 Abstract 
 —Sign language (SL) recognition, although has beenexplored for many years, is still a challenging problem for realpractice. The complex background and illumination conditionsaffect the hand tracking and make the SL recognition verydifficult. Fortunately, Kinect is able to provide depth and colordata simultaneously, based on which the hand and body actioncan be tracked more accurate and easier. Therefore, 3D motiontrajectory of each sign language vocabulary is aligned andmatched between probe and gallery to get the recognized result.This demo will show our primary efforts on sign languagerecognition and translation with Kinect.
 Keywords-sign language; hand tracking; 3D motion trajectory
I.
 
I
 NTRODUCTION
 Sign language is the most important communication way between hearing impaired community and normal persons. Inrecent years, sign language has been widely studied based onmultiple input sensors, such as data glove, web camera, stereocamera, and so on [1-3]. Although data glove based SLrecognition achieves good performance even for largevocabularies, the device is too expensive to popularize. Invision-based SL recognition, the key factor is the accurate andfast hand tracking and segmentation. However, it is verydifficult for the complex backgrounds and illuminations.Different from these previous methods, our system aims torealize fast and accurate 3D SL recognition based on the depthand color images captured by Kinect.II.
 
3D
 
T
RAJECTORY
M
ATCHING FOR 
S
IGN LANGUAGE
ECOGNITION
 The block diagram of our SL recognition algorithm is givenin Figure 1. First, the 3D trajectory description correspondingto the input SL word is generated by hand tracking technology provided by Kinect Windows SDK [4]. Considering thedifference of hand motion speed, a linear resampling is done toget the normalized trajectory by averaging the accumulatedlength of the whole vector. This operation aims to normalizethe trajectory of each word into the same sampling point. 
Figure 1. Block diagram of our 3D trajectory matching based sign language recognition method.
Gallery trajectoriesVisual & DepthStream of probeword
 
3D Trajectory byhand tracking
 
Normalized trajectory bylinear resamplingTrajectoryalignmentRecognition result basedon matching score

You're Reading a Free Preview

Download
/*********** DO NOT ALTER ANYTHING BELOW THIS LINE ! ************/ var s_code=s.t();if(s_code)document.write(s_code)//-->