Feature extraction from 2D gesture trajectory in Malaysian Sign Language recognition

Yona Falinie Abdul Gaus, and Wong , Hock Tze @ Farrah Wong Tze @ Farrah Wong and Teo, Kenneth Tze Kin (2011) Feature extraction from 2D gesture trajectory in Malaysian Sign Language recognition. In: 4th International Conference on Mechatronics: Integrated Engineering for Industrial and Societal Development, ICOM'11, 17-19 May 2011, Kuala Lumpur, Malaysia.

Full text not available from this repository.

Official URL: http://dx.doi.org/10.1109/ICOM.2011.5937179

Abstract

In this paper, a method to identify hand gesture trajectory in constrained environment is introduced. The method consists of three modules: collection of input images, skin segmentation and feature extraction. To reduce processing time, we compare the absolute difference between two consecutive frames then choose which frames have the highest value. YCbCr colour space is selected as the skin model because it behaves in such a way that the illumination component is concentrated in a single component (Y) while the blue and red chrominance component is in Cb and Cr. The hand gestures trajectory is to be recognized by using two methods: template matching and division by shape. Template matching required the removal of the head of the signer, leaving with just 2 hands only. For division of shape, the gesture are grouped into 5 classifications of hand postures that is vertical, horizontal, 45 above, 45 below and overlapping with hands. A total of 43 frames were selected manually for each hand posture and analyzed to obtain the variation of hand gesture feature such as width, heights, angle and distance. Our experimental results show up to 80% of accuracy in identifying the forms of the gesture trajectory. It shows that the feature extraction method proposed in this paper is appropriate for defining particular gesture trajectory.

Item Type:Conference Paper (UNSPECIFIED)
Uncontrolled Keywords:Absolute difference, Division by shape, Feature extraction, gesture trajectory, Skin segmentation, Template matching, YCbCr, Absolute difference, Division by shape, Gesture trajectories, Skin segmentation, Gesture recognition, Image matching, Image segmentation, Mechatronics, Template matching, Trajectories, Feature extraction
Subjects:?? TK7800-8360 ??
Divisions:SCHOOL > School of Engineering and Information Technology
ID Code:5000
Deposited By:IR Admin
Deposited On:01 Oct 2012 17:47
Last Modified:08 Sep 2014 15:12

Repository Staff Only: item control page


Browse Repository
Collection
   Articles
   Book
   Speeches
   Thesis
   UMS News
Search
Quick Search

   Latest Repository

Link to other Malaysia University Institutional Repository

Malaysia University Institutional Repository