Feature extraction from 2D gesture trajectory in Malaysian Sign Language recognition

Yona Falinie Abdul Gaus and Wong , Hock Tze @ Farrah Wong Tze @ Farrah Wong and Teo, Kenneth Tze Kin (2011) Feature extraction from 2D gesture trajectory in Malaysian Sign Language recognition. In: 4th International Conference on Mechatronics: Integrated Engineering for Industrial and Societal Development, ICOM'11, 17-19 May 2011, Kuala Lumpur, Malaysia.

Full text not available from this repository.

Abstract

In this paper, a method to identify hand gesture trajectory in constrained environment is introduced. The method consists of three modules: collection of input images, skin segmentation and feature extraction. To reduce processing time, we compare the absolute difference between two consecutive frames then choose which frames have the highest value. YCbCr colour space is selected as the skin model because it behaves in such a way that the illumination component is concentrated in a single component (Y) while the blue and red chrominance component is in Cb and Cr. The hand gestures trajectory is to be recognized by using two methods: template matching and division by shape. Template matching required the removal of the head of the signer, leaving with just 2 hands only. For division of shape, the gesture are grouped into 5 classifications of hand postures that is vertical, horizontal, 45 above, 45 below and overlapping with hands. A total of 43 frames were selected manually for each hand posture and analyzed to obtain the variation of hand gesture feature such as width, heights, angle and distance. Our experimental results show up to 80% of accuracy in identifying the forms of the gesture trajectory. It shows that the feature extraction method proposed in this paper is appropriate for defining particular gesture trajectory.

Item Type: Conference or Workshop Item (UNSPECIFIED)
Keyword: Absolute difference, Division by shape, Feature extraction, gesture trajectory, Skin segmentation, Template matching, YCbCr, Absolute difference, Division by shape, Gesture trajectories, Skin segmentation, Gesture recognition, Image matching, Image segmentation, Mechatronics, Template matching, Trajectories, Feature extraction
Subjects: T Technology > TK Electrical engineering. Electronics Nuclear engineering > TK1-9971 Electrical engineering. Electronics. Nuclear engineering > TK7800-8360 Electronics
Department: SCHOOL > School of Engineering and Information Technology
Depositing User: ADMIN ADMIN
Date Deposited: 01 Oct 2012 17:47
Last Modified: 08 Sep 2014 15:12
URI: https://eprints.ums.edu.my/id/eprint/5000

Actions (login required)

View Item View Item