Hidden Markov Model - Based gesture recognition with overlapping hand-head/hand-hand estimated using Kalman Filter

Yona Falinie Abdul Gaus and Wong, Hock Tze @ Farrah Wong (2012) Hidden Markov Model - Based gesture recognition with overlapping hand-head/hand-hand estimated using Kalman Filter. In: 3rd International Conference on Intelligent Systems, Modelling and Simulation (ISMS 2012) , 8-10 February 2012, Kota Kinabalu, Sabah, Malaysia.

Full text not available from this repository.


In this paper, we introduce a hand gesture recognition system to recognize isolated Malaysian Sign Language (MSL). The system consists of four modules: collection of input images, feature extraction, Hidden Markov Model (HMM) training, and gesture recognition. First, we apply skin segmentation procedure throughout the input frames in order to detect only skin region. Then, we proceed to feature extraction process consisting of centroids, hand distance and hand orientation collecting. Kalman Filter is used to identify the overlapping hand-head or hand-hand region. After having extracted the feature vector, the hand gesture trajectory is represented by gesture path in order to reduce system complexity. We apply Hidden Markov Model (HMM) to recognize the input gesture. The gesture to be recognized is separately scored against different states of HMMs. The model with the highest score indicates the corresponding gesture. In the experiments, we have tested our system to recognize 112 MSL, and the recognition rate is about 83%.

Item Type: Conference or Workshop Item (UNSPECIFIED)
Keyword: Feature extraction, Gesture path, Gesture trajectory, Hidden Markov Model, Kalman Filter, Skin segmentation YCbCr, States, Feature vectors, Gesture path, Gesture trajectories, Hand gesture, Hand-gesture recognition, Input image, Malaysians, Recognition rates, Sign language, Skin segmentation, States, System complexity, Feature extraction, Gesture recognition, Intelligent systems, Kalman filters, Hidden Markov models
Subjects: T Technology > TJ Mechanical engineering and machinery
Department: SCHOOL > School of Engineering and Information Technology
Depositing User: ADMIN ADMIN
Date Deposited: 10 Dec 2012 14:58
Last Modified: 10 Dec 2012 14:58
URI: https://eprints.ums.edu.my/id/eprint/5577

Actions (login required)

View Item View Item