Hidden markov model-based gesture recognition with overlapping hand-head/hand-hand estimated using Kalman filter

Yona Falinie Abdul Gaus, and Farrah Wong, (2012) Hidden markov model-based gesture recognition with overlapping hand-head/hand-hand estimated using Kalman filter. In: Intelligent Systems, Modelling and Simulation (ISMS), 2012 Third International Conference, 8-10 February 2012.

[img]
Preview
Text
Hidden_markov_model.pdf

Download (44kB) | Preview

Abstract

In this paper, we introduce a hand gesture recognition system to recognize isolated Malaysian Sign Language (MSL). The system consists of four modules: collection of input images, feature extraction, Hidden Markov Model (HMM) training, and gesture recognition. First, we apply skin segmentation procedure throughout the input frames in order to detect only skin region. Then, we proceed to feature extraction process consisting of centroids, hand distance and hand orientation collecting. Kalman Filter is used to identify the overlapping hand-head or hand-hand region. After having extracted the feature vector, the hand gesture trajectory is represented by gesture path in order to reduce system complexity. We apply Hidden Markov Model (HMM) to recognize the input gesture. The gesture to be recognized is separately scored against different states of HMMs. The model with the highest score indicates the corresponding gesture. In the experiments, we have tested our system to recognize 112 MSL, and the recognition rate is about 83%.

Item Type: Conference or Workshop Item (UNSPECIFIED)
Uncontrolled Keywords: Hidden Markov models, Skin, Image color analysis, Mathematical model, Equations, Handicapped aids, Feature extraction
Subjects: Q Science > QA Mathematics
Divisions: FACULTY > Faculty of Science and Natural Resources
Depositing User: Unnamed user with email storage.bpmlib@ums.edu.my
Date Deposited: 28 Nov 2016 05:16
Last Modified: 12 Oct 2017 01:16
URI: http://eprints.ums.edu.my/id/eprint/14988

Actions (login required)

View Item View Item

Browse Repository
Collection
   Articles
   Book
   Speeches
   Thesis
   UMS News
Search
Quick Search

   Latest Repository

Link to other Malaysia University Institutional Repository

Malaysia University Institutional Repository