Ensemble-based face expression recognition approach for image sentiment analysis

Ervin Gubin Moung and Chai, Chuan Wooi and Maisarah Mohd Sufian and Chin Kim On (2022) Ensemble-based face expression recognition approach for image sentiment analysis. International Journal of Electrical and Computer Engineering (IJECE), 12 (3). pp. 2588-2600. ISSN 088-8708

	Text Ensemble-based face expression recognition approach for image sentiment analysis.pdf Restricted to Registered users only Download (725kB) | Request a copy
	Text Ensemble-based face expression recognition approach for image sentiment analysis.ABSTRACT.pdf Download (76kB)

Abstract

Sentiment analysis based on images is an evolving area of study. Developing a reliable facial expression recognition (FER) device remains a difficult challenge as recognizing emotional feelings reflected in an image is dependent on a diverse set of factors. This paper presented an ensemble-based model for FER that incorporates multiple classification models: i) customized convolutional neural network (CNN), ii) ResNet50, and iii) InceptionV3. The model averaging ensemble classifier method is used to ensemble the predictions from the three models. Subsequently, the proposed FER model is trained and tested on a dataset with an uncontrolled environment (FER-2013 dataset). The experiment demonstrated that assembling multiple classifiers outperformed all single classifiers in classifying positive and neutral expressions (91.7%, 81.7% and 76.5% accuracy rate for happy, surprise, and neutral, respectively). However, when classifying disgust, anger, and sadness, the ResNet50 model alone is the better choice. Although the Custom CNN performs the best in classifying fear expression (55.7% accuracy), the proposed FER model can still classify fear expression with comparable performance (52.8% accuracy). This paper demonstrated the potential of using the ensemble-based method to enhance the performance of FER. As a result, the proposed FER model has shown a 72.3% accuracy rate.

Item Type:	Article
Keyword:	Classification , Convolutional neural network , Ensemble , Facial expression recognition , Image sentiment analysis , InceptionV3 , ResNet50
Subjects:	B Philosophy. Psychology. Religion > BF Psychology > BF1-990 Psychology Q Science > QA Mathematics > QA1-939 Mathematics > QA71-90 Instruments and machines
Department:	FACULTY > Faculty of Computing and Informatics
Depositing User:	DG MASNIAH AHMAD -
Date Deposited:	02 Aug 2022 12:04
Last Modified:	02 Aug 2022 12:04
URI:	https://eprints.ums.edu.my/id/eprint/33628

Actions (login required)

View Item