A Parallel-Model Speech Emotion Recognition Network Based on Feature Clustering

Li-Min Zhang and Giap Weng Ng and Yu-Beng Leau and Hao Yan (2023) A Parallel-Model Speech Emotion Recognition Network Based on Feature Clustering. IEEE Access, 11. pp. 1-11. ISSN 2169-3536

	Text ABSTRACT.pdf Download (40kB)
	Text FULL TEXT.pdf Restricted to Registered users only Download (1MB) | Request a copy

Abstract

Speech Emotion Recognition (SER) is a common aspect of human-computer interaction and has significant applications in fields such as healthcare, education, and elder care. Although researchers have made progress in speech emotion feature extraction and model identification, they have struggled to create an SER system with satisfactory recognition accuracy. To address this issue, we proposed a novel algorithm called F-Emotion to select speech emotion features and established a parallel deep learning model to recognize different types of emotions. We first extracted the emotion features from speech and calculated the F-Emotion value for each feature. These values were then used to determine the combination of speech emotion features that was optimal for speech emotion recognition. Next, a parallel deep learning model was established with the speech emotion feature combination as input to train and test for each type of emotion. Finally, decision fusion was applied to the parallel output results to obtain an overall recognition result. These analyses were conducted on two datasets, RAVDESS and EMO-DB, with the accuracy of speech emotion recognition reaching 82.3% and 88.8%, respectively. The results demonstrate that the F-Emotion algorithm can effectively analyze the correspondence between speech emotion features and emotion types. The MFCC feature best describes emotions of neutrality, happiness, fear, and surprise, and Mel best describes emotions of anger and sadness. The parallel deep learning model mechanism can improve the accuracy of speech emotion recognition.

Item Type:	Article
Keyword:	Speech emotion recognition, F-emotion algorithm, feature clustering, parallel model, deep learning
Subjects:	Q Science > QA Mathematics > QA1-939 Mathematics > QA150-272.5 Algebra T Technology > TA Engineering (General). Civil engineering (General) > TA1-2040 Engineering (General). Civil engineering (General) > TA630-695 Structural engineering (General)
Department:	FACULTY > Faculty of Computing and Informatics
Depositing User:	ABDULLAH BIN SABUDIN -
Date Deposited:	09 Feb 2024 11:15
Last Modified:	09 Feb 2024 11:15
URI:	https://eprints.ums.edu.my/id/eprint/38207

Actions (login required)

View Item