Multiclass emotion prediction using heart rate and virtual reality stimuli

Aaron Frederick Bulagang and James Mountstephens and Jason Teo (2021) Multiclass emotion prediction using heart rate and virtual reality stimuli. Journal Of Big Data, 8 (12). pp. 1-12. ISSN 2196-1115

	Text Multiclass emotion prediction using heart abstract.pdf Download (40kB)
	Text Multiclass emotion prediction using heart.pdf Restricted to Registered users only Download (1MB) | Request a copy

Abstract

Background: Emotion prediction is a method that recognizes the human emotion derived from the subject’s psychological data. The problem in question is the limited use of heart rate (HR) as the prediction feature through the use of common classifiers such as Support Vector Machine (SVM), K-Nearest Neighbor (KNN) and Random Forest (RF) in emotion prediction. This paper aims to investigate whether HR signals can be utilized to classify four-class emotions using the emotion model from Russell’s in a virtual reality (VR) environment using machine learning. Method: An experiment was conducted using the Empatica E4 wristband to acquire the participant’s HR, a VR headset as the display device for participants to view the 360° emotional videos, and the Empatica E4 real-time application was used during the experiment to extract and process the participant’s recorded heart rate. Findings: For intra-subject classification, all three classifiers SVM, KNN, and RF achieved 100% as the highest accuracy while inter-subject classification achieved 46.7% for SVM, 42.9% for KNN and 43.3% for RF. Conclusion: The results demonstrate the potential of SVM, KNN and RF classifiers to classify HR as a feature to be used in emotion prediction in four distinct emotion classes in a virtual reality environment. The potential applications include interactive gaming, affective entertainment, and VR health rehabilitation. Keywords: Four-class emotion classification, Electrocardiography, Machine learning, Virtual reality, HR, Empatica E4, KNN, RF, SVM

Item Type:	Article
Keyword:	Four-class emotion classification, Electrocardiography, Machine learning, Virtual reality, HR, Empatica E4, KNN, RF, SVM
Subjects:	?? QA76 ??
Department:	FACULTY > Faculty of Computing and Informatics
Depositing User:	NORAINI LABUK -
Date Deposited:	28 Apr 2021 15:38
Last Modified:	28 Apr 2021 15:38
URI:	https://eprints.ums.edu.my/id/eprint/26840

Actions (login required)

View Item