Multiclass emotion prediction using heart rate and virtual reality stimuli

Bulagang, A.F., and James Mountstephens and Teo, Jason Tze Wi (2021) Multiclass emotion prediction using heart rate and virtual reality stimuli. Journal of Big Data, 8 (1). ISSN 2196-1115

Text Multiclass emotion prediction using heart rate and virtual reality stimuli.pdf Download (43kB)

Abstract

Background: Emotion prediction is a method that recognizes the human emotion derived from the subject’s psychological data. The problem in question is the limited use of heart rate (HR) as the prediction feature through the use of common classifiers such as Support Vector Machine (SVM), K-Nearest Neighbor (KNN) and Random Forest (RF) in emotion prediction. This paper aims to investigate whether HR signals can be utilized to classify four-class emotions using the emotion model from Russell’s in a virtual reality (VR) environment using machine learning. Method: An experiment was conducted using the Empatica E4 wristband to acquire the participant’s HR, a VR headset as the display device for participants to view the 360° emotional videos, and the Empatica E4 real-time application was used during the experiment to extract and process the participant's recorded heart rate. Findings: For intra-subject classification, all three classifiers SVM, KNN, and RF achieved 100% as the highest accuracy while inter-subject classification achieved 46.7% for SVM, 42.9% for KNN and 43.3% for RF. Conclusion: The results demonstrate the potential of SVM, KNN and RF classifiers to classify HR as a feature to be used in emotion prediction in four distinct emotion classes in a virtual reality environment. The potential applications include interactive gaming, affective entertainment, and VR health rehabilitation.

Item Type:	Article
Keyword:	Electrocardiography, Empatica E4, Four-class emotion classification, HR, KNN, Machine learning, RF, SVM, Virtual reality
Subjects:	Q Science > Q Science (General) Q Science > QA Mathematics
Department:	FACULTY > Faculty of Computing and Informatics
Depositing User:	SITI AZIZAH BINTI IDRIS -
Date Deposited:	30 Apr 2021 10:17
Last Modified:	30 Apr 2021 10:17
URI:	https://eprints.ums.edu.my/id/eprint/26871

Actions (login required)

View Item