Comparing Eye-Tracking versus EEG Features for Four-Class Emotion Classification in VR Predictive Analytics

Lim, Jia Zheng and James Mountstephens, and Jason Teo, (2020) Comparing Eye-Tracking versus EEG Features for Four-Class Emotion Classification in VR Predictive Analytics. International Journal of Advanced Science and Technology, 29 (6). pp. 1492-1497.

[img]
Preview
Text
Comparing Eye-Tracking versus EEG Features for Four-Class Emotion Classification in VR Predictive Analytics.pdf

Download (44kB) | Preview
[img]
Preview
Text
Comparing Eye-Tracking versus EEG Features for Four-Class Emotion Classification in VR Predictive Analytics1.pdf

Download (411kB) | Preview

Abstract

This paper presents a novel emotion recognition approach using electroencephalography (EEG) brainwave signals augmented with eye-tracking data in virtual reality (VR) to classify 4-quadrant circumplex model of emotions. 3600 videos are used as the stimuli to evoke user’s emotions (happy, angry, bored, calm) with a VR headset and a pair of earphones. EEG signals are recorded via a wearable EEG brain-computer interfacing (BCI) device and pupil diameter is collected also from a wearable portable eye-tracker. We extract 5 frequency bands which are Delta, Theta, Alpha, Beta, and Gamma from EEG data as well as obtaining pupil diameter from the eye-tracker as the chosen as the eye-related feature for this investigation. Support Vector Machine (SVM) with Radial Basis Function (RBF) kernel is used as the classifier. The best accuracies based on EEG brainwave signals and pupil diameter are 98.44% and 58.30% respectively.

Item Type: Article
Uncontrolled Keywords: Emotion recognition, EEG, eye-tracking, pupil diameter, virtual reality, machine learning
Subjects: Q Science > QA Mathematics > QA75 Electronic computers. Computer science
T Technology > T Technology (General)
T Technology > TA Engineering (General). Civil engineering (General)
Divisions: FACULTY > Faculty of Computing and Informatics
Depositing User: MDM SITI AZIZAH IDRIS
Date Deposited: 01 Jul 2020 03:16
Last Modified: 01 Jul 2020 03:16
URI: http://eprints.ums.edu.my/id/eprint/25561

Actions (login required)

View Item View Item