E-Facetic: The integration of multimodal emotion expression for avatar through facial expression, acoustic and haptic

Abdullah Bade and Ahmad Hoirul Basori and Mohd Shahrizal Sunar and Daut Daman and Nadzari Saari (2010) E-Facetic: The integration of multimodal emotion expression for avatar through facial expression, acoustic and haptic. In: 9th ACM SIGGRAPH International Conference on VR Continuum and Its Applications in Industry (VRCAI 2010), 12-13 December 2010, Seoul, Korea.

Full text not available from this repository.


Latest 3D humanoid models are merely able to produce emotion sensations through facial animation, gesture and voice. However, few of them are really concerned about manipulating haptic tactile emotion through vibration, especially on expressing 3D humanoid model emotion using common haptic device like joystick. In this paper, we have created a mapping approach to classify force power of vibration into particular emotion appearance. To justify our mapping process, the happiness mode is converted into low to medium vibration with short and long duration.The conducted experiment found out that the RGB values (1-255) can easily be mapped into given magnitude force (0-10000 ) as suggested by vibration frequency classification. The experiments give significant positive result which is able to drive avatar to give more realistic expression. All users have strong confidence rate on differentiating and recognizing emotion of users. From the user testing, we obtained 67% user give strong and very strong impression that our system gives stronger emotional expression than Alfred systems. 29 % user gives medium values to our system compare to Alfred system. Finally, around 5% users said that our system provides a little impression than Alfred system. Furthermore, we have found an interesting finding that all users agree that high vibration of joystick equivalent to anger emotion. Experiments also proved that user manages to have strong feeling and impression while they interact and communicate with E-FACETIC. In the future, we believed that our proposed procedure will enhance the presence of avatar in the overall aspects of virtual reality, games or even serious games. Copyright © 2010 by the Association for Computing Machinery, Inc.

Item Type: Conference or Workshop Item (UNSPECIFIED)
Keyword: Avatar, Emotion, Facial animation, Vibration
Subjects: Q Science > QA Mathematics > QA1-939 Mathematics > QA71-90 Instruments and machines > QA75.5-76.95 Electronic computers. Computer science
Department: SCHOOL > School of Engineering and Information Technology
Depositing User: ADMIN ADMIN
Date Deposited: 10 Mar 2011 15:55
Last Modified: 26 Mar 2015 10:42
URI: https://eprints.ums.edu.my/id/eprint/2175

Actions (login required)

View Item View Item