Multimodal emotion recognition

Summary

This project aims to develop novel techniques for automatically recognizing emotions through combining physiology, behaviour, facial expressions and language.

Supervisor(s)

Associate Professor Rafael A. Calvo

Research Location

Electrical and Information Engineering

Program Type

PHD

Synopsis

The design of collaborative learning activities has not been informed by the underlying affective dynamics learners go through. Although emotions have generally been recognized as having an impact in learning, particularly during collaborative activities, researchers have found them hard to research and model. Recent advances in biomedical engineering, neuroscience and data mining have increased researchers attention to this issue. We are at a point where significant accuracy in recognizing basic emotional states is feasible through a number of approaches. The identification of affective and mental states provides a magnifying glass into the processes involved in collaborative learning activities.

Additional Information

For more information: Calvo, R. A., & D’Mello, S. (2010). Affect Detection: An Interdisciplinary Review of Models, Methods, and Their Applications. IEEE Transactions on Affective Computing, 1(1), 18-37. Published by the IEEE Computer Society.

Keywords

Emotion Recognition, affective computing, learning technologies

Opportunity ID

The opportunity ID for this research opportunity is: 1244

Other opportunities with Associate Professor Rafael A. Calvo

• Semantic awareness in collaborative writing
• Automatic mapping of concepts and relationships
• Social network visualization in collaborative work and learning
• Multimodal approaches for detecting attention in Human-Computer Interaction
• Positive computing applications - human-computer interaction to change the world
• Ubiquitous sensors to improve self-regulation skills in multiple environments