Sociology

Pattern recognition (psychology)

Archaeology

Key (lock)

Natural (archaeology)

Modalities

Social science

History

Human–computer interaction

Artificial intelligence

Facial expression

Emotion recognition

Facial recognition system

Computer science

Speech recognition

Facial expression recognition

Emotion detection

Computer security

Affective computing

Creatures

IEEE Signal Processing Magazine

Humans are emotional creatures. Multiple modalities are often involved when we express emotions, whether we do so explicitly (such as through facial expression and speech) or implicitly (e.g., via text or images). Enabling machines to have emotional intelligence, i.e., recognizing, interpreting, processing, and simulating emotions, is becoming increasingly important. In this tutorial, we discuss several key aspects of multimodal emotion recognition (MER).

Emotion Recognition From Multiple Modalities: Fundamentals and methodologies