ECG-based emotion recognition using CWT and deep learning

Abstract

Emotion recognition can enhance the Human-Machine Interaction (HMI) in several aspects such as an enriched personalization with intention-based adaptation and responsiveness. In this context, several valuable studies have been conducted by exploring the physiological signals. This chapter discusses the significance of assessing the Autonomic Nervous System (ANS) through physiological indicators like electrocardiogram (ECG), Galvanic Skin Response (GSR), Blood Pressure (BP), and respiration rates, with particular emphasis on ECG and GSR due to their insights into various pathological and psychophysiological conditions. While ECG provides detailed heart electrical activity information, GSR reflects ANS activity through sweat gland function. The simplicity, effectiveness, affordability, and noninvasiveness of these measures make them preferable, although automatic interpretation is crucial for accurately identifying patterns associated with specific mental and physiological states. This chapter aims to improve healthcare applications and human-computer interaction by investigating the possibilities of emotion recognition using AI algorithms applied to ECG and GSR signals. Machine learning and deep learning algorithms evaluate ECG and GSR data to categorize emotions. These techniques have shown promise in various fields, including affective computing, mental health assessment, and human-computer interaction. To validate their effectiveness in differentiating emotions for multiple applications, the chapter shows how to create an effective ecosystem for real-time emotion recognition from ECG and GSR signals using a blend of wavelet transform, convolutional neural networks, and transfer learning.