Feature extraction techniques for human-computer interaction

Abstract

In order to improve communication and interaction between humans and machines/computers, the multimodal signal processing and Artificial Intelligence (AI) are vital tools. For a seamless Human-Computer Interaction (HCI), it integrates and analyzes the data from several sensory modalities. The objective is to develop more efficient, natural, and intuitive interfaces that can comprehend and react to human input more effectively. Usually, these modalities consist of visual and auditory kinds of sensor data. However, a latest trend is to employ the physiological signals for modeling and realizing the contemporary HCIs. In this context, the feature extraction methods play an important role. The aim of feature extraction is to achieve accurate representation for modeling or identifying critical elements or intentions in the human body systems using machine or deep learning techniques. Feature extraction facilitates the identification and interpretation of relevant information from input data streams. This chapter explores various feature extraction techniques employed in HCI applications, ranging from parametric model-based methods to more complex approaches. Traditional techniques encompass the signal processing methods such as digital filtering and Fourier transform. The intended parametric model-based methods are the autoregressive, Yule-Walker, covariance, and modified covariance. Further considered approaches are the subspace-based methods, eigenvector, and time-frequency analysis such as the short-time Fourier transform and different variants of wavelet transform. Additionally, the oscillatory mode decompositions and common spatial patterns are described. These methods are effective for extracting pertinent information from the input signals, and moreover, they enable the automated decision support through machine and deep learning methodologies for the contemporary HCIs.