Combined Weighted Feature Correlation Approach for Enhanced EEG-Based Emotion Recognition Across Diverse Datasets

Summary

The paper is centered on EEG-based emotion recognition, which is an emerging domain in neuroscience and emotional computing. The traditional linear methods are insufficient as it is impossible to represent complicated emotional structure in video. To address this, the authors propose a new model, Combined Weighted Feature Correlation (CWFC), that capture the emotional relationships. After band pass filtering, Independent Component Analysis (ICA), Discrete Wavelet Transform (DWT) and Fast Fourier Transform (FFT) are employed by the model to extract non-linear features from EEG. In this case best feature is selected by LSTM and these features are evaluated by Random Forest Classifier. Introduction Generative Adversarial Network (GAN) based data augmentation gives 88% (for valence) and 86% (for Evaluation of Test Results The proposed GAN based arousal) accuracy on the DEAP dataset which is very high in data augmentation has been able to improve the performance when performance. The model validates that CWFC is beneficial across datasets, as it delivers an overall classification accuracy of 89% for emotional states on the SEED dataset.

Abstract

Emotion recognition using EEG Signals is an active area of research in affective computing and neuroscience, aiding scientists into their quest to understand the brain processes involved in emotions. In contrast to the existing works which focused on linear EEG features, the present work concentrates on non-linear features in order to better characterize the finer changes of emotional responding. Inspired by this, in current paper, proposed method is called Combined Weighted Feature Correlation (CWFC) to investigate the effect of non-linear components on the performance of emotion detection. As a first step, the EEG data is collected and pre-processed using bandpass filters to separate the frequency bands such as beta, alpha, gamma, delta, and theta. To detect intricate emotional patterns, features extraction is performed by Independent Component Analysis (ICA), DWT (Discrete Wavelet Transform) and FFT (Fast Fourier Transform). These features can be built as combined features into the CWFCC model to improve its power as well as its overall predictive accuracy. Then apply a Random Forest classifier to see how significant are these combined features. Proposed work integrates GAN data augmentation after optimal feature selection (with an emphasis on LSTM). On the DEAP dataset, this augmentation results in astonishing 88% valence accuracy and 86% arousal accuracy, which improves the recognition accuracy of emotion remarkably. Proposed model achieved valence and arousal accuracy of 62% and 65%, respectively, on the early DEAP without GAN data augmentation. Moreover, this model can distinguish between SEED dataset during Neutral emotional states, Negative, and Positive with an average accuracy of 89%. The proposed paper proclaims the superior performance of CWFC model with GAN based data augmentation on EEG for emotion recognition over different datasets through in-depth analysis and comparative study.

Introduction

Emotion recognition is important in human interaction and human communication. In order to establish successful interpersonal connections, one must be able to perceive and understand emotions, thus having far-reaching implications in domains as diverse as psychology, neurology, and human-computer interaction¹. In past few years, the electroencephalogram (EEG) based BCI (Brain Computer Interface) has been a merit tool that researchers have focused on to detect emotions. Although EEG-based BCI provide a direct window into the electrical activity of the human brain and an appropriate research tool for exploring emotional states. The automatic and ....

Protocol

The research did not include any direct engagement with human subjects. All datasets utilized in this study were sourced from publicly accessible platforms and were used in accordance with their stated usage policies. As such, formal ethical approval was not necessary.

1. Computational Environment Preparation

1. Prepare a Python environment (version 3.8 or higher) on a standard workstation.
2. Install TensorFlow (v2.x), Keras, Scikit-learn, NumPy, SciPy, MNE, and PyWavelets using pip.
3. Fix the random seed (seed = 42) in NumPy and TensorFlow to ensure consistent experimental results.

Results

The collection of two different EEG datasets; DEAP and SEED formed the first stage of the analysis. Figure 5 shows the graph of Valence-Arousal of LAHV, HALV, LALV, and HAHV are short form of low arousal high valence, high arousal low valence, low arousal low valence and high arousal high valence respectively. Four categories of psychological response have been reported: HAHV, LAHV, HALV, and LALV. Two fundamental emotional features, valence and arousal, are associated with each state and are measured by their mean and s.......

Discussion

In this paper, research conducted a thorough investigation of the EEG-based emotion recognition on two benchmark datasets (i.e., DEAP and SEED) and showed that the proposed CWFC model can effectively capture emotion-related discriminative information. Unlike previous works based essentially on linear descriptions or feature types, the proposed methodology unifies various nonlinear feature extractions that are interconnected and leverages them via a weighted correlation model to infer functional relationships. This multi-.......

Materials

List of materials used in this article

Name	Company	Catalog Number	Comments
DEAP Dataset	Queen Mary University of London	v1.0	EEG emotion dataset
DREAMER Dataset	IEEE DataPort	Public Release	EEG emotion dataset
Keras	Google LLC	2.x (TensorFlow backend)	Neural network modeling
Workstation	Lenovo	Intel Core i7, 16 GB RAM, 8 GB NVIDIA GPU	Model training and computation
MNE-Python	MNE Developers	1.x	EEG preprocessing
NumPy	NumPy Developers	1.x	Numerical computation
Operating System	Microsoft Corporation	Windows 11 (64-bit)	Computational platform
Python	Python Software Foundation	3.8+	Programming environment
PyWavelets	PyWavelets Developers	1.x	Wavelet decomposition
Scikit-learn	scikit-learn Developers	1.x	Machine learning utilities
SciPy	SciPy Community	1.x	Signal processing and resampling
SEED Dataset	BCMI Laboratory, Shanghai Jiao Tong University	Public Release	EEG emotion dataset
TensorFlow	Google LLC	2.x	Deep learning framework