EEG-Based Multi-Class Emotion Recognition using Hybrid LSTM Approach

Md Momenul Haque; Subrata Kumer Paul; Rakhi Rani Paul; Mursheda Nusrat Della; Md. Kamrul Islam; Sultan Fahim

Abstract

Emotion recognition is a crucial task in human-computer interaction, psychology, and neuroscience. Electroencephalogram (EEG)-based multi-class emotion recognition is a novel approach that aims to identify and classify human emotions by analysing EEG signals. Traditional methods of emotion recognition often face challenges in accurately identifying and classifying human emotions due to their complexity and subjectivity. EEG-based emotion recognition provides a direct and objective measure of three emotional states (positive, neutral, and negative), making it a promising tool for emotion recognition. The proposed hybrid LSTM approach combines the strengths of different traditional machine learning algorithms: Gaussian Naive Bayes (GNB), Support Vector Machine (SVM), Logistic Regression (LR), and Decision Tree (DT). The approach was tested on the EEG brainwave dataset, and LSTM achieved an accuracy of 95%, while the proposed hybrid LSTM-GNB, LSTM-SVM, LSTM-LR, and LSTM-DT models achieved 65%, 96%, 97%, and 96% accuracy, respectively. The contribution of this study is the development of a hybrid LSTM approach that combines the strengths of two different algorithms, resulting in higher accuracy for multi-class emotion recognition using EEG signals. The results demonstrate the potential of the hybrid LSTM approach for real-world applications such as emotion-based human-computer interaction and mental health diagnosis.

Keywords

EEG Signal, Hybrid LSTM, Emotion Recognition, Brainwave

References

Paul, R. R., Paul, S. K., & Hamid, Md. E. (2022). A 2D Convolution Neural Network Based Method for Human Emotion Classification from Speech Signal. In 2022 25th International Conference on Computer and Information Technology (ICCIT). 2022 25th International Conference on Computer and Information Technology (ICCIT). IEEE. https://doi.org/10.1109/iccit57492.2022.10054811
Subrata Kumer Paul, Rakhi Rani Paul, Nishimura, M., & Hamid, Md. E. (2020). Throat to Acoustic Speech Mapping for Spectral Parameter Correction using Artificial Neural Network Approach. In Proceedings of International Exchange and Innovation Conference on Engineering & Sciences (IEICES) (Vol. 6, pp. 238–242). Kyushu University. https://doi.org/10.5109/4102497
Zhang, J., Yin, Z., Chen, P., & Nichele, S. (2020). Emotion recognition using multi-modal data and machine learning techniques: A tutorial and review. In Information Fusion (Vol. 59, pp. 103–126). Elsevier BV. https://doi.org/10.1016/j.inffus.2020.01.011
Paul, S. K., & Paul, R. R. (2021). Speech Command Recognition System using Deep Recurrent Neural Networks. In 2021 5th International Conference on Electrical Engineering and Information Communication Technology (ICEEICT). 2021 5th International Conference on Electrical Engineering and Information Communication Technology (ICEEICT). IEEE. https://doi.org/10.1109/iceeict53905.2021.9667795
Hancer, E., & Subasi, A. (2022). EEG-based emotion recognition using dual tree complex wavelet transform and random subspace ensemble classifier. In Computer Methods in Biomechanics and Biomedical Engineering (pp. 1–13). Informa UK Limited. https://doi.org/10.1080/10255842.2022.2143714
Alotaibi, F. M., & Fawad. (2023). An AI-Inspired Spatio-Temporal Neural Network for EEG-Based Emotional Status. In Sensors (Vol. 23, Issue 1, p. 498). MDPI AG. https://doi.org/10.3390/s23010498
Oh, S. L., Vicnesh, J., Ciaccio, E. J., Yuvaraj, R., & Acharya, U. R. (2019). Deep Convolutional Neural Network Model for Automated Diagnosis of Schizophrenia Using EEG Signals. In Applied Sciences (Vol. 9, Issue 14, p. 2870). MDPI AG. https://doi.org/10.3390/app9142870
Subrata Kumer Paul & Rakhi Rani Paul, “Speech Recognition of Throat Microphone using MFCC Approach”, International Research Journal of Engineering and Technology (IRJET), Volume: 07 Issue: 05, May 2020, pp: 1940-1943
Nath, D., Anubhav, Singh, M., Sethia, D., Kalra, D., & Indu, S. (2020). A Comparative Study of Subject-Dependent and Subject-Independent Strategies for EEG-Based Emotion Recognition using LSTM Network. In Proceedings of the 2020 the 4th International Conference on Compute and Data Analysis. ICCDA 2020: 2020 The 4th International Conference on Compute and Data Analysis. ACM. https://doi.org/10.1145/3388142.3388167
Paul, S. K., & Paul, R. R. (2020). Effective Pitch Estimation using Canonical Correlation Analysis. In 2020 2nd International Conference on Advanced Information and Communication Technology (ICAICT). 2020 2nd International Conference on Advanced Information and Communication Technology (ICAICT). IEEE. https://doi.org/10.1109/icaict51780.2020.9333460
Zaman, S. M. T., Paul, S. K., Paul, R. R., & Hamid, Md. E. (2021). Detecting Diabetes in Human Body using Different Machine Learning Techniques. In 2021 International Conference on Computer, Communication, Chemical, Materials and Electronic Engineering (IC4ME2). 2021 International Conference on Computer, Communication, Chemical, Materials and Electronic Engineering (IC4ME2). IEEE. https://doi.org/10.1109/ic4me253898.2021.9768501
Paul, S. K., Paul, R. R., Nishimura, M., & Hamid, Md. E. (2021). Throat Microphone Speech Enhancement Using Machine Learning Technique. In Learning and Analytics in Intelligent Systems (pp. 1–11). Springer International Publishing. https://doi.org/10.1007/978-3-030-65407-8_1
Haque, Md. M., Kumer Paul, S., Paul, R. R., Ekramul Hamid, Md., Fahim, S., & Islam, S. (2022). A Comprehensive Study on Ethereum Blockchain-based Digital Marketplace using NFT Smart Contract Infrastructure. In 2022 25th International Conference on Computer and Information Technology (ICCIT). 2022 25th International Conference on Computer and Information Technology (ICCIT). IEEE. https://doi.org/10.1109/iccit57492.2022.10056108
Haque, Md. M., Paul, S. K., Paul, R. R., Rashidul Hasan, M. A. F. M., Fahim, S., & Islam, S. (2022). A Blockchain-Based Secure Payment System for Vehicle Fuel Filling Station. In 2022 25th International Conference on Computer and Information Technology (ICCIT). 2022 25th International Conference on Computer and Information Technology (ICCIT). Paper Publisher: IEEE. https://doi.org/10.1109/iccit57492.2022.10055001

Cites this article as

M. M. Haque, S. K. Paul, R. R. Paul, M. N. Della, M. K. Islam, S. Fahim, "EEG-Based Multi-Class Emotion Recognition using Hybrid LSTM Approach", International Journal of Innovative Research in Computer Science and Technology (IJIRCST), Vol-11, no.3, pp.1-6, 2023. Available from: https://doi.org/10.55524/ijircst.2023.11.3.1

Corresponding Author

Md Momenul Haque

Department of CSE, Bangladesh Army University of Engineering & Technology (BAUET), Qadirabad, Dayarampur, Natore-6431, Rajshahi, Bangladesh

Download Full Paper

Download PDF

No. of Downloads: 57 | No. of Views: 1060

Precision Agriculture Revolution: PALS Algorithm Unveiled

Siti Nur.

September 2024 - Vol 12, Issue 5
AI-Driven UX/UI Design: Empirical Research and Applications in FinTech

Yang Xu, Yingchia Liu, Haosen Xu, Hao Tan.

July 2024 - Vol 12, Issue 4
A Comparative Study of Cat Swarm Algorithm for Graph Coloring Problem: Convergence Analysis and Performance Evaluation

Ayesha Saeed, Ali Husnain, Anam Zahoor, Rashad Mehmood Gondal.

July 2024 - Vol 12, Issue 4

IJIRCST

EEG-Based Multi-Class Emotion Recognition using Hybrid LSTM Approach

Citations

Download Full Paper PDF

Total View 1060

Total Download 57