Developments in biomedical science, signal processing technologies have
led Electroencephalography (EEG) signals to be widely used in the diagnosis of
brain disease and in the field of Brain-Computer Interface (BCI). The collected
EEG signals are processed using Machine Learning-Random Forest and Naive Bayes- and Deep Learning-Recurrent
Neural Network (RNN), Neural Network (NN) and Long Short Term Memory
(LSTM)-Algorithms to obtain the recent mood of a person. The Algorithms
mentioned above have been imposed on the data set in order to find out what the
person is feeling at a particular moment. The following thesis is conducted to
find out one of the following moods (happy, surprised, disgust, fear, anger and
sadness) of a person at an instant, with an aim to obtain the result with least
amount of time delay as the mood differs. It is pretty obvious that the
accuracy of the output varies depending upon the algorithm used, time taken to
process the data, so that it is easy for us to compare the reliability and
dependency of a particular algorithm to another, prior to its practical
implementation. The imbalance data sets that were used had an imbalanced class
and thus, over fitting occurred. This problem was handled by generating
Artificial Data sets with the use of SMOTE Oversampling Technique.
References
[1]
Hasnul, M.A., Aziz, N.A.A., Alelyani, S., Mohana, M. and Aziz, A.A.J.S. (2021) Electrocardiogram-Based Emotion Recognition Systems and Their Applications in Healthcare—A Review. Sensors, 21, Article No. 5015.
https://doi.org/10.3390/s21155015
[2]
Acharya, D., Goel, S., Bhardwaj, H., Sakalle, A. and Bhardwaj, A. (2020) A Long Short Term Memory Deep Learning Network for the Classification of Negative Emotions Using EEG Signals. 2020 International Joint Conference on Neural Networks (IJCNN), Glasgow, 19-24 July 2020, 1-8.
https://doi.org/10.1109/IJCNN48605.2020.9207280
[3]
Sharma, R., Pachori, R.B. and Sircar, P. (2020) Automated Emotion Recognition Based on Higher Order Statistics and Deep Learning Algorithm. Biomedical Signal Processing and Control, 58, Article ID: 101867.
https://doi.org/10.1016/j.bspc.2020.101867
[4]
Nath, D., Singh, M., Sethia, D., Kalra, D. and Indu, S. (2020) An Efficient Approach to EEG-Based Emotion Recognition Using LSTM Network. 2020 16th IEEE International Colloquium on Signal Processing Its Applications (CSPA), Langkawi, 28-29 February 2020, 88-92.
Feidakis, M., Daradoumis, T. and Caballe, S. (2011) Emotion Measurement in Intelligent Tutoring Systems: What, When and How to Measure. Proceedings of the 2011 3rd International Conference on Intelligent Networking and Collaborative Systems, Fukuoka, 30 November-2 December 2011, 807-812.
https://doi.org/10.1109/INCoS.2011.82
Lu, N., Wu, Y., Feng, L. and Song, J. (2018) Deep Learning for Fall Detection: Three-Dimensional CNN Combined with LSTM on Video Kinematic Data. IEEE Journal of Biomedical and Health Informatics, 23, 314-323.
https://doi.org/10.1109/JBHI.2018.2808281
[9]
Gandhi, V., Prasad, G., Coyle, D., Behera, L. and McGinnity, T.M. (2014) Quantum Neural Network-Based EEG Filtering for a Brain-Computer Interface. IEEE Transactions on Neural Networks and Learning Systems, 25, 278-288.
https://doi.org/10.1109/TNNLS.2013.2274436
[10]
Campisi, P. and Rocca, D.L. (2014) Brain Waves for Automatic Biometric Based User Recognition. IEEE Transactions on Information Forensics and Security, 9, 782-800.
https://doi.org/10.1109/TIFS.2014.2308640
[11]
Cecotti, H. and Gräser, A. (2011) Convolutional Neural Networks for P300 Detection with Application to Brain-Computer Interfaces. IEEE Transactions on Pattern Analysis and Machine Intelligence, 33, 433-445.
https://doi.org/10.1109/TPAMI.2010.125
[12]
Iwasa, H., Horie, T. and Matsuyama, Y. (2016) Verification of Fraudulent PIN Holders by Brain Waves. 2016 International Joint Conference on Neural Networks (IJCNN), Vancouver, 24-29 July 2016, 2068-2075.
https://doi.org/10.1109/IJCNN.2016.7727454
[13]
Xu, H.Y., Lou, J., Su, R.D. and Zhang, E.P. (2009) Feature Extraction and Classification of EEG for Imaging Left-Right Hands Movement. International Conference on Computer Science and Information Technology, Kiev, 25-26 July 2009, 56-59.
https://doi.org/10.1109/ICCSIT.2009.5234611
[14]
Chai, R., Ling, S.H., Hunter, G.P., Tran, Y. and Nguyen, H.T. (2013) Brain-Computer Interface Classifier for Wheelchair Commands Using Neural Network with Fuzzy Particle Swarm Optimization. IEEE Journal of Biomedical and Health Informatics, 18, 1614-1624. https://doi.org/10.1109/JBHI.2013.2295006
[15]
Steyrl, D., Scherer, R., Förstner, O. and Müller-Putz, G. (2014) Motor Imagery Brain-Computer Interfaces: Random Forests vs Regularized LDA-Non-Linear Beats Linear. 6th International Brain-Computer Interface Conference, Graz, 16-19 September 2014.
[16]
Aeby, A., Santalucia, R., Van Hecke, A., Nebbioso, A., Vermeiren, J., Deconinck, N., De Tiège, X. and Van Bogaert, P. (2021) A Qualitative Awake EEG Score for the Diagnosis of Continuous Spike and Waves during Sleep (CSWS) Syndrome in Self-Limited Focal Epilepsy (SFE): A Case-Control Study. Seizure, 84, 34-39.
https://doi.org/10.1016/j.seizure.2020.11.008
[17]
Tang, H., Liu, W., Zheng, W.-L. and Lu, B.-L. (2017) Multimodal Emotion Recognition Using Deep Neural Networks. 24th International Conference, ICONIP 2017, Guangzhou, 14-18 November 2017, 811-819.
https://doi.org/10.1007/978-3-319-70093-9_86
[18]
Zheng, W.-L., Zhu, J.-Y. and Lu, B.-L. (2019) Identifying Stable Patterns over Time for Emotion Recognition from EEG. IEEE Transactions on Affective Computing, 10, 417-429. https://doi.org/10.1109/TAFFC.2017.2712143
[19]
Li, X., Song, D.W., Zhang, P., Yu, G.L., Hou, Y.X. and Hu, B. (2016) Emotion Recognition from Multi-Channel EEG Data through Convolutional Recurrent Neural Network. 2016 IEEE International Conference on Bioinformatics and Biomedicine (BIBM), Shenzhen, 15-18 December 2016, 352-359.
[20]
Tripathi, S., Acharya, S., Sharma, R.D., Mittal, S. and Bhattacharya, S. (2017) Using Deep and Convolutional Neural Networks for Accurate Emotion Classification on DEAP Data. Proceedings of the AAAI Conference on Artificial Intelligence, 31, 4746-4752. https://doi.org/10.1609/aaai.v31i2.19105
[21]
Al-Nafjan, A., Hosny, M., Al-Wabil, A. and Al-Ohali, Y. (2017) Classification of Human Emotions from Electroencephalogram (EEG) Signal Using Deep Neural Network. International Journal of Advanced Computer Science and Applications, 8, 419-425. https://doi.org/10.14569/IJACSA.2017.080955
[22]
Rayatdoost, S. and Soleymani, M. (2018) Cross-Corpus EEG-Based Emotion Recognition. 2018 IEEE 28th International Workshop on Machine Learning for Signal Processing (MLSP), Aalborg, 17-20 September 2018, 1-6.
https://doi.org/10.1109/MLSP.2018.8517037
[23]
Cao, G.L., Ma, Y.L., Meng, X.F., Gao, Y.Y. and Meng, M. (2019) Emotion Recognition Based on CNN. 2019 Chinese Control Conference (CCC), Guangzhou, 27-30 July 2019, 8627-8630. https://doi.org/10.23919/ChiCC.2019.8866540
[24]
Cimtay, Y., Ekmekcioglu, E. and Caglar-Ozhan, S. (2020) Cross-Subject Multimodal Emotion Recognition Based on Hybrid Fusion. IEEE Access, 8, 168865-168878.
https://doi.org/10.1109/ACCESS.2020.3023871
[25]
Cimtay, Y. and Ekmekcioglu, E. (2020) Investigating the Use of Pretrained Convolutional Neural Network on Cross-Subject and Cross-Dataset EEG Emotion Recognition. Sensors, 20, Article No. 2034. https://doi.org/10.3390/s20072034
Gao, Z.K., Wang, X.M., Yang, Y.X., Li, Y.L., Ma, K. and Chen, G.R. (2021) A Channel-Fused Dense Convolutional Network for EEG-Based Emotion Recognition. IEEE Transactions on Cognitive and Developmental Systems, 13, 945-954.
https://doi.org/10.1109/TCDS.2020.2976112
[28]
Acharya, D., Goel, S., Bhardwaj, H., Sakalle, A. and Bhardwaj, A. (2020) A Long Short Term Memory Deep Learning Network for the Classification of Negative Emotions Using EEG Signals. 2020 International Joint Conference on Neural Networks (IJCNN), Glasgow, 19-24 July 2020, 1-8.
https://doi.org/10.1109/IJCNN48605.2020.9207280
[29]
Andrzejak, R.G., Lehnertz, K., Mormann, F., Rieke, C., David, P. and Elger, C.E. (2001) Indications of Nonlinear Deterministic and Finite-Dimensional Structures in Time Series of Brain Electrical Activity: Dependence on Recording Region and Brain State. Physical Review E, Statistical, Nonlinear, and Soft Matter Physics, 64, Article ID: 061907. https://doi.org/10.1103/PhysRevE.64.061907
[30]
Rayatdoost, S. and Soleymani, M. (2018) Cross-Corpus EEG Based Emotion Recognition. 2018 IEEE 28th International Workshop on Machine Learning for Signal Processing (MLSP), Aalborg, 17-20 September 2018, 1-6.
https://doi.org/10.1109/MLSP.2018.8517037
[31]
Nanthini, B.S. and Santhi, B. (2015) Different Approaches to Analysing EEG Signals for Seizure Detection. International Journal of Signal and Imaging Systems Engineering, 8, 28-38. https://doi.org/10.1504/IJSISE.2015.067066
[32]
Chawla, N., Bowyer, K., Hall, L. and Kegelmeyer, P. (2000) SMOTE: Synthetic Minority Over-Sampling Technique. In: International Conference of Knowledge Based Computer Systems, Allied Press, Mumbai, 46-57.
[33]
Krawczyk, B. (2016) Learning from Imbalanced Data: Open Challenges and Future Directions. Progress in Artificial Intelligence, 5, 221-232.
https://doi.org/10.1007/s13748-016-0094-0
