The developments in the area of brain research by
analysing brain activity of individuals have given rise to many useful
applications, such as diagnosing mental disorders more efficiently, treatment
of cognitive disorders, and developing of brain-computer interfaces for treatment, communication and
entertainment purposes. However, the development of such applications is
hindered by a shortage of easy-to-use and comfortable sensors, as well as a
lack of high-quality brain activity data. In the first part of this paper, a review of the status of BCI applications is presented followed by a proposal of a framework for developing an intelligent BCI
headphone that takes leverages of the huge amount of data coming from playing videogames to let the players experience a full immersive
gaming experience.
References
[1]
Farwell, L.A. and Donchin, E. (1988) Talking off the Top of Your Head: Toward a Mental Prosthesis Utilizing Event-Related Brain Potentials. Electroencephalography and Clinical Neurophysiology, 70, 510-523.
https://doi.org/10.1016/0013-4694(88)90149-6
[2]
Leeb, R., Friedman, D., Mller-Putz, G., Scherer, R., Slater, M. and Pfurtscheller, G. (2007) Self-Paced (Asynchronous) BCI Control of a Wheelchair in Virtual Environments: A Case Study with a Tetraplegic. Computational Intelligence and Neuroscience, 2007, Article ID: 079642. https://doi.org/10.1155/2007/79642
[3]
Birbaumer, N., Elbert, T., Canavan, A. and Rockstroh, B. (1990) Slow Potentials of the Cerebral Cortex and Behavior. Physiological Reviews, 70, 1-41.
https://doi.org/10.1152/physrev.1990.70.1.1
[4]
Vidal, J.J. (1977) Real-Time Detection of Brain Events in EEG. Proceedings of the IEEE, 65, 633-641. https://doi.org/10.1109/PROC.1977.10542
[5]
Plass-Oude Bos, D., Reuderink, B., van de Laar, B., Gürkök, H., Mühl, C., Poel, M., et al. (2010) Brain-Computer Interfacing and Games. In: Tan, D. and Nijholt, A., Eds., Brain-Computer Interfaces. Human-Computer Interaction Series, Springer, London, 149-178. https://doi.org/10.1007/978-1-84996-272-8_10
[6]
Brouwer, A.-M., van Erp, J., Heylen, D., Jensen, O. and Poel, M. (2013) Effortless Passive BCIs for Healthy Users. In: Stephanidis, C. and Antona, M., Eds., Universal Access in Human-Computer Interaction. Design Methods, Tools, and Interaction Techniques for eInclusion. UAHCI 2013. Lecture Notes in Computer Science, Vol. 8009, Springer, Berlin, 615-622. https://doi.org/10.1007/978-3-642-39188-0_66
[7]
Selvam, V.S. and Shenbagadevi, S. (2011) Brain Tumor Detection Using Scalp Eeg With Modified Wavelet-ICA and Multi Layer Feed Forward Neural Network. 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Boston, 30 August-3 September 2011, 6104-6109.
https://doi.org/10.1109/IEMBS.2011.6091508
[8]
Sharanreddy, M. and Kulkarni, P.K. (2013) Detection of Primary Brain Tumor Present in EEG Signal Using Wavelet Transform and Neural Network. International Journal of Biological and Medical Research, 4, 2855-2859.
[9]
Poulos, M., Felekis, T. and Evangelou, A (2012) Is It Possible to Extract a Fingerprint for Early Breast Cancer via EEG Analysis? Medical Hypotheses, 78, 711-716.
https://doi.org/10.1016/j.mehy.2012.02.016
[10]
Sharanreddy, M. and Kulkarni, P.K. (2013) Automated EEG Signal Analysis for Identification of Epilepsy Seizures and Brain Tumour. Journal of Medical Engineering & Technology, 37, 511-519. https://doi.org/10.3109/03091902.2013.837530
[11]
Domingo, M.C. (2012) An Overview of the Internet of Things for People with Disabilities. Journal of Network and Computer Applications, 35, 584-596.
https://doi.org/10.1016/j.jnca.2011.10.015
[12]
Vecchiato, G., Astolfi, L., De Vico Fallani, F., Salinari, S., Cincotti, F., Aloise, F., Mattia, D., Marciani, M.G., Bianchi, L., Soranzo, R., et al. (2009) The Study of Brain Activity During the Observation of Commercial Advertsing by Using High Resolution EEG Techniques. 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Minneapolis, 3-6 September 2009, 57-60.
https://doi.org/10.1109/IEMBS.2009.5335045
Marquez, B.Y., Alanis, A., Lopez, M.A. and Magdaleno-Palencia, J.S. (2012) Sport Education Based Technology: Stress Measurement in Competence. 2012 International Conference on E-Learning and E-Technologies in Education (ICEEE), Lodz, 24-26 September 2012, 247-252. https://doi.org/10.1109/ICeLeTE.2012.6333422
[15]
Birbaumer, N., Ruiz, S. and Sitaram, R. (2013) Learned Regulation of Brain Metabolism. Trends in Cognitive Sciences, 17, 295-302.
https://doi.org/10.1016/j.tics.2013.04.009
[16]
Royer, A.S., Doud, A.J., Rose, M.L. and He, B. (2010) EEG Control of a Virtual Helicopter in 3-Dimensional Space Using Intelligent Control Strategies. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 18, 581-589.
https://doi.org/10.1109/TNSRE.2010.2077654
[17]
Tan, D.S. and Nijholt, A. (2010) Brain-Computer Interfaces: Applying Our Minds to Human-Computer Interaction. Springer, London.
https://doi.org/10.1007/978-1-84996-272-8
[18]
Mathan, S. (2008) Feature: Image Search at the Speed of Thought. Interactions, 15, 76-77. https://doi.org/10.1145/1374489.1374509
[19]
Nakanishi, I., Baba, S. and Li, S. (2011) Evaluation of Brain Waves as Biometrics for Driver Authentication Using Simplified Driving Simulator. 2011 International Conference on Biometrics and Kansei Engineering, Takamatsu, 19-22 September 2011, 71-76. https://doi.org/10.1109/ICBAKE.2011.27
[20]
Nakanishi, I., Baba, S., Ozaki, K. and Li, S. (2013) Using Brain Waves as Transparent Biometrics for On-Demand Driver Authentication. International Journal of Biometrics, 5, 288-305. https://doi.org/10.1504/IJBM.2013.055965
[21]
Hjelm, S. and Browall, C. (2000) Brainball—Using Brain Activity for Cool Competition. NordiCHI2000 Proceedings, Stockholm, 23-25 October 2000, 177-188.
[22]
Hjelm, S. (2003) Research+Design: The Making of Brainball. Interactions, 10, 26-34. https://doi.org/10.1145/604575.604576
[23]
Pineda, J.A., Silverman, D.S., Vankov, A. and Hestenes, J. (2003) Learning to Control Brain Rhythms: Making a Brain-Computer Interface Possible. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 11, 181-184.
https://doi.org/10.1109/TNSRE.2003.814445
[24]
Gurkok, H., Nijholt, A., Poel, M. (2015). Brain-Computer Interface Games: Towards a Framework. In: Nakatsu, R., Rauterberg, M., Ciancarini, P., Eds., Handbook of Digital Games and Entertainment Technologies. Springer, Singapore, 1-18.
https://doi.org/10.1007/978-981-4560-52-8_5-1
[25]
Gürkök, H., Hakvoort, G. and Poel, M. (2011) Evaluating User Experience in a Selection Based Brain-Computer Interface Game A Comparative Study. In: Anacleto, J.C., Fels, S., Graham, N., Kapralos, B., Saif El-Nasr, M. and Stanley, K., Eds., Entertainment Computing—ICEC 2011. ICEC 2011. Lecture Notes in Computer Science, Vol. 6972, Springer, Berlin, 77-88. https://doi.org/10.1007/978-3-642-24500-8_9
[26]
Baqapuri, H.I., et al. (2021) A Novel Brain–Computer Interface Virtual Environment for Neurofeedback during Functional MRI. Frontiers in Neuroscience, 14, Article 593854. https://doi.org/10.3389/fnins.2020.593854
[27]
Vega, I.M., Adarve, C.A., Villar-Vega, H.F. and Páramo, C.A. (2019) Serious Game for Real-Time Brain-Computer Interface Training. Journal of Physics: Conference Series, 1418, Article ID: 012011. https://doi.org/10.1088/1742-6596/1418/1/012011
[28]
Vasiljevic, G.A.M. and de Miranda, L.C. (2022) Comparing Users’ Performance and Game Experience between a Competitive and Collaborative Brain-Computer Interface. Behaviour & Information Technology.
https://doi.org/10.1080/0144929X.2022.2152727
[29]
Cattan, G. (2021) The Use of Brain-Computer Interfaces in Games Is Not Ready for the General Public. Frontiers in Computer Science, 3, Article 628773.
https://doi.org/10.3389/fcomp.2021.628773
[30]
Witmer, B.G. and Singer, M.J. (1998) Measuring Presence in Virtual Environments: A Presence Questionnaire. Presence: Teleoperators and Virtual Environments, 7, 225-240. https://doi.org/10.1162/105474698565686
[31]
van de Laar, B., Reuderink, B., Plass-Oude Bos, D. and Heylen, D. (2010) Evaluating User Experience of Actual and Imagined Movement in BCI Gaming. International Journal of Gaming and Computer-Mediated Simulations, 2, 33-47.
https://doi.org/10.4018/jgcms.2010100103
[32]
van de Laar, B., Gürkök, H., Plass-Oude Bos, D., Poel, M. and Nijholt, A. (2013) Experiencing BCI Control in a Popular Computer Game. IEEE Transactions on Computational Intelligence and AI in Games, 5, 176-184.
https://doi.org/10.1109/TCIAIG.2013.2253778
[33]
IJsselsteijn, W., De Kort, Y., Poels, K., Jurgelionis, A. and Bellotti, F. (2007) Characterising and Measuring User Experiences in Digital Games. International Conference on Advances in Computer Entertainment Technology, ACE 2007, Salzburg, 13-15 June 2007, 1-4.
[34]
van de Laar, B., Gürk, H., Plass-Oude Bos, D. and Nijboer, F., Nijholk, H., Plass-Oude Bos, D. and Nijboer, F., Nijholt, A. (2011) Perspectives on User Experience Evaluation of Brain-Computer Interfaces. In: Stephanidis, C., Ed., Universal Access in Human-Computer Interaction. Users Diversity. UAHCI 2011. Lecture Notes in Computer Science, Vol. 6766, Springer, Berlin, 600-609. https://doi.org/10.1007/978-3-642-21663-3_65
[35]
Başar, E., Başar-Eroglu, C., Parnefjord, R., Rahn, E. and Schürmann, M. (1992) Evoked Potentials: Ensembles of Brain Induced Rhythmicities in the Alpha, Theta and Gamma Ranges. In: Başar, E. and Bullock, T.H., Eds., Induced Rhythms in the Brain. Brain Dynamics, Birkhäuser, Boston, 155-181.
https://doi.org/10.1007/978-1-4757-1281-0_9
[36]
Tan, D., Nijholt, A. (2010). Brain-Computer Interfaces and Human-Computer Interaction. In: Tan, D., Nijholt, A. (eds) Brain-Computer Interfaces. Human-Computer Interaction Series. Springer, London, 3-19.
https://doi.org/10.1007/978-1-84996-272-8_1
[37]
Ahn, M., Lee, M., Choi, J. and Jun, S.C. (2014) A Review of Brain-Computer Interface Games and an Opinion Survey from Researchers, Developers and Users. Sensors, 14, 14601-14633. https://doi.org/10.3390/s140814601
