|
UPSI Digital Repository (UDRep)
|
|
| ||||||||||||||||||||||||||
| Abstract : Universiti Pendidikan Sultan Idris |
| The brain?computer interface (BCI) technique represents one of the furthermost active interdisciplinary study domains and includes a wide knowledge spectrum from a different disciplines such as medicine, neuroscience, machine learning and rehabilitation. The motor imagery (MI) technique based on BCI has been broadly applied in rehabilitation especially for upper limb motor movement where people with disabilities need to restore or improve their walking capability. Nowadays, virtual reality is a beneficial scheme for BCI users because it proposes a relatively cost-effective, safe way for BCI users to train and explain themselves in using BCI in a computer-generated environment earlier than in a real-life scenario. Depicting the whole picture for signal processing techniques and methods utilised in MI-based BCI training environments is difficult. In addition, numerous challenges and open issues regarding signal processing and pattern recognition exist in the literature of the current topic; however, to the best of our knowledge, this is the first attempt to highlight these challenges and open issues in signal processing methods, techniques and pattern recognition in smart BCI training environments. This work illustrates the effect of the theoretical perspectives associated with BCI works for research development in smart training environments. Consequently, this research copes with these issues via a systematic review protocol to help the large community of BCI users, especially people with disabilities. Fundamentally, four substantial databases, namely, IEEE, ScienceDirect, Scopus and PubMed contain a considerable amount of technical and scientific articles relevant to smart BCI training systems. A set of 375 articles is collected from 2010 to 2020 to reveal a clear picture and a better understanding of all the academic literature through a final set of 25 articles. In addition, this research provides the state of the art for signal processing, feature extraction, classification techniques and smart training environment characteristics for MI-based BCI applications. This study also reports the challenges and issues identified by the researchers as well as recommended solutions to solve the persistent problems. This study introduces the state-of-the art virtual and augmented reality environments as a smart platform and the neurofeedback schemes used for MI-based smart BCI training systems. Moreover, this study highlights for the first time 10 concepts of smart training in a virtual environment applied in MI and BCI, and investigates the evaluation of these concepts against the literature to gain only 45.55%. Collectively, the implication of this study will offer the opportunity of deploying an efficient smart BCI training system in terms of data acquisition and recording, pattern recognition and smart environment for BCI users and rehabilitation programmes. ? 2021, IUPESM and Springer-Verlag GmbH Germany, part of Springer Nature. |
| References |
Chin ZY, et al. "Navigation in a virtual environment using multiclass motor imagery Brain-Computer Interface," in 2013 IEEE Symposium on Computational Intelligence, Cognitive Algorithms, Mind, and Brain (CCMB). 2013:152–157. Badia SB, et al. "Using a hybrid brain computer interface and virtual reality system to monitor and promote cortical reorganization through motor activity and motor imagery training," IEEE Transact Neural Syst Rehabilitation Eng. 2012:21:174–181. Achanccaray D, et al. "Immersive virtual reality feedback in a brain computer interface for upper limb rehabilitation," in 2018 IEEE International Conference on Systems, Man, and Cybernetics (SMC). 2018:1006–1010. Dhital A, Banic AU. “Navigation in a virtual environment by dichotic listening: simultaneous audio cues for user-directed BCI classifcation,” in. IEEE Virtual Reality (VR). 2013;2013:71–2. Alchalabi B, Faubert J. "A Comparison between BCI Simulation and Neurofeedback for Forward/Backward Navigation in Virtual Reality," Comput Intell Neurosci. 2019;2019. Cantillo-Negrete J, et al. Robotic orthosis compared to virtual hand for Brain-Computer Interface feedback. Biocybernetics and Biomedical Engineering. 2019;39:263–72. Yang F, et al. "An adaptive BCI system for virtual navigation," in The 2nd International Conference on Information Science and Engineering. 2010:64–68. Wang W, et al. “A VR Combined with MI-BCI Application for Upper Limb Rehabilitation of Stroke,” in. IEEE MTT-S International Microwave Biomedical Conference (IMBioC). 2019;2019:1–4. Vourvopoulos A, i Badia S. B. "Motor priming in virtual reality can augment motor-imagery training efcacy in restorative brain-computer interaction: a within-subject analysis," J Neuroeng Rehabilitation. 2016;13:1–14. Aamer A, et al. "BCI Integrated with VR for Rehabilitation," in 2019 31st International Conference on Microelectronics (ICM). 2019; 166–169. Al-Saegh A, et al. Deep learning for motor imagery EEGbased classifcation: A review. Biomed Signal Process Control. 2021;63:102172. Wen D, et al., "Combining brain–computer interface and virtual reality for rehabilitation in neurological diseases: A narrative review," Ann Phys Rehabil Med. 2020. Khan M.A, et al. "Review on motor imagery based BCI systems for upper limb post-stroke neurorehabilitation: From designing to application," Comput Biol Med. 2020;103843. Moher D, et al. "Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement." 2015;4. Cooper C, et al. "Defning the process to literature searching in systematic reviews: a literature review of guidance and supporting studies." 2018;18:85. Talal M, et al. Smart home-based IoT for real-time and secure remote health monitoring of triage and priority system using body sensors: Multi-driven systematic review. J Med Syst. 2019;43:42. Albahri O, et al. Real-time remote health-monitoring Systems in a Medical Centre: A review of the provision of healthcare servicesbased body sensor information, open challenges and methodological aspects. J Med Syst. 2018;42:1–47. Albahri A, et al. Real-time fault-tolerant mHealth system: Comprehensive review of healthcare services, opens issues, challenges and methodological aspects. J Med Syst. 2018;42:1–56. Hamid RA, et al. How smart is e-tourism? A systematic review of smart tourism recommendation system applying data management. Computer Science Review. 2021;39:100337. Bramer W. M, et al. "Optimal database combinations for literature searches in systematic reviews: a prospective exploratory study." 2017;6:245. Gusenbauer M, Haddaway N. R. J. R. s. m. "Which academic search systems are suitable for systematic reviews or meta‐analyses? Evaluating retrieval qualities of Google Scholar, PubMed, and 26 other resources." 2020;11:181–217. Kraus S, et al. "The art of crafting a systematic literature review in entrepreneurship research." 2020;1–20. Albahri O, et al. Systematic review of real-time remote health monitoring system in triage and priority-based sensor technology: Taxonomy, open challenges, motivation and recommendations. J Med Syst. 2018;42:1–27. Zaidan A, et al. A review on smartphone skin cancer diagnosis apps in evaluation and benchmarking: coherent taxonomy, open issues and recommendation pathway solution. Heal Technol. 2018;8:223–38. Albahri A, et al. Role of biological data mining and machine learning techniques in detecting and diagnosing the novel coronavirus (COVID-19): a systematic review. J Med Syst. 2020;44:1–11. Mohammed K, et al. Real-time remote-health monitoring systems: a review on patients prioritisation for multiple-chronic diseases, taxonomy analysis, concerns and solution procedure. J Med Syst. 2019;43:1–21. Albahri O, et al. "Systematic review of artifcial intelligence techniques in the detection and classifcation of COVID-19 medical images in terms of evaluation and benchmarking: Taxonomy analysis, challenges, future solutions and methodological aspects," J Infect Public Health. 2020. Mohsin A, et al. Blockchain authentication of network applications: Taxonomy, classifcation, capabilities, open challenges, motivations, recommendations and future directions. Computer Standards & Interfaces. 2019;64:41–60. Almahdi E, et al. Mobile patient monitoring systems from a benchmarking aspect: Challenges, open issues and recommended solutions. J Med Syst. 2019;43:1–23. Škola F, Liarokapis F. Embodied VR environment facilitates motor imagery brain–computer interface training. Comput Graph. 2018;75:59–71. Al-Qaysi Z, et al. A review of disability EEG based wheelchair control system: Coherent taxonomy, open challenges and recommendations. Comput Methods Programs Biomed. 2018;164:221–37. Longo BB, et al. “Using Brain-Computer Interface to control an avatar in a Virtual Reality Environment,” in 5th ISSNIP-IEEE Biosignals and Biorobotics Conference. Biosignals and Robotics for Better and Safer Living (BRC). 2014;2014:1–4. Choi J, Jo S. "Application of Hybrid Brain-Computer Interface with Augmented Reality on Quadcopter Control," in 2020 8th International Winter Conference on Brain-Computer Interface (BCI). 2020;1–5. Kwon B. H, et al. "A Novel Framework for Visual Motion Imagery Classification Using 3D Virtual BCI Platform," in 2020 8th International Winter Conference on Brain-Computer Interface (BCI). 2020;1–5. Liu X, et al. “Performance evaluation of walking imagery training based on virtual environment in brain-computer interfaces,” in. IEEE International Symposium on Multimedia (ISM). 2017;2017:25–30. Afdideh F, et al. "Development of a MATLAB-based toolbox for brain computer interface applications in virtual reality," in 20th Iranian Conference on Electrical Engineering (ICEE2012). 2012;1579–1583. Yeh SC, et al. A multiplayer online car racing virtual-reality game based on internet of brains. J Syst Architect. 2018;89:30–40. Huang D, et al. Electroencephalography (EEG)-based brain–computer interface (BCI): A 2-D virtual wheelchair control based on eventrelated desynchronization/synchronization and state control. IEEE Trans Neural Syst Rehabil Eng. 2012;20:379–88. Dhital A, Banic A. "Navigation path diferences for dichotic listening BCI in virtual environments," in 2013 1st Workshop on Virtual and Augmented Assistive Technology (VAAT). 2013:7–9. Chin ZY, et al. “Online performance evaluation of motor imagery BCI with augmented-reality virtual hand feedback,” in. Annual International Conference of the IEEE Engineering in Medicine and Biology. 2010;2010:3341–4. Liang S, et al. Improving the discrimination of hand motor imagery via virtual reality based visual guidance. Comput Methods Programs Biomed. 2016;132:63–74. Ren S, et al. Enhanced Motor Imagery Based Brain-Computer Interface via FES and VR for Lower Limbs. IEEE Trans Neural Syst Rehabil Eng. 2020;28:1846–55. Xia B, et al. “The training strategy in brain-computer interface,” in. Sixth International Conference on Natural Computation. 2010;2010:2190–3. Song M, Kim J. A paradigm to enhance motor imagery using rubber hand illusion induced by visuo-tactile stimulus. IEEE Trans Neural Syst Rehabil Eng. 2019;27:477–86. Škola F, et al. Progressive training for motor imagery brain-computer interfaces using gamifcation and virtual reality embodiment. Front Hum Neurosci. 2019;13:329. Liang S, et al. "Efective user training for motor imagery based brain computer interface with object-directed 3D visual display," in 2014 7th International Conference on Biomedical Engineering and Informatics. 2014;297–301. Vourvopoulos AT, et al. Efcacy and brain imaging correlates of an immersive motor imagery BCI-driven VR system for upper limb motor rehabilitation: A clinical case report. Front Hum Neurosci. 2019;13:244. Velasco-Álvarez F, et al. Audio-cued motor imagery-based brain– computer interface: Navigation through virtual and real environments. Neurocomputing. 2013;121:89–98. Lotte F, et al "Electroencephalography (EEG)‐based brain– computer interfaces," Wiley Encyclopedia of Electrical and Electronics Engineering. 1999;1–20.
|
| This material may be protected under Copyright Act which governs the making of photocopies or reproductions of copyrighted materials. You may use the digitized material for private study, scholarship, or research. |