Assistive devices, like exoskeletons or orthoses, often make use of physiological data that allow the detection or prediction of movement onset. Movement onset can be detected at the executing site, the skeletal muscles, as by means of electromyography. Movement intention can be detected by the analysis of brain activity, recorded by, e.g., electroencephalography, or in the behavior of the subject by, e.g., eye movement analysis. These different approaches can be used depending on the kind of neuromuscular disorder, state of therapy or assistive device. In this work we conducted experiments with healthy subjects while performing self-initiated and self-paced arm movements. While other studies showed that multimodal signal analysis can improve the performance of predictions, we show that a sensible combination of electroencephalographic and electromyographic data can potentially improve the adaptability of assistive technical devices with respect to the individual demands of, e.g., early and late stages in rehabilitation therapy. In earlier stages for patients with weak muscle or motor related brain activity it is important to achieve high positive detection rates to support self-initiated movements. To detect most movement intentions from electroencephalographic or electromyographic data motivates a patient and can enhance her/his progress in rehabilitation. In a later stage for patients with stronger muscle or brain activity, reliable movement prediction is more important to encourage patients to behave more accurately and to invest more effort in the task. Further, the false detection rate needs to be reduced. We propose that both types of physiological data can be used in an and combination, where both signals must be detected to drive a movement. By this approach the behavior of the patient during later therapy can be controlled better and false positive detections, which can be very annoying for patients who are further advanced in rehabilitation, can be avoided.
References
[1]
Hogan N, Krebs HI (2011) Physically interactive robotic technology for neuromotor rehabilitation. Progress in Brain Research 192: 59–68.
[2]
Mihelj M, Nef T, Riener R (2007) ARMin II - 7 DoF rehabilitation robot: mechanics and kinematics. In: Proceedings of the IEEE International Conference on Robotics and Automation. 4120–4125. doi:10.1109/ROBOT.2007.364112.
[3]
Kwakkel G, Kollen BJ, Krebs HI (2008) Effects of robot-assisted therapy on upper limb recovery after stroke: a systematic review. Neurorehabilitation and Neural Repair 22: 111–121.
[4]
Staubli P, Nef T, Klamroth-Marganska V, Riener R (2009) E_ects of intensive arm training with the rehabilitation robot ARMin II in chronic stroke patients: four single-cases. Journal of NeuroEngineering and Rehabilitation 6: 46.
[5]
Lo AC, Guarino PD, Richards LG, Haselkorn JK, Wittenberg GF, et al. (2010) Robot-assisted therapy for long-term upper-limb impairment after stroke. New England Journal of Medicine 362: 1772–1783.
[6]
Mehrholz J, Elsner B, Werner C, Kugler J, Pohl M (2013) Electromechanicalassisted training for walking after stroke. Cochrane Database of Systematic Reviews: Issue 7. Art. No.: CD006185. DOI: 10.1002/14651858.CD006185.pub3.
[7]
United States Congress (2004). Assistive technology act (public law 108 364).
[8]
Kirchner EA, Albiez JC, Seeland A, Jordan M, Kirchner F (2013) Towards assistive robotics for home rehabilitation. In: Proceedings of the International Conference on Biomedical Electronics and Devices. SciTePress, 168–177.
[9]
Folgheraiter M, Jordan M, Straube S, Seeland A, Kim SK, et al. (2012) Measuring the improvement of the interaction comfort of a wearable exoskeleton. International Journal of Social Robotics 4: 285–302.
[10]
Folgheraiter M, Kirchner EA, Seeland A, Kim SK, Jordan M, et al.. (2011) A multimodal brain-arm interface for operation of complex robotic systems and upper limb motor recovery. In: Vieira P, Fred A, Filipe J, Gamboa H, editors, In Proceedings of the 4th International Conference on Biomedical Electronics and Devices (BIODEVICES-11). Rome: SciTePress, 150–162.
[11]
Bai O, Rathi V, Lin P, Huang D, Battapady H, et al. (2011) Prediction of human voluntary movement before it occurs. Clinical Neurophysiology 122: 364–372.
[12]
Ibá？ez J, Serrano J, del Castillo M, Barrios L, Gallego J, et al. (2011) An EEG-based design for the online detection of movement intention. Advances in Computational Intelligence 6691: 370–377.
[13]
Seeland A, Woehrle H, Straube S, Kirchner EA (2013) Online movement prediction in a robotic application scenario. In: 6th International IEEE EMBS Conference on Neural Engineering (NER). San Diego, California, 41–44.
[14]
Lew E, Chavarriaga R, Silvoni S, Millán JDR (2012) Detection of self-paced reaching movement intention from EEG signals. Frontiers in Neuroengineering 5: 13.
[15]
Novak D, Omlin X, Leins R, Riener R (2013) Predicting targets of human reaching motions using different sensing technologies. IEEE Trans Biomed Eng 60: 2645–2654.
[16]
Tabie M, Kirchner EA (2013) EMG onset detection - comparison of different methods for a movement prediction task based on EMG. In: Proceedings of the International Conference on Bio-inspired Systems and Signal Processing. SciTePress, 242–247.
[17]
Cavallaro EE, Rosen J, Perry JC, Burns S (2006) Real-time myoprocessors for a neural controlled powered exoskeleton arm. IEEE Transactions on Biomedical Engineering 53: 2387–2396.
[18]
Benitez LMV, Will N, Tabie M, Schmidt S, Kirchner EA, et al.. (2013) An EMGbased assistive orthosis for upper limb rehabilitation. In: International Conference on Biomedical Electronics and Devices. o.A.
[19]
Benitez LMV, Tabie M, Will N, Schmidt S, Jordan M, et al.. (2013) Exoskeleton technology in rehabilitation: Towards an EMG-based orthosis system for upper limb neuromotor rehabilitation. Journal of Robotics o.A.: o.A.
[20]
Pfurtscheller G (2000) Brain oscillations control hand orthosis in a tetraplegic. Neuroscience Letters 292: 211–214.
[21]
Muralidharan A, Chae J, Taylor DM (2011) Extracting attempted hand movements from EEGs in people with complete hand paralysis following stroke. Frontiers in Neuroscience 5: 39.
[22]
Shibasaki H, Hallett M (2006) What is the Bereitschaftspotential? Clinical Neurophysiology 117: 2341–2356.
[23]
Huang H, Zhang F, Hargrove LJ, Dou Z, Rogers DR, et al. (2011) Continuous locomotion-mode identification for prosthetic legs based on neuromuscularmechanical fusion. IEEE transactions on bio-medical engineering 58: 2867–2875.
[24]
Kirchner EA, Drechsler R (2013) A Formal Model for Embedded Brain Reading. Industrial Robot: An International Journal 40: 530–540.
[25]
Corbett EA, Perreault EJ, K？rding KP (2012) Decoding with limited neural data: a mixture of time-warped trajectory models for directional reaches. Journal of Neural Engineering 9: 036002.
[26]
Balconi E (2009) The multicomponential nature of movement-related cortical potentials: functional generators and psychological factors. Neuropsychological Trends 5: 59–84.
[27]
Cui RQ, Deecke L (1999) High resolution DC-EEG analysis of the Bereitschaftspotential and post movement onset potentials accompanying uni- or bilateral voluntary finger movements. Brain topography 11: 233–249.
[28]
Kornhuber HH, Deecke L (1965) Hirnpotential？nderungen bei Willkürbewegungen und passiven Bewegungen des Menschen: Bereitschaftspotential und reafferente Potentiale. Pflügers Archives 284: 1–17.
[29]
Deecke L, Scheid P, Kornhuber HH (1969) Distribution of readiness potential, premotion positivity, and motor potential of the human cerebral cortex preceding voluntary finger movements. Experimental Brain Research 7: 158–68.
[30]
Rivet B, Souloumiac A, Attina V, Gibert G (2009) xDAWN algorithm to enhance evoked potentials: application to brain-computer interface. IEEE Transactions on Biomedical Engineering 56: 2035–2043.
[31]
Vapnik VN (1995) The Nature of Statistical Learning Theory. New York, NY, USA: Springer New York Inc.
[32]
Platt JC (2000) Probabilistic outputs for support vector machines and comparisons to regularized likelihood methods. In: Smola, A.J., Bartlett, P.L., Scholkopf, B., Schuurmans, D. (Eds.), Advances in large margin classifiers. MIT Press, 61–74.
[33]
Kirchner EA, W？hrle H, Bergatt C, Kim SK, Metzen JH, et al.. (2010) Towards operator monitoring via brain reading – an EEG-based approach for space applications. In: Proc. 10th Int. Symp. Artificial Intelligence, Robotics and Automation in Space. Sapporo, 448–455.
[34]
Polich J (2007) Updating P300: an integrative theory of P3a and P3b. Clin Neurophysiol 118: 2128–48.
[35]
Chan ADC, Lemaire ED (2010) Flexible dry electrode for recording surface electromyogram. In: IEEE Instrumentation and Measurement Technology Conference. 1234–1237. doi:10.1109/IMTC.2010.5488293.
[36]
Popescu F, Fazli S, Badower Y, Blankertz B, Müller K (2007) Single trial classification of motor imagination using 6 dry eeg electrodes. PLoS ONE 2: e637.
[37]
Feess D, Krell MM, Metzen JH (2013) Comparison of sensor selection mechanisms for an ERP-based brain-computer interface. PLoS ONE 8: e67543.
