Skip to main content
Log in

Detecting and classifying three different hand movement types through electroencephalography recordings for neurorehabilitation

  • Original Article
  • Published:
Medical & Biological Engineering & Computing Aims and scope Submit manuscript

Abstract

Brain–computer interfaces can be used for motor substitution and recovery; therefore, detection and classification of movement intention are crucial for optimal control. In this study, palmar, lateral and pinch grasps were differentiated from the idle state and classified from single-trial EEG using only information prior to the movement onset. Fourteen healthy subjects performed the three grasps 100 times, while EEG was recorded from 25 electrodes. Temporal and spectral features were extracted from each electrode, and feature reduction was performed using sequential forward selection (SFS) and principal component analysis (PCA). The detection problem was investigated as the ability to discriminate between movement preparation and the idle state. Furthermore, all task pairs and the three movements together were classified. The best detection performance across movements (79 ± 8 %) was obtained by combining temporal and spectral features. The best movement–movement discrimination was obtained using spectral features: 76 ± 9 % (2-class) and 63 ± 10 % (3-class). For movement detection and discrimination, the performance was similar across grasp types and task pairs; SFS outperformed PCA. The results show it is feasible to detect different grasps and classify the distinct movements using only information prior to the movement onset, which may enable brain–computer interface-based neurorehabilitation of upper limb function through Hebbian learning mechanisms.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  1. Agashe HA and Contreras-Vidal JL (2013) Decoding the evolving grasping gesture from electroencephalographic (EEG) activity. In: 2013 35th annual international conference of the IEEE engineering in medicine and biology society (EMBC), pp 5590–5593

  2. Agashe HA and Contreras-Vidal JL (2011) Reconstructing hand kinematics during reach to grasp movements from electroencephalographic signals. In: 2011 annual international conference of the IEEE engineering in medicine and biology society (EMBC), pp 5444–5447

  3. Ahmadian P, Sanei S, Ascari L, Gonzalez-Villanueva L, Umilta MA (2013) Constrained blind source extraction of readiness potentials from EEG. IEEE Trans Neural Syst Rehabil Eng 21:567–575

    Article  PubMed  Google Scholar 

  4. Amanpour B and Erfanian A (2013) Classification of brain signals associated with imagination of hand grasping, opening and reaching by means of wavelet-based common spatial pattern and mutual information. In: 2013 35th annual international conference of the IEEE engineering in medicine and biology society (EMBC), pp 2224–2227

  5. Ang KK, Guan C (2013) Brain–computer interface in stroke rehabilitation. J Comput Sci Eng 7:139–146

    Article  Google Scholar 

  6. Boye AT, Kristiansen UQ, Billinger M, Nascimento OFD, Farina D (2008) Identification of movement-related cortical potentials with optimized spatial filtering and principal component analysis. Biomed Signal Process Control 3:300–304

    Article  Google Scholar 

  7. Daly JJ, Wolpaw JR (2008) Brain–computer interfaces in neurological rehabilitation. Lancet Neurol 7:1032–1043

    Article  PubMed  Google Scholar 

  8. Deng J, Yao J, Dewald JP (2005) Classification of the intention to generate a shoulder versus elbow torque by means of a time–frequency synthesized spatial patterns BCI algorithm. J Neural Eng 2:131–138

    Article  PubMed  Google Scholar 

  9. Feigin VL, Forouzanfar MH, Krishnamurthi R, Mensah GA, Connor M, Bennett DA, Moran AE, Sacco RL, Anderson L, Truelsen T, O’Donnell M, Venketasubramanian N, Barker-Collo S, Lawes CMM, Wang W, Shinohara Y, Witt E, Ezzati M, Naghavi M, Murray C (2014) Global and regional burden of stroke during 1990–2010: findings from the Global Burden of Disease Study 2010. Lancet 383:245–255

    Article  PubMed  PubMed Central  Google Scholar 

  10. Feys HM, De Weerdt WJ, Selz BE, Cox Steck GA, Spichiger R, Vereeck LE, Putman KD, Van Hoydonck GA (1998) Effect of a therapeutic intervention for the hemiplegic upper limb in the acute phase after stroke: a single-blind, randomized, controlled multicenter trial. Stroke 29:785–792

    Article  CAS  PubMed  Google Scholar 

  11. Grosse-Wentrup M, Mattia D, Oweiss K (2011) Using brain–computer interfaces to induce neural plasticity and restore function. J Neural Eng 8:025004

    Article  PubMed  PubMed Central  Google Scholar 

  12. Gu Y, Farina D, Murguialday AR, Dremstrup K, Montoya P, Birbaumer N (2009) Offline identification of imagined speed of wrist movements in paralyzed ALS patients from single-trial EEG. Frontiers Neurosci 3:62

    Google Scholar 

  13. Gu Y, Nascimento OF, Lucas MF, Farina D (2009) Identification of task parameters from movement-related cortical potentials. Med Biol Eng Comput 47:1257–1264

    Article  PubMed  Google Scholar 

  14. Gu Y, Dremstrup K, Farina D (2009) Single-trial discrimination of type and speed of wrist movements from EEG recordings. Clin Neurophysiol 120:1596–1600

    Article  PubMed  Google Scholar 

  15. Hebb DO (1949) The organization of behavior: a neuropsychological theory. Wiley, New York

    Google Scholar 

  16. Ibáñez J, Serrano J, Del Castillo M, Minguez J, Pons J (2015) Predictive classification of self-paced upper-limb analytical movements with EEG. Med Biol Eng Comput 53:1–10

    Article  Google Scholar 

  17. Ibanez J, Serrano JI, del Castillo MD, Monge E, Molina F, Rivas FM, Alguacil I, Miangolarra JC and Pons JL (2014) Upper-limb muscular electrical stimulation driven by EEG-based detections of the intentions to move: a proposed intervention for patients with stroke. In 2014 36th annual international conference of the IEEE engineering in medicine and biology society (EMBC), pp 1646–1649

  18. Jankelowitz S, Colebatch J (2005) Movement related potentials in acutely induced weakness and stroke. Exp Brain Res 161:104–113

    Article  CAS  PubMed  Google Scholar 

  19. Jerbi K, Vidal J, Mattout J, Maby E, Lecaignard F, Ossandon T, Hamamé C, Dalal S, Bouet R, Lachaux J (2011) Inferring hand movement kinematics from MEG, EEG and intracranial EEG: from brain–machine interfaces to motor rehabilitation. IRBM 32:8–18

    Article  Google Scholar 

  20. Jochumsen M, Niazi IK, Taylor D, Farina D, Dremstrup K (2015) Detecting and classifying movement-related cortical potentials associated with hand movements in healthy subjects and stroke patients from single-electrode, single-trial EEG. J Neural Eng 12:056013

    Article  PubMed  Google Scholar 

  21. Jochumsen M, Niazi IK, Mrachacz-Kersting N, Farina D, Dremstrup K (2013) Detection and classification of movement-related cortical potentials associated with task force and speed. J Neural Eng 10:056015

    Article  PubMed  Google Scholar 

  22. Jochumsen M, Niazi IK, Mrachacz-Kersting N, Jiang N, Farina D, Dremstrup K (2015) Comparison of spatial filters and features for the detection and classification of movement-related cortical potentials in healthy individuals and stroke patients. J Neural Eng 12:056003

    Article  PubMed  Google Scholar 

  23. Kato YX, Yonemura T, Samejima K, Maeda T and Ando H (2011) Development of a BCI master switch based on single-trial detection of contingent negative variation related potentials. In: 2011 annual international conference of the IEEE engineering in medicine and biology society, EMBC, pp 4629–4632

  24. Kornhuber HH, Deecke L (1965) Hirnpotentialänderrungen bei Willkürbewegungen und passiven Bewegungen des Menschen: Bereitschaftspotential und reafferente Potentiale. Pflügers Arch Ges Physiol 284:1–17

    Article  CAS  Google Scholar 

  25. Krakauer JW (2006) Motor learning: its relevance to stroke recovery and neurorehabilitation. Curr Opin Neurol 19:84–90

    Article  PubMed  Google Scholar 

  26. Liao K, Xiao R, Gonzalez J, Ding L (2014) Decoding individual finger movements from one hand using human EEG signals. PLoS ONE 9:e85192

    Article  PubMed  PubMed Central  Google Scholar 

  27. Lou X, Xiao S, Qi Y, Hu X, Wang Y, Zheng X (2013) Corticomuscular coherence analysis on hand movement distinction for active rehabilitation. Comput Math Methods Med 2013:908591

    Article  PubMed  PubMed Central  Google Scholar 

  28. Mrachacz-Kersting N, Niazi IK, Jiang N, Pavlovic A, Radovanović S, Kostic V, Popovic D, Dremstrup K, Farina D (2013) A novel brain–computer interface for chronic stroke patients. In: Pons J, Torricelli D, Pajaro M (eds) Converging clinical and engineering research on neurorehabilitation. Springer Publishing Company, Berlin, pp 837–841

    Chapter  Google Scholar 

  29. Mrachacz-Kersting N, Kristensen SR, Niazi IK, Farina D (2012) Precise temporal association between cortical potentials evoked by motor imagination and afference induces cortical plasticity. J Physiol (Lond) 590:1669–1682

    Article  CAS  PubMed Central  Google Scholar 

  30. Müller-Putz GR, Scherer R, Brunner C, Leeb R, Pfurtscheller G (2008) Better than random? A closer look on BCI results. Int J Bioelectromagn 10:52–55

    Google Scholar 

  31. Niazi IK, Jiang N, Jochumsen M, Nielsen JF, Dremstrup K, Farina D (2013) Detection of movement-related cortical potentials based on subject-independent training. Med Biol Eng Comput 51:507–512

    Article  PubMed  PubMed Central  Google Scholar 

  32. Niazi IK, Jiang N, Tiberghien O, Nielsen JF, Dremstrup K, Farina D (2011) Detection of movement intention from single-trial movement-related cortical potentials. J Neural Eng 8:066009

    Article  PubMed  Google Scholar 

  33. Niazi IK, Kersting NM, Jiang N, Dremstrup K, Farina D (2012) Peripheral electrical stimulation triggered by self-paced detection of motor intention enhances motor evoked potentials. IEEE Trans Neural Syst Rehabil Eng 20:595–604

    Article  PubMed  Google Scholar 

  34. Pascual-Leone A, Dang N, Cohen LG, Brasil-Neto JP, Cammarota A, Hallett M (1995) Modulation of muscle responses evoked by transcranial magnetic stimulation during the acquisition of new fine motor skills. J Neurophysiol 74:1037–1045

    CAS  PubMed  Google Scholar 

  35. Pfurtscheller G, Da Silva FL (1999) Event-related EEG/MEG synchronization and desynchronization: basic principles. Clin Neurophysiol 110:1842–1857

    Article  CAS  PubMed  Google Scholar 

  36. Popovic DB, Popovic MB, Sinkjær T (2002) Neurorehabilitation of upper extremities in humans with sensory-motor impairment. Neuromodulation Technol Neural Interface 5:54–66

    Article  Google Scholar 

  37. Popovic DB, Sinkjær T (2008) Central nervous system lesions leading to disability. J Autom Control 18:11–23

    Article  Google Scholar 

  38. Shibasaki H, Hallett M (2006) What is the Bereitschaftspotential? Clin Neurophysiol 117:2341–2356

    Article  PubMed  Google Scholar 

  39. Stefan K, Kunesch E, Cohen LG, Benecke R, Classen J (2000) Induction of plasticity in the human motor cortex by paired associative stimulation. Brain 123:572–584

    Article  PubMed  Google Scholar 

  40. Vuckovic A, Sepulveda F (2008) Quantification and visualisation of differences between two motor tasks based on energy density maps for brain–computer interface applications. Clin Neurophysiol 119:446–458

    Article  CAS  PubMed  Google Scholar 

  41. Vuckovic A, Sepulveda F (2008) Delta band contribution in cue based single trial classification of real and imaginary wrist movements. Med Biol Eng Comput 46:529–539

    Article  PubMed  Google Scholar 

  42. Vučković A, Sepulveda F (2012) A two-stage four-class BCI based on imaginary movements of the left and the right wrist. Med Eng Phys 34:964–971

    Article  PubMed  Google Scholar 

  43. Walter WG, Cooper R, Aldridge VJ, McCallum WC, Winter AL (1964) Contingent negative variation: an electric sign of sensorimotor association and expectancy in the human brain. Nature (Lond) 203:380–384

    Article  CAS  Google Scholar 

  44. Xiao R, Ding L (2013) Evaluation of EEG features in decoding individual finger movements from one hand. Comput Math Methods Med 2013:243257

    PubMed  PubMed Central  Google Scholar 

  45. Xu R, Jiang N, Lin C, Mrachacz-Kersting N, Dremstrup K, Farina D (2013) Enhanced low-latency detection of motor intention from EEG for closed-loop brain–computer interface applications. IEEE Trans Biomed Eng 61:288–296

    Google Scholar 

  46. Xu R, Jiang N, Mrachacz-Kersting N, Lin C, Asin G, Moreno J, Pons J, Dremstrup K, Farina D (2014) A closed-loop brain-computer interface triggering an active ankle-foot orthosis for inducing cortical neural plasticity. IEEE Trans Biomed Eng 20:2092–2101

    Google Scholar 

  47. Zhou J and Yedida S (2007) Channel selection in EEG-based prediction of shoulder/elbow movement intentions involving stroke patients: a computational approach. In IEEE symposium on computational intelligence and bioinformatics and computational biology, 2007 (CIBCB ‘07), pp 455–460

  48. Zhou J, Yao J, Deng J, Dewald J (2009) EEG-based classification for elbow versus shoulder torque intentions involving stroke subjects. Comput Biol Med 39:443–452

    Article  PubMed  PubMed Central  Google Scholar 

  49. Zhou J, Yao J, Deng J and Dewald J (2005) EEG-based discrimination of elbow/shoulder torques using brain computer interface algorithms: implications for rehabilitation. In 27th annual international conference of the engineering in medicine and biology society, 2005 (IEEE-EMBS 2005), pp 4134–4137

Download references

Acknowledgments

The authors would like to thank Astrid Clausen Nørgaard, Mads Nibe Stausholm, Regitze Kuhr Skals and Simon Christensen Dahl.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Mads Jochumsen.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Ethical approval

All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki Declaration and its later amendments or comparable ethical standards.

Informed consent

Informed consent was obtained from all individual participants included in the study.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Jochumsen, M., Niazi, I.K., Dremstrup, K. et al. Detecting and classifying three different hand movement types through electroencephalography recordings for neurorehabilitation. Med Biol Eng Comput 54, 1491–1501 (2016). https://doi.org/10.1007/s11517-015-1421-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11517-015-1421-5

Keywords

Navigation