A Comparison of Two Spelling Brain-Computer Interfaces Based on Visual P3 and SSVEP in Locked-In Syndrome

[en] Objectives: We study the applicability of a visual P3-based and a Steady State Visually Evoked Potentials (SSVEP)-based Brain-Computer Interfaces (BCIs) for mental text spelling on a cohort of patients with incomplete Locked-In Syndrome (LIS). Methods: Seven patients performed repeated sessions with each BCI. We assessed BCI performance, mental workload and overall satisfaction for both systems. We also investigated the effect of the quality of life and level of motor impairment on the performance. Results: All seven patients were able to achieve an accuracy of 70% or more with the SSVEP-based BCI, compared to 3 patients with the P3-based BCI, showing a better performance with the SSVEP BCI than with the P3 BCI in the studied cohort. Moreover, the better performance of the SSVEP-based BCI was accompanied by a lower mental workload and a higher overall satisfaction. No relationship was found between BCI performance and level of motor impairment or quality of life. Conclusion:Our results show a better usability of the SSVEP-based BCI than the P3-based one for the sessions performed by the tested population of locked-in patients with respect to all the criteria considered. The study shows the advantage of developing alternative BCIs with respect to the traditional matrix-based P3 speller using different designs and signal modalities such as SSVEPs to build a faster, more accurate, less mentally demanding and more satisfying BCI by testing both types of BCIs on a convenience sample of LIS patients.

Disciplines :

Electrical & electronics engineering
Computer science

Author, co-author :

Combaz, Adrien ^✱; KU Leuven > Laboratory for Neuro- and Psychophysiology > Computational Neuroscience Group > Msc

Chatelle, Camille ^✱; Université de Liège - ULiège > Centre de recherches du cyclotron

Robben, Arne

Vanhoof, Gertie

Goeleven, Ann

Thijs, Vincent

Van Hulle, Marc

Laureys, Steven ; Université de Liège - ULiège > Centre de recherches du cyclotron

^✱ These authors have contributed equally to this work.

Language :

English

Title :

A Comparison of Two Spelling Brain-Computer Interfaces Based on Visual P3 and SSVEP in Locked-In Syndrome

Alternative titles :

[en] P3 and SSVEP BCI in Locked-In Syndrome

Publication date :

25 September 2013

Journal title :

PLoS ONE

eISSN :

1932-6203

Publisher :

Public Library of Science, San Franscisco, United States - California

Volume :

Issue :

Pages :

e73691

Peer reviewed :

Peer Reviewed verified by ORBi

Available on ORBi :

since 09 October 2013

Statistics

Number of views

148 (31 by ULiège)

Number of downloads

81 (3 by ULiège)

More statistics

Scopus citations^®

Scopus citations^®
without self-citations

OpenCitations

OpenAlex citations

Bibliography

Wolpaw JR, Birbaumer N, McFarland DJ, Pfurtscheller G, Vaughan TM, (2002) Brain-computer interfaces for communication and control. Clin Neurophysiol 113: 767-791.
Laureys S, Pellas F, Van Eeckhout P, Ghorbel S, Schnakers C, et al. (2005) The locked-in syndrome: what is it like to be conscious but paralyzed and voiceless? Prog Brain Res 150: 495-511.
Patterson JR, Grabois M, (1986) Locked-in syndrome: a review of 139 cases. Stroke 17: 758-764.
Hayashi H, Kato S, (1989) Total manifestations of amyotrophic lateral sclerosis. ALS in the totally locked-in state. J Neurol Sci 93: 19-35.
Chatelle C, Chennu S, Noirhomme Q, Cruse D, Owen AM, et al. (2012) Brain-computer interfacing in disorders of consciousness. Brain Inj 8: 447-456.
Farwell LA, Donchin E, (1988) Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. Electroencephalogr Clin Neurophysiol 70: 510-523.
Donchin E, Spencer KM, Wijesinghe R, (2000) The mental prosthesis: assessing the speed of a P300-based brain-computer interface. IEEE Trans Rehabil Eng 8: 174-179.
Sutton S, Braren M, John ER, Zubin J, (1965) Evoked-Potential Correlates of Stimulus Uncertainty. Science 150: 1187-1188.
Bianchi L, Sami S, Hillebrand A, Fawcett IP, Quitadamo LR, et al. (2010) Which physiological components are more suitable for visual ERP based brain-computer interface? A preliminary MEG/EEG study. Brain Topogr 23: 180-185.
Kaufmann T, Hammer EM, Kübler A (2011) ERPs contributing to classification in the P300 BCI. In: 5th Int. Brain-Comput. Interface Conf. pp. 49-52.
Guger C, Daban S, Sellers EW, Holzner C, Krausz G, et al. (2009) How many people are able to control a P300-based brain-computer interface (BCI)? Neurosci Lett 462: 94-98.
Sellers EW, Donchin E, (2006) A P300-based brain-computer interface: initial tests by ALS patients. Clin Neurophysiol 117: 538-548.
Hoffimann U, Vesin JM, Ebrahimi T, Diserens K, (2008) An efficient P300-based brain-computer interface for disabled subjects. J Neurosci Methods 167: 115-125.
Manyakov NV, Chumerin N, Combaz A, Van Hulle MM (2011) Comparison of Classi_cation Methods for P300 Brain-Computer Interface on Disabled Subjects. Comput Intell Neurosci 2011: ID 519868.
Mak JN, Arbel Y, Minett JW, McCane LM, Yuksel B, et al. (2011) Optimizing the P300-based brain-computer interface: current status, limitations and future directions. J Neural Eng 8: 025003.
Nijboer F, Sellers EW, Mellinger J, Jordan MA, Matuz T, et al. (2008) A P300-based braincomputer interface for people with amyotrophic lateral sclerosis. Clin Neurophysiol 119: 1909-1916.
Silvoni S, Volpato C, Cavinato M, Marchetti M, Priftis K, et al. (2009) P300-Based Brain-Computer Interface Communication: Evaluation and Follow-up in Amyotrophic Lateral Sclerosis. Front Neurosci 3: 60.
Sellers EW, Vaughan TM, Wolpaw JR, (2010) A brain-computer interface for long-term independent home use. Amyotroph Lateral Scler 11: 449-455.
Piccione F, Giorgi F, Tonin P, Priftis K, Giove S, et al. (2006) P300-based brain computer interface: reliability and performance in healthy and paralysed participants. Clin Neurophysiol 117: 531-537.
Regan D, (1966) Some characteristics of average steady-state and transient responses evoked by modulated light. Electroencephalogr Clin Neurophysiol 20: 238-248.
Herrmann CS, (2001) Human EEG responses to 1-100 Hz icker: resonance phenomena in visual cortex and their potential correlation to cognitive phenomena. Exp Brain Res 137: 346-353.
Luck SJ (2005) An Introduction to the Event-Related Potential Technique.
Perlstein WM, Cole MA, Larson M, Kelly K, Seignourel P, et al. (2003) Steady-state visual evoked potentials reveal frontally-mediated working memory activity in humans. Neurosci Lett 342: 191-195.
Gray M, Kemp AH, Silberstein RB, Nathan PJ, (2003) Cortical neurophysiology of anticipatory anxiety: an investigation utilizing steady state probe topography (SSPT). Neuroimage 20: 975-986.
Vialatte FB, Maurice M, Dauwels J, Cichocki A, (2010) Steady-state visually evoked potentials: focus on essential paradigms and future perspectives. Prog Neurobiol 90: 418-38.
Parini S, Maggi L, Turconi AC, Andreoni G, (2009) A robust and self-paced BCI system based on a four class SSVEP paradigm: algorithms and protocols for a high-transfer-rate direct brain communication. Comput Intell Neurosci 2009: 864564.
Volosyak I, Guger C, Graser A (2010) Toward BCI Wizard - best BCI approach for each user. In: 32nd Annu. Int. Conf. IEEE Eng. Med. Biol. Soc. volume 2010, pp. 4201-4204.
Bauer G, Gerstenbrand F, Rumpl E, (1979) Varieties of the locked-in syndrome. J Neurol 221: 77-91.
Ortner R, Aloise F, Prückl R, Schettini F, Putz V, et al. (2011) Accuracy of a P300 speller for people with motor impairments: a comparison. Clin EEG Neurosci 42: 214-218.
Nam CS, Woo J, Bahn S, (2012) Severe motor disability affects functional cortical integration in the context of brain-computer interface (BCI) use. Ergonomics 55: 581-91.
Yazicioglu RF, Merken P, Puers R, Van Hoof C (2006) Low-Power Low-Noise 8-Channel EEG Front-End ASIC for Ambulatory Acquisition Systems. In: Proc. 23nd Solid-State Circuits Conf. pp. 247-250.
Combaz A, Chumerin N, Manyakov NV, Robben A, Suykens JAK, et al. (2012) Towards the detection of error-related potentials and its integration in the context of a P300 speller braincomputer interface. Neurocomputing 80: 73-82.
Krusienski DJ, Sellers EW, McFarland DJ, Vaughan TM, Wolpaw JR, (2008) Toward enhanced P300 speller performance. J Neurosci Methods 167: 15-21.
Pastor MA, Artieda J, Arbizu J, Valencia M, Masdeu JC, (2003) Human cerebral activation during steady-state visual-evoked responses. J Neurosci 23: 11621-11627.
Pastor MA, Valencia M, Artieda J, Alegre M, Masdeu JC, (2007) Topography of cortical activation differs for fundamental and harmonic frequencies of the steady-state visual-evoked responses. An EEG and PET H215O study. Cereb Cortex 17: 1899-1905.
Brainard DH, (1997) The Psychophysics Toolbox. Spat Vis 10: 433-436.
Pelli DG, (1997) The VideoToolbox software for visual psychophysics: transforming numbers into movies. Spat Vis 10: 437-442.
Volosyak I, Cecotti H, Graser A (2009) Impact of Frequency Selection on LCD Screens for SSVEP Based Brain-Computer Interfaces. In: Bio-Inspired Syst: Comput. Ambient Intell., volume 5517 of Lecture Notes in Computer Science.pp. 706-713.
Pritchard WS, (1981) Psychophysiology of P300. Psychol Bull 89: 506-540.
Guan C, Thulasidas M, Wu J (2004) High performance p300 speller for brain-computer interface. In: IEEE Workshop Biomed. Circuits Syst. pp. S3.5.INV - 13-16.
Townsend G, LaPallo BK, Boulay CB, Krusienski DJ, Frye GE, et al. (2010) A novel P300-based brain-computer interface stimulus presentation paradigm: moving beyond rows and columns. Clin Neurophysiol 121: 1109-1120.
Jin J, Allison BZ, Sellers EW, Brunner C, Horki P, et al. (2011) An adaptive P300-based control system. J Neural Eng 8: 036006.
Pires G, Nunes U, Castelo-Branco M, (2012) Comparison of a row-column speller vs. a novel lateral single-character speller: Assessment of BCI for severe motor disabled patients. Clin Neurophysiol 123: 1168-1181.
Fazel-Rezai R, Gavett S, Ahmad W, Rabbi A, Schneider E, (2011) A Comparison among Several P300 Brain-Computer Interface Speller Paradigms. Clin EEG Neurosci 42: 209-213.
Rakotomamonjy A, Guigue V, Mallet G, Alvarado V (2005) Ensemble of SVMs for Improving Brain Computer Interface P300 Speller Performances. In: Artif. Neural Netw. Biol. Inspir., volume 3696 of Lecture Notes in Computer Science. pp. 45-50.
Cristianini N, Shawe-Taylor J (2000) An Introduction to Support Vector Machines and Other Kernel-based Learning Methods.
Suykens JAK, Van Gestel T, De Brabanter J, De Moor B, Vandewalle J (2002) Least squares support vector machines.
Keerthi SS, DeCoste D, (2006) A modified finite Newton method for fast solution of large scale linear SVMs. J Mach Learn Res 6: 341-361.
Segers H, Combaz A, Manyakov NV, Chumerin N, Vanderperren K, et al. (2011) Steady State Visual Evoked Potential (SSVEP)-based Brain Spelling System with Synchronous and Asynchronous Typing Modes. In: 15th Nordi.-Balt. Conf. Biomed. Eng. Med. Phys., volume 34: 164-167.
Friman O, Volosyak I, Gräser A, (2007) Multiple channel detection of steady-state visual evoked potentials for brain-computer interfaces. IEEE Trans Biomed Eng 54: 742-750.
Chumerin N, Manyakov NV, Combaz A, Robben A, Van Vliet M, et al. (2011) Subject-adaptive steady-state visual evoked potential detection for brain-computer interface. In: 6th IEEE Int. Conf. Intell. Data Acquis. Adv. Comput. Syst. pp. 369-373.
Allison BZ, Neuper C (2010) Could Anyone Use a BCI? In: Brain-Comput. Interface Appl. Minds Hum. Comput. Interact., Human-Computer Interaction Series. pp. 35-54.
Kübler A, Birbaumer N, (2008) Brain-computer interfaces and communication in paralysis: extinction of goal directed thinking in completely paralysed patients? Clin Neurophysiol 119: 2658-2666.
Choularton S, Dale R (2004) User responses to speech recognition errors: consistency of behaviour across domains. In: 10th Aust. Int. Conf. Speech Sci. Technol. pp. 457-462.
Wolpaw JR, Birbaumer N, Heetderks WJ, McFarland DJ, Hunter Peckham P, et al. (2000) Brain-computer interface technology: a review of the first international meeting. IEEE Trans Rehabil Eng 8: 164-73.
McFarland DJ, Sarnacki WA, Wolpaw JR, (2003) Brain-computer interface (BCI) operation: optimizing information transfer rates. Biol Psychol 63: 237-251.
Serby H, Yom-Tov E, Inbar GF, (2005) An improved P300-based brain-computer interface. IEEE Trans Neural Syst Rehabil Eng 13: 89-98.
Nijboer F, Birbaumer N, Kübler A, (2010) The inuence of psychological state and motivation on brain-computer interface performance in patients with amyotrophic lateral sclerosis - a longitudinal study. Front Neurosci 4: 1-13.
Field A (2005) Discovering statistics using SPSS. Second edition.
Bernheim JL, (1999) How to get serious answers to the serious question: "How have you been?": subjective quality of life (QOL) as an individual experiential emergent construct. Bioethics 13: 272-287.
Hart SG, Staveland LE, (1988) Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. In: Hum. Ment. Workload, chapter 7: 139-183.
Byers JC, Bittner AC, Hill SG, (1989) Traditional and raw task load index (TLX) correlations: Are paired comparisons necessary? In: Adv. Ind. Ergon. Saf., volume 1: 481-488.
Nygren TE, (1991) Psychometric properties of subjective workload measurement techniques: Implications for their use in the assessment of perceived mental workload. Hum Factors 33: 17-33.
Moroney WF, Biers DW, Eggemeier FT, Mitchell JA (1992) A comparison of two scoring procedures with the NASA task load index in a simulated ight task. In: Proc. IEEE Natl. Aerosp. Electron. Conf. volume 2, pp. 734-740.
Casanova E, Lazzari RE, Lotta S, Mazzucchi A, (2003) Locked-in syndrome: improvement in the prognosis after an early intensive multidisciplinary rehabilitation. Arch Phys Med Rehabil 84: 862-867.
Cedarbaum JM, Stambler N, Malta E, Fuller C, Hilt D, et al. (1999) The ALSFRS-R: a revised ALS functional rating scale that incorporates assessments of respiratory function. BDNF ALS Study Group (Phase III). J Neurol Sci 169: 13-21.
Legendre P, (2000) Comparison of permutation methods for the partial correlation and partial mantel tests. J Statist Comput Simul 67: 37-73.
Vázquez-Marrufo M, González-Rosa JJ, Galvao-Carmona A, Hidalgo-Muñoz A, Borges M, et al. (2013) Retest reliability of individual p3 topography assessed by high density electroencephalography. PLoS ONE 8: e62523.
Guger C, Edlinger G, Harkam W, Niedermayer I, Pfurtscheller G, (2003) How many people are able to operate an EEG-based brain-computer interface (BCI)? IEEE Trans Neural Syst Rehabil Eng 11: 145-147.
Treder MS, Blankertz B, (2010) (C) overt attention and visual speller design in an ERP-based brain-computer interface. Behav Brain Funct 6: 28.
Lotte F, Congedo M, Lécuyer A, Lamarche F, Arnaldi B, (2007) A review of classification algorithms for EEG-based brain-computer interfaces. J Neural Eng 4: R1-R13.
Linden DEJ, (2005) The p300: where in the brain is it produced and what does it tell us? Neuroscientist 11: 563-576.
Comerchero MD, Polich J, (1999) P3a and P3b from typical auditory and visual stimuli. Clin Neurophysiol 110: 24-30.
Tsai ML, Hung KL, Lu HH, (2012) Auditory Event-related Potentials in Children With Attention Deficit Hyperactivity Disorder. Pediatr Neonatol 53: 118-124.
Bennys K, Portet F, Touchon J, Rondouin G, (2007) Diagnostic value of event-related evoked potentials N200 and P300 subcomponents in early diagnosis of Alzheimer's disease and mild cognitive impairment. J Clin Neurophysiol 24: 405-412.
Papaliagkas VT, Kimiskidis VK, Tsolaki MN, Anogianakis G, (2011) Cognitive event-related potentials: longitudinal changes in mild cognitive impairment. Clin Neurophysiol 122: 1322-6.
Andersen SK, Fuchs S, Müller MM, (2011) Effects of feature-selective and spatial attention at different stages of visual processing. J Cogn Neurosci 23: 238-246.
Martens U, Gert AL, Gruber T, (2012) Inuences of encoding and retrieval on the steady-state visual evoked potential. Neuroreport 23: 337-341.
Schnakers C, Majerus S, Goldman S, Boly M, Van Eeckhout P, et al. (2008) Cognitive function in the locked-in syndrome. J Neurol 255: 323-330.
Brunner P, Joshi S, Briskin S, Wolpaw JR, Bischof H, et al. (2010) Does the 'P300' speller depend on eye gaze? J Neural Eng 7: 056013.
Aloise F, Aricò P, Schettini F, Riccio A, Salinari S, et al. (2012) A covert attention P300-based braincomputer interface: Geospell. Ergonomics 55: 538-551.
Lesenfants D, Partoune N, Soddu A, Lehembre R, Müller-Putz G, et al. (2011) Design of a novel covert SSVEP-based BCI. In: 5th Int. Brain-Comput. Interface Conf. pp. 1-4.