[en] Objective. Cortically-controlled motor prostheses aim to restore functions lost to neurological disease and injury. Several proof of concept demonstrations have shown encouraging results, but barriers to clinical translation still remain. In particular, intracortical prostheses must satisfy stringent power dissipation constraints so as not to damage cortex. Approach. One possible solution is to use ultra-low power neuromorphic chips to decode neural signals for these intracortical implants. The first step is to explore in simulation the feasibility of translating decoding algorithms for brain–machine interface (BMI) applications into spiking neural networks (SNNs). Main results. Here we demonstrate the validity of the approach by implementing an existing Kalman-filter-based decoder in a simulated SNN using the Neural Engineering Framework (NEF), a general method for mapping control algorithms onto SNNs. To measure this system's robustness and generalization, we tested it online in closed-loop BMI experiments with two rhesus monkeys. Across both monkeys, a Kalman filter implemented using a 2000-neuron SNN has comparable performance to that of a Kalman filter implemented using standard floating point techniques. Significance. These results demonstrate the tractability of SNN implementations of statistical signal processing algorithms on different monkeys and for several tasks, suggesting that a SNN decoder, implemented on a neuromorphic chip, may be a feasible computational platform for low-power fully-implanted prostheses. The validation of this closed-loop decoder system and the demonstration of its robustness and generalization hold promise for SNN implementations on an ultra-low power neuromorphic chip using the NEF.
Disciplines :
Engineering, computing & technology: Multidisciplinary, general & others
Author, co-author :
Dethier, Julie ; Université de Liège - ULiège > Dép. d'électric., électron. et informat. (Inst.Montefiore) > Systèmes et modélisation
Nuyujukian, Paul
Ryu, Stephen I
Shenoy, Krishna V.
Boahen, Kwabena
Language :
English
Title :
Design and validation of a real-time spiking-neural-network decoder for brain–machine interfaces
scite shows how a scientific paper has been cited by providing the context of the citation, a classification describing whether it supports, mentions, or contrasts the cited claim, and a label indicating in which section the citation was made.
Bibliography
Taylor D M, Tillery S I and Schwartz A B 2002 Direct cortical control of 3D neuroprosthetic devices Science 296 1829-32 (Pubitemid 34596262)
Carmena J M, Lebedev M A, Crist R E, O'Doherty J E, Santucci D M, Dimitrov D F, Patil P G, Henriquez C S and Nicolelis M A 2003 Learning to control a brain-machine interface for reaching and grasping by primates PLoS Biol. 1 193-208 (Pubitemid 39112162)
Musallam S, Corneil B D, Greger B, Scherberger H and Andersen R A 2004 Cognitive control signals for neural prosthetics Science 305 258-62 (Pubitemid 38886742)
Hochberg L R, Serruya M D, Friehs G M, Mukand J A, Saleh M, Caplan A H, Branner A, Chen D, Penn R D and Donoghue J P 2006 Neuronal ensemble control of prosthetic devices by a human with tetraplegia Nature 442 164-71 (Pubitemid 44086558)
Santhanam G, Ryu S I, Yu B M, Afshar A and Shenoy K V 2006 A high-performance brain-computer interface Nature 442 195-8 (Pubitemid 44086565)
Velliste M, Perel S, Spalding M C, Whitford A S and Schwartz A B 2008 Cortical control of a prosthetic arm for self-feeding Nature 453 1098-101 (Pubitemid 351871735)
Ganguly K, Dimitrov D F, Wallis J D and Carmena J M 2011 Reversible large-scale modification of cortical networks during neuroprosthetic control Nature Neurosci. 14 662-7
O'Doherty J E, Lebedev M A, Ifft P J, Zhuang K Z, Shokur S, Bleuler H and Nicolelis M A 2011 Active tactile exploration using a brain-machine-brain interface Nature 479 228-31
Ethier C, Oby E R, Bauman M J and Miller L E 2012 Restoration of grasp following paralysis through brain-controlled stimulation of muscles Nature 485 368-71
Hochberg L R et al 2012 Reach and grasp by people with tetraplegia using a neurally controlled robotic arm Nature 485 372-5
Nuyujukian P, Gilja V, Chestek C A, Cunningham J P, Fan J M, Yu B M, Ryu S I and Shenoy K V 2010 Generalization and robustness of a continuous cortically-controlled prosthesis enabled by feedback control design Meeting of Society for Neuroscience 2010 (San Diego, CA,) Program No. 20.7
Gilja V, Chestek C A, Diester I, Henderson J M, Deisseroth K and Shenoy K V 2011 Challenges and opportunities for next-generation intra-cortically based neural prostheses IEEE Trans. Biomed. Eng. 58 1891-9
Gilja V et al 2012 A high performance neural prosthesis enabled by control algorithm design Nature Neurosci. 15 1752-7
Kim S P, Simeral J D, Hochberg L R, Donoghue J P and Black M J 2008 Neural control of computer cursor velocity by decoding motor cortical spiking activity in humans with tetraplegia J. Neural Eng. 5 455-76
Li Z, O'Doherty J E, Hanson T L, Lebedev M A, Henriquez C S and Nicolelis M A L 2009 Unscented Kalman filter for brain-machine interfaces PLoS One 4 e6243
Chase S M, Kass R E and Schwartz A B 2012 Behavioral and neural correlates of visuomotor adaptation observed through a brain-computer interface in primary motor cortex J. Neurophysiol. 108 624-44
Jackson A, Mavoori J and Fetz E E 2006 Long-term motor cortex plasticity induced by an electronic neural implant Nature 444 56-60 (Pubitemid 44684753)
Zanos S, Richardson A G, Shupe L, Miles F P and Fetz E E 2011 The Neurochip-2. An autonomous head-fixed computer for recording and stimulating in freely behaving monkeys IEEE Trans. Neural Syst. Rehabil. Eng. 19 427-35
Santhanam G, Linderman M D, Gilja V, Afshar A, Ryu S I, Meng T H and Shenoy K V 2007 HermesB: a continuous neural recording system for freely behaving primates IEEE Trans. Biomed. Eng. 54 2037-50 (Pubitemid 350006065)
Chestek C A, Gilja V, Nuyujukian P, Kier R J, Solzbacher F, Ryu S I, Harrison R R and Shenoy K V 2009 HermesC: low-power wireless neural recording system for freely moving primates IEEE Trans. Neural Syst. Rehabil. Eng. 17 330-8
Hua G, Walker R M, Nuyujukian P, Makinwa K A A, Shenoy K V, Murmann B and Meng T H 2012 HermesE: a 96-channel full data rate direct neural interface in 0.13 μm CMOS IEEE J. Solid-State Circuits 47 1043-55
Miranda H, Gilja V, Chestek C A, Shenoy K V and Meng T H 2010 HermesD: a high-rate long-range wireless transmission system for simultaneous multichannel neural recording applications IEEE Trans. Biomed. Circuits Syst. 4 181-91
Gilja V, Chestek C A, Nuyujukian P, Foster J D and Shenoy K V 2010 Autonomous head-mounted electrophysiology systems for freely-behaving primates Curr. Opin. Neurobiol. 20 676-86
Borton D A, Yin M, Aceros J and Nurmikko A 2013 An implantable wireless neural interface for recording cortical circuit dynamics in moving primates J. Neural Eng. 10 026010
Harrison R R, Watkins P T, Kier R J, Lovejoy R O, Black D J, Greger B and Solzbacher F 2007 A low-power integrated circuit for a wireless 100-electrode neural recording system IEEE J. Solid-State Circuits 42 123-33 (Pubitemid 46103876)
Harrison R R 2008 The design of integrated circuits to observe brain activity Proc. IEEE 96 1203-16
Wolf P D 2008 Thermal considerations for the design of an implanted cortical brain-machine interface (BMI) Indwelling Neural Implants: Strategies for Contending with the In Vivo Environment ed W M Reichert (Boca Raton, FL: CRC Press) chapter 3
Kim S, Tathireddy P, Normann R A and Solzbacher F 2007 Thermal impact of an active 3-D microelectrode array implanted in the brain IEEE Trans. Neural Syst. Rehabil. Eng. 15 493-501 (Pubitemid 350274176)
Dethier J, Gilja V, Nuyujukian P, Elassaad S A, Shenoy K V and Boahen K 2011 Spiking neural network decoder for brain-machine interfaces Proc. 5th Int. IEEE EMBS Conf. on Neural Engineering (Cancun, Mexico,) pp 396-9
Miranda H and Meng T H 2010 A programmable pulse UWB transmitter with 34% energy efficiency for multichannel neurorecording systems CICC: Custom Integrated Circuits Conf. pp 1-4
Laubach M, Wessberg J and Nicolelis M A L 2000 Cortical ensemble activity increasingly predicts behaviour outcomes during learning of a motor task Nature 405 567-71 (Pubitemid 30367728)
Zumsteg Z S, Kemere C, O'Driscoll S, Santhanam G, Ahmed R E, Shenoy K V and Meng T H 2005 Power feasibility of implantable digital spike sorting circuits for neural prosthetic systems IEEE Trans. Neural Syst. Rehabil. Eng. 13 272-9 (Pubitemid 41417773)
Harrison R R and Charles C 2003 A low-power low-noise CMOS amplifier for neural recording applications IEEE J. Solid-State Circuits 38 958-65
Silver R, Boahen K, Grillner S, Kopell N and Olsen K L 2007 Neurotech for neuroscience: unifying concepts, organizing principles, and emerging tools J. Neurosci. 27 11807-19 (Pubitemid 350072090)
Arthur J V and Boahen K 2011 Silicon neuron design: the dynamical systems approach IEEE Trans. Circuits Syst. I 58 1034-43
Fang H, Wang Y and He J 2010 Spiking neural networks for cortical neuronal spike train decoding Neural Comput. 22 1060-85
Sussillo D, Nuyujukian P, Fan J M, Kao J C, Stavisky S D, Ryu S I and Shenoy K V 2012 A recurrent neural network for closed-loop intracortical brain-machine interface decoders J. Neural Eng. 9 026027
Dethier J, Nuyujukian P, Eliasmith C, Stewart T, Elassaad S A, Shenoy K V and Boahen K 2011 A brain-machine interface operating with a real-time spiking neural network control algorithm Advances in Neural Information Processing Systems vol 24 ed J Shawe-Taylor (Cambridge: MIT Press) pp 2213-21
Kalman R E 1960 A new approach to linear filtering and prediction problems Trans. ASME D 82 35-45
Malik W Q, Truccolo W, Brown E N and Hochberg L R 2011 Efficient decoding with steady-state Kalman filter in neural interface systems IEEE Trans. Neural Syst. Rehabil. Eng. 19 25-34
Eliasmith C and Anderson C H 2003 Neural Engineering: Computation, Representation, and Dynamics in Neurobiological Systems (Cambridge: MIT Press)
Singh R and Eliasmith C 2006 Higher-dimensional neurons explain the tuning and dynamics of working memory cells J. Neurosci. 26 3667-78
Eliasmith C 2005 A unified approach to building and controlling spiking attractor networks Neural Comput. 17 1276-314 (Pubitemid 40659530)
Eliasmith C 2007 How to build a brain: from function to implementation Synthese 159 373-88
Churchland M M, Cunningham J P, Kaufman M T, Foster J D, Nuyujukian P, Ryu S I and Shenoy K V 2012 Neural population dynamics during reaching Nature 487 51-6
This website uses cookies to improve user experience. Read more
Save & Close
Accept all
Decline all
Show detailsHide details
Cookie declaration
About cookies
Strictly necessary
Performance
Strictly necessary cookies allow core website functionality such as user login and account management. The website cannot be used properly without strictly necessary cookies.
This cookie is used by Cookie-Script.com service to remember visitor cookie consent preferences. It is necessary for Cookie-Script.com cookie banner to work properly.
Performance cookies are used to see how visitors use the website, eg. analytics cookies. Those cookies cannot be used to directly identify a certain visitor.
Used to store the attribution information, the referrer initially used to visit the website
Cookies are small text files that are placed on your computer by websites that you visit. Websites use cookies to help users navigate efficiently and perform certain functions. Cookies that are required for the website to operate properly are allowed to be set without your permission. All other cookies need to be approved before they can be set in the browser.
You can change your consent to cookie usage at any time on our Privacy Policy page.