[en] Objective. Measurement of the cortical tracking of continuous speech from
electroencephalography (EEG) recordings using a forward model is an important tool in
auditory neuroscience. Usually the stimulus is represented by its temporal envelope. Recently,
the phonetic representation of speech was successfully introduced in English. We aim to
show that the EEG prediction from phoneme-related speech features is possible in Dutch. The
method requires a manual channel selection based on visual inspection or prior knowledge to
obtain a summary measure of cortical tracking. We evaluate a method to (1) remove nonstimulus-related activity from the EEG signals to be predicted, and (2) automatically select
the channels of interest. Approach. Eighteen participants listened to a Flemish story, while
their EEG was recorded. Subject-specific and grand-average temporal response functions
were determined between the EEG activity in different frequency bands and several stimulus
features: the envelope, spectrogram, phonemes, phonetic features or a combination. The
temporal response functions were used to predict EEG from the stimulus, and the predicted
was compared with the recorded EEG, yielding a measure of cortical tracking of stimulus
features. A spatial filter was calculated based on the generalized eigenvalue decomposition
(GEVD), and the effect on EEG prediction accuracy was determined. Main results. A model
including both low- and high-level speech representations was able to better predict the brain
responses to the speech than a model only including low-level features. The inclusion of a
GEVD-based spatial filter in the model increased the prediction accuracy of cortical responses
to each speech feature at both single-subject (270% improvement) and group-level (310%).
Significance. We showed that the inclusion of acoustical and phonetic speech information
and the addition of a data-driven spatial filter allow improved modelling of the relationship
between the speech and its brain responses and offer an automatic channel selection.
Disciplines :
Neurology
Author, co-author :
Lesenfants, Damien ; Université de Liège - ULiège > Service administratif de la Fac. (FPLSE)
Vanthornhout, Jonas
Verschueren, Eline
Francart, Tom
Language :
English
Title :
Data-driven spatial filtering for improved measurement of cortical tracking of multiple representations of speech
scite shows how a scientific paper has been cited by providing the context of the citation, a classification describing whether it supports, mentions, or contrasts the cited claim, and a label indicating in which section the citation was made.
Bibliography
Abrams D A, Nicol T, Zecker S and Kraus N 2008 Right-hemisphere auditory cortex is dominant for coding syllable patterns in speech J. Neurosci. 28 3958-65
Brodbeck C, Hong L E and Simon J Z 2018 Rapid transformation from auditory to linguistic representations of continuous speech Curr. Biol. 28 3976-83
Broderick M P, Anderson A J, Di Liberto G M, Crosse M J and Lalor E C 2018 Electrophysiological correlates of semantic dissimilarity reflect the comprehension of natural, narrative speech Curr. Biol. 28 803-9
Chang E F, Rieger J W, Johnson K, Berger M S, Barbaro N M and Knight R T 2010 Categorical speech representation in human superior temporal gyrus Nat. Neurosci. 13 1428-32
Crosse M J, Di Liberto G M, Bednar A and Lalor E C 2016 The multivariate temporal response function (mTRF) toolbox: A MATLAB toolbox for relating neural signals to continuous stimuli Frontiers Hum. Neurosci. 10 604
Das N, Vanthornhout J, Francart T and Bertrand A 2019 Stimulus-Aware spatial filtering for single-Trial neural response and temporal response function estimation in high-density EEG with applications in auditory research (BioRxiv: 541318)
de Cheveigné A and Parra L C 2014 Joint decorrelation, a versatile tool for multichannel data analysis NeuroImage 98 487-505
Di Liberto G M and Lalor E C 2016 Isolating neural indices of continuous speech processing at the phonetic level Adv. Exp. Med. Biol. 894 337-45
Di Liberto G M and Lalor E C 2017 Indexing cortical entrainment to natural speech at the phonemic level: methodological considerations for applied research Hear. Res. 348 70-7
Di Liberto G M, O'Sullivan J A and Lalor E C 2015 Low-frequency cortical entrainment to speech reflects phoneme-level processing Curr. Biol. 25 2457-65
Ding N and Simon J Z 2012 Neural coding of continuous speech in auditory cortex during monaural and dichotic listening J. Neurophysiol. 107 78-89
Ding N and Simon J Z 2013 Adaptive temporal encoding leads to a background-insensitive cortical representation of speech J. Neurosci. 33 5728-35
Ding N and Simon J Z 2014 Cortical entrainment to continuous speech: functional roles and interpretations Frontiers Hum. Neurosci. 8 311
Dmochowski J P, Ki J J, DeGuzman P, Sajda P and Parra L C 2018 Extracting multidimensional stimulus-response correlations using hybrid encoding-decoding of neural activity NeuroImage 180 134-46
Drullman R, Festen J M and Plomp R 1994a Effect of reducing slow temporal modulations on speech reception J. Acoust. Soc. Am. 95 2670-80
Drullman R, Festen J M and Plomp R 1994b Effect of temporal envelope smearing on speech reception J. Acoust. Soc. Am. 95 1053-64
Duchateau J, Kong Y O, Cleuren L, Latacz L, Roelens J, Samir A, Demuynck K, Verhelst W and Van Hamme H 2009 Developing a reading tutor: design and evaluation of dedicated speech recognition and synthesis modules Speech Commun. 51 985-94
Elliott T M and Theunissen F E 2009 The modulation transfer function for speech intelligibility PLoS Comput. Biol. 5 e1000302
Francart T, van Wieringen A and Wouters J 2008 APEX 3: A multi-purpose test platform for auditory psychophysical experiments J. Neurosci. Methods 172 283-93
Giraud A L and Poeppel D 2012 Cortical oscillations and speech processing: emerging computational principles and operations Nat. Neurosci. 15 511-7
Gonçalves N R, Whelan R, Foxe J J and Lalor E C 2014 Towards obtaining spatiotemporally precise responses to continuous sensory stimuli in humans: A general linear modeling approach to EEG NeuroImage 97 196-205
Goswami U and Leong V 2013 Speech rhythm and temporal structure: converging perspectives? Lab. Phonol. 4 67-92
Greenwood D D 1961 Auditory masking and the critical band J. Acoust. Soc. Am. 33 484-502
Hajipour Sardouie S, Shamsollahi M B, Albera L and Merlet I 2015 Interictal EEG noise cancellation: GEVD and DSS based approaches versus ICA and DCCA based methods IRBM 36 20-32
Hassani A, Bertrand A and Moonen M 2016 GEVD-based low-rank approximation for distributed adaptive node-specific signal estimation in wireless sensor networks IEEE Trans. Signal Process. 64 2557-72
Lesenfants D, Vanthornhout J, Verschueren E, Decruy L and Francart T 2019 Predicting individual speech intelligibility from the cortical tracking of acoustic-And phonetic-level speech representations Hear. Res. 380 1-9
Mirkovic B, Debener S, Jaeger M and De Vos M 2015 Decoding the attended speech stream with multi-channel EEG: implications for online, daily-life applications J Neural Eng. 12 046007
Moskvina A 2013 Comparative Study of English, Dutch and German Prosodic Features (Fundamental Frequency and Intensity) as Means of Speech (Berlin: Springer) pp 86-91
Nichols T E and Holmes A P 2002 Nonparametric permutation tests for functional neuroimaging: A primer with examples Hum. Brain Mapp. 15 1-25
Noirhomme Q, Lesenfants D, Gomez F, Soddu A, Schrouff J, Garraux G, Luxen A, Phillips C and Laureys S 2014 Biased binomial assessment of cross-validated estimation of classification accuracies illustrated in diagnosis predictions NeuroImage 4 687-94
O'Sullivan J A, Power A J, Mesgarani N, Rajaram S, Foxe J J, Shinn-Cunningham B G, Slaney M, Shamma S A and Lalor E C 2015 Attentional selection in a cocktail party environment can be decoded from single-Trial EEG Cerebral Cortex 25 1697-706
Okada K, Rong F, Venezia J, Matchin W, Hsieh I H, Saberi K, Serences J T and Hickok G 2010 Hierarchical organization of human auditory cortex: evidence from acoustic invariance in the response to intelligible speech Cerebral Cortex 20 2486-95
Peelle J E, Johnsrude I S and Davis M H 2010 Hierarchical processing for speech in human auditory cortex and beyond Frontiers Hum. Neurosci. 20 2486-95
Ríos-López P, Molnar M T, Lizarazu M and Lallier M 2017 The role of slow speech amplitude envelope for speech processing and reading development Frontiers Psychol. 8 1497
Rosen S 1992 Temporal information in speech: Acoustic, auditory and linguistic aspects Phil. Trans. R. Soc. B 336 367-73
Serizel R, Moonen M, Van Dijk B and Wouters J 2014 Low-rank approximation based multichannel Wiener filter algorithms for noise reduction with application in cochlear implants IEEE/ACM Trans. Audio Speech Lang. Process. 22 785-99
Shannon R V, Zeng F G, Kamath V, Wygonski J and Ekelid M 1995 Speech recognition with primarily temporal cues Science 270 303-4
Somers B, Francart T and Bertrand A 2018 A generic EEG artifact removal algorithm based on the multi-channel Wiener filter J. Neural Eng. 15 36007
Vanthornhout J, Decruy L, Wouters J, Simon J Z and Francart T 2018 Speech intelligibility predicted from neural entrainment of the speech envelope J. Assoc. Res. Otolaryngol. 19 181-91
Similar publications
Sorry the service is unavailable at the moment. Please try again later.
This website uses cookies to improve user experience. Read more
Save & Close
Accept all
Decline all
Show detailsHide details
Cookie declaration
About cookies
Strictly necessary
Performance
Strictly necessary cookies allow core website functionality such as user login and account management. The website cannot be used properly without strictly necessary cookies.
This cookie is used by Cookie-Script.com service to remember visitor cookie consent preferences. It is necessary for Cookie-Script.com cookie banner to work properly.
Performance cookies are used to see how visitors use the website, eg. analytics cookies. Those cookies cannot be used to directly identify a certain visitor.
Used to store the attribution information, the referrer initially used to visit the website
Cookies are small text files that are placed on your computer by websites that you visit. Websites use cookies to help users navigate efficiently and perform certain functions. Cookies that are required for the website to operate properly are allowed to be set without your permission. All other cookies need to be approved before they can be set in the browser.
You can change your consent to cookie usage at any time on our Privacy Policy page.
