2019 • In IEEE transactions on neural systems and rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society, 27 (4), p. 619-629
[en] The individual differences approach focuses on the variation of behavioral and neural signatures across subjects. In this context, we searched for intracranial neural markers of performance in three individuals with distinct behavioral patterns (efficient, borderline, and inefficient) in a dual-valence task assessing facial and lexical emotion recognition. First, we performed a preliminary study to replicate well-established evoked responses in relevant brain regions. Then, we examined time series data and network connectivity, combined with multivariate pattern analyses and machine learning, to explore electrophysiological differences in resting-state versus task-related activity across subjects. Next, using the same methodological approach, we assessed the neural decoding of performance for different dimensions of the task. The classification of time series data mirrored the behavioral gradient across subjects for stimulus type but not for valence. However, network-based measures reflected the subjects' hierarchical profiles for both stimulus types and valence. Therefore, this measure serves as a sensitive marker for capturing distributed processes such as emotional valence discrimination, which relies on an extended set of regions. Network measures combined with classification methods may offer useful insights to study single subjects and understand inter-individual performance variability. Promisingly, this approach could eventually be extrapolated to other neuroscientific techniques.
Disciplines :
Neurosciences & behavior
Author, co-author :
Hesse, Eugenia
Mikulan, Ezequiel
Sitt, Jacobo D.
Garcia, Maria Del Carmen
Silva, Walter
Ciraolo, Carlos
Vaucheret, Esteban
Raimondo, Federico ; Université de Liège - ULiège > Consciousness-Coma Science Group
J. D. Van Horn, S. T. Grafton, and M. B. Miller, "Individual variability in brain activity: A nuisance or an opportunity?" Brain Imag. Behav., vol. 2, no. 4, pp. 327-334, Dec. 2008.
N. Mainy et al., "Cortical dynamics of word recognition, " Hum. Brain Mapping, vol. 29, no. 11, pp. 1215-1230, Nov. 2008.
S. Wang et al., "Neurons in the human amygdala selective for perceived emotion, " Proc. Nat. Acad. Sci., vol. 111, no. 30, pp. E3110-E3119, Jul. 2014.
L. Pessoa, M. McKenna, E. Gutierrez, and L. G. Ungerleider, "Neural processing of emotional faces requires attention, " Proc. Nat. Acad. Sci., vol. 99, no. 17, pp. 11458-11463, Jul. 2014.
E. Halgren, P. Baudena, G. Heit, and M. Clarke, "Spatio-temporal stages in face and word processing. 1. Depth recorded potentials in the human occipital and parietal lobes, " J. Physiol.-Paris, vol. 88, no. 1, pp. 1-50, 1994.
E. Halgren, P. Baudena, G. Heit, M. Clarke, K. Marinkovic, and P. Chauvel, "Spatio-temporal stages in face and word processing. 2. Depth-recorded potentials in the human frontal and Rolandic cortices, " J. Physiol.-Paris, vol. 88, no. 1, pp. 51-80, 1994.
A. Ibáñez et al., "Facial and semantic emotional interference: A pilot study on the behavioral and cortical responses to the Dual Valence Association Task, " Behav. Brain Functions, vol. 7, no. 1, p. 8, 2011.
A. Ibanez et al., "Cortical deficits of emotional face processing in adults with ADHD: Its relation to social cognition and executive function, " Social Neurosci., vol. 6, nos. 5-6, pp. 464-481, 2011.
A. Ibáñez et al., "The face and its emotion: Right N170 deficits in structural processing and early emotional discrimination in schizophrenic patients and relatives, " Psychiatry Res., vol. 195, nos. 1-2, pp. 18-26, Jan. 2012.
J. Dubois and R. Adolphs, "Building a science of individual differences from fMRI, " Trends Cogn. Sci., vol. 20, no. 6, pp. 425-443, Jun. 2016.
T. Eichele et al., "Assessing the spatiotemporal evolution of neuronal activation with single-trial event-related potentials and functional MRI, " Proc. Nat. Acad. Sci., vol. 102, no. 49, pp. 17798-17803, Dec. 2005.
D. Wilkinson and P. Halligan, "The relevance of behavioural measures for functional-imaging studies of cognition, " Nature Rev. Neurosci., vol. 5, no. 1, pp. 67-73, Jan. 2004.
J. Xiong et al., "Intersubject variability in cortical activations during a complex language task, " NeuroImage, vol. 12, no. 3, pp. 326-339, Sep. 2000.
J.-P. Lachaux, N. Axmacher, F. Mormann, E. Halgren, and N. E. Crone, "High-frequency neural activity and human cognition: Past, present and possible future of intracranial EEG research, " Prog. Neurobiol., vol. 98, no. 3, pp. 279-301, Sep. 2012.
S. A. Guillory and K. A. Bujarski, "Exploring emotions using invasive methods: Review of 60 years of human intracranial electrophysiology, " Social Cogn. Affect. Neurosci., vol. 9, no. 12, pp. 1880-1889, Dec. 2014.
J. Parvizi et al., "Electrical stimulation of human fusiform face-selective regions distorts face perception, " J. Neurosci., vol. 32, no. 43, pp. 14915-14920, Oct. 2012.
H. Kawasaki, N. Tsuchiya, C. K. Kovach, and K. V. Nourski, "Processing of facial emotion in the human fusiform gyrus, " J. Cogn. Neurosci., vol. 24, no. 6, pp. 1358-1370, Jun. 2012.
J. V. Haxby, E. A. Hoffman, and M. I. Gobbini, "The distributed human neural system for face perception, " Trends Cogn. Sci., vol. 4, no. 6, pp. 223-233, Jun. 2000.
E. A. Hoffman and J. V. Haxby, "Distinct representations of eye gaze and identity in the distributed human neural system for face perception, " Nature Neurosci., vol. 3, no. 1, pp. 80-84, Jan. 2000.
B. Rossion, R. Caldara, M. Seghier, A. M. Schuller, F. Lazeyras, and E. Mayer, "A network of occipito-temporal face-sensitive areas besides the right middle fusiform gyrus is necessary for normal face processing, " Brain, vol. 126, no. 11, pp. 2381-2395, Jul. 2003.
T. Allison et al., "Face recognition in human extrastriate cortex, " J. Neurophysiol., vol. 71, no. 2, p. 821, Feb. 1994.
T. Allison, G. McCarthy, A. Nobre, A. Puce, and A. Belger, "Human extrastriate visual cortex and the perception of faces, words, numbers, and colors, " Cerebral Cortex, vol. 4, no. 5, pp. 544-554, Sep. 1994.
C. J. Price, "The anatomy of language: Contributions from functional neuroimaging, " J. Anatomy, vol. 197, no. 3, pp. 335-359, Oct. 2000.
J. F. Démonet, G. Thierry, and D. Cardebat, "Renewal of the neurophysiology of language: Functional neuroimaging, " Physiol. Rev., vol. 85, no. 1, pp. 49-95, Jan. 2005.
J. R. Vidal et al., "Long-distance amplitude correlations in the high gamma band reveal segregation and integration within the reading network, " J. Neurosci., vol. 32, no. 19, pp. 6421-6434, May 2012.
P. A. Kragel and K. S. LaBar, "Decoding the nature of emotion in the brain, " Trends Cogn. Sci., vol. 20, no. 6, pp. 444-455, Jun. 2016.
R. Adolphs, "Neural systems for recognizing emotion, " Current Opinion Neurobiol., vol. 12, no. 2, pp. 169-177, Apr. 2002.
L. Naccache et al., "A direct intracranial record of emotions evoked by subliminal words, " Proc. Nat. Acad. Sci., vol. 102, no. 21, pp. 7713-7717, May 2005.
A. Ibáñez et al., "From neural signatures of emotional modulation to social cognition: Individual differences in healthy volunteers and psychiatric participants, " Social Cogn. Affect. Neurosci., vol. 9, no. 7, pp. 939-950, Jul. 2014.
J. T. Townsend and F. G. Ashby, Stochastic Modeling of Elementary Psychological Processes. Cambridge, U.K.: Cambridge Univ. Press, 1983.
E. Hesse et al., "Early detection of intentional harm in the human amygdala, " Brain, vol. 139, no. 1, pp. 54-61, 2015.
J.-P. Lachaux, D. Hoffmann, L. Minotti, A. Berthoz, and P. Kahane, "Intracerebral dynamics of saccade generation in the human frontal eye field and supplementary eye field, " NeuroImage, vol. 30, no. 4, pp. 1302-1312, May 2006.
W. Sedley et al., "Neural signatures of perceptual inference, " Elife, vol. 5, Mar. 2016, Art. no. e11476.
A. Brovelli J.-P. Lachaux, P. Kahane, and D. Boussaoud, "High gamma frequency oscillatory activity dissociates attention from intention in the human premotor cortex, " NeuroImage, vol. 28, no. 1, pp. 154-164, Oct. 2005.
N. E. Crone et al., "Electrocorticographic gamma activity during word production in spoken and sign language, " Neurology, vol. 57, no. 11, pp. 2045-2053, Dec. 2001.
K. Tanji, K. Suzuki, A. Delorme, H. Shamoto, and N. Nakasato, "High-frequency γ-band activity in the basal temporal cortex during picture-naming and lexical-decision tasks, " J. Neurosci., vol. 25, no. 13, pp. 3287-3293, Mar. 2005.
H. Kawasaki et al., "Single-neuron responses to emotional visual stimuli recorded in human ventral prefrontal cortex, " Nature Neurosci., vol. 4, no. 1, pp. 15-16, 2001.
J. Parvizi, V. Rangarajan, W. R. Shirer, N. Desai, and M. D. Greicius, "The will to persevere induced by electrical stimulation of the human cingulate gyrus, " Neuron, vol. 80, no. 6, pp. 1359-1367, Dec. 2013.
B. L. Foster, V. Rangarajan, W. R. Shirer, and J. Parvizi, "Intrinsic and task-dependent coupling of neuronal population activity in human parietal cortex, " Neuron, vol. 86, no. 2, pp. 578-590, Apr. 2015.
M. Dastjerdi, M. Ozker, B. L. Foster, V. Rangarajan, and J. Parvizi, "Numerical processing in the human parietal cortex during experimental and natural conditions, " Nature Commun., vol. 4, p. 2528, Oct. 2013.
J. V. Haxby, A. C. Connolly, and J. S. Guntupalli, "Decoding neural representational spaces using multivariate pattern analysis, " Annu. Rev. Neurosci., vol. 37, pp. 435-456, Jul. 2014.
N. Kriegeskorte, R. Goebel, and P. Bandettini, "Information-based functional brain mapping, " Proc. Nat. Acad. Sci., vol. 103, no. 10, pp. 3863-3868, Mar. 2006.
A. Gonzalez et al., "Electrocorticography reveals the temporal dynamics of posterior parietal cortical activity during recognition memory decisions, " Proc. Nat. Acad. Sci., vol. 112, no. 35, pp. 11066-11071, Sep. 2015.
H. Liu, Y. Agam, J. R. Madsen, and G. Kreiman, "Timing, timing, timing: Fast decoding of object information from intracranial field potentials in human visual cortex, " Neuron, vol. 62, no. 2, pp. 281-290, Apr. 2009.
J. Schrouff, J. Mourão-Miranda, C. Phillips, and J. Parvizi, "Decoding intracranial EEG data with multiple kernel learning method, " J. Neurosci. Methods, vol. 261, pp. 19-28, Mar. 2016.
C. Song, R. Xu, and B. Hong, "Decoding of Chinese phoneme clusters using ECoG, " in Proc. 36th Annu. Int. Conf. IEEE Eng. Med. Biol. Soc., Aug. 2014, pp. 1278-1281.
E. A. Hirshorn et al., "Decoding and disrupting left midfusiform gyrus activity during word reading, " Proc. Nat. Acad. Sci., vol. 113, no. 29, pp. 8162-8167, Jul. 2016.
J. R. King et al., "Information sharing in the brain indexes consciousness in noncommunicative patients, " Current Biol., vol. 23, no. 19, pp. 1914-1919, Oct. 2013.
A. Canales-Johnson et al., "Auditory feedback differentially modulates behavioral and neural markers of objective and subjective performance when tapping to your heartbeat, " Cereb Cortex, vol. 25, no. 11, pp. 4490-4503, Nov. 2015.
S. Chennu et al., "Expectation and attention in hierarchical auditory prediction, " J. Neurosci., vol. 33, no. 27, pp. 11194-11205, Jul. 2013.
K. E. Weaver et al., "Directional patterns of cross frequency phase and amplitude coupling within the resting state mimic patterns of fMRI functional connectivity, " NeuroImage, vol. 128, pp. 238-251, Mar. 2016.
C. Jacques and B. Rossion, "Early electrophysiological responses to multiple face orientations correlate with individual discrimination performance in humans, " NeuroImage, vol. 36, no. 3, pp. 863-876, Jul. 2007.
P. O. Jacquet and A. Avenanti, "Perturbing the action observation network during perception and categorization of actions' goals and grips: State-dependency and virtual lesion TMS effects, " Cerebral Cortex, vol. 25, no. 3, pp. 598-608, Mar. 2015.
C. Brozzoli, M. Ishihara, S. M. Göbel, R. Salemme, Y. Rossetti, and A. Farnè, "Touch perception reveals the dominance of spatial over digital representation of numbers, " Proc. Nat. Acad. Sci., vol. 105, no. 14, pp. 5644-5648, Apr. 2008.
C. Mevorach, G. W. Humphreys, and L. Shalev, "Opposite biases in salience-based selection for the left and right posterior parietal cortex, " Nature Neurosci., vol. 9, no. 6, pp. 740-742, May 2006.
J. R. King et al., "Single-trial decoding of auditory novelty responses facilitates the detection of residual consciousness, " NeuroImage, vol. 83, pp. 726-738, Dec. 2013.
A. Gramfort et al., "MNE software for processing MEG and EEG data, " NeuroImage, vol. 86, pp. 446-460, Feb. 2014.
S. Chennu et al., "Spectral signatures of reorganised brain networks in disorders of consciousness, " PLoS Comput. Biol., vol. 10, no. 10, Oct. 2014, Art. no. e1003887.
C. J. Honey, R. Kötter, M. Breakspear, and O. Sporns, "Network structure of cerebral cortex shapes functional connectivity on multiple time scales, " Proc. Nat. Acad. Sci., vol. 104, no. 24, pp. 10240-10245, Jun. 2007.
M. J. Chadwick, H. M. Bonnici, and E. A. Maguire, "Decoding information in the human hippocampus: A user's guide, " Neuropsychologia, vol. 50, no. 13, pp. 3107-3121, Nov. 2012.
G. Varoquaux, P. R. Raamana, D. A. Engemann, A. Hoyos-Idrobo, Y. Schwartz, and B. Thirion, "Assessing and tuning brain decoders: Cross-validation, caveats, and guidelines, " NeuroImage, vol. 145, pp. 166-179, Jan. 2017.
J. Townsend, and F. G. Ashby, The Stochastic Modeling of Elementary Psychological Processes. New York, NY, USA: Cambridge Univ. Press, 1983.
J. Kinnison, S. Padmala, J.-M. Choi, and L. Pessoa, "Network analysis reveals increased integration during emotional and motivational processing, " J. Neurosci., vol. 32, no. 24, pp. 8361-8372, Jun. 2012.
V. T. Nguyen, M. Breakspear, and R. Cunnington, "Fusing concurrent EEG-fMRI with dynamic causal modeling: Application to effective connectivity during face perception, " NeuroImage, vol. 102, pp. 60-70, Nov. 2014.
S. Heim, S. B. Eickhoff, A. K. Ischebeck, A. D. Friederici, K. E. Stephan, and K. Amunts, "Effective connectivity of the left BA 44, BA 45, and inferior temporal gyrus during lexical and phonological decisions identified with DCM, " Hum. Brain Mapping, vol. 30, no. 2, pp. 392-402, Feb. 2009.
X. Wang, Z. Zhen, Y. Song, L. Huang, X. Kong, and J. Liu, "The hierarchical structure of the face network revealed by its functional connectivity pattern, " J. Neurosci., vol. 36, no. 3, pp. 890-900, Jan. 2016.
S. L. Fairhall and A. Ishai, "Effective connectivity within the distributed cortical network for face perception, " Cerebral Cortex, vol. 17, no. 10, pp. 2400-2406, Oct. 2007.
L. Cohen et al., "The visual word form area: Spatial and temporal characterization of an initial stage of reading in normal subjects and posterior split-brain patients, " Brain, vol. 123, no. 2, pp. 291-307, Feb. 2000.
R. Gaillard et al., "Direct intracranial, FMRI, and lesion evidence for the causal role of left inferotemporal cortex in reading, " Neuron, vol. 50, no. 2, pp. 191-204, Apr. 2006.
J. L. Whitwell and C. R. Jack, "Comparisons between Alzheimer disease, frontotemporal lobar degeneration, and normal aging with brain mapping, " Topics Magn. Reson. Imag., vol. 16, no. 6, pp. 409-425, Dec. 2005.
N. F. Dronkers, D. P. Wilkins, R. D. Van Valin, Jr., B. B. Redfern, and J. J. Jaeger, "Lesion analysis of the brain areas involved in language comprehension, " Cognition, vol. 92, nos. 1-2, pp. 145-177, May/Jun. 2004.
R. Adolphs, "Recognizing emotion from facial expressions: Psychological and neurological mechanisms, " Behav. Cogn. Neurosci. Rev., vol. 1, no. 1, pp. 21-62, Mar. 2002.
K. L. Phan, T. Wager, S. F. Taylor, and I. Liberzon, "Functional neuroanatomy of emotion: A meta-analysis of emotion activation studies in PET and fMRI, " NeuroImage, vol. 16, no. 2, pp. 331-348, Jun. 2002.
K. Vytal and S. Hamann, "Neuroimaging support for discrete neural correlates of basic emotions: A voxel-based meta-analysis, " J. Cogn. Neurosci., vol. 22, no. 12, pp. 2864-2885, Dec. 2010.
M. Gander and A. Buchheim, "Attachment classification, psychophysiology and frontal EEG asymmetry across the lifespan: A review, " Frontiers Hum. Neurosci., vol. 9, p. 79, Feb. 2015.
D. J. L. G. Schutter, P. Putman, E. Hermans, and J. van Honk, "Parietal electroencephalogram beta asymmetry and selective attention to angry facial expressions in healthy human subjects, " Neurosci. Lett., vol. 314, nos. 1-2, pp. 13-16, Nov. 2001.
E. A. Phelps and J. E. LeDoux, "Contributions of the amygdala to emotion processing: From animal models to human behavior, " Neuron, vol. 48, no. 2, pp. 175-187, Oct. 2005.
S. G. Costafreda, M. J. Brammer, A. S. David, and C. H. Y. Fu, "Predictors of amygdala activation during the processing of emotional stimuli: A meta-analysis of 385 PET and fMRI studies, " Brain Res. Rev., vol. 58, no. 1, pp. 57-70, Jun. 2008.
R. Adolphs, D. Tranel, H. Damasio, and A. Damasio, "Impaired recognition of emotion in facial expressions following bilateral damage to the human amygdala, " Nature, vol. 372, no. 6507, pp. 669-672, Dec. 1994.
N. Tsuchiya, H. Kawasaki, H. Oya, M. A. Howard, III., and R. Adolphs, "Decoding face information in time, frequency and space from direct intracranial recordings of the human brain, " PLoS One, vol. 3, no. 12, p. e3892, 2008.
K. Müsch et al., "Selective attention modulates high-frequency activity in the face-processing network, " Cortex, vol. 60, pp. 34-51, Nov. 2014.
G. Pourtois, L. Spinelli, M. Seeck, and P. Vuilleumier, "Modulation of face processing by emotional expression and gaze direction during intracranial recordings in right fusiform cortex, " J. Cogn. Neurosci., vol. 22, no. 9, pp. 2086-2107, Sep. 2010.
S. Grossberg, "How does a brain build a cognitive code?" in Studies of Mind and Brain. Dordrecht, The Netherlands: Springer, 1982, pp. 1-52.
K. Kveraga, A. S. Ghuman, and M. Bar, "Top-down predictions in the cognitive brain, " Brain Cognition, vol. 65, no. 2, pp. 145-168, Nov. 2007.
T. S. Lee and D. Mumford, "Hierarchical Bayesian inference in the visual cortex, " J. Opt. Soc. Amer. A, Opt. Image Sci., vol. 20, no. 7, pp. 1434-1448, Jul. 2003.
Y. Li, R. M. Richardson, and A. S. Ghuman, "Multi-Connection Pattern Analysis: Decoding the representational content of neural communication, " NeuroImage, vol. 162, pp. 32-44, Nov. 2017.
Y. Liang, B. Liu, X. Li, and P. Wang, "Multivariate pattern classification of facial expressions based on large-scale functional connectivity, " Frontiers Hum. Neurosci., vol. 12, p. 94, Mar. 2018.
A. Ibáñez, M. M. Velásquez, M. M. Caro, "Implicit emotional awareness in frontotemporal dementia, " Cogn. Neurosci., vol. 4, nos. 3-4, pp. 204-206, Nov. 2013.
T. Ossandón et al., "Transient suppression of broadband gamma power in the default-mode network is correlated with task complexity and subject performance, " J. Neurosci., vol. 31, no. 41, pp. 14521-14530, Oct. 2011.
J. K. Kleen et al., "Oscillation phase locking and late ERP components of intracranial hippocampal recordings correlate to patient performance in a working memory task, " Frontiers Hum. Neurosci., vol. 10, p. 287, Jun. 2016.
B. J. He and J. M. Zempel, "Average is optimal: An inverted-U relationship between trial-to-trial brain activity and behavioral performance, " PLoS Comput. Biol., vol. 9, no. 11, 2013, Art. no. e1003348.
J. E. Kragel et al., "Similar patterns of neural activity predict memory function during encoding and retrieval, " NeuroImage, vol. 155, pp. 60-71, Jul. 2017.
Y. Ezzyat et al., "Closed-loop stimulation of temporal cortex rescues functional networks and improves memory, " Nature Commun., vol. 9, no. 1, p. 365, Feb. 2018.
A. S. Ghuman et al., "Dynamic encoding of face information in the human fusiform gyrus, " Nature Commun., vol. 5, p. 5672, Dec. 2014.
J. W. Krakauer, A. A. Ghazanfar, A. Gomez-Marin, M. A. MacIver, and D. Poeppel, "Neuroscience needs behavior: Correcting a reductionist bias, " Neuron, vol. 93, no. 3, pp. 480-490, Feb. 2017.
L. Tsoi, J. Dungan, A. Waytz, and L. Young, "Distinct neural patterns of social cognition for cooperation versus competition, " NeuroImage, vol. 137, pp. 86-96, Aug. 2016.
M. A. Just et al., "Machine learning of neural representations of suicide and emotion concepts identifies suicidal youth, " Nature Hum. Behav., vol. 1, pp. 911-919, Oct. 2017.
M. A. Just, V. L. Cherkassky, A. Buchweitz, T. A. Keller, T. M. Mitchell, "Identifying autism from neural representations of social interactions: Neurocognitive markers of autism, " PLoS One, vol. 9, no. 12, 2014, Art. no. e113879.
