[en] A growing body of evidence suggests that reward may be a powerful determinant of attentional selection. To date, the study of value-based attentional capture has been mainly focused on the visual sensory modality. It is yet unknown how reward information is communicated and integrated across the different senses in order to resolve between competing choices during selective attention. Our study investigated the interference produced by an auditory reward-associated distractor when a semantically-related visual target was concurrently presented. We measured both manual and saccadic response times towards a target image (drum or trumpet), while an irrelevant sound (congruent or incongruent instrument) was heard. Each sound was previously associated with either a high or a low reward. We found that manual responses were slowed by a high-reward auditory distractor when sound and image were semantically congruent. A similar effect was observed for saccadic responses, but only for participants aware of the past reward contingencies. Auditory events associated with reward value were thus capable of involuntarily capturing attention in the visual modality. This reward effect can mitigate cross-modal semantic integration and appears to be differentially modulated by awareness for saccadic vs. manual responses. Together, our results extend previous work on value-driven attentional biases in perception by showing that these may operate across sensory modalities and override cross-modal integration for semantically-related stimuli. This study sheds new light on the potential implication of brain regions underlying value-driven attention across sensory modalities.
Disciplines :
Neurosciences & behavior Neurology
Author, co-author :
Sanz, Leandro ; Université de Genève - UNIGE > Neuroscience Department > Laboratory for Behavioral Neurology and Imaging of Cognition
Vuilleumier, Patrik ✱; Université de Genève - UNIGE > Neuroscience Department > Laboratory for Behavioral Neurology and Imaging of Cognition
Bourgeois, Alexia ✱; Université de Genève - UNIGE > Neuroscience Department > Laboratory for Behavioral Neurology and Imaging of Cognition
✱ These authors have contributed equally to this work.
Language :
English
Title :
Cross-modal integration during value-driven attentional capture
Awh, E., Belopolsky, A.V., Theeuwes, J., Top-down versus bottom-up attentional control: a failed theoretical dichotomy. Trends Cogn. Sci. 16 (2012), 437–443, 10.1016/j.tics.2012.06.010.
Bourgeois, A., Chelazzi, L., Vuilleumier, P., How motivation and reward learning modulate selective attention. Prog. Brain Res. 229 (2016), 325–342, 10.1016/bs.pbr.2016.06.004.
Bourgeois, A., Neveu, R., Bayle, D.J., Vuilleumier, P., How does reward compete with goal-directed and stimulus-driven shifts of attention?. Cogn. Emot. 31 (2017), 109–118, 10.1080/02699931.2015.1085366.
Bourgeois, A., Neveu, R., Vuilleumier, P., How does awareness modulate goal-directed and stimulus-driven shifts of attention triggered by value learning?. PLoS One 11 (2016), 1–13, 10.1371/journal.pone.0160469.
Buschman, T.J., Kastner, S., From behavior to neural dynamics: an integrated theory of attention. Neuron 88 (2015), 127–144, 10.1016/j.neuron.2015.09.017.
Chelazzi, L., Della Libera, C., Sani, I., Santandrea, E., Neural basis of visual selective attention. Wiley Interdiscip. Rev. Cogn. Sci. 2 (2011), 392–407, 10.1002/wcs.117.
Chelazzi, L., Perlato, A., Santandrea, E., Della Libera, C., Rewards teach visual selective attention. Vis. Res. 85 (2013), 58–62, 10.1016/j.visres.2012.12.005.
Corbetta, M., Shulman, G.L., Control of goal-directed and stimulus-driven attention in the brain. Nat. Rev. Neurosci. 3 (2002), 201–215, 10.1038/nrn755.
Della Libera, C., Chelazzi, L., Visual selective attention and the effects of monetary rewards. Psychol. Sci. 17 (2006), 222–227, 10.1111/j.1467-9280.2006.01689.x.
Ding, L., Hikosaka, O., Behavioral/systems/cognitive comparison of reward modulation in the frontal eye field and caudate of the Macaque. J. Neurosci. 26 (2006), 6695–6703, 10.1523/JNEUROSCI.0836-06.2006.
Failing, M., Theeuwes, J., Selection history: how reward modulates selectivity of visual attention. Psychon. Bull. Rev. 25 (2018), 514–538, 10.3758/s13423-017-1380-y.
Failing, M.F., Theeuwes, J., Exogenous visual orienting by reward. J. Vis., 14, 2014, 6, 10.1167/14.5.6.
Hickey, C., Chelazzi, L., Theeuwes, J., Reward-priming of location in visual search. PLoS One, 9, 2014, e103372, 10.1371/journal.pone.0103372.
Hickey, C., Chelazzi, L., Theeuwes, J., Reward changes salience in human vision via the anterior cingulate. J. Neurosci. 30 (2010), 11096–11103, 10.1523/JNEUROSCI.1026-10.2010.
Hickey, C., Peelen, M.V., Neural mechanisms of incentive salience in naturalistic human vision. Neuron 85 (2015), 512–518, 10.1016/j.neuron.2014.12.049.
Hickey, C., van Zoest, W., Reward-associated stimuli capture the eyes in spite of strategic attentional set. Vis. Res. 92 (2013), 67–74, 10.1016/j.visres.2013.09.008.
Hikosaka, O., Kim, H.F., Yasuda, M., Yamamoto, S., Basal ganglia circuits for reward value-guided behavior. Annu. Rev. Neurosci. 37 (2014), 289–306, 10.1146/annurev-neuro-071013-013924.
Hillyard, S.A., Störmer, V.S., Feng, W., Martinez, A., McDonald, J.J., Cross-modal orienting of visual attention. Neuropsychologia 83 (2016), 170–178, 10.1016/j.neuropsychologia.2015.06.003.
Ikeda, T., Hikosaka, O., Positive and negative modulation of motor response in primate superior colliculus by reward expectation. J. Neurophysiol. 98 (2007), 3163–3170, 10.1152/jn.00975.2007.
Johnson, J.A., Zatorre, R.J., Attention to simultaneous unrelated auditory and visual events: behavioral and neural correlates. Cereb. Cortex 15 (2005), 1609–1620, 10.1093/cercor/bhi039.
Peck, C.J., Jangraw, D.C., Suzuki, M., Efem, R., Gottlieb, J., Reward modulates attention independently of action value in posterior parietal cortex. J. Neurosci. 29 (2009), 11182–11191, 10.1523/JNEUROSCI.1929-09.2009.
Pierrot-Deseilligny, C., Muri, R.M., Ploner, C.J., Gaymard, B., Rivaud-Pechoux, S., Cortical control of ocular saccades in humans: a model for motricity. Prog. Brain Res. 142 (2003), 3–17, 10.1016/S0079-6123(03)42003-7.
Pooresmaeili, A., FitzGerald, T.H.B., Bach, D.R., Toelch, U., Ostendorf, F., Dolan, R.J., Cross-modal effects of value on perceptual acuity and stimulus encoding. Proc. Natl. Acad. Sci. USA 111 (2014), 15244–15249, 10.1073/pnas.1408873111.
Posner, M.I., Orienting of attention. Q. J. Exp. Psychol. 32 (1980), 3–25.
Quentin, R., Chanes, L., Vernet, M., Valero-Cabré, A., Fronto-parietal anatomical connections influence the modulation of conscious visual perception by high-beta frontal oscillatory activity. Cereb. Cortex 25 (2015), 2095–2101, 10.1093/cercor/bhu014.
Schneider, W., Eschman, A., Zuccolotto, A., Burgess, S., Cernicky, B., Gilkey, D., Gliptis, J., Maciejczyk, V., Macwhinney, B., Rodgers, K., James, J.S., E-prime user's guide. Pittsbg. Psychol. Softw. Tools Inc., 2002.
Serences, J.T., Value-based modulations in human visual cortex. Neuron 60 (2008), 1169–1181, 10.1016/j.neuron.2008.10.051.
Shomstein, S., Yantis, S., Control of attention shifts between vision and audition in human cortex. J. Neurosci. 24 (2004), 10702–10706, 10.1523/JNEUROSCI.2939-04.2004.
Talsma, D., Senkowski, D., Soto-Faraco, S., Woldorff, M.G., The multifaceted interplay between attention and multisensory integration. Trends Cogn. Sci. 14 (2010), 400–410, 10.1016/j.tics.2010.06.008.
Theeuwes, J., Belopolsky, A.V., Reward grabs the eye: oculomotor capture by rewarding stimuli. Vis. Res. 74 (2012), 80–85, 10.1016/j.visres.2012.07.024.
Vroomen, J., De Gelder, B., Perceptual effects of cross-modal stimulation: ventriloquism and the freezing phenomenon. Handb. Multisens. Process. 3 (2004), 1–23.
Vuilleumier, P., Affective and motivational control of vision. Curr. Opin. Neurol. 28 (2015), 29–35, 10.1097/WCO.0000000000000159.
Vuilleumier, P., Armony, J.L., Driver, J., Dolan, R.J., Effects of attention and emotion on face processing in the human brain: an event-related fMRI study. Neuron 30 (2001), 829–841, 10.1016/S0896-6273(01)00328-2.
Vuilleumier, P., Brosch, T., Interactions of emotion and attention. Gazzaniga, M.S., (eds.) The Cognitive Neurosciences IV, 2009, MIT Press, Cambridge, 925–934.
Yasuda, M., Hikosaka, O., Functional territories in primate substantia nigra pars reticulata separately signaling stable and flexible values. J. Neurophysiol. 113 (2015), 1681–1696, 10.1152/jn.00674.2014.