[en] Conditioned stimuli (CSs) come to act as motivational magnets following repeated association with unconditioned stimuli (UCSs) such as sucrose rewards. By traditional views, the more reliably predictive a Pavlovian CS-UCS association, the more the CS becomes attractive. However, in some cases, less predictability might equal more motivation. Here we examined the effect of introducing uncertainty in CS-UCS association on CS strength as an attractive motivation magnet. In the present study, Experiment 1 assessed the effects of Pavlovian predictability versus uncertainty about reward probability and/or reward magnitude on the acquisition and expression of sign-tracking (ST) and goal-tracking (GT) responses in an autoshaping procedure. Results suggested that uncertainty produced strongest incentive salience expressed as sign-tracking. Experiment 2 examined whether a within-individual temporal shift from certainty to uncertainty conditions could produce a stronger CS motivational magnet when uncertainty began, and found that sign-tracking still increased after the shift. Overall, our results support earlier reports that ST responses become more pronounced in the presence of uncertainty regarding CS-UCS associations, especially when uncertainty combines both probability and magnitude. These results suggest that Pavlovian uncertainty, although diluting predictability, is still able to enhance the incentive motivational power of particular CSs.
Disciplines :
Neurosciences & behavior
Author, co-author :
Anselme, Patrick ; Université de Liège - ULiège > Département de Psychologie : cognition et comportement > Neuroscience comportementale et psychopharmacologie expér.
Robinson, Mike J.F.
Berridge, Kent C.
Language :
English
Title :
Reward uncertainty enhances incentive salience attribution as sign-tracking
scite shows how a scientific paper has been cited by providing the context of the citation, a classification describing whether it supports, mentions, or contrasts the cited claim, and a label indicating in which section the citation was made.
Bibliography
Anselme P. The uncertainty processing theory of motivation. Behavioural Brain Research 2010, 208:291-310.
Anselme P, Robinson MJF, DiFeliceantonio AG, Berridge KC. Replacement of goal-tracking by sign-tracking under reward uncertainty, and impairment by dopamine antagonism in the rat. Abstract. Washington, DC: Society for Neuroscience; 2011.
Bean D., Mason G.J., Bateson M. Contrafreeloading in starlings: testing the information hypothesis. Behaviour 1999, 136:1267-1282.
Beckmann J.S., Bardo M.T. Environmental enrichment reduces attribution of incentive salience to a food-associated stimulus. Behavioural Brain Research 2012, 226:331-334.
Belzung C. Biologie des émotions 2007, De Boeck, Bruxelles.
Berridge K.C. The debate over dopamine's role in reward: the case for incentive salience. Psychopharmacology 2007, 19:391-431.
Berridge K.C. From prediction error to incentive salience: mesolimbic computation of reward motivation. European Journal of Neuroscience 2012, 35:1124-1143.
Berridge K.C., Robinson T.E. What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience?. Brain Research Reviews 1998, 28:309-369.
Boakes R.A. Performance on learning to associate a stimulus with positive reinforcement. Operant-Pavlovian interactions 1977, 67-97. Lawrence Erlbaum Associates, New Jersey. H. Davis, H.M.B. Hurwitz (Eds.).
Cardinal R.N., Howes N.J. Effects of lesions of the nucleus accumbens core on choice between small certain rewards and large uncertain rewards in rats. BMC Neuroscience 2005, 6:37.
Collins L., Young D.B., Davies K., Pearce J.M. The influence of partial reinforcement on serial autoshaping with pigeons. Quarterly Journal of Experimental Psychology 1983, 35B:275-290.
Davey G.C.L., Cleland G.G., Oakley D.A. Applying Konorski's model of classical conditioning to signal-centered behavior in the rat: some functional similarities between hunger CRs and sign-tracking. Animal Learning and Behavior 1982, 10:257-262.
DiFeliceantonio A.G., Berridge K.C. Which cue to 'want'? Opioid stimulation of central amygdala makes goal-trackers show stronger goal-tracking, just as sign-trackers show stronger sign-tracking. Behavioural Brain Research 2012, 230:399-408.
Doya K. Modulators of decision making. Nature Review Neuroscience 2008, 11:410-416.
Falk J.L. Production of polydipsia in normal rats by an intermittent food schedule. Science 1961, 133:195-196.
Fiorillo C.D. Transient activation of midbrain dopamine neurons by reward risk. Neuroscience 2011, 197:162-171.
Fiorillo C.D., Tobler P.N., Schultz W. Discrete coding of reward probability and uncertainty by dopamine neurons. Science 2003, 299:1898-1902.
Flagel S.B., Akil H., Robinson T.E. Individual differences in the attribution of incentive salience to reward-related cues: implications for addiction. Neuropharmacology 2009, 56:139-148.
Flagel S.B., Watson S.J., Robinson T.E., Akil H. Individual differences in the propensity to approach signals vs. goals promote different adaptations in the dopamine system of rats. Psychopharmacology 2007, 191:599-607.
Flagel S.B., Clark J.J., Robinson T.E., Mayo L., Czuj A., Willuhn I., Akers C.A., Clinton S.M., Phillips P.E.M., Akil H. A selective role for dopamine in stimulus-reward learning. Nature 2011, 469:53-57.
Forkman B. The effect of uncertainty on the food intake of the Mongolian gerbil. Behaviour 1993, 124:197-206.
Forkman B. The foraging behaviour of Mongolian gerbils: a behavioural need or a need to know?. Behaviour 1996, 133:129-143.
Funamizu A., Ito M., Doya K., Kanzaki R., Takahashi H. Uncertainty in action-value estimation affects both action choice and learning rate of the choice behaviors of rats. European Journal of Neuroscience 2012, 35:1180-1189.
Gallistel C.R. Conditioning from an information processing perspective. Behavioural Processes 2003, 62:89-101.
Gibbon J., Farrell L., Locurto C.M., Duncan H.J., Terrace H.S. Partial reinforcement in autoshaping with pigeons. Animal Learning and Behavior 1980, 8:45-59.
Glimcher P.W., Camerer C.F., Fehr E., Poldrack R.A. Neuroeconomics. Decision making and the brain 2009, Academic Press, New York.
Ikemoto S., Panksepp J. The role of nucleus accumbens dopamine in motivated behavior: a unifying interpretation with special reference to reward-seeking. Brain Research Reviews 1999, 31:6-41.
Inglis I.R., Forkman B., Lazarus J. Free food or earned food? A review and fuzzy model of contrafreeloading. Animal Behaviour 1997, 53:1171-1191.
Kacelnik A., Bateson M. Risky theories: the effects of variance on foraging decisions. American Zoologist 1996, 36:402-434.
Katz R.J., Roth K. Tail pinch induced stress-arousal facilitates brain stimulation reward. Physiology and Behavior 1979, 22:193-194.
Leussis M.P., Bolivar V.J. Habituation in rodents: a review of behavior, neurobiology, and genetics. Neuroscience and Biobehavioral Reviews 2006, 30:1045-1064.
Linnet J, Mouridsen K, Peterson E, Moller A, Doudet DJ, Gjedde A. Striatal dopamine release codes uncertainty in pathological gambling. Psychiatry Research-Neuroimaging; in press, doi:10.1016/j.pscychresns.2012.04.012.
Lomanowska A.M., Lovic V., Rankine M.J., Mooney S.J., Robinson T.E., Kraemer G.W. Inadequate early social experience increases the incentive salience of reward-related cues in adulthood. Behavioural Brain Research 2011, 220:91-99.
Mackintosh N.J. A theory of attention: variations in the associability of stimuli with reinforcement. Psychological Review 1975, 82:276-298.
Mahler S.V., Berridge K.C. Which cue to 'want'? Central amygdala opioid activation enhances and focuses incentive salience on a prepotent reward cue. Journal of Neuroscience 2009, 29:6500-6513.
Montague P.R., Dayan P., Sejnowski T.J. A framework for mesencephalic dopamine systems based on predictive Hebbian learning. Journal of Neuroscience 1996, 16:1936-1947.
Nader K., Bechara A., van der Kooy D. Neurobiological constraints on behavioral models of motivation. Annual Review of Psychology 1997, 48:85-114.
Ono K. Free-choice preference under uncertainty. Behavioural Processes 2000, 49:11-19.
Oswald L.M., Wong D.F., McCaul M., Zhou Y., Kuwabara H., Choi L., Brasic J., Wand G.S. Relationships among ventral striatal dopamine release, cortisol secretion, and subjective responses to amphetamine. Neuropsychopharmacology 2005, 30:821-832.
Pearce J.M., Hall G. A model for Pavlovian learning: variations in the effectiveness of conditioned but not of unconditioned stimuli. Psychological Review 1980, 87:532-552.
Preuschoff K., Bossaerts P., Quartz S.R. Neural differentiation of expected reward and risk in human subcortical structures. Neuron 2006, 51:381-390.
Rescorla R.A. Pavlovian conditioning and its proper control procedures. Psychological Review 1967, 74:71-80.
Rescorla R.A., Wagner A.R. A theory of pavlovian conditioning: variations in the effectiveness of reinforcement and nonreniforcement. Classical conditioning II: current theory and research 1972, 64-99. Appleton-Century-Crofts, New York. A.H. Black, W.F. Prokasy (Eds.).
Robinson T.E., Berridge K.C. The psychology and neurobiology of addiction: an incentive-sensitization view. Addiction 2000, 95(Suppl.):S91-S117.
Robinson T.E., Flagel S.B. Dissociating the predictive and incentive motivational properties of reward-related cues through the study of individual differences. Biological Psychiatry 2009, 65:869-873.
Robinson MJF, Berridge KC. Instant incentive salience: dynamic transformation of an aversive salt cue into a 'wanted' motivational magnet. Abstract. San Diego, CA: Society for Neuroscience; 2010.
Schultz W. Predictive reward signal of dopamine neurons. Journal of Neurophysiology 1998, 80:1-27.
Schultz W., Apicella P., Ljungberg T. Responses of monkey dopamine neurons to reward and conditioned stimuli during successive steps of learning a delayed response task. Journal of Neuroscience 1993, 13:900-913.
Shurtleff D., Delamater A.R., Riley A.L. A reevaluation of the CS - hypothesis for schedule-induced polydipsia under intermittent schedules of pellet delivery. Animal Learning and Behavior 1983, 11:247-254.
Singer B.F., Scott-Railton J., Vezina P. Unpredictable saccharin reinforcement enhances locomotor responding to amphetamine. Behavioural Brain Research 2012, 226:340-344.
Stephens DW, Krebs JR. Foraging theory. Princeton, NJ: Princeton University Press.
Tindell A.J., Smith K.S., Berridge K.C., Aldridge J.W. Dynamic computation of incentive salience: 'wanting' what was never 'liked'. Journal of Neuroscience 2009, 29:12220-12228.
Tindell A.J., Berridge K.C., Zhang J., Peciña S., Aldridge J.W. Ventral pallidal neurons code incentive motivation: amplification by mesolimbic sensitization and amphetamine. European Journal of Neuroscience 2005, 22:2617-2634.
Tomie A., Aguado A.S., Pohorecky L.A., Benjamin D. Individual differences in Pavlovian autoshaping of lever-pressing in rats predict stress-induced corticosterone release and mesolimbic levels of monoamines. Pharmacology Biochemistry and Behavior 2000, 65:509-517.
Tomie A., Tirado A.D., Yu L., Pohorecky L.A. Pavlovian autoshaping procedures increase plasma corticosterone and levels of norepinephrine and serotonin in prefrontal cortex in rats. Behavioural Brain Research 2004, 153:97-105.
Zhang J., Berridge K.C., Tindell A.J., Smith K.S., Aldridge J.W. A neural computational model of incentive salience. PLoS Computational Biology 2009, 5:e1000437.
Similar publications
Sorry the service is unavailable at the moment. Please try again later.
This website uses cookies to improve user experience. Read more
Save & Close
Accept all
Decline all
Show detailsHide details
Cookie declaration
About cookies
Strictly necessary
Performance
Strictly necessary cookies allow core website functionality such as user login and account management. The website cannot be used properly without strictly necessary cookies.
This cookie is used by Cookie-Script.com service to remember visitor cookie consent preferences. It is necessary for Cookie-Script.com cookie banner to work properly.
Performance cookies are used to see how visitors use the website, eg. analytics cookies. Those cookies cannot be used to directly identify a certain visitor.
Used to store the attribution information, the referrer initially used to visit the website
Cookies are small text files that are placed on your computer by websites that you visit. Websites use cookies to help users navigate efficiently and perform certain functions. Cookies that are required for the website to operate properly are allowed to be set without your permission. All other cookies need to be approved before they can be set in the browser.
You can change your consent to cookie usage at any time on our Privacy Policy page.