全部 标题 作者
关键词 摘要

OALib Journal期刊
ISSN: 2333-9721
费用:99美元

查看量下载量

相关文章

更多...
PLOS ONE  2012 

The Role of the Rat Medial Prefrontal Cortex in Adapting to Changes in Instrumental Contingency

DOI: 10.1371/journal.pone.0033302

Full-Text   Cite this paper   Add to My Lib

Abstract:

In order to select actions appropriate to current needs, a subject must identify relationships between actions and events. Control over the environment is determined by the degree to which action consequences can be predicted, as described by action-outcome contingencies – i.e. performing an action should affect the probability of the outcome. We evaluated in a first experiment adaptation to contingency changes in rats with neurotoxic lesions of the medial prefrontal cortex. Results indicate that this brain region is not critical to adjust instrumental responding to a negative contingency where the rats must refrain from pressing a lever, as this action prevents reward delivery. By contrast, this brain region is required to reduce responding in a non-contingent situation where the same number of rewards is freely delivered and actions do not affect the outcome any more. In a second experiment, we determined that this effect does not result from a different perception of temporal relationships between actions and outcomes since lesioned rats adapted normally to gradually increasing delays in reward delivery. These data indicate that the medial prefrontal cortex is not directly involved in evaluating the correlation between action-and reward-rates or in the perception of reward delays. The deficit in lesioned rats appears to consist of an abnormal response to the balance between contingent and non-contingent rewards. By highlighting the role of prefrontal regions in adapting to the causal status of actions, these data contribute to our understanding of the neural basis of choice tasks.

References

[1]  Rangel A, Camerer C, Montague PR (2008) A framework for studying the neurobiology of value-based decision making. Nat Rev Neurosci 9: 545–556.
[2]  Kargo WJ, Szatmary B, Nitz DA (2007) Adaptation of prefrontal cortical firing patterns and their fidelity to changes in action-reward contingencies. J Neurosci 27: 3548–3559.
[3]  Tanaka SC, Balleine BW, O'Doherty JP (2008) Calculating consequences: brain systems that encode the causal effects of actions. J Neurosci 28: 6750–6755.
[4]  Balleine BW, O'Doherty JP (2010) Human and rodent homologies in action control: corticostriatal determinants of goal-directed and habitual action. Neuropsychopharmacology 35: 48–69.
[5]  Ostlund SB, Balleine BW (2005) Lesions of medial prefrontal cortex disrupt the acquisition but not the expression of goal-directed learning. J Neurosci 25: 7763–7770.
[6]  Tran-Tu-Yen DA, Marchand AR, Pape JR, Di Scala G, Coutureau E (2009) Transient role of the rat prelimbic cortex in goal-directed behaviour. Eur J Neurosci 30: 464–471.
[7]  Dutech A, Coutureau E, Marchand AR (2011) A reinforcement learning approach to instrumental contingency degradation in rats. J Physiol Paris 105: 36–44.
[8]  Killcross S, Coutureau E (2003) Coordination of actions and habits in the medial prefrontal cortex of rats. Cereb Cortex 13: 400–408.
[9]  Balleine BW, Dickinson A (1998) Goal-directed instrumental action: contingency and incentive learning and their cortical substrates. Neuropharmacology 37: 407–419.
[10]  Corbit LH, Balleine BW (2003) The role of prelimbic cortex in instrumental conditioning. Behav Brain Res 146: 145–157.
[11]  Naneix F, Marchand AR, Di Scala G, Pape JR, Coutureau E (2009) A role for medial prefrontal dopaminergic innervation in instrumental conditioning. J Neurosci 29: 6599–6606.
[12]  Balleine BW (2005) Neural bases of food-seeking: affect, arousal and reward in corticostriatolimbic circuits. Physiol Behav 86: 717–730.
[13]  Dickinson A, Squire S, Varga Z, Smith JW (1998) Omission learning after instrumental pretraining. Q J Exp Psychol B 51: 271–286.
[14]  Paxinos G, Watson C (1998) The Rat brain in stereotaxic coordinates. San Diego (CA): Academic Press.
[15]  Shanks DR, Dickinson A (1991) Instrumental judgment and performance under variations in action-outcome contingency and contiguity. Mem Cognit 19: 353–360.
[16]  Ishikawa A, Ambroggi F, Nicola SM, Fields HL (2008) Contributions of the amygdala and medial prefrontal cortex to incentive cue responding. Neuroscience 155: 573–584.
[17]  Coutureau E, Marchand AR, Di Scala G (2009) Goal-directed responding is sensitive to lesions to the prelimbic cortex or basolateral nucleus of the amygdala but not to their disconnection. Behav Neurosci 123: 443–448.
[18]  Mazaleski JL, Iwata BA, Vollmer TR, Zarcone JR, Smith RG (1993) Analysis of the reinforcement and extinction components in DRO contingencies with self-injury. J Appl Behav Anal 26: 143–156.
[19]  Rushworth MF, Behrens TE (2008) Choice, uncertainty and value in prefrontal and cingulate cortex. Nat Neurosci 11: 389–397.
[20]  Reynolds GS (1961) Behavioral contrast. J Exp Anal Behav 4: 57–71.
[21]  Yin HH, Knowlton BJ, Balleine BW (2006) Inactivation of dorsolateral striatum enhances sensitivity to changes in the action-outcome contingency in instrumental conditioning. Behav Brain Res 166: 189–196.
[22]  Ostlund SB, Winterbauer NE, Balleine BW (2009) Evidence of action sequence chunking in goal-directed instrumental conditioning and its dependence on the dorsomedial prefrontal cortex. J Neurosci 29: 8280–8287.
[23]  Thompson RH, Iwata BA, Hanley GP, Dozier CL, Samaha AL (2003) The effects of extinction, noncontingent reinforcement and differential reinforcement of other behavior as control procedures. J Appl Behav Anal 36: 221–238.
[24]  Vollmer TR, Ringdahl JE, Roane HS, Marcus BA (1997) Negative side effects of noncontingent reinforcement. J Appl Behav Anal 30: 161–164.
[25]  Davis J, Bitterman ME (1971) Differential reinforcement of other behavior (DRO): a yoked-control comparison. J Exp Anal Behav 15: 237–241.
[26]  Ringdahl JE, Vollmer TR, Borrero JC, Connell JE (2001) Fixed-time schedule effects as a function of baseline reinforcement rate. J Appl Behav Anal 34: 1–15.
[27]  Williams BA (1976) The effects of unsignalled delayed reinforcement. J Exp Anal Behav 26: 441–449.
[28]  Coutureau E, Killcross S (2003) Inactivation of the infralimbic prefrontal cortex reinstates goal-directed responding in overtrained rats. Behav Brain Res 146: 167–174.
[29]  Dalley JW, Cardinal RN, Robbins TW (2004) Prefrontal executive and cognitive functions in rodents: neural and neurochemical substrates. Neurosci Biobehav Rev 28: 771–784.
[30]  Fuster JM (2001) The prefrontal cortex-an update: time is of the essence. Neuron 30: 319–333.
[31]  Azzi R, Fix DSR, Keller FS, Rocha e Silva MI (1964) Exteroceptive control of response under delayed reinforcement. J Exp Anal Behav 7: 159–162.
[32]  Roesch MR, Calu DJ, Burke KA, Schoenbaum G (2007) Should I stay or should I go? Transformation of time-discounted rewards in orbitofrontal cortex and associated brain circuits. Ann N Y Acad Sci 1104: 21–34.
[33]  Kheramin S, Body S, Ho MY, Velazquez-Martinez DN, Bradshaw CM, et al. (2004) Effects of orbital prefrontal cortex dopamine depletion on inter-temporal choice: a quantitative analysis. Psychopharmacology (Berl) 175: 206–214.
[34]  Miller EK, Cohen JD (2001) An integrative theory of prefrontal cortex function. Annu Rev Neurosci 24: 167–202.
[35]  Bitterman ME, Schoel WM (1970) Instrumental learning in animals: parameters of reinforcement. Annu Rev Psychol 21: 367–436.
[36]  Dickinson A (1985) Actions and habits : the development of behavioural autonomy. Phil Trans R Soc Lond B Biol Sci 308: 67–78.
[37]  Maia TV (2009) Reinforcement learning, conditioning, and the brain: Successes and challenges. Cogn Affect Behav Neurosci 9: 343–364.
[38]  Alexander WH, Brown JW (2011) Medial prefrontal cortex as an action-outcome predictor. Nat Neurosci 14: 1338–1344.
[39]  Gl?scher J, Daw N, Dayan P, O'Doherty JP (2010) States versus rewards: dissociable neural prediction error signals underlying model-based and model-free reinforcement learning. Neuron 66: 585–595.
[40]  Faure A, Haberland U, Conde F, El Massioui N (2005) Lesion to the nigrostriatal dopamine system disrupts stimulus-response habit formation. J Neurosci 25: 2771–2780.
[41]  Hitchcott PK, Quinn JJ, Taylor JR (2007) Bidirectional modulation of goal-directed actions by prefrontal cortical dopamine. Cereb Cortex 17: 2820–2827.
[42]  Lex B, Hauber W (2010) The role of dopamine in the prelimbic cortex and the dorsomedial striatum in instrumental conditioning. Cereb Cortex 20: 873–883.
[43]  Lammel S, Hetzel A, Hackel O, Jones I, Liss B, et al. (2008) Unique properties of mesoprefrontal neurons within a dual mesocorticolimbic dopamine system. Neuron 57: 760–773.
[44]  Fiorillo CD, Tobler PN, Schultz W (2003) Discrete coding of reward probability and uncertainty by dopamine neurons. Science 299: 1898–1902.
[45]  Matsumoto K, Tanaka K (2004) The role of the medial prefrontal cortex in achieving goals. Curr Opin Neurobiol 14: 178–185.
[46]  Ragozzino ME (2007) The contribution of the medial prefrontal cortex, orbitofrontal cortex, and dorsomedial striatum to behavioral flexibility. Ann N Y Acad Sci 1121: 355–375.
[47]  Daw ND, Niv Y, Dayan P (2005) Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nat Neurosci 8: 1704–1711.
[48]  Durstewitz D, Seamans JK (2008) The dual-state theory of prefrontal cortex dopamine function with relevance to catechol-o-methyltransferase genotypes and schizophrenia. Biol Psychiatry 64: 739–749.

Full-Text

Contact Us

service@oalib.com

QQ:3279437679

WhatsApp +8615387084133