[1] | Rangel A, Camerer C, Montague PR (2008) A framework for studying the neurobiology of value-based decision making. Nat Rev Neurosci 9: 545–556.
|
[2] | Kargo WJ, Szatmary B, Nitz DA (2007) Adaptation of prefrontal cortical firing patterns and their fidelity to changes in action-reward contingencies. J Neurosci 27: 3548–3559.
|
[3] | Tanaka SC, Balleine BW, O'Doherty JP (2008) Calculating consequences: brain systems that encode the causal effects of actions. J Neurosci 28: 6750–6755.
|
[4] | Balleine BW, O'Doherty JP (2010) Human and rodent homologies in action control: corticostriatal determinants of goal-directed and habitual action. Neuropsychopharmacology 35: 48–69.
|
[5] | Ostlund SB, Balleine BW (2005) Lesions of medial prefrontal cortex disrupt the acquisition but not the expression of goal-directed learning. J Neurosci 25: 7763–7770.
|
[6] | Tran-Tu-Yen DA, Marchand AR, Pape JR, Di Scala G, Coutureau E (2009) Transient role of the rat prelimbic cortex in goal-directed behaviour. Eur J Neurosci 30: 464–471.
|
[7] | Dutech A, Coutureau E, Marchand AR (2011) A reinforcement learning approach to instrumental contingency degradation in rats. J Physiol Paris 105: 36–44.
|
[8] | Killcross S, Coutureau E (2003) Coordination of actions and habits in the medial prefrontal cortex of rats. Cereb Cortex 13: 400–408.
|
[9] | Balleine BW, Dickinson A (1998) Goal-directed instrumental action: contingency and incentive learning and their cortical substrates. Neuropharmacology 37: 407–419.
|
[10] | Corbit LH, Balleine BW (2003) The role of prelimbic cortex in instrumental conditioning. Behav Brain Res 146: 145–157.
|
[11] | Naneix F, Marchand AR, Di Scala G, Pape JR, Coutureau E (2009) A role for medial prefrontal dopaminergic innervation in instrumental conditioning. J Neurosci 29: 6599–6606.
|
[12] | Balleine BW (2005) Neural bases of food-seeking: affect, arousal and reward in corticostriatolimbic circuits. Physiol Behav 86: 717–730.
|
[13] | Dickinson A, Squire S, Varga Z, Smith JW (1998) Omission learning after instrumental pretraining. Q J Exp Psychol B 51: 271–286.
|
[14] | Paxinos G, Watson C (1998) The Rat brain in stereotaxic coordinates. San Diego (CA): Academic Press.
|
[15] | Shanks DR, Dickinson A (1991) Instrumental judgment and performance under variations in action-outcome contingency and contiguity. Mem Cognit 19: 353–360.
|
[16] | Ishikawa A, Ambroggi F, Nicola SM, Fields HL (2008) Contributions of the amygdala and medial prefrontal cortex to incentive cue responding. Neuroscience 155: 573–584.
|
[17] | Coutureau E, Marchand AR, Di Scala G (2009) Goal-directed responding is sensitive to lesions to the prelimbic cortex or basolateral nucleus of the amygdala but not to their disconnection. Behav Neurosci 123: 443–448.
|
[18] | Mazaleski JL, Iwata BA, Vollmer TR, Zarcone JR, Smith RG (1993) Analysis of the reinforcement and extinction components in DRO contingencies with self-injury. J Appl Behav Anal 26: 143–156.
|
[19] | Rushworth MF, Behrens TE (2008) Choice, uncertainty and value in prefrontal and cingulate cortex. Nat Neurosci 11: 389–397.
|
[20] | Reynolds GS (1961) Behavioral contrast. J Exp Anal Behav 4: 57–71.
|
[21] | Yin HH, Knowlton BJ, Balleine BW (2006) Inactivation of dorsolateral striatum enhances sensitivity to changes in the action-outcome contingency in instrumental conditioning. Behav Brain Res 166: 189–196.
|
[22] | Ostlund SB, Winterbauer NE, Balleine BW (2009) Evidence of action sequence chunking in goal-directed instrumental conditioning and its dependence on the dorsomedial prefrontal cortex. J Neurosci 29: 8280–8287.
|
[23] | Thompson RH, Iwata BA, Hanley GP, Dozier CL, Samaha AL (2003) The effects of extinction, noncontingent reinforcement and differential reinforcement of other behavior as control procedures. J Appl Behav Anal 36: 221–238.
|
[24] | Vollmer TR, Ringdahl JE, Roane HS, Marcus BA (1997) Negative side effects of noncontingent reinforcement. J Appl Behav Anal 30: 161–164.
|
[25] | Davis J, Bitterman ME (1971) Differential reinforcement of other behavior (DRO): a yoked-control comparison. J Exp Anal Behav 15: 237–241.
|
[26] | Ringdahl JE, Vollmer TR, Borrero JC, Connell JE (2001) Fixed-time schedule effects as a function of baseline reinforcement rate. J Appl Behav Anal 34: 1–15.
|
[27] | Williams BA (1976) The effects of unsignalled delayed reinforcement. J Exp Anal Behav 26: 441–449.
|
[28] | Coutureau E, Killcross S (2003) Inactivation of the infralimbic prefrontal cortex reinstates goal-directed responding in overtrained rats. Behav Brain Res 146: 167–174.
|
[29] | Dalley JW, Cardinal RN, Robbins TW (2004) Prefrontal executive and cognitive functions in rodents: neural and neurochemical substrates. Neurosci Biobehav Rev 28: 771–784.
|
[30] | Fuster JM (2001) The prefrontal cortex-an update: time is of the essence. Neuron 30: 319–333.
|
[31] | Azzi R, Fix DSR, Keller FS, Rocha e Silva MI (1964) Exteroceptive control of response under delayed reinforcement. J Exp Anal Behav 7: 159–162.
|
[32] | Roesch MR, Calu DJ, Burke KA, Schoenbaum G (2007) Should I stay or should I go? Transformation of time-discounted rewards in orbitofrontal cortex and associated brain circuits. Ann N Y Acad Sci 1104: 21–34.
|
[33] | Kheramin S, Body S, Ho MY, Velazquez-Martinez DN, Bradshaw CM, et al. (2004) Effects of orbital prefrontal cortex dopamine depletion on inter-temporal choice: a quantitative analysis. Psychopharmacology (Berl) 175: 206–214.
|
[34] | Miller EK, Cohen JD (2001) An integrative theory of prefrontal cortex function. Annu Rev Neurosci 24: 167–202.
|
[35] | Bitterman ME, Schoel WM (1970) Instrumental learning in animals: parameters of reinforcement. Annu Rev Psychol 21: 367–436.
|
[36] | Dickinson A (1985) Actions and habits : the development of behavioural autonomy. Phil Trans R Soc Lond B Biol Sci 308: 67–78.
|
[37] | Maia TV (2009) Reinforcement learning, conditioning, and the brain: Successes and challenges. Cogn Affect Behav Neurosci 9: 343–364.
|
[38] | Alexander WH, Brown JW (2011) Medial prefrontal cortex as an action-outcome predictor. Nat Neurosci 14: 1338–1344.
|
[39] | Gl?scher J, Daw N, Dayan P, O'Doherty JP (2010) States versus rewards: dissociable neural prediction error signals underlying model-based and model-free reinforcement learning. Neuron 66: 585–595.
|
[40] | Faure A, Haberland U, Conde F, El Massioui N (2005) Lesion to the nigrostriatal dopamine system disrupts stimulus-response habit formation. J Neurosci 25: 2771–2780.
|
[41] | Hitchcott PK, Quinn JJ, Taylor JR (2007) Bidirectional modulation of goal-directed actions by prefrontal cortical dopamine. Cereb Cortex 17: 2820–2827.
|
[42] | Lex B, Hauber W (2010) The role of dopamine in the prelimbic cortex and the dorsomedial striatum in instrumental conditioning. Cereb Cortex 20: 873–883.
|
[43] | Lammel S, Hetzel A, Hackel O, Jones I, Liss B, et al. (2008) Unique properties of mesoprefrontal neurons within a dual mesocorticolimbic dopamine system. Neuron 57: 760–773.
|
[44] | Fiorillo CD, Tobler PN, Schultz W (2003) Discrete coding of reward probability and uncertainty by dopamine neurons. Science 299: 1898–1902.
|
[45] | Matsumoto K, Tanaka K (2004) The role of the medial prefrontal cortex in achieving goals. Curr Opin Neurobiol 14: 178–185.
|
[46] | Ragozzino ME (2007) The contribution of the medial prefrontal cortex, orbitofrontal cortex, and dorsomedial striatum to behavioral flexibility. Ann N Y Acad Sci 1121: 355–375.
|
[47] | Daw ND, Niv Y, Dayan P (2005) Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nat Neurosci 8: 1704–1711.
|
[48] | Durstewitz D, Seamans JK (2008) The dual-state theory of prefrontal cortex dopamine function with relevance to catechol-o-methyltransferase genotypes and schizophrenia. Biol Psychiatry 64: 739–749.
|