全部 标题 作者
关键词 摘要

OALib Journal期刊
ISSN: 2333-9721
费用:99美元

查看量下载量

相关文章

更多...
PLOS ONE  2012 

Formal Comparison of Dual-Parameter Temporal Discounting Models in Controls and Pathological Gamblers

DOI: 10.1371/journal.pone.0047225

Full-Text   Cite this paper   Add to My Lib

Abstract:

Temporal or delay discounting refers to the phenomenon that the value of a reward is discounted as a function of time to delivery. A range of models have been proposed that approximate the shape of the discount curve describing the relationship between subjective value and time. Recent evidence suggests that more than one free parameter may be required to accurately model human temporal discounting data. Nonetheless, many temporal discounting studies in psychiatry, psychology and neuroeconomics still apply single-parameter models, despite their oftentimes poor fit to single-subject data. Previous comparisons of temporal discounting models have either not taken model complexity into account, or have overlooked particular models. Here we apply model comparison techniques in a large sample of temporal discounting datasets using several discounting models employed in the past. Among the models examined, an exponential-power model from behavioural economics (CS model, Ebert & Prelec 2007) provided the best fit to human laboratory discounting data. Inter-parameter correlations for the winning model were moderate, whereas they were substantial for other dual-parameter models examined. Analyses of previous group and context effects on temporal discounting with the winning model provided additional theoretical insights. The CS model may be a useful tool in future psychiatry, psychology and neuroscience work on inter-temporal choice.

References

[1]  Green L, Myerson J (2004) A discounting framework for choice with delayed and probabilistic rewards. Psychol Bull 130: 769–792.
[2]  Frederick S, Loewenstein G, O'Donoghue T (2002) Time Discounting and Time Preference: A Critical Review. Journal of Economic Literature 40: 351–401.
[3]  Bickel WK, Miller ML, Yi R, Kowal BP, Lindquist DM, et al. (2007) Behavioral and neuroeconomics of drug addiction: competing neural systems and temporal discounting processes. Drug Alcohol Depend 90 Suppl 1S85–91.
[4]  Bickel WK, Jarmolowicz DP, Mueller ET, Koffarnus MN, Gatchalian KM (2012) Excessive discounting of delayed reinforcers as a trans-disease process contributing to addiction and other disease-related vulnerabilities: Emerging evidence. Pharmacol Ther 134: 287–297.
[5]  Peters J, Buchel C (2011) The neural mechanisms of inter-temporal decision-making: understanding variability. Trends Cogn Sci 15: 227–239.
[6]  Sellitto M, Ciaramelli E, di Pellegrino G (2011) The neurobiology of intertemporal choice: insight from imaging and lesion studies. Rev Neurosci 22: 565–574.
[7]  Killeen PR (2009) An additive-utility model of delay discounting. Psychol Rev 116: 602–619.
[8]  Samuelson PA (1937) A note on measurement of utility. Review of Economic Studies 4: 155–161.
[9]  Mazur JE (1987) An adjusting procedure for studying delayed reinforcement. In: Commons ML, Mazur JE, Nevin JA, Rachlin H, editors. Quantitative analyses of behavior: Vol 5 The effect of delay and of intervening events on reinforcement value. Hillsdale, NJ: Erlbaum. pp. 55–73.
[10]  McKerchar TL, Green L, Myerson J, Pickford TS, Hill JC, et al. (2009) A comparison of four models of delay discounting in humans. Behav Processes 81: 256–259.
[11]  Loewenstein G, Prelec D (1992) Anomalies in intertemporal choice: Evidence and an interpretation. The Quarterly Journal of Economics 107: 573–597.
[12]  Ebert J, Prelec D (2007) The Fragility of Time: Time-Insensitivity and Valuation of the Near and Far Future. Managment Science 53: 1423–1438.
[13]  Bleichrodt H, Rohde KIM, Wakker P (2009) Non-hyperbolic time inconsistency. Games and Economic Behavior 66: 27–38.
[14]  Yi R, Landes RD, Bickel WK (2009) Novel Models of Intertemporal Valuation: Past and Future Outcomes. J Neurosci Psychol Econ 2: 102.
[15]  Rachlin H (2006) Notes on discounting. J Exp Anal Behav 85: 425–435.
[16]  Kable JW, Glimcher PW (2010) An “as soon as possible” effect in human intertemporal decision making: behavioral evidence and neural mechanisms. J Neurophysiol 103: 2513–2531.
[17]  Read D, Scholten M (2006) Discounting by Intervals: A Generalized Model of Intertemporal Choice. Managment Science 52: 1424–1436.
[18]  Green L, Myerson J, Macaux EW (2005) Temporal discounting when the choice is between two delayed rewards. J Exp Psychol Learn Mem Cogn 31: 1121–1133.
[19]  Thaler R (1981) Some empirical evidence on dynamic inconsistency. Economics Letters 8: 201–207.
[20]  Myerson J, Green L (1995) Discounting of delayed rewards: Models of individual choice. J Exp Anal Behav 64: 263–276.
[21]  Kalenscher T, Windmann S, Diekamp B, Rose J, Güntürkün O, et al. (2005) Single units in the pigeon brain integrate reward amount and time-to-reward in an impulsive choice task. Curr Biol 15: 594–602.
[22]  Kable JW, Glimcher PW (2007) The neural correlates of subjective value during intertemporal choice. Nat Neurosci 10: 1625–1633.
[23]  van der Pol M, Cairns J (2010) Descriptive validity of alternative intertemporal models for health outcomes: an axiomatic test. Health Econ 20: 770–782.
[24]  Takahashi T, Oono H, Radford M (2008) Psychphysics of time perception and intertemporal choice models. Physica A 387: 2066–2074.
[25]  Johnson MW, Bickel WK (2008) An algorithm for identifying nonsystematic delay-discounting data. Exp Clin Psychopharmacol 16: 264–274.
[26]  Peters J, Buchel C (2009) Overlapping and Distinct Neural Systems Code for Subjective Value during Intertemporal and Risky Decision Making. J Neurosci 29: 15727–15734.
[27]  Kim S, Hwang J, Lee D (2008) Prefrontal coding of temporally discounted values during intertemporal choice. Neuron 59: 161–172.
[28]  Monterosso J, Ainslie G (1999) Beyond discounting: possible experimental models of impulse control. Psychopharmacology (Berl) 146: 339–347.
[29]  Figner B, Knoch D, Johnson EJ, Krosch AR, Lisanby SH, et al. (2010) Lateral prefrontal cortex and self-control in intertemporal choice. Nat Neurosci 13: 538–539.
[30]  McClure SM, Laibson DI, Loewenstein G, Cohen JD (2004) Separate neural systems value immediate and delayed monetary rewards. Science 306: 503–507.
[31]  Bjork JM, Momenan R, Hommer DW (2008) Delay Discounting Correlates with Proportional Lateral Frontal Cortex Volumes. Biol Psychiatry 65(8): 710–713.
[32]  Berns GS, Laibson D, Loewenstein G (2007) Intertemporal choice - toward an integrative framework. Trends Cogn Sci 11: 482–488.
[33]  Wittmann M, Paulus MP (2008) Decision making, impulsivity and time perception. Trends Cogn Sci 12: 7–12.
[34]  Radu PT, Yi R, Bickel WK, Gross JJ, McClure SM (2011) A mechanism for reducing delay discounting by altering temporal attention. J Exp Anal Behav 96: 363–385.
[35]  Zauberman G, Kyu Kim B, Malkoc SA, Bettman JR (2009) Discounting Time and Time Discounting: Subjective Time Perception and Intertemporal Preferences. Journal of Marketing Research XLVI: 543–556.
[36]  Kim B, Zauberman G (2009) Perception of Anticipatory Time in Temporal Discounting. Journal of Neuroscience, Psychology, and Economics 2: 91–101.
[37]  Ray D, Bossaerts P (2011) Positive temporal dependence of the biological clock implies hyperbolic discounting. Front Neurosci 5: 2.
[38]  Nakahara H, Kaveri S (2010) Internal-time temporal difference model for neural value-based decision making. Neural Comput 22: 3062–3106.
[39]  McKerchar TL, Green L, Myerson J (2010) On the scaling interpretation of exponents in hyperboloid models of delay and probability discounting. Behav Processes 84: 440–444.
[40]  Read D (2001) Is Time-Discounting Hyperbolic or Subadditive? J Risk Uncertainty 23: 5–32.
[41]  Pine A, Seymour B, Roiser JP, Bossaerts P, Friston KJ, et al. (2009) Encoding of marginal utility across time in the human brain. J Neurosci 29: 9575–9581.
[42]  Stevens SS (1957) On the psychophysical law. Psychol Rev 64: 153–181.
[43]  Laibson D (1997) Golden Eggs and Hyperbolic Discounting. Quart J Econom 112: 443–477.
[44]  McClure SM, Ericson KM, Laibson DI, Loewenstein G, Cohen JD (2007) Time discounting for primary rewards. J Neurosci 27: 5796–5804.
[45]  Pitt MA, Myung IJ (2002) When a good fit can be bad. Trends Cogn Sci 6: 421–425.
[46]  Akaike H (1974) A new look at the statistical model identification. IEEE Transactions on Automatic Control 19: 716–723.
[47]  Schwarz G (1978) Estimating the dimesion of a model. The Annals of Statistics 6: 461–464.
[48]  Lewandowsky S, Farrell S (2011) Computational Modeling in Cognition: Principles and Practice. Thousand Oaks, California: SAGE Publications.
[49]  Peters J, Buchel C (2010) Episodic future thinking reduces reward delay discounting through an enhancement of prefrontal-mediotemporal interactions. Neuron 66: 138–148.
[50]  Miedl SF, Peters J, Buchel C (2012) Altered neural reward representations in pathological gamblers revealed by delay and probability discounting. Arch Gen Psychiatry 69: 177–186.
[51]  Prevost C, Pessiglione M, Metereau E, Clery-Melin ML, Dreher JC (2010) Separate valuation subsystems for delay and effort decision costs. J Neurosci 30: 14080–14090.
[52]  Daw N (2011) Trial by trial data analysis using computational models.; Delgado MR, Phelps EA, Robbins T, editors. Oxford, UK: Oxford University Press. 3–38 p.
[53]  Madden GJ, Bickel WK, Jacobs EA (1999) Discounting of delayed rewards in opioid-dependent outpatients: exponential or hyperbolic discounting functions? Exp Clin Psychopharmacol 7: 284–293.
[54]  Bickel WK, Odum AL, Madden GJ (1999) Impulsivity and cigarette smoking: delay discounting in current, never, and ex-smokers. Psychopharmacology (Berl) 146: 447–454.
[55]  Petry NM, Casarella T (1999) Excessive discounting of delayed rewards in substance abusers with gambling problems. Drug Alcohol Depend 56: 25–32.
[56]  Stephan KE, Penny WD, Daunizeau J, Moran RJ, Friston KJ (2009) Bayesian model selection for group studies. Neuroimage 46: 1004–1017.
[57]  Dixon MR, Marley J, Jacobs EA (2003) Delay discounting by pathological gamblers. J Appl Behav Anal 36: 449–458.
[58]  Petry NM (2001) Pathological gamblers, with and without substance use disorders, discount delayed rewards at high rates. J Abnorm Psychol 110: 482–487.
[59]  Alessi SM, Petry NM (2003) Pathological gambling is associated with impulsivity in a delay discounting procedure. Behav Processes 64: 345–354.
[60]  Glascher J, Hampton AN, O'Doherty JP (2009) Determining a role for ventromedial prefrontal cortex in encoding action-based value signals during reward-related decision making. Cereb Cortex 19: 483–495.
[61]  Pessiglione M, Seymour B, Flandin G, Dolan RJ, Frith CD (2006) Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans. Nature 442: 1042–1045.
[62]  Peters J, Bromberg U, Schneider S, Brassen S, Menz M, et al. (2011) Lower Ventral Striatal Activation During Reward Anticipation in Adolescent Smokers. Am J Psychiatry 168(5): 540–9.
[63]  Pine A, Shiner T, Seymour B, Dolan RJ (2010) Dopamine, time, and impulsivity in humans. J Neurosci 30: 8888–8896.
[64]  Wagenmakers EJ, Farrell S (2004) AIC model selection using Akaike weights. Psychon Bull Rev 11: 192–196.
[65]  Bach DR, Hulme O, Penny WD, Dolan RJ (2011) The known unknowns: neural representation of second-order uncertainty, and ambiguity. J Neurosci 31: 4811–4820.
[66]  Morgan BJT (2009) Applied Stochastic Modelling: Chapman & Hall/CRC.
[67]  Huber DE (2006) Computer simulations of the ROUSE model: an analytic simulation technique and a comparison between the error variance-covariance and bootstrap methods for estimating parameter confidence. Behav Res Methods 38: 557–568.
[68]  Gill J, King G (2004) What to Do When Your Hessian Is Not Invertible. Sociological Methods & Research 33: 54–87.
[69]  Ballard K, Knutson B (2009) Dissociable neural representations of future reward magnitude and delay during temporal discounting. Neuroimage 45: 143–150.
[70]  Green L, Fry A, Myerson J (1994) Discounting of delayed rewards: a life-span comparison. Psychol Sci 5: 33–36.
[71]  Kurth-Nelson Z, Bickel W, Redish AD (2012) A theoretical account of cognitive effects in delay discounting. Eur J Neurosci 35: 1052–1064.
[72]  Grace RC (1999) The Matching Law And Amount-dependent Exponential Discounting As Accounts Of Self-control Choice. J Exp Anal Behav 71: 27–44.
[73]  Scholten M, Read D (2010) The psychology of intertemporal tradeoffs. Psychol Rev 117: 925–944.
[74]  Doyle JR, Chen HC, Savani K (2011) New designs for research in delay discounting. Judgement and Decision Making 6: 759–770.
[75]  Ohmura Y, Takahashi T, Kitamura N, Wehr P (2006) Three-month stability of delay and probability discounting measures. Exp Clin Psychopharmacol 14: 318–328.
[76]  Simpson CA, Vuchinich RE (2000) Reliability of a measure of temporal discounting. The Psychological Record 50: 3–16.
[77]  Kirby KN (2009) One-year temporal stability of delay-discount rates. Psychon Bull Rev 16: 457–462.
[78]  Jimura K, Myerson J, Hilgard J, Keighley J, Braver TS, et al. (2011) Domain independence and stability in young and older adults' discounting of delayed rewards. Behav Processes 87: 253–259.
[79]  Odum AL (2011) Delay discounting: trait variable? Behav Processes 87: 1–9.
[80]  Stewart N, Chater N, Brown GD (2006) Decision by sampling. Cogn Psychol 53: 1–26.
[81]  Ungemach C, Stewart N, Reimers S (2011) How incidental values from the environment affect decisions about money, risk, and delay. Psychol Sci 22: 253–260.

Full-Text

Contact Us

service@oalib.com

QQ:3279437679

WhatsApp +8615387084133