Background The Continuous Performance Test-Identical Pairs version (CPT-IP) is a well-established measure of sustained attention, and its more challenging versions are particularly suited to detect subtle processing deficits in patients with schizophrenia. However, while there are few longitudinal samples for the CPT-IP, no study has addressed stability for more than two month in patients with schizophrenia. Assessing long-term test-retest reliability of the CPT-IP would facilitate the ability of clinicians to draw conclusions from studies involving interventions as long term cognitive or pharmacological treatments. The present study assessed 12 month test-retest reliability for the two most challenging versions of CPT-IP (4-digit and shapes) in a matched sample of clinically stable schizophrenia outpatients and healthy controls. Methods Fifty clinically stable schizophrenia outpatients and 50 healthy controls were assessed with the CPT-IP for the 4-digit and shape conditions. From these, 40 patients and 47 controls were reassessed with an average interval of 12.3 months between test sessions. Test-retest reliability was analyzed with Pearson correlations and results were compared with previous data involving healthy controls and short-term studies in patients with schizophrenia. Results Especially d’ and hit rate discriminated well between patients with schizophrenia and healthy controls for both CPT-IP conditions and at both test sessions. Healthy controls demonstrated sufficient long term test-retest correlations of d’, hit rate and reaction time for both the 4-digit and shape conditions. However, in schizophrenia patients, long-term reliability correlations were at best moderate for d’ and hit rate only. Conclusions The current study provides further evidence that d’ and hit rate yield consistent cross-sectional discrimination sensitivity. At best moderate long-term test-retest reliability of d’ in schizophrenia outpatients may be not sufficient for practical use of this measure in long term clinical trials.
References
[1]
Green MF, Kern RS, Heaton RK (2004) Longitudinal studies of cognition and functional outcome in schizophrenia: implications for MATRICS. Schizophr Res 72: 41–51.
[2]
Shamsi S, Lau A, Lencz T, Burdick KE, DeRosse P, et al. (2011) Cognitive and symptomatic predictors of functional disability in schizophrenia. Schizophr Res 126 (1–3): 257–264.
[3]
Cornblatt BA, Malhotra AK (2001) Impaired attention as an endophenotype for molecular genetic studies of schizophrenia. Am J Med Genet 105(1): 11–5.
[4]
Cornblatt BA, Lenzenweger MF, Erlenmeyer-Kimling L (1989) The continuous performance test, identical pairs version: II. Contrasting attentional profiles in schizophrenic and depressed patients. Psychiatry Res 29(1): 65–85.
[5]
Kumar CT, Christodoulou T, Vyas NS, Kyriakopoulos M, Corrigall R, et al. (2010) Deficits in visual sustained attention differentiate genetic liability and disease expression for schizophrenia from Bipolar Disorder. Schizophr Res 124(1–3): 152–60.
[6]
Cornblatt BA, Risch NJ, Faris G, Friedman D, Erlenmeyer-Kimling L (1988) The Continuous Performance Test, identical pairs version (CPT-IP): I. New findings about sustained attention in normal families. Psychiatry Res 26(2): 223–38.
[7]
Cornblatt BA, Keilp JG (1994) Impaired attention, genetics, and the pathophysiology of schizophrenia. Schizophr Bull 20(2): 248.
[8]
Salgado-Pineda P, Baeza I, Pérez-Gómez M, Vendrell P, Junqué C, et al. (2003) Sustained attention impairment correlates to gray matter decreases in first episode neuroleptic-naive schizophrenic patients. Neuroimage 19: 365–75.
[9]
Roitman SE, Cornblatt BA, Bergman A, Obuchowski M, Mitropoulou V, et al. (1997) Attentional functioning in schizotypal personality disorder. Am J Psychiatry 154(5): 655–60.
[10]
Kurtz MM, Ragland JD, Bilker W, Gur RC, Gur RE (2001) Comparison of the continuous performance test with and without working memory demands in healthy controls and patients with schizophrenia. Schizophr Res 48: 307–316.
[11]
Gooding DC, Matts CW, Rollmann EA (2006) Sustained attention deficits in relation to psychometrically identified schizotypy: evaluating a potential endophenotypic marker. Schizophr Res 82: 27–37.
[12]
Franke P, Maier W, Hardt J, Hain C, Cornblatt BA (1994) Attentional abilities and measures of schizotypy: their variation and covariation in schizophrenic patients, their siblings, and normal control subjects. Psychiatry Res 54(3): 259–72.
[13]
Chen WJ, Faraone SV (2000) Sustained attention deficits as markers of genetic susceptibility to schizophrenia. Am J Med Genet 97(1): 52–57.
[14]
Keefe RS, Fox KH, Harvey PD, Cucchiaro J, Siu C, et al. (2011) Characteristics of the MATRICS Consensus Cognitive Battery in a 29-site antipsychotic schizophrenia clinical trial. Schizophr Res 125(2–3): 161–168.
[15]
Nuechterlein KH, Green MF, Kern RS, Baade LE, Barch D, et al. (2008) The MATRICS Consensus Cognitive Battery, part 1: test selection, reliability, and validity. Am J Psychiatry 165(2): 203–213.
[16]
Kahn PV, Walker TM, Williams TS, Cornblatt BA, Mohs RC, et al. (2012) Standardizing the use of the Continuous Performance Test in schizophrenia research: A validation study. Schizophr Res 142: 153–158.
[17]
Oldfield RC (1971) The assessment and analysis of handedness: The Edinburgh Inventory. Neuropsychologia 9: 97–113.
[18]
Kay SR, Fiszbein A, Opher LA (1987) The positive and negative syndrome scale (PANSS) for schizophrenia. Schizophr Bull 13(2): 261–276.
[19]
Leucht S, Kane JM, Kissling W, Hamann J, Etschel E, et al. (2005) What does the PANSS mean? Schizophr Res 79: 231–238.
[20]
Andreasen NC, Pressler M, Nopoulos P, Miller D, Ho BC (2010) Antipsychotic dose equivalents and dose-years: a standardized method for comparing exposure to different drugs. Biol Psychiatry 67: 255–262.
[21]
Sheehan DV, Lecrubrier Y, Sheehan KH, Amorim P, Janavs J, et al. (1998) The Mini-International Neuropsychiatric Interview (M.I.N.I.): the development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. J Clin Psychiatry 59: 22–33.
[22]
Altman DG (1991) Practical statistics for medical research. Chapman and Hall, Padstow, Cornwall.
[23]
Bergida H, Lenzenweger MF (2006) Schizotypy and sustained attention: confirming evidence from an adult community sample. J Abnorm Psychol 115 (3): 545–51.
[24]
Thaden E, Rhinewine JP, Lencz T, Kester H, Cervellione KL, et al. (2006) Early-onset schizophrenia is associated with impaired adolescent development of attentional capacity using the identical pairs continuous performance test. Schizophr Res 81(2–3): 157–66.
[25]
Barch D, Keefe RS (2010) Anticipating DSM-V: Opportunities and challenges for cognition and psychosis. Schizophr Bull 36: 43–47.
[26]
Rajiv T, Gaebel W, Barch DM, Bustillo J, Gur RE, et al. (2013) Definition and description of schizophrenia in the DSM-5. Schizophr Res. 150(1): 3–10.
[27]
Pietrzak RH, Snyder PJ, Jackson CE, Olver J, Norman T, et al. (2009) Stability of cognitive impairment in chronic schizophrenia over brief and intermediate re-test intervals. Hum Psychopharmacol Clin Exp 24: 113–121.
[28]
Barnett JH, Croudace TJ, Jaycock S, Blackwell C, Hynes F, et al. (2007) Improvement and decline of cognitive function in schizophrenia over one year: a longitudinal investigation using latent growth modeling BMC Psychiatry. 7: 16.
[29]
Miles AA, Heinrichs RW, Ammari N, Hartman L, McDermid Vaz S et al.. (2013) Stability and change in symptoms, cognition, and community outcome in schizophrenia. Schizophr Res Sep 27. doi: 10.1016/j.schres.2013.09.006.
[30]
Rodríguez-Sánchez JM, Ayesa-Arriola R, Pérez-Iglesias R, Peria？ez JA, Martinez-Garcia O, et al. (2013) Course of cognitive deficits in first episode of non-affective psychosis: A 3-year follow-up study. Schizophr Res. 150(1): 121–8.
[31]
Roalf DR, Gur RC, Almasy L, Richard J, Gallagher RS, et al. (2013) Neurocognitive Performance Stability in a Multiplex Multigenerational Study of Schizophrenia. Schizophr Bull 39(5): 1008–17.
[32]
Nunnally JC, Bernstein IH (1994) Psychometric theory (third edition). New York, McGraw Hill.
[33]
Cicchetti DV (1999) Sample size requirements for increasing the precision of reliability estimates: Problems and proposed solutions. J Clin Exp Neuropsychol 21: 567–570.
[34]
Cicchetti DV (2001) The Precision of Reliability and Validity Estimates Re-Visited: Distinguishing Between Clinical and Statistical Significance of Sample Size Requirements. J Clin Exp Neuropsychol 23: 695–700.
