Objective We validate an online, personalized mortality risk measure called “RealAge” assigned to 30 million individuals over the past 10 years. Methods 188,698 RealAge survey respondents were linked to California Department of Public Health death records using a one-way cryptographic hash of first name, last name, and date of birth. 1,046 were identified as deceased. We used Cox proportional hazards models and receiver operating characteristic (ROC) curves to estimate the relative scales and predictive accuracies of chronological age, the RealAge score, and the Framingham ATP-III score for hard coronary heart disease (HCHD) in this data. To address concerns about selection and to examine possible heterogeneity, we compared the results by time to death at registration, underlying cause of death, and relative health among users. Results The RealAge score is accurately scaled (hazard ratios: age 1.076; RealAge-age 1.084) and more accurate than chronological age (age c-statistic: 0.748; RealAge c-statistic: 0.847) in predicting mortality from hard coronary heart disease following survey completion. The score is more accurate than the Framingham ATP-III score for hard coronary heart disease (c-statistic: 0.814), perhaps because self-reported cholesterol levels are relatively uninformative in the RealAge user sample. RealAge predicts deaths from malignant neoplasms, heart disease, and external causes. The score does not predict malignant neoplasm deaths when restricted to users with no smoking history, no prior cancer diagnosis, and no indicated health interest in cancer (p-value 0.820). Conclusion The RealAge score is a valid measure of mortality risk in its user population.
References
[1]
Harris Interactive, Inc (2010) Harris Poll: Cyberchondriacs” on the rise? Those who go online for healthcare information continues to increase.
[2]
Pew Internet and American Life Project (2013) Online Health 2013. Pew Research Center's Internet & American Life Project.
[3]
Morahan-Martin JM (2004) How internet users find, evaluate, and use online health information: a cross-cultural review. CyberPsychology & Behavior 7: 497–510.
[4]
Hesse BW, Nelson DE, Kreps GL, Croyle RT, Arora NK, et al. (2005) Trust and sources of health information: the impact of the Internet and its implications for health care providers: findings from the first Health Information National Trends Survey. Archives of Internal Medicine 165: 2618.
[5]
Sillence E, Briggs P, Harris PR, Fishwick L (2007) How do patients evaluate and make use of online health information? Social Science & Medicine 64: 1853–1862.
[6]
Zulman DM, Kirch M, Zheng K, An LC (2011) Trust in the Internet as a Health Resource Among Older Adults: Analysis of Data from a Nationally Representative Survey. Journal of Medical Internet Research 13: e19.
[7]
Krebs P, Prochaska JO, Rossi JS (2010) A meta-analysis of computer-tailored interventions for health behavior change. Preventive Medicine 51: 214–221.
[8]
Winker MA, Flanagin A, Chi-Lum B, White J, Andrews K, et al. (2000) Guidelines for medical and health information sites on the internet. The Journal of the American Medical Association 283: 1600–1606.
[9]
Eysenbach G, Powell J, Kuss O, Sa ER (2002) Empirical Studies Assessing the Quality of Health Information for Consumerson the World Wide Web. The Journal of the American Medical Asso-ciation 287: 2691–2700.
[10]
Diaz JA, Griffith RA, Ng JJ, Reinert SE, Friedmann PD, et al. (2002) Patients' use of the Internet for medical information. Journal of General Internal Medicine 17: 180–185.
[11]
Schwartz KL, Roe T, Northrup J, Meza J, Seifeldin R, et al. (2006) Family medicine patients' use of the Internet for health information: a MetroNet study. The Journal of the American Board of Family Medicine 19: 39–45.
[12]
World Health Organization (1990) International Statistical Classification of Diseases and Health Related Problems, Tenth Edition. Geneva: World Health Organization.
[13]
Cox DR (1972) Regression models and life-tables. Journal of the Royal Statistical Society Series B (Methodological): 187–220.
[14]
Allison PD (1984) Event history analysis: Regression for longitudinal event data. Sage Publications, Incorporated.
[15]
Steyerberg EW, Vickers AJ, Cook NR, Gerds T, Gonen M, et al. (2010) Assessing the Performance of Prediction Models. Epidemiology 21: 128–138.
[16]
Harrell FE (2001) Regression modeling strategies: with applications to linear models, logistic regression, and survival analysis. New York: Springer.
[17]
Pencina MJ, D' Agostino RB, Vasan RS (2008) Evaluating the added predictive ability of a new marker: From area under the ROC curve to reclassification and beyond. Statistics in Medicine 27: 157–172.
[18]
Cook NR, Paynter NP, Eaton CB, Manson JE, Martin LW, et al. (2012) Comparison of the Fram-ingham and Reynolds Risk Scores for Global Cardiovascular Risk Prediction in the Multiethnic Women's Health Initiative. Circulation 125: 1748–1756.
[19]
Executive Summary of the Third Report of the National Cholesterol Education Program (NCEP) Expert Panel on Detection, Evaluation, and Treatment of High Blood Cholesterol in Adults (Adult Treatment Panel III). The Journal of the American Medical Association 285: 2486–2497.
[20]
Mayer DK, Terrin NC, Kreps GL, Menon U, McCance K, et al. (2007) Cancer survivors information seeking behaviors: A comparison of survivors who do and do not seek information about cancer. Patient Education and Counseling 65: 342–350.
[21]
Hesse BW, Arora NK, Burke Beckjord E, Finney Rutten LJ (2008) Information support for cancer survivors. Cancer 112: 2529–2540.
[22]
Weaver JB III, Mays D, Weaver SS, Hopkins GL, Ero?lu D, et al. (2010) Health Information–Seeking Behaviors, Health Indicators, and Health Risks. American Journal of Public Health 100: 1520–1525.
[23]
Kom EL, Graubard BI, Midthune D (1997) Time-to-Event Analysis of Longitudinal Follow-up of a Survey: Choice of the Time-scale. American Journal of Epidemiology 145: 72–80.
[24]
Thiébaut ACM, Bénichou J (2004) Choice of time-scale in Cox's model analysis of epidemiologic cohort data: a simulation study. Statistics in Medicine 23: 3803–3820.
[25]
Hughes SL, Seymour RB, Campbell RT, Shaw JW, Fabiyi C, et al. (2011) Comparison of Two Health-Promotion Programs for Older Workers. American Journal of Public Health 101: 883–890.