Objective We evaluated the validity of physician billing claims to identify deceased organ donors in large provincial healthcare databases. Methods We conducted a population-based retrospective validation study of all deceased donors in Ontario, Canada from 2006 to 2011 (n = 988). We included all registered deaths during the same period (n = 458,074). Our main outcome measures included sensitivity, specificity, positive predictive value, and negative predictive value of various algorithms consisting of physician billing claims to identify deceased organ donors and organ-specific donors compared to a reference standard of medical chart abstraction. Results The best performing algorithm consisted of any one of 10 different physician billing claims. This algorithm had a sensitivity of 75.4% (95% CI: 72.6% to 78.0%) and a positive predictive value of 77.4% (95% CI: 74.7% to 80.0%) for the identification of deceased organ donors. As expected, specificity and negative predictive value were near 100%. The number of organ donors identified by the algorithm each year was similar to the expected value, and this included the pre-validation period (1991 to 2005). Algorithms to identify organ–specific donors performed poorly (e.g. sensitivity ranged from 0% for small intestine to 67% for heart; positive predictive values ranged from 0% for small intestine to 37% for heart). Interpretation Primary data abstraction to identify deceased organ donors should be used whenever possible, particularly for the detection of organ-specific donations. The limitations of physician billing claims should be considered whenever they are used.
References
[1]
Abouna GM (2008) Organ Shortage Crisis: Problems and Possible Solutions. Transplantation Proceedings 40: 34–38 doi:10.1016/j.transproceed.2007.11.067.
[2]
CIHI - e-Statistics Report on Transplant, Waiting List and Donor Statistics (2011) (n.d.). Available: http://www.cihi.ca/CIHI-ext-portal/inter？net/en/document/typesofcare/specializeds？ervices/organreplacements/report_stats20？11. Accessed 2013 Mar 4.
[3]
Schold JD, Segev DL (2012) Increasing the pool of deceased donor organs for kidney transplantation. Nature Reviews Nephrology 8: 325–331.
[4]
Garcia-Valdecasas JC (2012) European approach to increasing organ donation: European Union donor card, presumed consent, and other innovations. Liver Transplantation 18: S8–S9 doi:10.1002/lt.23538.
[5]
Benchimol EI, Manuel DG, To T, Griffiths AM, Rabeneck L, et al. (2011) Development and use of reporting guidelines for assessing the quality of validation studies of health administrative data. Journal of Clinical Epidemiology 64: 821–829 doi:10.1016/j.jclinepi.2010.10.006.
[6]
Woodworth GF, Baird CJ, Garces-Ambrossi G, Tonascia J, Tamargo RJ (2009) Inaccuracy of the administrative database: comparative analysis of two databases for the diagnosis and treatment of intracranial aneurysms. Neurosurgery 65: 251–256 discussion 256–257. doi:10.1227/01.NEU.0000347003.35690.7A.
[7]
Antoniou T, Zagorski B, Loutfy MR, Strike C, Glazier RH (2011) Validation of Case-Finding Algorithms Derived from Administrative Data for Identifying Adults Living with Human Immunodeficiency Virus Infection. PLoS ONE 6: e21748 doi:10.1371/journal.pone.0021748.
[8]
Nosyk B, Colley G, Yip B, Chan K, Heath K, et al. (2013) Application and Validation of Case-Finding Algorithms for Identifying Individuals with Human Immunodeficiency Virus from Administrative Data in British Columbia, Canada. PLoS ONE 8: e54416 doi:10.1371/journal.pone.0054416.
[9]
Tamblyn R, Reid T, Mayo N, McLeod P, Churchill-Smith M (2000) Using medical services claims to assess injuries in the elderly: sensitivity of diagnostic and procedure codes for injury ascertainment. Journal of clinical epidemiology 53: 183–194.
[10]
Quan H, Li B, Duncan Saunders L, Parsons GA, Nilsson CI, et al. (2008) Assessing Validity of ICD-9-CM and ICD-10 Administrative Data in Recording Clinical Conditions in a Unique Dually Coded Database. Health Serv Res 43: 1424–1441 doi:10.1111/j.1475-6773.2007.00822.x.
[11]
Fleet JL, Shariff SZ, Gandhi S, Weir MA, Jain AK, et al. (2012) Validity of the International Classification of Diseases 10th revision code for hyperkalaemia in elderly patients at presentation to an emergency department and at hospital admission. BMJ Open 2 doi:10.1136/bmjopen-2012-002011.
[12]
Sheehy E, Conrad SL, Brigham LE, Luskin R, Weber P, et al. (2003) Estimating the Number of Potential Organ Donors in the United States. New England Journal of Medicine 349: 667–674 doi:10.1056/NEJMsa021271.
[13]
Ontario Fact Sheet July 2012 (n.d.). Available: http://www.fin.gov.on.ca/en/economy/ecup？dates/factsheet.html. Accessed 2012 July 11.
[14]
CIHI - DAD Metadata (n.d.). Available: http://www.cihi.ca/CIHI-ext-portal/inter？net/en/document/typesofcare/hospitalcare？/acutecare/dad_metadata#. Accessed 2012 Dec 17.
[15]
Garg AX, Iansavichus AV, Wilczynski NL, Kastner M, Baier LA, et al. (2009) Filtering Medline for a clinical discipline: diagnostic test assessment framework. BMJ 339: b3435–b3435 doi:10.1136/bmj.b3435.
[16]
Newcombe RG (1998) Two-sided confidence intervals for the single proportion: comparison of seven methods. Statistics in Medicine 17: 857–872 doi:;10.1002/(SICI)1097-0258(19980430)17:8<85？7::AID-SIM777>3.0.CO;2-E.
[17]
Ooba N, Setoguchi S, Ando T, Sato T, Yamaguchi T, et al. (2013) Claims-Based Definition of Death in Japanese Claims Database: Validity and Implications. PLoS ONE 8: e66116 doi:10.1371/journal.pone.0066116.
[18]
Duffy SW, Warwick J, Williams ARW, Keshavarz H, Kaffashian F, et al. (2004) A simple model for potential use with a misclassified binary outcome in epidemiology. J Epidemiol Community Health 58: 712–717 doi:10.1136/jech.2003.010546.
[19]
Boucek MM, Mashburn C, Dunn SM, Frizell R, Edwards L, et al. (2008) Pediatric Heart Transplantation after Declaration of Cardiocirculatory Death. New England Journal of Medicine 359: 709–714 doi:10.1056/NEJMoa0800660.
[20]
Hammill BG, Hernandez AF, Peterson ED, Fonarow GC, Schulman KA, et al. (2009) Linking inpatient clinical registry data to Medicare claims data using indirect identifiers. American Heart Journal 157: 995–1000 doi:10.1016/j.ahj.2009.04.002.
[21]
Redelmeier DA, Markel F, Scales DC (2013) Organ donation after death in Ontario: a population-based cohort study. CMAJ Available: http://www.cmaj.ca/content/early/2013/04？/02/cmaj.122047. Accessed 2013 Apr 7.
[22]
Meyfroidt G, Güiza F, Ramon J, Bruynooghe M (2009) Machine learning techniques to examine large patient databases. Best Practice & Research Clinical Anaesthesiology 23: 127–143 doi:10.1016/j.bpa.2008.09.003.
[23]
Gandhi S, Shariff SZ, Fleet JL, Weir MA, Jain AK, et al. (2012) Validity of the International Classification of Diseases 10th revision code for hospitalisation with hyponatraemia in elderly patients. BMJ Open 2 doi:10.1136/bmjopen-2012-001727.
[24]
Moist LM, Richards HA, Miskulin D, Lok CE, Yeates K, et al. (2011) A Validation Study of the Canadian Organ Replacement Register. CJASN 6: 813–818 doi:10.2215/CJN.06680810.
[25]
Guttmann A, Nakhla M, Henderson M, To T, Daneman D, et al. (2010) Validation of a health administrative data algorithm for assessing the epidemiology of diabetes in Canadian children. Pediatric Diabetes 11: 122–128 doi:10.1111/j.1399-5448.2009.00539.x.
[26]
Hwang YJ, Shariff SZ, Gandhi S, Wald R, Clark E, et al. (2012) Validity of the International Classification of Diseases, Tenth Revision code for acute kidney injury in elderly patients at presentation to the emergency department and at hospital admission. BMJ open Available: http://bmjopen.bmj.com/content/2/6/e0018？21.short. Accessed 2013 May 2.
[27]
Widdifield J, Bernatsky S, Paterson JM, Tu K, Ng R, et al. (2013) Accuracy of Canadian health administrative databases in identifying patients with rheumatoid arthritis: A validation study using the medical records of rheumatologists. Arthritis Care & Research n/a–n/a doi:10.1002/acr.22031.
