Biomarkers are becoming increasingly important for streamlining drug discovery and development. In addition, biomarkers are widely expected to be used as a tool for disease diagnosis, personalized medication, and surrogate endpoints in clinical research. In this paper, we highlight several important aspects related to study design and statistical analysis for clinical research incorporating biomarkers. We describe the typical and current study designs for exploring, detecting, and utilizing biomarkers. Furthermore, we introduce statistical issues such as confounding and multiplicity for statistical tests in biomarker research.
References
[1]
Ioannidis, J.P.; Panagiotou, O.A. Comparison of effect sizes associated with biomarkers reported in highly cited individual articles and in subsequent meta-analyses. J. Am. Med. Assoc. 2011, 305, 2200–2210, doi:10.1001/jama.2011.713.
[2]
Biomarkers Definitions Working Group. Biomarkers and surrogate endpoints: Preferred definitions and conceptual framework. Clin. Pharmacol. Ther. 2001, 69, 89–95, doi:10.1067/mcp.2001.113989. 11240971
[3]
Frank, R.; Hargreaves, R. Clinical biomarkers in drug discovery and development. Nat. Rev. Drug Discov. 2003, 2, 566–580, doi:10.1038/nrd1130. 12838269
[4]
Hayes, D.F.; Bast, R.C.; Desch, C.E.; Daniel, F.; Fritsche, H.; Kemeny, N.E.; Jessup, J.M.; Locker, G.Y.; Macdonald, J.S.; Mennel, R.G.; et al. Tumor marker utility grading system: A framework to evaluate clinical utility of tumor markers. J. Natl. Cancer Inst. 1996, 88, 1456–1466, doi:10.1093/jnci/88.20.1456. 8841020
[5]
Jenkins, M.; Flynn, A.; Smart, T.; Harbron, C.; Sabin, T.; Ratnayake, J.; Delmar, P.; Herath, A.; Jarvis, P.; Matcham, J. On behalf of the PSI Biomarker Special Interest Group. A statistician's perspective on biomarkers in drug development. Pharm. Stat. 2011, 6, 494–507.
[6]
Ludwig, J.A.; Weinstein, J.N. Biomarkers in cancer staging, prognosis and treatment selection. Nat. Rev. Cancer 2005, 5, 845–856, doi:10.1038/nrc1739. 16239904
[7]
Mega, J.L.; Close, S.L.; Wiviott, S.D.; Shen, L.; Hockett, R.D.; Brandt, J.T.; Walker, J.R.; Antman, E.M.; Macias, W.; Braunwald, E.; Sabatine, M.S. Cytochrome P-450 polymorphisms and response to clopidogrel. N. Engl. J. Med. 2009, 360, 354–362, doi:10.1056/NEJMoa0809171. 19106084
[8]
Simon, R. The use of genomics in clinical trial design. Clin. Cancer Res. 2008, 14, 5984–5993, doi:10.1158/1078-0432.CCR-07-4531. 18829477
[9]
Wang, Z.Y.; Chen, Z. Acute promyelocytic leukemia: From highly fatal to highly curable. Blood 2008, 1, 2505–2515.
[10]
Berger, R.; Huelsman, M.; Strecker, K.; Bojic, A.; Moser, P.; Stanek, B.; Pacher, R. B-type natriuretic peptide predicts sudden death in patients with chronic heart failure. Circulation 2002, 21, 2392–2397.
[11]
Buyse, M.; Michiels, S.; Sargent, D.J.; Grothey, A.; Mateson, A.; de Gramont, A. Integrating biomarkers in clinical trials. Expert Rev. Mol. Diagn. 2011, 11, 171–182, doi:10.1586/erm.10.120. 21405968
[12]
Hayes, D.F.; Trock, B.; Harris, A.L. Assessing the clinical impact of prognostic factors: When is “statistically significant” clinically useful? Breast. Cancer. Res. Treat. 1998, 52, 305–319, doi:10.1023/A:1006197805041. 10066089
[13]
Simon, R.; Altman, D.G. Statistical aspects of prognostic factor studies in oncology. Br. J. Cancer 1994, 69, 979–985, doi:10.1038/bjc.1994.192. 8198989
[14]
Sargent, D.J.; Conley, B.A.; Allegra, C.; Collette, L. Clinical trial designs for predictive marker validation in cancer treatment trials. J. Clin. Oncol. 2005, 23, 2020–2027, doi:10.1200/JCO.2005.01.112. 15774793
[15]
Chakravarty, A.G.; Rothmann, M.; Sridhara, R. Regulatory issues in use of biomarkers in oncology trials. Stat. Biopharm. Res. 2011, 3, 569–576, doi:10.1198/sbr.2011.09026.
[16]
Ando, Y.; Saka, H.; Ando, M.; Sawa, T.; Muro, K.; Ueoka, H.; Yokoyama, A.; Saitoh, H.; Shimokata, K.; Hasegawa, Y. Polymorphisms of UDP-glucuronosyltransferase gene and irinotecan toxicity: A pharmacogenetic analysis. Cancer Res. 2000, 60, 6921–6926. 11156391
[17]
Innocenti, F.; Undevia, S.D.; Iyer, L.; Chen, P.X.; Das, S.; Kocherginsky, M.; Karrison, T.; Janisch, L.; Ramírez, J.; Rubin, C.M.; et al. Genetic variants in the UDP-glucuronosyltransferase 1A1 gene predict the risk of severe neutropenia of irinotecan. J. Clin. Oncol. 2004, 22, 1382–1388, doi:10.1200/JCO.2004.07.173. 15007088
[18]
Marcuello, E.; Altés, A.; Menoyo, A.; Del Rio, E.; Gómez-Pardo, M.; Baiget, M. UGT1A1 gene variations and irinotecan treatment in patients with metastatic colorectal cancer. Br. J. Cancer 2004, 91, 678–682. 15280927
[19]
Rouits, E.; Boisdron-Celle, M.; Dumont, A.; Guerin, O.; Morel, A.; Gamelin, E. Relevance of different UGT1A1 polymorphisms in irinotecan-induced toxicity: A molecular and clinical study of 75 patients. Clin. Cancer Res. 2004, 10, 5151–5159, doi:10.1158/1078-0432.CCR-03-0548. 15297419
Prentice, R.L. Surrogate endpoints in clinical trials: Definitions and operational criteria. Stat. Med. 1989, 8, 431–440, doi:10.1002/sim.4780080407. 2727467
[22]
Fleming, T.R.; DeMets, D.L. Surrogate end points in clinical trials: Are we being misled? Ann. Intern. Med. 1996, 125, 605–613. 8815760
[23]
Mandrekar, S.J.; Sargent, D.J. Clinical trial designs for predictive biomarker validation: Theoretical considerations and practical challenges. J. Clin. Oncol. 2009, 27, 4027–4034, doi:10.1200/JCO.2009.22.3701. 19597023
[24]
Mandrekar, S.J.; Sargent, D.J. Clinical trial designs for predictive biomarker validation: One size does not fit all. J. Biopharm. Stat. 2009, 19, 530–542, doi:10.1080/10543400902802458. 19384694
[25]
Clinical Trials (PDQ？) National Cancer Institute. Available online: http://www.cancer.gov/clinicaltrials/CALGB-30506 (accessed on 31 May 2012).
[26]
Potti, A.; Mukherjee, S.; Petersen, R.; Dressman, H.K.; Bild, A.; Koontz, J.; Kratzke, R.; Watson, M.A.; Kelley, M.; Ginsburg, G.S.; et al. A genomic strategy to refine prognosis in early-stage non-small-cell lung cancer. N. Engl. J. Med. 2006, 355, 570–580, doi:10.1056/NEJMoa060467. 16899777
[27]
Freidlin, B.; McShane, L.M.; Korn, E.L. Randomized clinical trials with biomarkers: Design issues. J. Natl. Cancer Inst. 2010, 102, 152–160, doi:10.1093/jnci/djp477. 20075367
[28]
Hoering, A.; LeBlanc, M.; Crowley, J.J. Randomized Phase III clinical trial designs for targeted agents. Clin. Cancer Res. 2008, 14, 4358–4367, doi:10.1158/1078-0432.CCR-08-0288. 18628448
Young, K.Y.; Laird, A.; Zhou, X.H. The efficiency of clinical trial designs for predictive biomarker validation. Clin. Trials 2010, 7, 557–566, doi:10.1177/1740774510370497. 20571132
[31]
Clinicaltrials.gov: NCT00174629. GILT docetaxel—non-small cell lung cancer. Available online: http://clinicaltrials.gov/ct2/results?term=NCT00174629 (accessed on 13 March 2012).
[32]
Cobo, M.; Isla, D.; Massuti, B.; Montes, A.; Sanchez, J.M.; Provencio, M.; Vi？olas, N.; Paz-Ares, L.; Lopez-Vivanco, G.; Mu？oz, M.A.; et al. Customizing cisplatin based on quantitative excision repair cross-complementing 1 mRNA expression: A Phase III trial in non-small-cell lung cancer. J. Clin. Oncol. 2007, 25, 2747–2754, doi:10.1200/JCO.2006.09.7915. 17602080
[33]
Simon, R.; Maitournam, A. Evaluating the efficiency of targeted designs for randomized clinical trials. Clin. Cancer Res. 2004, 10, 6759–6763, doi:10.1158/1078-0432.CCR-04-0496. 15501951
[34]
Chow, S.C.; Liu, J.P. Designs for Clinical Trials. Designs for Clinical Trials. In Design and Analysis of Clinical Trials, 2nd ed. ed.; Wiley & Sons: New York, NY, USA, 2004; pp. 194–214.
[35]
Slamon, D.J.; Leyland-Jones, B.; Shak, S.; Fuchs, H.; Paton, V.; Bajamonde, A.; Fleming, T.; Eiermann, W.; Wolter, J.; Pegram, M.; et al. Use of chemotherapy plus a monoclonal antibody against HER2 for metastatic breast cancer that overexpresses HER2. N. Engl. J. Med. 2001, 344, 783–792, doi:10.1056/NEJM200103153441101. 11248153
[36]
Piccart-Gebhart, M.J.; Procter, M.; Leyland-Jones, B.; Goldhirsch, A.; Untch, M.; Smith, I.; Gianni, L.; Baselga, J.; Bell, R.; Jackisch, C.; et al. Trastuzumab after adjuvant chemotherapy in HER2-positive breast cancer. N. Engl. J. Med. 2005, 353, 1659–1672, doi:10.1056/NEJMoa052306. 16236737
[37]
Cronin, M.; Sangli, C.; Liu, M.L.; Pho, M.; Dutta, D.; Nguyen, A.; Jeong, J.; Wu, J.; Langone, K.C.; Watson, D. Analytical validation of the Oncotype DX genomic diagnostic test for recurrence prognosis and therapeutic response prediction in node-negative, estrogen receptor-positive breast cancer. Clin. Chem. 2007, 53, 1084–1091, doi:10.1373/clinchem.2006.076497. 17463177
[38]
Paik, S.; Shak, S.; Tang, G.; Kim, C.; Baker, J.; Cronin, M.; Baehner, F.L.; Walker, M.G.; Watson, D.; Park, T.; et al. A multigene assay to predict recurrence of tamoxifen-treated, node-negative breast cancer. N. Engl. J. Med. 2004, 351, 2817–2826, doi:10.1056/NEJMoa041588. 15591335
[39]
Paik, S.; Tang, G.; Shak, S.; Kim, C.; Baker, J.; Kim, W.; Cronin, M.; Baehner, F.L.; Watson, D.; Bryant, J.; et al. Gene expression and benefit of chemotherapy in women with node-negative, estrogen receptorpositive breast cancer. J. Clin. Oncol. 2006, 24, 3726–3734, doi:10.1200/JCO.2005.04.7985. 16720680
[40]
Sparano, J.A.; Paik, S. Development of the 21-gene assay and its application in clinical practice and clinical trials. J. Clin. Oncol. 2008, 26, 721–728, doi:10.1200/JCO.2007.15.1068. 18258979
[41]
Zujewski, J.A.; Kamin, L. Trial assessing individualized options for treatment for breast cancer: The TAILORx trial. Future Oncol. 2008, 4, 603–610, doi:10.2217/14796694.4.5.603. 18922117
[42]
Freidlin, B.; Simon, R. Adaptive signature design: An adaptive clinical trial design for generating and prospectively testing a gene expression signature for sensitive patients. Clin. Cancer Res. 2005, 11, 7872–7878, doi:10.1158/1078-0432.CCR-05-0605. 16278411
[43]
Freidlin, B.; Jiang, W.; Simon, R. The cross-validated adaptive signature design. Clin. Cancer Res. 2010, 16, 691–698, doi:10.1158/1078-0432.CCR-09-1357. 20068112
[44]
Jiang, W.; Freidlin, B.; Simon, R. Biomarker adaptive threshold design: A procedure for evaluating treatment with possible biomarker-defined subset effect. J. Natl. Cancer Inst. 2007, 99, 1036–1043, doi:10.1093/jnci/djm022. 17596577
[45]
Wang, S.J.; O'Neill, R.T.; Hung, H.M.J. Approaches to evaluation of treatment effect in randomized clinical trials with genomic subset. Pharm. Stat. 2007, 6, 227–244, doi:10.1002/pst.300. 17688238
[46]
Zhou, X.; Liu, S.; Kim, E.S.; Herbst, R.S.; Lee, J.J. Bayesian adaptive design for targeted therapy development in lung cancer: A step towards personalized medicine. Clin. Trials 2008, 5, 181–193, doi:10.1177/1740774508091815. 18559407
[47]
Albert, J.H.; Chib, S. Bayesian analysis of binary and polychotomous response Data. J. Am. Stat. Assoc. 1993, 88, 669–679, doi:10.1080/01621459.1993.10476321.
[48]
Food and Drug Administration. Guidance for industry and FDA staff: Guidance for the use of bayesian statistics in medical device clinical trials. Available online: http://www.fda.gov/downloads/MedicalDevices/DeviceRegulationandGuidance/GuidanceDocuments/ucm071121.pdf (accessed on 31 May 2012).
[49]
Korn, E.L.; Midthune, D.; Chen, T.T.; Rubinstein, L.V.; Christian, M.C.; Simon, R.M. A comparison of two phase I trial designs. Stat. Med. 1994, 13, 1799–1806, doi:10.1002/sim.4780131802. 7997713
[50]
Chow, S.C. Encyclopedia of Biopharmaceutical Statistics; Marcel Dekker: New York, NY, USA, 2000; p. 245.
[51]
Lagakos, S.W. The challenge of subgroup analyses—Reporting without distorting. N. Engl. J. Med. 2006, 354, 1667–1669, doi:10.1056/NEJMp068070. 16625007
[52]
Cox, D.R. Regression models and life-tables. J. Roy. Stat. Soc. B. Met. 1972, 34, 187–220.
[53]
Assmann, S.F.; Pocock, S.J.; Enos, L.E.; Kasten, L.E. Subgroup analysis and other (mis)uses of baseline data in clinical trials. Lancet 2000, 355, 1064–1069, doi:10.1016/S0140-6736(00)02039-0. 10744093
[54]
Chen, J.J.; Roberson, P.K.; Schell, M.J. The false discovery rate: A key concept in large-scale genetic studies. Cancer Control 2010, 17, 58–62. 20010520
[55]
Lehmann, E.L.; Romano, J.P. Testing Statistical Hypotheses, 3rd ed. ed.; Springer-Verlag: New York, NY, USA, 2005.
Bauer, P. Multiple testing in clinical trials. Stat. Med. 1991, 10, 871–890, doi:10.1002/sim.4780100609. 1831562
[58]
Benjamini, Y.; Hochberg, Y. Controlling the false discovery rate: A practical and powerful approach to multiple testing. J. Roy. Stat. Soc. B 1995, 57, 289–300.
[59]
Westfall, P.H.; Young, S.S. Resampling-Based Multiple Testing: Examples and Methods for P-Value Adjustment; Wiley & Sons: New York, NY, USA, 1993.
[60]
Godfrey, K.A.M. Comparing the means of several groups. N. Engl. J. Med. 1985, 313, 1450–1456, doi:10.1056/NEJM198512053132305. 4058548
[61]
Hochberg, Y.; Tamhane, A.C. Multiple Comparison Procedures; Wiley & Sons: New York, NY, USA, 1987.
[62]
Miller, R.G. Simultaneous Statistical Inference, 2nd ed. ed.; Springer-Verlag: New York, NY, USA, 1981.
[63]
Tamhane, A.C. Multiple Comparisons. In Handbook of Statistics; Gosh, S., Rao, C.R., Eds.; Elsevier Science Publishing Company: North-Holland, The Netherlands, 1996; Volume 13, pp. 587–630.
[64]
ICH E9 Expert Working Group. Statistical principles for clinical trials: ICH harmonized tripartite guideline. Stat. Med. 1999, 18, 1905–1942. 10532877
