It is well-known that the
power of Cochran’s Q test to assess the presence of heterogeneity among
treatment effects in a clinical meta-analysis is low due to the small number of
studies combined. Two modified tests (PL1, PL2) were proposed by replacing the profile maximum
likelihood estimator (PMLE) into the variance formula of logarithm of risk
ratio in the standard chi-square test statistic for testing the null common
risk ratios across all k studies (i = 1, L, k). The simply naive test (SIM)
as another comparative candidate has considerably arisen. The performance of
tests in terms of type I error rate under the null hypothesis and power of test
under the random effects hypothesis was done via a simulation plan with various
combinations of significance levels, numbers of studies, sample sizes in
treatment and control arms, and true risk ratios as effect sizes of interest.
The results indicated that for moderate to large study sizes (k？≥ 16)？in combination with
moderate to large sample sizes？(？≥ 50), three tests (PL1,
References
[1]
Lipsitz, S.R., Dear, K.B.G., Laird, N.M. and Molenberghs, G. (1998) Tests for Homogeneity of the Risk Difference When Data Are Sparse. Biometrics, 54, 148-160.
https://doi.org/10.2307/2534003
[2]
Lui, K.J. (2007) Testing Homogeneity of the Risk Ratio in Stratified Noncompliance Randomized Trials. Contemporary Clinical Trials, 28, 614-625.
https://doi.org/10.1016/j.cct.2007.02.010
[3]
Smolinsky, L. and Marx, B.D. (2018) Odds Ratios, Risk Ratios, and Bornmann and Haunschild’s New Indicators. Journal of Informetrics, 12, 732-735.
https://doi.org/10.1016/j.joi.2018.06.011
[4]
Améndola, C., et al. (2019) The Maximum Likelihood Degree of Historic Varieties. Journal of Symbolic Computation, 92, 222-242.
https://doi.org/10.1016/j.jsc.2018.04.016
[5]
Kulinskaya, E. and Dollinger, M.B. (2015) An Accurate Test for Homogeneity of Odds Ratios Based on Cochran’s Q-Statistic. BMC Medical Research Methodology, 15, 49. https://doi.org/10.1186/s12874-015-0034-x
[6]
Boissel, J.-P., Blanchard, J., Panak, E., Peyrieux, J.-C. and Sacks, H. (1989) Considerations for the Meta-Analysis of Randomized Clinical Trials: Summary of a Panel Discussion. Controlled Clinical Trials, 10, 254-281.
https://doi.org/10.1016/0197-2456(89)90067-6
[7]
Kulinskaya, E., Dollinger, M.B. and Bjorkestol, K. (2011) On the Moments of Cochran's Q Statistic under the Null Hypothesis with Application to the Meta-Analysis of Risk Difference. Research Synthesis Methods, 2, 254-270.
https://doi.org/10.1002/jrsm.54
[8]
Fleiss, J.L. (1986) Analysis of Data from Multiclinic Trials. Controlled Clinical Trials, 7, 267-275. https://doi.org/10.1016/0197-2456(86)90034-6
[9]
Shadish, W.R. and Haddock, C.K. (1994) The Handbook of Research Synthesis. Russell Sage Foundation.
[10]
Ferrari, S.L., Lucambio, F. and Cribari-Neto, F. (2005) Improved Profile Likelihood Inference. Journal of Statistical Planning and Inference, 134, 373-391.
https://doi.org/10.1016/j.jspi.2004.05.001
[11]
Bohnimg, D., Kuhnert, R. and Rattanasiri, S. (2008) Meta-Analysis of Binary Data Using Profile Likelihood. Chapman & Hall/CRC Press, Boca Raton.
[12]
Farquhar, C.M., Marjoribanks, J., Lethaby, A. and Basser, R. (2007) High Dose Chemotherapy for Poor Prognosis Breast Cancer: Systematic Review and Meta-Analysis. Cancer Treatment Reviews, 33, 325-337.
https://doi.org/10.1016/j.ctrv.2007.01.007
[13]
Schwarzer, G. (2007) Meta: An R Package for Meta-Analysis. R News, 7, 40–45.
https://cran.r-project.org/doc/Rnews/Rnews_2007-3.pdf
[14]
Mottillo, S., Filion, K.B., Genest, J., Joseph, L., Pilote, L., Poirier, P., et al. (2010) The Metabolic Syndrome and Cardiovascular Risk: A Systematic Review and Meta-Analysis. Journal of the American College of Cardiology, 56, 1113-1132.
https://doi.org/10.1016/j.jacc.2010.05.034
[15]
Bradley, J. (1978) Robustness? British Journal of Mathematical and Statistical Psychology, 31, 144-152. https://doi.org/10.1111/j.2044-8317.1978.tb00581.x
[16]
Mathes, T. and Kuss, O. (2018) A Comparison of Methods for Meta-Analysis of a Small Number of Studies with Binary Outcomes. Research Synthesis Methods, 9.
https://doi.org/10.1002/jrsm.1296
[17]
Willis, B.H. and Riley, R.D. (2017) Measuring the Statistical Validity of Summary Meta-Analysis and Meta-Regression Results for Use in Clinical Practice. Statistics in Medicine, 36, 3283-3301. https://doi.org/10.1002/sim.7372
[18]
Bagheri, Z., Ayatollahi, S.M.T. and Jafari, P. (2011) Comparison of Three Tests of Homogeneity of Odds Ratios in Multicenter Trials with Unequal Sample Sizes within and among Centers. BMC Medical Research Methodology, 11, 58.
https://doi.org/10.1186/1471-2288-11-58
[19]
Viechtbauer, W. (2007) Hypothesis Tests for Population Heterogeneity in Meta-Analysis. British Journal of Mathematical and Statistical Psychology, 60, 29-60.
https://doi.org/10.1186/1471-2288-11-58
![\"\"](\"Edit_4424cc50-e4d1-4fb1-87f5-f260059ec34f.bmp\")
