In a previous article, an R script was developed and divided into three parts to implement the multivariate normality (MVN) Q-test based on both the chi-square approximation and the bootstrap approach, using either the Shapiro-Wilk W statistic (QSWa and QSWb) or the Shapiro-Francia W’ statistic (QSFa and QSFb). Royston’s H-test was included as a supplementary MVN test. The aim of this study is to compare the hit rate and statistical power of the four Q-test variants and the H-test using 200 samples drawn from multivariate standard normal distributions and 200 samples from multivariate t-distributions with five degrees of freedom. The simulations vary in sample size (50, 75, 100, 125, 150, 200, 250, and 500), number of variables (from 2 to 6), and homogeneous inter-variable correlation (0, 0.3, 0.5, 0.7, and 0.9). The H-test outperformed QSWb and QSFb, but not QSWa in the multivariate normal samples or QSFa in the multivariate t-distribution samples. QSFb performed better than QSWb. It is concluded that the bootstrap approach is conservative under the null hypothesis of multivariate normality. However, when the assumption of independence is violated, the bootstrap approach is theoretically more appropriate than QSWa and QSFa. A 10% significance level is recommended for QSFb in terms of hit rate, but in terms of statistical power, only when rejecting the null hypothesis.
References
[1]
Moral, J. (2025) MVN Q-Test I: A Bootstrap-Based Implementation in R. Journal of Data Analysis and Information Processing, 13, 389-424. https://doi.org/10.4236/jdaip.2025.134024
[2]
Rubia, J.M.L. (2023) Proposal and Pilot Study: A Generalization of the W or W’ Statistic for Multivariate Normality. OpenJournalofStatistics, 13, 119-169. https://doi.org/10.4236/ojs.2023.131008
[3]
Royston, P. (1992) Approximating the Shapiro-Wilk W-Test for Non-Normality. StatisticsandComputing, 2, 117-119. https://doi.org/10.1007/bf01891203
[4]
Shapiro, S.S. and Wilk, M.B. (1965) An Analysis of Variance Test for Normality (Complete Samples). Biometrika, 52, 591‑611. https://doi.org/10.2307/2333709
[5]
Royston, P. (1993) A Toolkit for Testing for Non-Normality in Complete and Censored Samples. TheStatistician, 42, 37‑43. https://doi.org/10.2307/2348109
[6]
Shapiro, S.S. and Francia, R.S. (1972) An Approximate Analysis of Variance Test for Normality. JournaloftheAmericanStatisticalAssociation, 67, 215-216. https://doi.org/10.1080/01621459.1972.10481232
[7]
Royston, J.P. (1983) Some Techniques for Assessing Multivarate Normality Based on the Shapiro-Wilk W. AppliedStatistics, 32, 121‑133. https://doi.org/10.2307/2347291
[8]
Jobst, L.J., Bader, M. and Moshagen, M. (2023) A Tutorial on Assessing Statistical Power and Determining Sample Size for Structural Equation Models. PsychologicalMethods, 28, 207-221. https://doi.org/10.1037/met0000423
[9]
Braun, W.J. and Murdoch, D.J. (2021) A First Course in Statistical Programming with R. 3rd Edition, Cambridge University Press. https://doi.org/10.1017/9781108993456
[10]
Giorgi, F.M., Ceraolo, C. and Mercatelli, D. (2022) The R Language: An Engine for Bioinformatics and Data Science. Life, 12, Article No. 648. https://doi.org/10.3390/life12050648
[11]
Anis, W., Kuntoro, K. and Melaniani, S. (2021) Difference of Power Test and Type II Error (β) on Mardia MVN Test, Henze Zikler’s MVN Test, and Royston’s MVN Test Using Multivariate Data Analysis. JurnalBiometrikadanKependudukan, 10, 153‑161. https://doi.org/10.20473/jbk.v10i2.2021.153-161
[12]
Khatun, N. (2021) Applications of Normality Test in Statistical Analysis. OpenJournalofStatistics, 11, 113-122. https://doi.org/10.4236/ojs.2021.111006
[13]
Mardia, K.V. (1980) 9 Tests of Unvariate and Multivariate Normality. In: Krishnaiah, P.R., Ed., HandbookofStatistics 1: Analysis of Variance, Elsevier, 279-320. https://doi.org/10.1016/s0169-7161(80)01011-5
[14]
Genz, A., Bretz, F., Miwa, T., Mi, X., Leisch, F., Scheipl, F., Bornkamp, B., Maechler, M. and Hothorn, T. (2025) mvtnorm: Multivariate Normal and t Distributions (Version 1.3-3). https://doi.org/10.32614/CRAN.package.mvtnorm
[15]
Wilson, E.B. (1927) Probable Inference, the Law of Succession, and Statistical Inference. JournaloftheAmericanStatisticalAssociation, 22, 209-212. https://doi.org/10.1080/01621459.1927.10502953
[16]
Signorell, A. (2025) DescTools: Tools for Descriptive Statistics. Version 0.99.6. https://doi.org/10.32614/CRAN.package.DescTools
[17]
Cochran, W.G. (1950) The Comparison of Percentages in Matched Samples. Biometrika, 37, 256-266. https://doi.org/10.1093/biomet/37.3-4.256
[18]
Tomczak, M. and Tomczak, E. (2014) The Need to Report Effect Size Estimates Re-visited. An Overview of Some Recommended Measures of Effect Size. Trends in Sport Sciences, 1, 19-25.
[19]
Sheskin, D.J. (2011) Handbook of Parametric and Non-Parametric Statistical Procedures. 5th Edition, Chapman and Hall/CRC.
[20]
Barnett, M.J., Doroudgar, S., Khosraviani, V. and Ip, E.J. (2022) Multiple Comparisons: To Compare or Not to Compare, That Is the Question. ResearchinSocialandAdministrativePharmacy, 18, 2331-2334. https://doi.org/10.1016/j.sapharm.2021.07.006
[21]
Bonferroni, C.E. (1936) Teoria statistica delle classi e calcolo delle probabilità, Pubblicazioni del R Istituto Superiore di Scienze Economiche e Commerciali di Firenze 8, 3-62.
[22]
Cohen, J. (1988) Statistical Power Analysis for Behavioral Sciences. 2nd Edition, Lawrence Erlbaum Associates.
[23]
IBM Corporation (2022) IBM SPSS Statistics for Windows, Version 27.0. IBM Corporation.
[24]
Mauchly, J.W. (1940) Significance Test for Sphericity of a Normal n-Variate Distribution. TheAnnalsofMathematicalStatistics, 11, 204-209. https://doi.org/10.1214/aoms/1177731915
[25]
Huynh, H. and Feldt, L.S. (1970) Conditions under Which Mean Square Ratios in Repeated Measurements Designs Have Exact F-Distributions. JournaloftheAmericanStatisticalAssociation, 65, 1582-1589. https://doi.org/10.2307/2284340
[26]
Pillai, K.C.S. (1955) Some New Test Criteria in Multivariate Analysis. TheAnnalsofMathematicalStatistics, 26, 117-121. https://doi.org/10.1214/aoms/1177728599
[27]
Din, I.U. and Hayat, Y. (2021) ANOVA or MANOVA for Correlated Traits in Agricultural Experiments. SarhadJournalofAgriculture, 37, 1250-1259. https://doi.org/10.17582/journal.sja/2021/37.4.1250.1259
[28]
Rousselet, G., Pernet, C.R. and Wilcox, R.R. (2023) An Introduction to the Bootstrap: A Versatile Method to Make Inferences by Using Data-Driven Simulations. Meta-Psychology, 7, 1-24. https://doi.org/10.15626/mp.2019.2058
[29]
Pearson, K. (1895) Notes on Regression and Inheritance in the Case of Two Parents. Proceedings of the Royal Society of London, 58, 240-242. https://doi.org/10.1098/rspl.1895.0041
[30]
Friedman, M. (1937) The Use of Ranks to Avoid the Assumption of Normality Implicit in the Analysis of Variance. JournaloftheAmericanStatisticalAssociation, 32, 675-701. https://doi.org/10.1080/01621459.1937.10503522
[31]
Conover, W.J. (1999) Practical Nonparametric Statistics. 3rd Edition, John Wiley and Sons.
[32]
Kendall, M.G. and Gibbons, J.D. (1990) Rank Correlation Methods. 5th Edition, Oxford University Press.
[33]
In, J. and Lee, D.K. (2024) Alternatives to the P Value: Connotations of Significance. KoreanJournalofAnesthesiology, 77, 316-325. https://doi.org/10.4097/kja.23630
[34]
JASP Team (2024) (Version 0.19.2) [Computer Software]. https://jasp-stats.org/download/
[35]
Meyners, M. and Hasted, A. (2021) On the Applicability of ANOVA Models for CATA Data. FoodQualityandPreference, 92, Article ID: 104219. https://doi.org/10.1016/j.foodqual.2021.104219
[36]
Calvetti, D. and Somersalo, E. (2023) Continuous and Discrete Multivariate Distributions. In: Calvetti, D. and Somersalo, E., Eds., Bayesian Scientific Computing, Springer International Publishing, 35-48. https://doi.org/10.1007/978-3-031-23824-6_3
[37]
Wald, A. and Wolfowitz, J. (1943) An Exact Test for Randomness in the Non-Parametric Case Based on Serial Correlation. TheAnnalsofMathematicalStatistics, 14, 378-388. https://doi.org/10.1214/aoms/1177731358
[38]
Ljung, G.M. and Box, G.E.P. (1978) On a Measure of Lack of Fit in Time Series Models. Biometrika, 65, 297-303. https://doi.org/10.1093/biomet/65.2.297
[39]
Henze, N. and Zirkler, B. (1990) A Class of Invariant Consistent Tests for Multivariate Normality. CommunicationsinStatistics—TheoryandMethods, 19, 3595-3617. https://doi.org/10.1080/03610929008830400
[40]
Korkmaz, S. (2025) Package “MVN”. Multivariate Normality Tests. https://cran.r-project.org/web/packages/MVN//MVN.pdf
