This article presents an analytical framework that utilizes deep neural network-based quantile regression to detect structural changes in high-dimensional, time dependent data. By leveraging on deep neural networks for quantile regression, the model combines the robustness of quantile regression with the computational efficiency of deep learning to estimate conditional quantiles. These estimators can identify abrupt shifts in data distribution without imposing strict structural assumptions, making them more resilient to heavy-tailed data compared to mean-based methods. The study derives the asymptotic properties of the deep quantile regression estimator for change point detection, particularly within high-dimensional, non-linear, and complex datasets. Under specific regularity conditions, the asymptotic properties of the proposed estimator are established. The simulation results demonstrate the convergence of the deep quantile regression estimator to the true conditional quantile function as the sample size. The deep quantile regression estimator achieves the minimax optimal convergence rate, effectively alleviating the curse of dimensionality when the target function adheres to a compositional structure. The empirical process theory and the method of sieve estimation are employed to demonstrate the consistency of the deep quantile regression estimator. The results show that the normalized estimator is asymptotically normal and exhibits inherent robustness to outliers and heavy-tailed noise compared to least-squares-based deep learning models. This theoretical framework provides a foundation for the construction of confidence intervals and hypothesis testing for complex, non-parametric quantile models in fields such as finance, risk management, and econometrics.
Khan, F.A., Haldar, N.A.H., Ali, A., Iftikhar, M., Zia, T.A. and Zomaya, A.Y. (2017) A Continuous Change Detection Mechanism to Identify Anomalies in ECG Signals for WBAN-Based Healthcare Environments. IEEEAccess, 5, 13531-13544. https://doi.org/10.1109/access.2017.2714258
[3]
Habibi, R. (2021) Bayesian Online Change Point Detection in Finance. FinancialInternetQuarterly, 17, 27-33. https://doi.org/10.2478/fiqf-2021-0025
[4]
Jaiswal, R.K., Lohani, A.K. and Tiwari, H.L. (2015) Statistical Analysis for Change Detection and Trend Assessment in Climatological Parameters. EnvironmentalProcesses, 2, 729-749. https://doi.org/10.1007/s40710-015-0105-3
[5]
Antoch, J., Hu?ková, M. and Veraverbeke, N. (1995) Change-Point Problem and Bootstrap. JournalofNonparametricStatistics, 5, 123-144. https://doi.org/10.1080/10485259508832639
[6]
Xu, R., Huang, S., Song, Z., Gao, Y. and Wu, J. (2024) A Deep Mixed-Effects Modeling Approach for Real-Time Monitoring of Metal Additive Manufacturing Process. IISETransactions, 56, 945-959. https://doi.org/10.1080/24725854.2023.2192252
[7]
Wen, J.C., Lee, C.S., Keane, P.A., Xiao, S., Rokem, A.S., Chen, P.P., et al. (2019) Forecasting Future Humphrey Visual Fields Using Deep Learning. PLOS ONE, 14, e0214875. https://doi.org/10.1371/journal.pone.0214875
[8]
Koenker, R. and Bassett, G. (1978) Regression Quantiles. Econometrica, 46, 33-50. https://doi.org/10.2307/1913643
[9]
Belloni, A., Chen, M., Madrid Padilla, O.H. and Wang, Z. (2023) High-Dimensional Latent Panel Quantile Regression with an Application to Asset Pricing. The Annals of Statistics, 51, 96-121. https://doi.org/10.1214/22-aos2223
[10]
Salinas, D., Bohlke-Schneider, M., Callot, L., Medico, R. and Gasthaus, J. (2019) High-Dimensional Multivariate Forecasting with Low-Rank Gaussian Copula Processes. Proceedings of the 33rd International Conference on Neural Information Processing Systems, Vancouver, 8-14 December 2019, 6827-6837.
[11]
Belloni, A., Chernozhukov, V. and Kato, K. (2019) Valid Post-Selection Inference in High-Dimensional Approximately Sparse Quantile Regression Models. JournaloftheAmericanStatisticalAssociation, 114, 749-758. https://doi.org/10.1080/01621459.2018.1442339
[12]
Hornik, K. (1991) Approximation Capabilities of Multilayer Feedforward Networks. NeuralNetworks, 4, 251-257. https://doi.org/10.1016/0893-6080(91)90009-t
[13]
Barron, A.R. (1994) Approximation and Estimation Bounds for Artificial Neural Networks. MachineLearning, 14, 115-133. https://doi.org/10.1023/a:1022650905902
[14]
Gupta, B.B., Chui, K.T., Gaurav, A., Arya, V. and Chaurasia, P. (2023) A Novel Hybrid Convolutional Neural Network-and Gated Recurrent Unit-Based Paradigm for IoT Network Traffic Attack Detection in Smart Cities. Sensors, 23, Article 8686. https://doi.org/10.3390/s23218686
[15]
Hu, X., Chu, L., Pei, J., Liu, W. and Bian, J. (2021) Model Complexity of Deep Learning: A Survey. KnowledgeandInformationSystems, 63, 2585-2619. https://doi.org/10.1007/s10115-021-01605-0
[16]
Chronopoulos, I., Raftapostolos, A. and Kapetanios, G. (2024) Forecasting Value-At-Risk Using Deep Neural Network Quantile Regression. JournalofFinancialEconometrics, 22, 636-669. https://doi.org/10.1093/jjfinec/nbad014
[17]
Schmidt-Hieber, J. (2020) Nonparametric Regression Using Deep Neural Networks with ReLU Activation Function. TheAnnalsofStatistics, 48, 1875-1897. https://doi.org/10.1214/19-aos1875
[18]
Farrell, M.H., Liang, T. and Misra, S. (2021) Deep Neural Networks for Estimation and Inference. Econometrica, 89, 181-213. https://doi.org/10.3982/ecta16901
[19]
Chen, X. and Liao, Y. and Wang, W. (2022) Inference on Time Series Nonparametric Conditional Moment Restrictions Using General Sieves. arXiv:2301.00092
[20]
Shen, G. and Jiao, Y. and Lin, Y. and Horowitz, J.L. and Huang, J. (2021) Deep Quantile Regression: Mitigating the Curse of Dimensionality through Composition. arXiv:2107.04907
[21]
Wang, L., Kim, Y. and Li, R.Z. (2013) Calibrating Nonconvex Penalized Regression in Ultra-High Dimension. Annals of Statistics, 41, 2505-2536. https://doi.org/10.1214/13-AOS1159
[22]
Koenker, R. (2005) Quantile Regression. Cambridge University Press. https://doi.org/10.1017/cbo9780511754098
[23]
LeCun, Y., Bengio, Y. and Hinton, G. (2015) Deep Learning. Nature, 521, 436-444. https://doi.org/10.1038/nature14539
[24]
Ghysels, Eric and Babii, Andrii and Chen, Xi and Kumar, Rohit (2020) Binary Choice with Asymmetric Loss in a Data-Rich Environment: Theory and an Application to Racial Justice. CEPR Discussion Papers.
[25]
Liang, S. and Srikant, R. (2017) Why Deep Neural Networks for Function Approximation? 5th International Conference on Learning Representations (ICLR 2017), Toulon, 24-26 April 2017.
[26]
Yarotsky, D. (2017) Error Bounds for Approximations with Deep Relu Networks. NeuralNetworks, 94, 103-114. https://doi.org/10.1016/j.neunet.2017.07.002
[27]
Andersen, P.K. and Gill, R.D. (1982) Cox’s Regression Model for Counting Processes: A Large Sample Study. TheAnnalsofStatistics, 10, 1100-1120. https://doi.org/10.1214/aos/1176345976
[28]
Pollard, D. (1991) Asymptotics for Least Absolute Deviation Regression Estimators. EconometricTheory, 7, 186-199. https://doi.org/10.1017/s0266466600004394
[29]
van der Vaart, A.W. and Wellner, J.A. (2023) Statistical Applications. In: van der Vaart, A.W. and Wellner, J.A., Eds., Weak Convergence and Empirical Processes, Springer International Publishing, 385-591. https://doi.org/10.1007/978-3-031-29040-4_3
[30]
van der Vaart, A.W. and Wellner, J.A. (1996) Weak Convergence. In: Vaart, A.W., Wellner, J.A., Eds., SpringerSeriesinStatistics, Springer, 16-28. https://doi.org/10.1007/978-1-4757-2545-2_3