全部 标题 作者
关键词 摘要

OALib Journal期刊
ISSN: 2333-9721
费用:99美元

查看量下载量

相关文章

更多...

Asymptotic Properties of Deep Quantile Regression Estimator for Change Point Detection

DOI: 10.4236/ojs.2026.165021, PP. 419-459

Keywords: Change Point, Single Change Point, Multiple Change Points, Deep Quantile Regression Estimator, Deep Neural Network

Full-Text   Cite this paper   Add to My Lib

Abstract:

This article presents an analytical framework that utilizes deep neural network-based quantile regression to detect structural changes in high-dimensional, time dependent data. By leveraging on deep neural networks for quantile regression, the model combines the robustness of quantile regression with the computational efficiency of deep learning to estimate conditional quantiles. These estimators can identify abrupt shifts in data distribution without imposing strict structural assumptions, making them more resilient to heavy-tailed data compared to mean-based methods. The study derives the asymptotic properties of the deep quantile regression estimator for change point detection, particularly within high-dimensional, non-linear, and complex datasets. Under specific regularity conditions, the asymptotic properties of the proposed estimator are established. The simulation results demonstrate the convergence of the deep quantile regression estimator to the true conditional quantile function as the sample size. The deep quantile regression estimator achieves the minimax optimal convergence rate, effectively alleviating the curse of dimensionality when the target function adheres to a compositional structure. The empirical process theory and the method of sieve estimation are employed to demonstrate the consistency of the deep quantile regression estimator. The results show that the normalized estimator is asymptotically normal and exhibits inherent robustness to outliers and heavy-tailed noise compared to least-squares-based deep learning models. This theoretical framework provides a foundation for the construction of confidence intervals and hypothesis testing for complex, non-parametric quantile models in fields such as finance, risk management, and econometrics.

References

[1]  Page, E.S. (1954) Continuous Inspection Schemes. Biometrika, 41, 100-115.
https://doi.org/10.1093/biomet/41.1-2.100
[2]  Khan, F.A., Haldar, N.A.H., Ali, A., Iftikhar, M., Zia, T.A. and Zomaya, A.Y. (2017) A Continuous Change Detection Mechanism to Identify Anomalies in ECG Signals for WBAN-Based Healthcare Environments. IEEE Access, 5, 13531-13544.
https://doi.org/10.1109/access.2017.2714258
[3]  Habibi, R. (2021) Bayesian Online Change Point Detection in Finance. Financial Internet Quarterly, 17, 27-33.
https://doi.org/10.2478/fiqf-2021-0025
[4]  Jaiswal, R.K., Lohani, A.K. and Tiwari, H.L. (2015) Statistical Analysis for Change Detection and Trend Assessment in Climatological Parameters. Environmental Processes, 2, 729-749.
https://doi.org/10.1007/s40710-015-0105-3
[5]  Antoch, J., Hu?ková, M. and Veraverbeke, N. (1995) Change-Point Problem and Bootstrap. Journal of Nonparametric Statistics, 5, 123-144.
https://doi.org/10.1080/10485259508832639
[6]  Xu, R., Huang, S., Song, Z., Gao, Y. and Wu, J. (2024) A Deep Mixed-Effects Modeling Approach for Real-Time Monitoring of Metal Additive Manufacturing Process. IISE Transactions, 56, 945-959.
https://doi.org/10.1080/24725854.2023.2192252
[7]  Wen, J.C., Lee, C.S., Keane, P.A., Xiao, S., Rokem, A.S., Chen, P.P., et al. (2019) Forecasting Future Humphrey Visual Fields Using Deep Learning. PLOS ONE, 14, e0214875.
https://doi.org/10.1371/journal.pone.0214875
[8]  Koenker, R. and Bassett, G. (1978) Regression Quantiles. Econometrica, 46, 33-50.
https://doi.org/10.2307/1913643
[9]  Belloni, A., Chen, M., Madrid Padilla, O.H. and Wang, Z. (2023) High-Dimensional Latent Panel Quantile Regression with an Application to Asset Pricing. The Annals of Statistics, 51, 96-121.
https://doi.org/10.1214/22-aos2223
[10]  Salinas, D., Bohlke-Schneider, M., Callot, L., Medico, R. and Gasthaus, J. (2019) High-Dimensional Multivariate Forecasting with Low-Rank Gaussian Copula Processes. Proceedings of the 33rd International Conference on Neural Information Processing Systems, Vancouver, 8-14 December 2019, 6827-6837.
[11]  Belloni, A., Chernozhukov, V. and Kato, K. (2019) Valid Post-Selection Inference in High-Dimensional Approximately Sparse Quantile Regression Models. Journal of the American Statistical Association, 114, 749-758.
https://doi.org/10.1080/01621459.2018.1442339
[12]  Hornik, K. (1991) Approximation Capabilities of Multilayer Feedforward Networks. Neural Networks, 4, 251-257.
https://doi.org/10.1016/0893-6080(91)90009-t
[13]  Barron, A.R. (1994) Approximation and Estimation Bounds for Artificial Neural Networks. Machine Learning, 14, 115-133.
https://doi.org/10.1023/a:1022650905902
[14]  Gupta, B.B., Chui, K.T., Gaurav, A., Arya, V. and Chaurasia, P. (2023) A Novel Hybrid Convolutional Neural Network-and Gated Recurrent Unit-Based Paradigm for IoT Network Traffic Attack Detection in Smart Cities. Sensors, 23, Article 8686.
https://doi.org/10.3390/s23218686
[15]  Hu, X., Chu, L., Pei, J., Liu, W. and Bian, J. (2021) Model Complexity of Deep Learning: A Survey. Knowledge and Information Systems, 63, 2585-2619.
https://doi.org/10.1007/s10115-021-01605-0
[16]  Chronopoulos, I., Raftapostolos, A. and Kapetanios, G. (2024) Forecasting Value-At-Risk Using Deep Neural Network Quantile Regression. Journal of Financial Econometrics, 22, 636-669.
https://doi.org/10.1093/jjfinec/nbad014
[17]  Schmidt-Hieber, J. (2020) Nonparametric Regression Using Deep Neural Networks with ReLU Activation Function. The Annals of Statistics, 48, 1875-1897.
https://doi.org/10.1214/19-aos1875
[18]  Farrell, M.H., Liang, T. and Misra, S. (2021) Deep Neural Networks for Estimation and Inference. Econometrica, 89, 181-213.
https://doi.org/10.3982/ecta16901
[19]  Chen, X. and Liao, Y. and Wang, W. (2022) Inference on Time Series Nonparametric Conditional Moment Restrictions Using General Sieves. arXiv:2301.00092
[20]  Shen, G. and Jiao, Y. and Lin, Y. and Horowitz, J.L. and Huang, J. (2021) Deep Quantile Regression: Mitigating the Curse of Dimensionality through Composition. arXiv:2107.04907
[21]  Wang, L., Kim, Y. and Li, R.Z. (2013) Calibrating Nonconvex Penalized Regression in Ultra-High Dimension. Annals of Statistics, 41, 2505-2536.
https://doi.org/10.1214/13-AOS1159
[22]  Koenker, R. (2005) Quantile Regression. Cambridge University Press.
https://doi.org/10.1017/cbo9780511754098
[23]  LeCun, Y., Bengio, Y. and Hinton, G. (2015) Deep Learning. Nature, 521, 436-444.
https://doi.org/10.1038/nature14539
[24]  Ghysels, Eric and Babii, Andrii and Chen, Xi and Kumar, Rohit (2020) Binary Choice with Asymmetric Loss in a Data-Rich Environment: Theory and an Application to Racial Justice. CEPR Discussion Papers.
[25]  Liang, S. and Srikant, R. (2017) Why Deep Neural Networks for Function Approximation? 5th International Conference on Learning Representations (ICLR 2017), Toulon, 24-26 April 2017.
[26]  Yarotsky, D. (2017) Error Bounds for Approximations with Deep Relu Networks. Neural Networks, 94, 103-114.
https://doi.org/10.1016/j.neunet.2017.07.002
[27]  Andersen, P.K. and Gill, R.D. (1982) Cox’s Regression Model for Counting Processes: A Large Sample Study. The Annals of Statistics, 10, 1100-1120.
https://doi.org/10.1214/aos/1176345976
[28]  Pollard, D. (1991) Asymptotics for Least Absolute Deviation Regression Estimators. Econometric Theory, 7, 186-199.
https://doi.org/10.1017/s0266466600004394
[29]  van der Vaart, A.W. and Wellner, J.A. (2023) Statistical Applications. In: van der Vaart, A.W. and Wellner, J.A., Eds., Weak Convergence and Empirical Processes, Springer International Publishing, 385-591.
https://doi.org/10.1007/978-3-031-29040-4_3
[30]  van der Vaart, A.W. and Wellner, J.A. (1996) Weak Convergence. In: Vaart, A.W., Wellner, J.A., Eds., Springer Series in Statistics, Springer, 16-28.
https://doi.org/10.1007/978-1-4757-2545-2_3

Full-Text

Contact Us

service@oalib.com

QQ:3279437679

WhatsApp +8615387084133