Forecasting future expected returns out-of-sample is challenging due to some statistical characteristics, such as the stochastic and dynamic nature in the time series. Conventional machine learning techniques focus mainly on point forecasting, which cannot take distributional properties of the returns into account. The Generalised Additive Models for Location, Scale and Shape (GAMLSS) fills this gap by forecasting both the expected returns and the distribution of the returns, thereby making it easier to verify the statistically distributed properties and ensuring models’ validity over the out-of-sample periods. In this paper, we obtained a dataset from the Amit Goyal webpage consisting of 15 financial variables, each covering monthly observations from January 1970 to December 2022. The study has revealed the effectiveness of GAMLSS as a flexible distributional regression in forecasting the U.S. stock market out-of-sample using a rolling window with alternative recursive window methods, to ensure robustness in the analysis. The rolling approach efficiently dealt with any problem of structural dynamics or adverse economic conditions across business cycles. The GAMLSS models demonstrate statistical evidence of superiority over the conventional machine learning techniques across all out-of-sample forecasting windows. Notably, the inclusion of smoothing splines as potential smoothers in the GAMLSS helps to statistically improve the predictive task of the forecasting models. In addition, the GAMLSS models are more economically effective than the buy-and-hold trading strategy, which relies solely on the risk-free treasury bills. Thus, the out-of-sample rolling window forecasts produced by the GAMLSS models tend to be more promising in guaranteeing the fate of investors and portfolio managers while undertaking risky investments with target expectations in a real-time market setting.
References
[1]
Rapach, D.E., Ringgenberg, M.C. and Zhou, G. (2016) Short Interest and Aggregate Stock Returns. JournalofFinancialEconomics, 121, 46-65. https://doi.org/10.1016/j.jfineco.2016.03.004
[2]
Khan, S. and Alghulaiakh, H. (2020) ARIMA Model for Accurate Time Series Stocks Forecasting. InternationalJournalofAdvancedComputerScienceandApplications, 11, 524-528. https://doi.org/10.14569/ijacsa.2020.0110765
[3]
Majumder, A., Rahman, M.M., Biswas, A.A., Zulfiker, M.S. and Basak, S. (2021) Stock Market Prediction: A Time Series Analysis. In: SSomani, A.K., Mundra, A., Doss, R. and Bhattacharya, S., Eds., Smart Systems: Innovations in Computing, Springer, 389-401. https://doi.org/10.1007/978-981-16-2877-1_35
[4]
Iworiso, J. and Vrontos, S. (2019) On the Directional Predictability of Equity Premium Using Machine Learning Techniques. JournalofForecasting, 39, 449-469. https://doi.org/10.1002/for.2632
[5]
Rouf, N., Malik, M.B., Arif, T., Sharma, S., Singh, S., Aich, S., et al. (2021) Stock Market Prediction Using Machine Learning Techniques: A Decade Survey on Methodologies, Recent Developments, and Future Directions. Electronics, 10, Article 2717. https://doi.org/10.3390/electronics10212717
[6]
Iworiso, J. and Vrontos, S. (2020) On the Predictability of the Equity Premium Using Deep Learning Techniques. TheJournalofFinancialDataScience, 3, 74-92. https://doi.org/10.3905/jfds.2020.1.051
[7]
Khattak, A., Khan, A., Ullah, H., Asghar, M.U., Arif, A., Kundi, F.M., et al. (2021) An Efficient Supervised Machine Learning Technique for Forecasting Stock Market Trends. In: Guarda, T., Anwar, S., Leon, M. and Mota Pinto, F.J., Eds., Information and Knowledge in Internet of Things, Springer, 143-162. https://doi.org/10.1007/978-3-030-75123-4_7
[8]
Kumbure, M.M., Lohrmann, C., Luukka, P. and Porras, J. (2022) Machine Learning Techniques and Data for Stock Market Forecasting: A Literature Review. ExpertSystemswithApplications, 197, Article ID: 116659. https://doi.org/10.1016/j.eswa.2022.116659
[9]
Iworiso, J. (2023) Forecasting Stock Market Out-of-Sample with Regularised Regression Training Techniques. InternationalJournalofEconometricsandFinancialManagement, 11, 1-12. https://doi.org/10.12691/ijefm-11-1-1
[10]
Sonkavde, G., Dharrao, D.S., Bongale, A.M., Deokate, S.T., Doreswamy, D. and Bhat, S.K. (2023) Forecasting Stock Market Prices Using Machine Learning and Deep Learning Models: A Systematic Review, Performance Analysis and Discussion of Implications. InternationalJournalofFinancialStudies, 11, Article 94. https://doi.org/10.3390/ijfs11030094
[11]
Adeleye, R.A., Tubokirifuruar, T.S., Bello, B.G., Ndubuisi, N.L., Asuzu, O.F. and Owolabi, O.R. (2024) Machine Learning for Stock Market Forecasting: A Review of Models and Accuracy. Finance&AccountingResearchJournal, 6, 112-124. https://doi.org/10.51594/farj.v6i2.783
[12]
Rigby, R.A. and Stasinopoulos, D.M. (2005) Generalized Additive Models for Location, Scale and Shape. JournaloftheRoyalStatisticalSocietySeriesC: AppliedStatistics, 54, 507-554. https://doi.org/10.1111/j.1467-9876.2005.00510.x
[13]
Stasinopoulos, M.D., Rigby, R.A., Heller, G.Z., Voudouris, V. and De Bastiani, F. (2017) Flexible Regression and Smoothing: Using GAMLSS in R. CRC Press.
[14]
Nyberg, H. (2011) Forecasting the Direction of the US Stock Market with Dynamic Binary Probit Models. InternationalJournalofForecasting, 27, 561-578. https://doi.org/10.1016/j.ijforecast.2010.02.008
[15]
Musallam, S.R.M. (2018) Exploring the Relationship between Financial Ratios and Market Stock Returns. EurasianJournalofBusinessandEconomics, 11, 101-116. https://doi.org/10.17015/ejbe.2018.021.06
Ang, A. and Bekaert, G. (2006) Stock Return Predictability: Is It There? ReviewofFinancialStudies, 20, 651-707. https://doi.org/10.1093/rfs/hhl021
[18]
Neely, C.J., Rapach, D.E., Tu, J. and Zhou, G. (2014) Forecasting the Equity Risk Premium: The Role of Technical Indicators. ManagementScience, 60, 1772-1791. https://doi.org/10.1287/mnsc.2013.1838
[19]
Agrawal, M., Khan, A.U. and Shukla, P.K. (2019) Stock Price Prediction Using Technical Indicators: A Predictive Model Using Optimal Deep Learning. International Journal of Recent Technology and Engineering (IJRTE), 8, 2297-2305.
[20]
Dai, Z., Zhu, H. and Kang, J. (2021) New Technical Indicators and Stock Returns Predictability. InternationalReviewofEconomics&Finance, 71, 127-142. https://doi.org/10.1016/j.iref.2020.09.006
[21]
Campbell, J.Y. and Thompson, S.B. (2007) Predicting Excess Stock Returns Out of Sample: Can Anything Beat the Historical Average? ReviewofFinancialStudies, 21, 1509-1531. https://doi.org/10.1093/rfs/hhm055
[22]
Rapach, D. and Zhou, G. (2013) Forecasting Stock Returns. HandbookofEconomicForecasting, 2, 328-383. https://doi.org/10.1016/b978-0-444-53683-9.00006-2
Nevasalmi, L. (2020) Forecasting Multinomial Stock Returns Using Machine Learning Methods. TheJournalofFinanceandDataScience, 6, 86-106. https://doi.org/10.1016/j.jfds.2020.09.001
[25]
Kumar, D., Sarangi, P.K. and Verma, R. (2022) A Systematic Review of Stock Market Prediction Using Machine Learning and Statistical Techniques. MaterialsToday: Proceedings, 49, 3187-3191. https://doi.org/10.1016/j.matpr.2020.11.399
[26]
Bansal, M., Goyal, A. and Choudhary, A. (2022) Stock Market Prediction with High Accuracy Using Machine Learning Techniques. ProcediaComputerScience, 215, 247-265. https://doi.org/10.1016/j.procs.2022.12.028
[27]
Cui, H., Rajagopalan, S. and Ward, A.R. (2020) Predicting Product Return Volume Using Machine Learning Methods. EuropeanJournalofOperationalResearch, 281, 612-627. https://doi.org/10.1016/j.ejor.2019.05.046
[28]
Leung, E., Lohre, H., Mischlich, D., Shea, Y. and Stroh, M. (2021) The Promises and Pitfalls of Machine Learning for Predicting Stock Returns. TheJournalofFinancialDataScience, 3, 21-50. https://doi.org/10.3905/jfds.2021.1.062
[29]
Campisi, G., Muzzioli, S. and De Baets, B. (2024) A Comparison of Machine Learning Methods for Predicting the Direction of the US Stock Market on the Basis of Volatility Indices. InternationalJournalofForecasting, 40, 869-880. https://doi.org/10.1016/j.ijforecast.2023.07.002
[30]
Ayyildiz, N. and Iskenderoglu, O. (2024) How Effective Is Machine Learning in Stock Market Predictions? Heliyon, 10, e24123. https://doi.org/10.1016/j.heliyon.2024.e24123
[31]
Massacci, D. (2015) Predicting the Distribution of Stock Returns: Model Formulation, Statistical Evaluation, Var Analysis and Economic Significance. JournalofForecasting, 34, 191-208. https://doi.org/10.1002/for.2332
[32]
Stasinopoulos, M.D., Rigby, R.A. and Bastiani, F.D. (2018) GAMLSS: A distributional regression approach. StatisticalModelling, 18, 248-273. https://doi.org/10.1177/1471082x18759144
[33]
Hastie, T. and Tibshirani, R. (1990) Exploring the Nature of Covariate Effects in the Proportional Hazards Model. Biometrics, 46, 1005-1016. https://doi.org/10.2307/2532444
[34]
Yun, Y., Kim, H., Shin, S.Y., Lee, J., Deshpande, A.D. and Kim, C. (2014) Statistical Method for Prediction of Gait Kinematics with Gaussian Process Regression. JournalofBiomechanics, 47, 186-192. https://doi.org/10.1016/j.jbiomech.2013.09.032
[35]
Schulz, E., Speekenbrink, M. and Krause, A. (2018) A Tutorial on Gaussian Process Regression: Modelling, Exploring, and Exploiting Functions. JournalofMathematicalPsychology, 85, 1-16. https://doi.org/10.1016/j.jmp.2018.03.001
[36]
Iworiso, J. (2020) On the Predictability of US Stock Market Using Machine Learning and Deep Learning Techniques. Master’s Thesis, University of Essex.
[37]
Wang, J. (2023) An Intuitive Tutorial to Gaussian Process Regression. ComputinginScience&Engineering, 25, 4-11. https://doi.org/10.1109/mcse.2023.3342149
[38]
Zou, H. and Hastie, T. (2005) Regularization and Variable Selection via the Elastic Net. JournaloftheRoyalStatisticalSocietySeriesB: StatisticalMethodology, 67, 301-320. https://doi.org/10.1111/j.1467-9868.2005.00503.x
[39]
Hoerl, A.E. and Kennard, R.W. (1970) Ridge Regression: Biased Estimation for Nonorthogonal Problems. Technometrics, 12, 55-67. https://doi.org/10.1080/00401706.1970.10488634
[40]
Patwary, M.J.A., Karim, M.J., Hamim, S.I., Sifath, M., Bhuiyan, M.A.S. and Miraz, M.H. (2023) Stock Price Prediction Using Semi-Supervised Ridge Regression. In: Miraz, M.H., Southall, G., Ali, M. and Ware, A., Eds., Emerging Technologies in Computing, Springer, 118-128. https://doi.org/10.1007/978-3-031-25161-0_9
[41]
Tibshirani, R. (1996) Regression Shrinkage and Selection via the Lasso. JournaloftheRoyalStatisticalSocietySeriesB: StatisticalMethodology, 58, 267-288. https://doi.org/10.1111/j.2517-6161.1996.tb02080.x
[42]
Roy, S.S., Mittal, D., Basu, A. and Abraham, A. (2015) Stock Market Forecasting Using LASSO Linear Regression Model. In: Abraham, A., Krömer, P. and Snasel, V., Eds., Afro-European Conference for Industrial Advancement, Springer, 371-381. https://doi.org/10.1007/978-3-319-13572-4_31
[43]
Peterson, C. and Rögnvaldsson, T.S. (1991) An Introduction to Artificial Neural Networks (No. LU-TP-91-23). CERN.
[44]
Qiu, M., Song, Y. and Akagi, F. (2016) Application of Artificial Neural Network for the Prediction of Stock Market Returns: The Case of the Japanese Stock Market. Chaos, Solitons&Fractals, 85, 1-7. https://doi.org/10.1016/j.chaos.2016.01.004
[45]
Chandrika, P.V. and Srinivasan, K.S. (2021) Predicting Stock Market Movements Using Artificial Neural Networks. UniversalJournalofAccountingandFinance, 9, 405-410. https://doi.org/10.13189/ujaf.2021.090315
[46]
Ali, M., Khan, D.M., Aamir, M., Ali, A. and Ahmad, Z. (2021) Predicting the Direction Movement of Financial Time Series Using Artificial Neural Network and Support Vector Machine. Complexity, 2021, Article ID: 2906463. https://doi.org/10.1155/2021/2906463
[47]
Awad, M. and Khanna, R. (2015) Support Vector Regression. In: Awad, M. and Khanna, R., Eds., EfficientLearningMachines, Apress, 67-80. https://doi.org/10.1007/978-1-4302-5990-9_4
[48]
Sheta, A.F., Ahmed, S.E.M. and Faris, H. (2015) A Comparison between Regression, Artificial Neural Networks and Support Vector Machines for Predicting Stock Market Index. International Journal of Advanced Research in Artificial Intelligence, 4, 55-63.
[49]
Kurani, A., Doshi, P., Vakharia, A. and Shah, M. (2021) A Comprehensive Comparative Study of Artificial Neural Network (ANN) and Support Vector Machines (SVM) on Stock Forecasting. AnnalsofDataScience, 10, 183-208. https://doi.org/10.1007/s40745-021-00344-x
[50]
Xu, X. and Liu, W. (2024) Forecasting the Equity Premium: Can Machine Learning Beat the Historical Average? QuantitativeFinance, 24, 1445-1461. https://doi.org/10.1080/14697688.2024.2409278