The research focuses on improving predictive accuracy in the financial sector through the exploration of machine learning algorithms for stock price prediction. The research follows an organized process combining Agile Scrum and the Obtain, Scrub, Explore, Model, and iNterpret (OSEMN) methodology. Six machine learning models, namely Linear Forecast, Naive Forecast, Simple Moving Average with weekly window (SMA 5), Simple Moving Average with monthly window (SMA 20), Autoregressive Integrated Moving Average (ARIMA), and Long Short-Term Memory (LSTM), are compared and evaluated through Mean Absolute Error (MAE), with the LSTM model performing the best, showcasing its potential for practical financial applications. A Django web application “Predict It” is developed to implement the LSTM model. Ethical concerns related to predictive modeling in finance are addressed. Data quality, algorithm choice, feature engineering, and preprocessing techniques are emphasized for better model performance. The research acknowledges limitations and suggests future research directions, aiming to equip investors and financial professionals with reliable predictive models for dynamic markets.
References
[1]
Vijh, M., Chandola, D., Tikkiwal, V.A. and Kumar, A. (2020) Stock Closing Price Prediction Using Machine Learning Techniques. Procedia Computer Science, 167, 599-606. https://doi.org/10.1016/j.procs.2020.03.326
[2]
Idrees, S.M., Alam, M.A. and Agarwal, P. (2019) A Prediction Approach for Stock Market Volatility Based on Time Series Data. IEEE Access, 7, 17287-17298. https://doi.org/10.1109/access.2019.2895252
[3]
Parray, I.R., Khurana, S.S., Kumar, M. and Altalbe, A.A. (2020) Time Series Data Analysis of Stock Price Movement Using Machine Learning Techniques. Soft Computing, 24, 16509-16517. https://doi.org/10.1007/s00500-020-04957-x
[4]
Raubitzek, S. and Neubauer, T. (2022) An Exploratory Study on the Complexity and Machine Learning Predictability of Stock Market Data. Entropy, 24, Article 332. https://doi.org/10.3390/e24030332
[5]
Padakandla, S. (2021) A Survey of Reinforcement Learning Algorithms for Dynamically Varying Environments. ACM Computing Surveys, 54, 1-25. https://doi.org/10.1145/3459991
[6]
Bouteska, A. and Regaieg, B. (2020) Loss Aversion, Overconfidence of Investors and Their Impact on Market Performance Evidence from the US Stock Markets. Journal of Economics, Finance and Administrative Science, 25, 451-478. https://doi.org/10.1108/jefas-07-2017-0081
[7]
Ren, R., Wu, D.D. and Liu, T. (2019) Forecasting Stock Market Movement Direction Using Sentiment Analysis and Support Vector Machine. IEEE Systems Journal, 13, 760-770. https://doi.org/10.1109/jsyst.2018.2794462
[8]
Patel, J., Shah, S., Thakkar, P. and Kotecha, K. (2015) Predicting Stock and Stock Price Index Movement Using Trend Deterministic Data Preparation and Machine Learning Techniques. Expert Systems with Applications, 42, 259-268. https://doi.org/10.1016/j.eswa.2014.07.040
[9]
Kandel, L.R. (2018) Risk and Return Analysis of Commercial Banks of Nepal (with Reference to NABIL and NIBL). Pravaha, 24, 109-119. https://doi.org/10.3126/pravaha.v24i1.20231
[10]
Xu, S.Y. (2014) Stock Price Forecasting Using Information from Yahoo Finance and Google Trend. Master’s or doctoral thesis, UC Berkely.
[11]
Nayak, S.C., Misra, B.B. and Behera, H.S. (2014) Impact of Data Normalization on Stock Index Forecasting. International Journal of Computer Information Systems and Industrial Management Applications, 6, 257-269.
[12]
Rouf, N., Malik, M.B. and Arif, T. (2021) Predicting the Stock Market Trend: An Ensemble Approach Using Impactful Exploratory Data Analysis. In: Bhattacharya, M., Kharb, L. and Chahal, D., Eds., Communications in Computer and Information Science, Springer, 223-234. https://doi.org/10.1007/978-3-030-88378-2_18
[13]
Shen, S., Jiang, H. and Zhang, T. (2012) Stock Market Forecasting Using Machine Learning Algorithms. Department of Electrical Engineering, Stanford University.
[14]
Pal, A. and Prakash, P.K.S. (2017) Practical Time Series Analysis: Master Time Series Data Processing, Visualization, and Modeling Using Python. Packt Publishing Ltd.
[15]
Kumar, D., Sarangi, P.K. and Verma, R. (2022) A Systematic Review of Stock Market Prediction Using Machine Learning and Statistical Techniques. Materials Today: Proceedings, 49, 3187-3191. https://doi.org/10.1016/j.matpr.2020.11.399
[16]
Mahajan, S.D., Deshmukh, K.V., Thite, P.R., Samel, B.Y. and Chate, P.J. (2016) Stock Market Prediction and Analysis Using Naïve Bayes. International Journal on Recent and Innovation Trends in Computing and Communication, 4, 121-124.
[17]
Chatzis, S.P., Siakoulis, V., Petropoulos, A., Stavroulakis, E. and Vlachogiannakis, N. (2018) Forecasting Stock Market Crisis Events Using Deep and Statistical Machine Learning Techniques. Expert Systems with Applications, 112, 353-371. https://doi.org/10.1016/j.eswa.2018.06.032
[18]
Gururaj, V., Shriya, V.R. and Ashwini, K. (2019) Stock Market Prediction using Linear Regression and Support Vector Machines. International Journal of Applied Engineering Research, 14, 1931-1934.
[19]
Ristanoski, G., Liu, W. and Bailey, J. (2013) Time Series Forecasting Using Distribution Enhanced Linear Regression. Lecture Notes in Computer Science, 7818, 484-495. https://doi.org/10.1007/978-3-642-37453-1_40
[20]
Ariyo, A.A., Adewumi, A.O. and Ayo, C.K. (2014) Stock Price Prediction Using the ARIMA Model. 2014 UKSim-AMSS 16th International Conference on Computer Modelling and Simulation, Cambridge, 26-28 March 2014, 106-112. https://doi.org/10.1109/uksim.2014.67
[21]
Zhu, Z. and He, K. (2022) Prediction of Amazon’s Stock Price Based on ARIMA, Xgboost, and LSTM Models. Proceedings of Business and Economic Studies, 5, 127-136. https://doi.org/10.26689/pbes.v5i5.4432
[22]
Khan, S. and Alghulaiakh, H. (2020) ARIMA Model for Accurate Time Series Stocks Forecasting. International Journal of Advanced Computer Science and Applications, 11, 524-528. https://doi.org/10.14569/ijacsa.2020.0110765
[23]
Mondal, P., Shit, L. and Goswami, S. (2014) Study of Effectiveness of Time Series Modeling (ARIMA) in Forecasting Stock Prices. International Journal of Computer Science, Engineering and Applications, 4, 13-29. https://doi.org/10.5121/ijcsea.2014.4202
[24]
Trafalis, T.B. and Ince, H. (2000) Support Vector Machine for Regression and Applications to Financial Forecasting. Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks. IJCNN 2000. Neural Computing: New Challenges and Perspectives for the New Millennium, Como, 27 July 2000, 348-353. https://doi.org/10.1109/ijcnn.2000.859420
[25]
Rather, A.M. (2021) LSTM-Based Deep Learning Model for Stock Prediction and Predictive Optimization Model. EURO Journal on Decision Processes, 9, Article ID: 100001. https://doi.org/10.1016/j.ejdp.2021.100001
[26]
Moghar, A. and Hamiche, M. (2020) Stock Market Prediction Using LSTM Recurrent Neural Network. Procedia Computer Science, 170, 1168-1173. https://doi.org/10.1016/j.procs.2020.03.049
[27]
Pramod, B.S. and Shastry, M.P.M. (2021) Stock Price Prediction Using LSTM. Test Engineering and Management, 83, 5246-5251.
[28]
Gao, Y., Wang, R. and Zhou, E. (2021) Stock Prediction Based on Optimized LSTM and GRU Models. Scientific Programming, 2021, Article ID: 4055281. https://doi.org/10.1155/2021/4055281
[29]
Tsai, C.F. and Wang, S.P. (2009) Stock Price Forecasting by Hybrid Machine Learning Techniques. Proceedings of the International MultiConference of Engineers and Computer Scientists, 1, 60.
[30]
Wen, M., Li, P., Zhang, L. and Chen, Y. (2019) Stock Market Trend Prediction Using High-Order Information of Time Series. IEEE Access, 7, 28299-28308. https://doi.org/10.1109/access.2019.2901842
[31]
Zeng, Z. and Khushi, M. (2020) Wavelet Denoising and Attention-Based RNN-ARIMA Model to Predict Forex Price. 2020 International Joint Conference on Neural Networks (IJCNN), Glasgow, 19-24 July 2020, 1-7. https://doi.org/10.1109/ijcnn48605.2020.9206832
[32]
Skehin, T., Crane, M. and Bezbradica, M. (2018) Day Ahead Forecasting of FAANG Stocks Using ARIMA, LSTM Networks and Wavelets. Proceedings of the 26th AIAI Irish Conference on Artificial Intelligence and Cognitive Science (AICS 2018), Dublin, 6-7 December 2018, 334-340.
[33]
Mahadik, A., Vaghela, D. and Mhaisgawali, A. (2021) Stock Price Prediction Using LSTM and ARIMA. 2021 Second International Conference on Electronics and Sustainable Communication Systems (ICESC), Coimbatore, 4-6 August 2021, 1594-1601. https://doi.org/10.1109/icesc51422.2021.9532655
[34]
Turner Lee, N. (2019) Algorithmic Bias Detection and Mitigation: Best Practices and Policies to Reduce Consumer Harms. Brookings.
[35]
Nikou, M., Mansourfar, G. and Bagherzadeh, J. (2019) Stock Price Prediction Using DEEP Learning Algorithm and Its Comparison with Machine Learning Algorithms. Intelligent Systems in Accounting, Finance and Management, 26, 164-174. https://doi.org/10.1002/isaf.1459
