全部 标题 作者
关键词 摘要

OALib Journal期刊
ISSN: 2333-9721
费用:99美元

查看量下载量

相关文章

更多...

A Novel Time Series Prediction Approach Based on a Hybridization of Least Squares Support Vector Regression and Swarm Intelligence

DOI: 10.1155/2014/754809

Full-Text   Cite this paper   Add to My Lib

Abstract:

This research aims at establishing a novel hybrid artificial intelligence (AI) approach, named as firefly-tuned least squares support vector regression for time series prediction . The proposed model utilizes the least squares support vector regression (LS-SVR) as a supervised learning technique to generalize the mapping function between input and output of time series data. In order to optimize the LS-SVR’s tuning parameters, the incorporates the firefly algorithm (FA) as the search engine. Consequently, the newly construction model can learn from historical data and carry out prediction autonomously without any prior knowledge in parameter setting. Experimental results and comparison have demonstrated that the has achieved a significant improvement in forecasting accuracy when predicting both artificial and real-world time series data. Hence, the proposed hybrid approach is a promising alternative for assisting decision-makers to better cope with time series prediction. 1. Introduction Generally, time series forecasting involves the prediction of future values of data based on discovering the pattern in the historical data series and extrapolating that pattern into the future. Time series forecasting is a widely discussed issue and its applications appear in various fields of business and engineering [1]. The reason is that prediction of future events is crucial for many kinds of planning and decision-making processes. Applications regarding time series data can be easily found in the literature, such as wind energy forecasting [2], water resource management [3], traffic accident prediction [4], and cash flow forecasting in construction projects [5]. Hence, it is not surprising that time series analyses and predictions are on the rise among researchers. Notably, constructing a predictive model for time series forecasting is a challenging task. It is because real-world time series data are often characterized by nonlinearity, being nonstationary, and irregularity [6]. Random noise and effect of unidentified factors are the main causes that degrade the prediction accuracy. Moreover, in most cases, the underlying model that generates the series is unknown and the process of discovering such model is oftentimes hindered by the stochastic nature of the time-dependent data [7]. Particularly, for each time series, determination of a suitable embedding dimension is also of major concern [8, 9]. Therefore, these challenges necessitate the development of advanced approaches. Over the recent years, there has been increasing efforts dedicated in establishing AI

References

[1]  A. Cherif, H. Cardot, and R. Boné, “SOM time series clustering and prediction with recurrent neural networks,” Neurocomputing, vol. 74, no. 11, pp. 1936–1944, 2011.
[2]  J. Zhou, J. Shi, and G. Li, “Fine tuning support vector machines for short-term wind speed forecasting,” Energy Conversion and Management, vol. 52, no. 4, pp. 1990–1998, 2011.
[3]  H. Yoon, S.-C. Jun, Y. Hyun, G.-O. Bae, and K.-K. Lee, “A comparative study of artificial neural networks and support vector machines for predicting groundwater levels in a coastal aquifer,” Journal of Hydrology, vol. 396, no. 1-2, pp. 128–138, 2011.
[4]  L. Barba, N. Rodriguez, and C. Montt, “Smoothing strategies combined with ARIMA and neural networks to improve the forecasting of traffic accidents,” The Scientific World Journal, vol. 2014, Article ID 152375, 12 pages, 2014.
[5]  M. Y. Cheng and A. F. V. Roy, “Evolutionary fuzzy decision model for cash flow prediction using time-dependent support vector machines,” International Journal of Project Management, vol. 29, no. 1, pp. 56–65, 2011.
[6]  S. Ismail, A. Shabri, and R. Samsudin, “A hybrid model of self-organizing maps (SOM) and least square support vector machine (LSSVM) for time-series forecasting,” Expert Systems with Applications, vol. 38, no. 8, pp. 10574–10578, 2011.
[7]  W. Yan, H. Qiu, and Y. Xue, “Gaussian process for long-term time-series forecasting,” in Proceedings of the International Joint Conference on Neural Networks (IJCNN '09), pp. 3420–3427, June 2009.
[8]  K. Lukoseviciute and M. Ragulskis, “Evolutionary algorithms for the selection of time lags for time series forecasting by fuzzy inference systems,” Neurocomputing, vol. 73, no. 10–12, pp. 2077–2088, 2010.
[9]  M. Zou and H. Tao, “Short term load forecasting with least square support vector regression and PSO,” in Applied Informatics and Communication, J. Zhang, Ed., vol. 228, pp. 124–132, Springer, Berlin, Germany, 2011.
[10]  P. Melin, J. Soto, O. Castillo, and J. Soria, “A new approach for time series prediction using ensembles of ANFIS models,” Expert Systems with Applications, vol. 39, no. 3, pp. 3494–3506, 2012.
[11]  J. Mu, F. Wu, and A. Zhang, “Housing value forecasting based on machine learning methods,” Abstract and Applied Analysis, vol. 2014, Article ID 648047, 7 pages, 2014.
[12]  K. de Brabanter, P. Karsmakers, F. Ojeda, et al., “LS-SVMlab toolbox user's guide version 1.8,” Internal Report 10-146, ESAT-SISTA, Katholieke Universiteit Leuven, Leuven, Belgium, 2010.
[13]  J. Suykens, J. V. Gestel, J. D. Brabanter, B. D. Moor, and J. Vandewalle, Least Square Support Vector Machines, World Scientific Publishers, Singapore, 2002.
[14]  L. Yu, H. Chen, S. Wang, and K. K. Lai, “Evolving least squares support vector machines for stock market trend mining,” IEEE Transactions on Evolutionary Computation, vol. 13, no. 1, pp. 87–102, 2009.
[15]  J. A. K. Suykens and J. Vandewalle, “Least squares support vector machine classifiers,” Neural Processing Letters, vol. 9, no. 3, pp. 293–300, 1999.
[16]  H.-H. Tran and N.-D. Hoang, “An artificial intelligence approach for groutability estimation based on autotuning support vector machine,” Journal of Construction Engineering, vol. 2014, Article ID 109184, 9 pages, 2014.
[17]  M.-Y. Cheng, N.-D. Hoang, A. F. V. Roy, and Y.-W. Wu, “A novel time-depended evolutionary fuzzy SVM inference model for estimating construction project at completion,” Engineering Applications of Artificial Intelligence, vol. 25, no. 4, pp. 744–752, 2012.
[18]  M. Cheng and N. Hoang, “Groutability estimation of grouting processes with microfine cements using an evolutionary instance-based learning approach,” Journal of Computing in Civil Engineering, vol. 28, no. 4, Article ID 04014014, 2014.
[19]  E. Bonabeau, M. Dorigo, and G. Theraulaz, Swarm Intelligence: From Natural to Artificial Systems, Oxford University Press, New York, NY, USA, 1999.
[20]  C. Grosan, A. Abraham, and M. Chis, “Swarm intelligence in data mining,” Studies in Computational Intelligence, vol. 34, pp. 1–20, 2006.
[21]  X.-S. Yang, Firefly Algorithm, Luniver Press, Bristol, UK, 2008.
[22]  S. K. Pal, C. S. Rai, and A. P. Singh, “Comparative study of firefly algorithm and particle swarm optimization for noisy non-linear optimization problems,” International Journal of Intelligent Systems and Applications, vol. 4, pp. 50–57, 2012.
[23]  X.-S. Yang, Nature-Inspired Optimization Algorithms, Elsevier, 2014.
[24]  G. P. Zhang, “Time series forecasting using a hybrid ARIMA and neural network model,” Neurocomputing, vol. 50, pp. 159–175, 2003.
[25]  Y. Bao, Y. Yang, T. Xiong, and J. Zhang, “A comparative study of multi-step-ahead prediction for crude oil price with support vector regression,” in Proceedings of the 4th International Joint Conference on Computational Sciences and Optimization (CSO '11), pp. 598–602, April 2011.
[26]  M. B. Kennel, R. Brown, and H. D. I. Abarbanel, “Determining embedding dimension for phase-space reconstruction using a geometrical construction,” Physical Review A, vol. 45, no. 6, pp. 3403–3411, 1992.
[27]  G.-S. Su, “A new intelligent model for nonlinear time series prediction,” in Proceedings of the International Conference on Computer Science and Software Engineering (CSSE '08), vol. 1, pp. 435–438, Wuhan, China, December 2008.
[28]  M.-Y. Cheng and N.-D. Hoang, “Risk score inference for bridge maintenance project using evolutionary fuzzy least squares support vector machine,” Journal of Computing in Civil Engineering, vol. 28, no. 3, Article ID 04014003, 2014.
[29]  A. Hashmi, N. Goel, S. Goel, and D. Gupta, “Firefly algorithm for unconstrained optimization,” IOSR Journal of Computer Engineering, vol. 11, pp. 75–78, 2013.
[30]  R. L. Haupt and S. E. Haupt, Practical Genetic Algorithm, John Wiley & Sons, 2004.
[31]  C. M. Bishop, Pattern Recognition and Machine Learning, Springer, Singapore, 2006.
[32]  J.-S. R. Jang, C.-T. Sun, and E. Mizutani, Neuro-Fuzzy and Soft Computing: A Computational Approach to Learning and Machine Intelligence, Prentice Hall, 1997.
[33]  M.-Y. Cheng and Y.-W. Wu, “Evolutionary support vector machine inference system for construction management,” Automation in Construction, vol. 18, no. 5, pp. 597–604, 2009.

Full-Text

Contact Us

service@oalib.com

QQ:3279437679

WhatsApp +8615387084133