To address the difficulties in fusing multi-mode sensor data for complex industrial machinery, an adaptive deep coupling convolutional auto-encoder (ADCCAE) fusion method was proposed. First, the multi-mode features extracted synchronously by the CCAE were stacked and fed to the multi-channel convolution layers for fusion. Then, the fused data was passed to all connection layers for compression and fed to the Softmax module for classification. Finally, the coupling loss function coefficients and the network parameters were optimized through an adaptive approach using the gray wolf optimization (GWO) algorithm. Experimental comparisons showed that the proposed ADCCAE fusion model was superior to existing models for multi-mode data fusion.
References
[1]
Wang, Y., Wen, X., Jie, Y., et al. (2023) Online Detection Method for Bearing Incipient Faults Based on Contrastive Learning. Journal of Vibration and Shock, 42, 229-236.
[2]
Tian, Y., Chen, H., Wang, F., et al. (2021) Overview of SLAM Algorithms for Mobile Robots. Computer Science, 48, 223-234.
[3]
Charles, S.T. (2023) A Smart Helmet Framework Based on Visual-Inertial SLAM and Multi-Sensor Fusion to Improve Situational Awareness and Reduce Hazards in Mountaineering. International Journal of Software Science and Computational Intelligence (IJSSCI), 15, 1-19. https://doi.org/10.4018/IJSSCI.333628
[4]
Tian, Y. (2022) Research on Control Strategy of Vehicle AEB System Based on Multi-Sensor Fusion. Master’s Thesis, North China University of Water Resources and Electric Power, Zhenzhou.
[5]
Buchaiah, S. and Shakya, P. (2022) Bearing Fault Diagnosis and Prognosis Using Data Fusion Based Feature Extraction and Feature Selection. Measurement, 188, Article ID: 110506. https://doi.org/10.1016/j.measurement.2021.110506
[6]
Fatehi, A. and Huang, B. (2017) Kalman Filtering Approach to Multi-Rate Information Fusion in the Presence of Irregular Sampling Rate and Variable Measurement Delay. Journal of Process Control, 53, 15-25. https://doi.org/10.1016/j.jprocont.2017.02.010
[7]
Xiong, J., Zhang, Q., Wan, J., et al. (2018) Data Fusion Method Based on Mutual Dimensionless. IEEE/ASME Transactions on Mechatronics, 23, 506-517. https://doi.org/10.1109/TMECH.2017.2759791
[8]
Sun, C., Wang, Y. and Sun, G. (2020) A Multi-Criteria Fusion Feature Selection Algorithm for Fault Diagnosis of Helicopter Planetary Gear Train. Chinese Journal of Aeronautics, 33, 1549-1561. https://doi.org/10.1016/j.cja.2019.07.014
[9]
Wang, H., Ni, G., Chen, J. and Qu, J.M. (2020) Research on Rolling Bearing State Health Monitoring and Life Prediction Based on PCA and Internet of Things with Multi-Sensor. Measurement, 157, Article ID: 107657. https://doi.org/10.1016/j.measurement.2020.107657
[10]
Liu, X.F., Sun, R.J., Bo, L. and Luo, H. (2020) A Novel Sparse Classification Fusion Method and Its Application in Locomotive Bearing Fault Diagnosis. Proceedings of the CSEE, 40, 5675-5681.
[11]
Haghighat, M., Abdel-Mottaleb, M. and Alhalabi, W. (2016) Discriminant Correlation Analysis: Real-Time Feature Level Fusion for Multimodal Biometric Recognition. IEEE Transactions on Information Forensics and Security, 11, 1984-1996. https://doi.org/10.1109/TIFS.2016.2569061
[12]
Xu, X., Tao, Z., Ming, W., et al. (2020) Intelligent Monitoring and Diagnostics Using a Novel Integrated Model Based on Deep Learning and Multi-Sensor Feature Fusion. Measurement, 165, Article ID: 108086. https://doi.org/10.1016/j.measurement.2020.108086
[13]
Wu, Z., Jiang, H., Zhao, K. and Li, X.Q. (2019) An Adaptive Deep Transfer Learning Method for Bearing Fault Diagnosis. Measurement, 151, Article ID: 107227. https://doi.org/10.1016/j.measurement.2019.107227
[14]
Huang, R., Liao, Y., Zhang, S. and Li, W.H. (2019) Deep Decoupling Convolutional Neural Network for Intelligent Compound Fault Diagnosis. IEEE Access, 7, 1848-1858. https://doi.org/10.1109/ACCESS.2018.2886343
[15]
Xia, M., Li, T., Xu, L., et al. (2018) Fault Diagnosis for Rotating Machinery Using Multiple Sensors and Convolutional Neural Networks. IEEE/ASME Transactions on Mechatronics, 23, 101-110. https://doi.org/10.1109/TMECH.2017.2728371
[16]
He, J., Yang, B., Zhang, C., et al. (2019) Robust Consensus Braking Algorithm for Distributed EMUs with Uncertainties. IET Control Theory & Applications, 13, 2766-2774. https://doi.org/10.1049/iet-cta.2018.6107
[17]
Lecun, Y., Bengio, Y. and Hinton, G. (2015) Deep Learning. Nature, 521, 436-444. https://doi.org/10.1038/nature14539
[18]
Schmidhuber, J. (2015) Deep Learning in Neural Networks: An Overview. Neural Networks, 61, 85-117. https://doi.org/10.1016/j.neunet.2014.09.003
[19]
Han, Y., Tang, B. and Deng, L. (2018) Multi-Level Wavelet Packet Fusion in Dynamic Ensemble Convolutional Neural Network for Fault Diagnosis. Measurement, 127, 246-255. https://doi.org/10.1016/j.measurement.2018.05.098
[20]
Zhang, C., Zhang, Q., He, J., et al. (2020) Consistent Total Traction Torque-Oriented Coordinated Control of Multimotors with Input Saturation for Heavy-Haul Locomotives. Journal of Advanced Transportation, 2020, Article ID: 1390764. https://doi.org/10.1155/2020/1390764
[21]
Jing, L., Wang, T., Zhao, M. and Wang, P. (2017) An Adaptive Multi-Sensor Data Fusion Method Based on Deep Convolutional Neural Networks for Fault Diagnosis of Planetary Gearbox. Sensors, 17, Article 414. https://doi.org/10.3390/s17020414
[22]
Li, S., Wang, H., Song, L., et al. (2020) An Adaptive Data Fusion Strategy for Fault Diagnosis Based on the Convolutional Neural Network. Measurement, 165, Article ID: 108122. https://doi.org/10.1016/j.measurement.2020.108122
[23]
Wang, H., Li, S., Song, L. and Cui, L.L. (2019) A Novel Convolutional Neural Network Based Fault Recognition Method via Image Fusion of Multi-Vibration-Signals. Computers in Industry, 105, 182-190. https://doi.org/10.1016/j.compind.2018.12.013
[24]
Chen, H., Hu, N., Cheng, Z., et al. (2019) A Deep Convolutional Neural Network Based Fusion Method of Two-Direction Vibration Signal Data for Health State Identification of Planetary Gearboxes. Measurement, 146, 268-278. https://doi.org/10.1016/j.measurement.2019.04.093
[25]
Hao, S., Ge, F., Li, Y. and Jiang, J.Y. (2020) Multisensor Bearing Fault Diagnosis Based on One-Dimensional Convolutional Long Short-Term Memory Networks. Measurement, 159, Article ID: 107802. https://doi.org/10.1016/j.measurement.2020.107802
[26]
Chen, Z. and Li, W. (2017) Multisensor Feature Fusion for Bearing Fault Diagnosis Using Sparse Autoencoder and Deep Belief Network. IEEE Transactions on Instrumentation and Measurement, 66, 1693-1702. https://doi.org/10.1109/TIM.2017.2669947
[27]
Moslem, A.M., Singh, J., Bravo-Imaz, I. and Lee, J. (2020) Multisensor Data Fusion for Gearbox Fault Diagnosis Using 2-D Convolutional Neural Network and Motor Current Signature Analysis. Mechanical Systems and Signal Processing, 144, Article ID: 106861. https://doi.org/10.1016/j.ymssp.2020.106861
[28]
Li, T., Zhao, Z., Sun, C., et al. (2020) Multi-Scale CNN for Multi-Sensor Feature Fusion in Helical Gear Fault Detection. Procedia Manufacturing, 49, 89-93. https://doi.org/10.1016/j.promfg.2020.07.001
[29]
Zhou, F., Hu, P., Yang, S. and Wen, C.L. (2018) A Multimodal Feature Fusion-Based Deep Learning Method for Online Fault Diagnosis of Rotating Machinery. Sensors, 18, Article 3521. https://doi.org/10.3390/s18103521
[30]
Wang, J., Fu, P., Zhang, L., et al. (2019) Multilevel Information Fusion for Induction Motor Fault Diagnosis. IEEE/ASME Transactions on Mechatronics, 24, 2139-2150. https://doi.org/10.1109/TMECH.2019.2928967
[31]
Fu, P., Wang, J., Zhang, X., Zhang, L.B. and Gao, R.X. (2020) Dynamic Routing-Based Multimodal Neural Network for Multi-Sensory Fault Diagnosis of Induction Motor. Journal of Manufacturing Systems, 55, 264-272. https://doi.org/10.1016/j.jmsy.2020.04.009
[32]
Li, F., Pang, X. and Yang, Z. (2019) Motor Current Signal Analysis Using Deep Neural Networks for Planetary Gear Fault Diagnosis. Measurement, 145, 45-54. https://doi.org/10.1016/j.measurement.2019.05.074
[33]
Chen, Z., Gryllias, K. and Li, W. (2020) Intelligent Fault Diagnosis for Rotary Machinery Using Transferable Convolutional Neural Network. IEEE Transactions on Industrial Informatics, 16, 339-349. https://doi.org/10.1109/TII.2019.2917233
[34]
Wen, L., Li, X., Gao, L. and Zhang, Y.Y. (2018) A New Convolutional Neural Network-Based Data-Driven Fault Diagnosis Method. IEEE Transactions on Industrial Electronics, 65, 5990-5998. https://doi.org/10.1109/TIE.2017.2774777
[35]
Jiang, G., He, H., Yan, J., et al. (2019) Multiscale Convolutional Neural Networks for Fault Diagnosis of Wind Turbine Gearbox. IEEE Transactions on Industrial Electronics, 66, 3196-3207. https://doi.org/10.1109/TIE.2018.2844805
[36]
He, J., Chen, X., Mao, S., et al. (2020) Virtual Line Shafting-Based Total-Amount Coordinated Control of Multi-Motor Traction Power. Journal of Advanced Transportation, 2020, Article ID: 4735397. https://doi.org/10.1155/2020/4735397
[37]
Masci, J., Masci, J., Meier, U., et al. (2011) Stacked Convolutional Auto-Encoders for Hierarchical Feature Extraction. In: Honkela, T., Duch, W., Girolami, M. and Kaski, S., Eds., ICANN 2011: Artificial Neural Networks and Machine Learning—ICANN 2011, Springer, Berlin, 52-59. https://doi.org/10.1007/978-3-642-21735-7_7
[38]
Kingma, D.P. and Ba, J.L. (2015) Adam: A Method for Stochastic Optimization. arXiv: 1412.6980.
[39]
Ma, M., Sun, C. and Chen, X. (2018) Deep Coupling Autoencoder for Fault Diagnosis with Multimodal Sensory Data. IEEE Transactions on Industrial Informatics, 14, 1137-1145. https://doi.org/10.1109/TII.2018.2793246
[40]
Mirjalili, S., Mirjalili, S.M. and Lewis, A. (2014) Grey Wolf Optimizer. Advances in Engineering Software, 69, 46-61. https://doi.org/10.1016/j.advengsoft.2013.12.007
[41]
Zhang, X., Liu, Z., Miao, Q., et al. (2018) An Optimized Time Varying Filtering Based Empirical Mode Decomposition Method with Grey Wolf Optimizer for Machinery Fault Diagnosis. Journal of Sound and Vibration, 418, 55-78. https://doi.org/10.1016/j.jsv.2017.12.028
[42]
Hoang, D.T. and Kang, H.J. (2020) A Motor Current Signal-Based Bearing Fault Diagnosis Using Deep Learning and Information Fusion. IEEE Transactions on Instrumentation and Measurement, 69, 3325-3333. https://doi.org/10.1109/TIM.2019.2933119
[43]
Sun, W., Shao, S., Zhao, R., et al. (2016) A Sparse Auto-Encoder-Based Deep Neural Network Approach for Induction Motor Faults Classification. Measurement, 89, 171-178. https://doi.org/10.1016/j.measurement.2016.04.007
[44]
Yu, J. and Zhao, X. (2020) One-Dimensional Residual Convolutional Auto Encoderbased Feature Learning for Gearbox Fault Diagnosis. IEEE Transactions on Industrial Informatics, 16, 6347-6348. https://doi.org/10.1109/TII.2020.2966326
