Manhole cover defect recognition is of significant practical importance as it can accurately identify damaged or missing covers, enabling timely replacement and maintenance. Traditional manhole cover detection techniques primarily focus on detecting the presence of covers rather than classifying the types of defects. However, manhole cover defects exhibit small inter-class feature differences and large intra-class feature variations, which makes their recognition challenging. To improve the classification of manhole cover defect types, we propose a Progressive Dual-Branch Feature Fusion Network (PDBFFN). The baseline backbone network adopts a multi-stage hierarchical architecture design using Res-Net50 as the visual feature extractor, from which both local and global information is obtained. Additionally, a Feature Enhancement Module (FEM) and a Fusion Module (FM) are introduced to enhance the network’s ability to learn critical features. Experimental results demonstrate that our model achieves a classification accuracy of 82.6% on a manhole cover defect dataset, outperforming several state-of-the-art fine-grained image classification models.
References
[1]
Wei, Z., Yang, M., Wang, L., et al. (2019) Customized Mobile LiDAR System for Manhole Cover Detection and Identification. Sensors, 19, Article 2422.
https://doi.org/10.3390/s19102422
[2]
Qiang, R.P., Sun, H. and Dong, Y.C. (2018) Implementation of Manhole Cover Detection System Based on Multi Feature Fusion. Electron Technology Applications, 44, 44-47.
[3]
Oji, S., Shi, Y. and Shi, Z. (2012) Manhole Cover Detection Using Vehicle-Based Multi-Sensor Data. ISPRS International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, XXXIX-B3, 281-284.
https://doi.org/10.1109/9.402235
[4]
Rao, Y., Chen, G., Lu, J., et al. (2021) Counterfactual Attention Learning for fine-Grained Visual Categorization and Reidentification. Proceedings of the 2021 IEEE/CVF International Conference on Computer Vision (ICCV), Montreal, 10-17 October 2021, 1005-1014. https://doi.org/10.1109/9.402235
[5]
Liu, C., Xie, H., Zha, Z., Ma, L., Yu, L. and Zhang, Y. (2020) Filtration and Distillation: Enhancing Region Attention for Fine-Grained Visual Categorization. Proceedings of the AAAI Conference on Artificial Intelligence, 34, 11555-11562.
https://doi.org/10.1609/aaai.v34i07.6822
[6]
Gao, Y., Han, X., Wang, X., Huang, W. and Scott, M. (2020) Channel Interaction Networks for Fine-Grained Image Categorization. Proceedings of the AAAI Conference on Artificial Intelligence, 34, 10818-10825.
https://doi.org/10.1609/aaai.v34i07.6712
[7]
Zhuang, P., Wang, Y. and Qiao, Y. (2020) Learning Attentive Pairwise Interaction for Fine-Grained Classification. Proceedings of the AAAI Conference on Artificial Intelligence, 34, 13130-13137. https://doi.org/10.1609/aaai.v34i07.7016
[8]
Song, J. and Yang, R. (2021) Feature Boosting, Suppression, and Diversification for Fine-Grained Visual Classification. 2021 International Joint Conference on Neural Networks (IJCNN), Shenzhen, 18-22 July 2021, 1-8.
https://doi.org/10.1109/ijcnn52387.2021.9534004
[9]
Lin, T., Dollar, P., Girshick, R., He, K., Hariharan, B. and Belongie, S. (2017) Feature Pyramid Networks for Object Detection. 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, 21-26 July 2017, 936-944.
https://doi.org/10.1109/cvpr.2017.106
[10]
Wang, X., Girshick, R., Gupta, A. and He, K. (2018) Non-Local Neural Networks. 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, 18-23 June 2018, 7794-7803. https://doi.org/10.1109/cvpr.2018.00813
[11]
Chen, X., Fu, C., Zhao, Y., Zheng, F., Song, J., Ji, R., et al. (2020) Salience-Guided Cascaded Suppression Network for Person Re-Identification. 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, 13-19 June 2020, 3297-3307. https://doi.org/10.1109/cvpr42600.2020.00336
