Aiming at the land cover (features) recognition of outdoor sports venues (football field, basketball court, tennis court and baseball field), this paper proposed a set of object recognition methods and technical flow based on Mask R-CNN. Firstly, through the preprocessing of high spatial resolution remote sensing imagery (HSRRSI) and collecting the artificial samples of outdoor sports venues, the training data set required for object recognition of land cover features was constructed. Secondly, the Mask R-CNN was used as the basic training model to be adapted to cope with outdoor sports venues. Thirdly, the recognition results were compared with the four object-oriented machine learning classification methods in eCognition?. The experiment results of effectiveness verification show that the Mask R-CNN is superior to traditional methods not only in technical procedures but also in outdoor sports venues (football field, basketball court, tennis court and baseball field) recognition results, and it achieves the precision of 0.8927, a recall of 0.9356 and an average precision of 0.9235. Finally, from the aspect of practical engineering application, using and validating the well-trained model, an empirical application experiment was performed on the HSRRSI of Xicheng and Daxing District of Beijing respectively, and the generalization ability of the trained model of Mask R-CNN was thoroughly evaluated.
References
[1]
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V. and Rabinovich, A. (2015) Going Deeper with Convolutions. Conference on Computer Vision and Pattern Recognition, Boston, 7-12 June 2015, 2-8. https://doi.org/10.1109/CVPR.2015.7298594
[2]
Girshick, R., Donahue, J., Darrell, T. and Malik, J. (2014) Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation. Conference on Computer Vision and Pattern Recognition, Columbus, 23-28 June 2014, 580-587. https://doi.org/10.1109/CVPR.2014.81
[3]
Girshick, R. (2015) Fast R-CNN. In: Proceedings of the 2015 IEEE International Conference on Computer Vision, IEEE Computer Society, Washington DC, 1440-1448. https://doi.org/10.1109/ICCV.2015.169
[4]
He, K.M., Zhang, X.Y., Ren, S.Q. and Sun, J. (2014) Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition. Transactions on Pattern Analysis & Machine Intelligence, 37, 1904-1916. https://doi.org/10.1109/TPAMI.2015.2389824
[5]
Ren, S.Q., He, K.M., Girshick, R. and Sun, J. (2015) Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks. IEEE Transactions on Pattern Analysis & Machine Intelligence, 39, 1137-1149. https://doi.org/10.1109/TPAMI.2016.2577031
[6]
Xu, Y.Z., Yu, G.Z., Wang, Y.P., Wu, X.K. and Ma, Y.L. (2017) Car Detection from Low-Altitude UAV Imagery with the Faster R-CNN. Journal of Advanced Transportation, 2017, Article ID: 2823617. https://doi.org/10.1155/2017/2823617
[7]
Sun, X.D., Wu, P.C. and Hoi, S.C.H. (2018) Face Detection Using Deep Learning: An Improved Faster RCNN Approach. Neurocomputing, 299, 42-50.
[8]
He, K.M., Gkioxari, G., Dollár, P. and Girshick, R. (2018) Mask R-CNN. IEEE International Conference on Computer Vision, Venice, 22-29 October 2017, 1. https://doi.org/10.1109/TPAMI.2018.2844175
[9]
Zhao, K., Kang, J., Jung, J. and Sohn, G. (2018) Building Extraction from Satellite Images Using Mask R-CNN with Building Boundary Regularization. Conference on Computer Vision and Pattern Recognition Workshops, Salt Lake City, 18-22 June 2018, 247-251.
[10]
Ji, S.P., Wei, S.Q. and Lu, M. (2018) Fully Convolutional Networks for Multisource Building Extraction from an Open Aerial and Satellite Imagery Data Set. IEEE Transactions on Geoscience and Remote Sensing, 57, 574-586.
[11]
Song, S.R., Liu, J.H., Pu, H., Liu, Y. and Luo, J.Y. (2019) The Comparison of Fusion Methods for HSRRSI Considering the Effectiveness of Land Cover (Features) Object Recognition Based on Deep Learning. Remote Sensing, 11, 1435. https://doi.org/10.3390/rs11121435
[12]
Wada, K. (2018) Image Polygonal Annotation with Python (Polygon, Rectangle, Circle, Line, Point and Image-Level Flag Annotation). https://github.com/wkentaro/labelme
[13]
He, K.M., Zhang, X.Y., Ren, S.Q. and Sun, J. (2015) Deep Residual Learning for Image Recognition. Conference on Computer Vision and Pattern Recognition, Las Vegas, 27-30 June 2016, 770-778.
[14]
Liu, J.H., Pu, H., Song, S.R. and Du, M.Y. (2018) An Adaptive Scale Estimating Method of Multiscale Image Segmentation Based on Vector Edge and Spectral Statistics Information. International Journal of Remote Sensing, 39, 6826-6845.
[15]
Ghatkar, J.G., Singh, R.K. and Shanmugam, P. (2019) Classification of Algal Bloom Species from Remote Sensing Data Using an Extreme Gradient Boosted Decision Tree Model. International Journal of Remote Sensing, 40, 9412-9438. https://doi.org/10.1080/01431161.2019.1633696
[16]
Lashkenari, M.S. and Khazaie Poul, A. (2016) Application of KNN and Semi-Empirical Models for Prediction of Polycyclic Aromatic Hydrocarbons Solubility in Supercritical Carbon Dioxide. Polycyclic Aromatic Compounds, 37, 415-425.
[17]
Jebur, M.N., Shafri, H.Z.M., Pradhan, B. and Tehrany, M.S. (2014) Per-Pixel and Object-Oriented Classification Methods for Mapping Urban Land Cover Extraction Using SPOT 5 Imagery. Geocarto International, 29, 792-806. https://doi.org/10.1080/10106049.2013.848944
[18]
Cheng, G., Zhou, P.C. and Han, J.W. (2016) Learning Rotation-Invariant Convolutional Neural Networks for Object Detection in VHR Optical Remote Sensing Images. IEEE Transactions on Geoscience and Remote Sensing, 54, 7405-7415. https://doi.org/10.1109/EORSA.2016.7552845
[19]
Long, Y., Gong, Y.P., Xiao, Z.F. and Liu, Q. (2017) Accurate Object Localization in Remote Sensing Images Based on Convolutional Neural Networks. IEEE Transactions on Geoscience and Remote Sensing, 55, 2486-2498. https://doi.org/10.1109/TGRS.2016.2645610
[20]
Nogueira, K., Penatti, O.A.B. and dos Santos, J.A. (2016) Towards Better Exploiting Convolutional Neural Networks for Remote Sensing Scene Classification. Pattern Recognition, 61, 539-556. https://doi.org/10.1016/j.patcog.2016.07.001
