A two-stage automatic key frame selection method is proposed to enhance stitching speed and quality for UAV aerial videos. In the first stage, to reduce redundancy, the overlapping rate of the UAV aerial video sequence within the sampling period is calculated. Lagrange interpolation is used to fit the overlapping rate curve of the sequence. An empirical threshold for the overlapping rate is then applied to filter candidate key frames from the sequence. In the second stage, the principle of minimizing remapping spots is used to dynamically adjust and determine the final key frame close to the candidate key frames. Comparative experiments show that the proposed method significantly improves stitching speed and accuracy by more than 40%.
References
[1]
Li, X.L. and Ling, C.Q. (2022) Application of UAV Remote Sensing Technology in Agricultural Conditions Monitoring. Modern Agricultural Equipment, 43, 45-51.
[2]
Liu, Z., Wan, W., Huang, J.Y., et al. (2018) Research Progress on Inversion of Key Parameters of Crop Growth Based on UAV Remote Sensing. Journal of Agricultural Engineering, 34, 60-71.
[3]
Luo, Y., Li, Y., Li, Z., et al.(2021) MS-SLAM: Motion State Decision of Key Frames for UAV-Based Vision Localization. IEEEAccess, 9, 67667-67679. https://doi.org/10.1109/ACCESS.2021.3077591
[4]
Zhao, Y., Chen, L., Zhang, X., et al.(2021) RTSfM: Real-Time Structure from Motion for Mosaicing and DSM Mapping of Sequential Aerial Images with Low Overlap. IEEE Transactions on Geoscience and Remote Sensing, 60, 1-15. https://doi.org/10.1109/TGRS.2021.3090203
[5]
Wang, Z. and Zhu, Y. (2020) Video Key Frame Monitoring Algorithm and Virtual Reality Display Based on Motion Vector. IEEE Access, 8, 159027-159038.
[6]
Zhang, F., Yang, T., Liu, L., et al.(2020) Image-Only Real-Time Incremental UAV Image Mosaic for Multi-Strip Flight. IEEE Transactions on Multimedia, 60, 1410-1425. https://doi.org/10.1109/TMM.2020.2997193
[7]
Fadaeieslam, M.J., Soryani, M. and Fathy, M. (2011) Efficient Key Frames Selection for Panorama Generation from Video. Journal of Electronic Imaging, 20, 2763-2769. https://doi.org/10.1117/1.3591366
[8]
Dong, J. and Liu, H. (2017) Video Stabilization for Strict Real-Time Applications. IEEE Transactions on Circuits and Systems for Video Technology, 27, 716-724. https://doi.org/10.1109/TCSVT.2016.2589860
[9]
Liu, S.L., Zhao, Y.D., Wang, G.H., et al. (2012) An Automatic Key Frame Extraction Method. Surveying and Mapping Science, 37, 110-112 115.
[10]
Liu, Y., Wang, G.J., Yao, A.B., et al. (2010) Video Stitching Based on Adaptive Frame Sampling. Journal of Tsinghua University(Science and Technology), 50, 108-112.
[11]
Ren, C.F. (2014) Research on Key Technologies of Orthophoto Production of Aerial Video Images. Wuhan University, Wuhan.
[12]
Liu, J.J. (2018) GPS Satellite Orbit Position Fitting Based on Lagrangian Interpolation Method. Science and Technology Innovation and Productivity, 294, 19-21.
[13]
Yang, L., Cao, J., Tang, L., et al.(2014) Optimized Design of Automatic Panoramic Images Mosaic. Multimedia Tools and Applications, 72, 503-514. https://doi.org/10.1007/s11042-013-1387-y
[14]
Yong, H., Huang, J., Xiang, W., et al.(2019) Panoramic Background Image Generation for PTZ Cameras. IEEE Transactions on Image Processing, 28, 3162-3176. https://doi.org/10.1109/TIP.2019.2894940
[15]
Zheng, J., Peng, W., Wang, Y., et al.(2021) Accelerated RANSAC for Accurate Image Registration in Aerial Video Surveillance. IEEE Access, 9, 36775-36790. https://doi.org/10.1109/ACCESS.2021.3061818
[16]
Huang, F.S. and Lin, S.Z. (2019) Multi-Band Image Fusion Rules Comparison Based on the Laplace Pyramid Transformation Method. Infrared Technology, 41, 64-71.
[17]
Cheng, Y.S. and Chuang, Y.Y. (2016) Natural Image Stitching with the Global Similarity Prior. Computer Vision-ECCV 2016, Amsterdam, 11-14 October 2016, 186-201. https://doi.org/10.1007/978-3-319-46454-1_12
[18]
Xiong, Y. and Pulli, K. (2010) Fast Panorama Stitching for High-Quality Panoramic Images on Mobile Phones. IEEE Transactions on Consumer Electronics, 56, 298-306. https://doi.org/10.1109/TCE.2010.5505931
[19]
Liu, Y., He, M., Wang, Y., et al. (2022) Farmland Aerial Images Fast-Stitching Method and Application Based on Improved SIFT Algorithm. IEEE Access, 10, 95411-95424. https://doi.org/10.1109/ACCESS.2022.3204657
[20]
Chang, H.H., Wu, L.G., et al. (2019) Remote Sensing Image Registration Based on Modified SIFT and Feature Slope Grouping. IEEE Geoscience and Remote Sensing Letters, 16, 1363-1367. https://doi.org/10.1109/LGRS.2019.2899123
[21]
Xiang, Y., Wang, F. and You, H. (2018) OS-SIFT: A Robust SIFT-Like Algorithm for High-Resolution Optical-to-SAR Image Registration in Suburban Areas. IEEE Transactions on Geoscience and Remote Sensing, 56, 3078-3090. https://doi.org/10.1109/TGRS.2018.2790483
