This work focuses on the problem of monitoring the coastline, which in Portugal’s case means monitoring 3007 kilometers, including 1793 maritime borders with the Atlantic Ocean to the south and west. The human burden on the coast becomes a problem, both because erosion makes the cliffs unstable and because pollution increases, making the fragile dune ecosystem difficult to preserve. It is becoming necessary to increase the control of access to beaches, even if it is not a popular measure for internal and external tourism. The methodology described can also be used to monitor maritime borders. The use of images acquired in the infrared range guarantees active surveillance both day and night, the main objective being to mimic the infrared cameras already installed in some critical areas along the coastline. Using a series of infrared photographs taken at low angles with a modified camera and appropriate filter, a recent deep learning algorithm with the right training can simultaneously detect and count whole people at close range and people almost completely submerged in the water, including partially visible targets, achieving a performance with F1 score of 0.945, with 97% of targets correctly identified. This implementation is possible with ordinary laptop computers and could contribute to more frequent and more extensive coverage in beach/border surveillance, using infrared cameras at regular intervals. It can be partially automated to send alerts to the authorities and/or the nearest lifeguards, thus increasing monitoring without relying on human resources.
References
[1]
Cao, C., Liu, F., Tan, H., Song, D., Shu, W., Li, W., Zhou, Y., Bo, X. and Xie, Z. (2018) Deep Learning and Its Applications in Biomedicine. Genomics, Proteomics & Bioinformatics, 16, 17-32. https://doi.org/10.1016/j.gpb.2017.07.003
[2]
Wang, J., Ma, Y., Zhang, L., Gao, R.X. and Wu, D. (2018) Deep Learning for Smart Manufacturing: METHODS and Applications. Journal of Manufacturing Systems,48, 144-156. https://doi.org/10.1016/j.jmsy.2018.01.003
[3]
Perera, P. and Patel, V.M. (2019) Deep Transfer Learning for Multiple Class Novelty Detection. IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, 15-20 June 2019, 11536-11544. https://doi.org/10.1109/CVPR.2019.01181
[4]
Ouyang, Y., Wang, K. and Wu, S. (2019) SAR Image Ground Object Recognition Detection Method Based on Optimized and Improved CNN. IEEE 4th Advanced Information Technology, Electronic and Automation Control Conference, Chengdu, 20-22 December 2019, 1727-1731. https://doi.org/10.1109/IAEAC47372.2019.8997680
[5]
Masita, K., Hasan, A. and Shongwe, T. (2020) Deep Learning in Object Detection: A Review. 2020 International Conference on Artificial Intelligence, Big Data, Computing and Data Communication Systems (icABCD), Durban, 6-7 August 2020, 1-11. https://doi.org/10.1109/icABCD49160.2020.9183866
[6]
Talaei Khoei, T., Ould Slimane, H. and Kaabouch, N. (2023) Deep Learning: Systematic Review, Models, Challenges, and Research Directions. Neural Computing and Applications,35, 23103-23124. https://doi.org/10.1007/s00521-023-08957-4
[7]
viso.ai (2022) The 100 Most Popular Computer Vision Applications in 2024.
[8]
Redmon, J., Divvala, S., Girshick, R. and Farhadi, A. (2016) You Only Look Once: Unified, Real-Time Object Detection. IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, 27-30 June 2016, 779-788. https://doi.org/10.1109/CVPR.2016.91
[9]
GitHub (2023) WongKinYiu/yolov7: Implementation of Paper—YOLOv7: Trainable Bag-of-Freebies Sets New State-of-the-Art for Real-Time Object Detectors.
[10]
Wang, C., Bochkovskiy, A. and Liao, H. (2022) YOLOv7: Trainable Bag-of-Freebies Sets New State-of-the-Art for Real-Time Object Detectors. 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Vancouver, 17-24 June 2023, 7464-7475. https://doi.org/10.1109/CVPR52729.2023.00721
[11]
Tu, J., Zhang, C. and Hao, P. (2013) Robust Real-Time Attention-Based Head Shoulder Detection for Video Surveillance. 2013 IEEE International Conference on Image Processing, Melbourne, 15-18 September 2013, 3340-3344. https://doi.org/10.1109/ICIP.2013.6738688
[12]
Wang, S., Zhang, J. and Miao, Z. (2013) A New Edge Feature for Head-Shoulder Detection. 2013 IEEE International Conference on Image Processing, Melbourne, 15-18 September 2013, 2822-2826. https://doi.org/10.1109/ICIP.2013.6738581
[13]
Hu, R., Wang, R., Shan, S. and Chen, X. (2014) Robust Head-Shoulder Detection Using a Two-Stage Cascade Framework. 22nd International Conference on Pattern Recognition, Stockholm, 24-28 August 2014, 2796-2801. https://doi.org/10.1109/ICPR.2014.482
[14]
Guan, Y. and Huang, Y. (2015) Multi-Pose Human Head Detection and Tracking Boosted by Efficient Human Head Validation Using Ellipse Detection. Engineering Applications of Artificial Intelligence,37, 181-193. https://doi.org/10.1016/j.engappai.2014.08.004
[15]
Hsu, F.C., Gubbi, J. and Palaniswami, M. (2015) Head Detection Using Motion Features and Multi-Level Pyramid Architecture. Computer Vision and Image Understanding,137, 38-49. https://doi.org/10.1016/j.cviu.2015.04.007
[16]
Wang, X., Han, T.X. and Yan, S. (2009) An HOG-LBP Human Detector with Partial Occlusion Handling. IEEE 12th International Conference on Computer Vision,Kyoto, 29 September-2 October 2009, 32-39. https://doi.org/10.1109/ICCV.2009.5459207
[17]
Al-Zaydi, Z.Q.H., Ndzi, D.L., Yang, Y. and Kamarudin, M.L. (2016) An Adaptive People Counting System with Dynamic Features Selection and Occlusion Handling. Journal of Visual Communication and Image Representation,39, 218-225. https://doi.org/10.1016/j.jvcir.2016.05.018
[18]
Silva, R., Chevtchenko, S., Moura, A., Cordeiro, F. and Macario, V. (2017) Detecting People from Beach Images. 2017 International Conference on Tools with Artificial Intelligence, Boston, 6-8 November 2017, 636-643. https://ieeexplore.ieee.org/document/8372005
[19]
Green, S., Blumenstein, M., Browne, M. and Tomlinson, R. (2005) The Detection and Quantification of Persons in Cluttered Beach Scenes Using Neural Network-Based Classification. Sixth International Conference on Computational Intelligence and Multimedia Applications (ICCIMA’05), Las Vegas, 16-18 August 2005, 303-308. https://dl.acm.org/doi/10.1109/ICCIMA.2005.57 https://doi.org/10.1109/ICCIMA.2005.57
[20]
Browne, M., Blumenstein, M., Tomlinson, R. and Lane, C. (2005) An Intelligent System for Remote Monitoring and Prediction of Beach Conditions. Proceedings of the International Conference on Artificial Intelligence and Applications, Innsbruck, Austria, 14-16 February 2005, 533-537.
[21]
Rao, P.S., Rani, S.P., Badal, T. and Guptha, S.K. (2020) Object Detection in Infrared Images Using Convolutional Neural Networks. Journal of Information Assurance and Security,15, 136-143.
[22]
Bustos, N., Mashhadi, M., Lai-Yuen, S., Sarkar, S. and Das, T. (2023) A Systematic Literature Review on Object Detection Using Near-Infrared and Thermal Images. Neurocomputing,560, Article ID: 126804. https://dl.acm.org/doi/10.1016/j.neucom.2023.126804 https://doi.org/10.1016/j.neucom.2023.126804
[23]
Kyeremeh, G.K., Abdul-Al, M., Qahwaji, R. and Abd-Alhameed, R.A. (2022) Infrared Imagery and Border Control Systems. 2nd International Multi-Disciplinary Conference Theme: Integrated Sciences and Technologies, Sakarya, 7-9 September 2021. https://eudl.eu/doi/10.4108/eai.7-9-2021.2314979 https://doi.org/10.4108/eai.7-9-2021.2314979
Image J. (2022) Image J. https://imagej.net/ij/index.html
[28]
Sardá, R., Valls, J.F., Pintó, J., Ariza, E., Lozoya, J.P., Fraguell, R.M., Martí, C., Rucabado, J., Ramis, J. and Jimenez, J.A. (2015) Towards a New Integrated Beach Management System: The Ecosystem-Based Management System for Beaches. Ocean & Coastal Management,118, 167-177. https://doi.org/10.1016/j.ocecoaman.2015.07.020
