|
|
融合场景机制的机械作业操作识别算法
|
Abstract:
机械作业场景下的操作识别可以大大提高安全监督效率，针对传统的目标检测算法无法根据不同的机械作业场景识别操作行为的问题，提出一种融合场景机制的机械作业操作识别算法，融合两个在COCO数据集上预训练好的YOLOv5s模型，先进行机械作业场景识别，再进行关键目标检测，同时利用交并比构建逻辑函数对作业人员的操作行为进行判定。以角磨机作业场景为例，经实验验证，本文的算法模型识别精确率为97.9%，平均识别时间为0.114 s，满足了精确性与实时性要求。
Operation recognition in mechanical operation scenarios can greatly improve the efficiency of safety supervision. Aiming at the problem that traditional target detection algorithms cannot identify operation behaviors according to different mechanical operation scenarios, a mechanical operation recognition algorithm integrating scene mechanism is proposed, which integrates two YOLOv5s models pre-trained on COCO data sets. First, the mechanical operation scene is identified, and then the key target is detected. At the same time, the operation behavior of the operator is judged by the logic function constructed by the intersection ratio. Taking the operation scene of Angle mill as an example, the experimental verification shows that the algorithm model recognition accuracy rate is 97.9%, and the average recognition time is 0.114s, which meets the accuracy and real-time requirements.
| [1] | 刘全龙, 彭雨蒙, 赵盼, 等. 基于HFACS模型的制造企业机械伤害事故致因分析[J]. 中国安全科学学报, 2023, 33(3): 51-59. |
| [2] | Bagga, P., Mitra, A., Das, A.K., et al. (2022) Secure Biometric-Based Access Control Scheme for Future IoT-Enabled Cloud-Assisted Video Surveillance System. Computer Communications, 195, 27-39. https://doi.org/10.1016/j.comcom.2022.08.003 |
| [3] | Zaidi, S.S.A., Ansari, M.S., Aslam, A., et al. (2022) A Survey of Modern Deep Learning Based Object Detection Models. Digital Signal Processing, 126, Article ID: 103514. https://doi.org/10.1016/j.dsp.2022.103514 |
| [4] | Zheng, A., Zhang, Y., Zhang, X., et al. (2022) Progressive End-To-End Object Detection in Crowded Scenes. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, 18-24 June 2022, 847-856. https://doi.org/10.1109/CVPR52688.2022.00093 |
| [5] | Yang, J., Liu, S., Li, Z., et al. (2022) Real-Time Object Detection for Streaming Perception. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, 18-24 June 2022, 5375-5385. https://doi.org/10.1109/CVPR52688.2022.00531 |
| [6] | Sowmyayani, S. and Rani, P.A.J. (2022) Salient Object Based Visual Sentiment Analysis by Combining Deep Features and Handcrafted Features. Multimedia Tools and Applications, 81, 7941-7955. https://doi.org/10.1007/s11042-022-11982-5 |
| [7] | Xu, M., Qin, L., Chen, W., et al. (2023) Multi-View Adversarial Discriminator: Mine the Non-Causal Factors for Object Detection in Unseen Domains. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Vancouver, 17-24 June 2023, 8103-8112. https://doi.org/10.1109/CVPR52729.2023.00783 |
| [8] | Zhang, P., Li, X., Hu, X., et al. (2021) Vinvl: Revisiting Visual Representations in Vision-Language Models. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Nashville, 20-25 June 2021, 5579-5588. https://doi.org/10.1109/CVPR46437.2021.00553 |
| [9] | Xiao, Y., Tian, Z., Yu, J., et al. (2020) A Review of Object Detection Based on Deep Learning. Multimedia Tools and Applications, 79, 23729-23791. https://doi.org/10.1007/s11042-020-08976-6 |
| [10] | Yue, S., Zhang, Q., Shao, D., et al. (2022) Safety Helmet Wearing Status Detection Based on Improved Boosted Random Ferns. Multimedia Tools and Applications, 81, 16783-16796. https://doi.org/10.1007/s11042-022-12014-y |
| [11] | He, Z., Zhang, L., Gao, X. and Zhang, D. (2023) Multi-Adversarial Faster-RCNN with Paradigm Teacher for Unrestricted Object Detection. International Journal of Computer Vision, 131, 680-700. https://doi.org/10.1007/s11263-022-01728-z |
| [12] | Zhang, Z., Yin, X. and Yan, Z. (2022) Rapid Data Annotation for Sand-Like Granular Instance Segmentation Using Mask-RCNN. Automation in Construction, 133, Article ID: 103994. https://doi.org/10.1016/j.autcon.2021.103994 |
| [13] | Yan, J. and Wang, Z. (2022) YOLO V3 VGG16-Based Automatic Operations Monitoring and Analysis in a Manufacturing Workshop under Industry 4.0. Journal of Manufacturing Systems, 63, 134-142. https://doi.org/10.1016/j.jmsy.2022.02.009 |
| [14] | Wei, P., Yu, X., Di, Z., et al. (2022) Design of Robot Automatic Navigation under Computer Intelligent Algorithm and Machine Vision. Journal of Industrial Information Integration, 28, Article ID: 100366. https://doi.org/10.1016/j.jii.2022.100366 |
| [15] | Chen, Z., Ma, C., Ren, J., et al. (2023) Research on the Identification Method of Safety Wearing of Electric Power Workers Based on Deep Learning. Frontiers in Energy Research, 10, Article 1091322. https://doi.org/10.3389/fenrg.2022.1091322 |
| [16] | Ji, X., Gong, F., Yuan, X., et al. (2023) A High-Performance Framework for Personal Protective Equipment Detection on the Offshore Drilling Platform. Complex & Intelligent Systems, 9, 5637-5652. https://doi.org/10.1007/s40747-023-01028-0 |
| [17] | Chen, B., Wang, X., Bao, Q., et al. (2022) An Unsafe Behavior Detection Method Based on Improved YOLO Framework. Electronics, 11, Article 1912. https://doi.org/10.3390/electronics11121912 |
| [18] | 李永上, 马荣贵, 张美月. 改进YOLOv5s DeepSORT的监控视频车流量统计[J]. 计算机工程与应用, 2022, 58(5): 271-279. |
| [19] | Wang, C., Peng, G. and De Baets, B. (2022) Class-Specific Discriminative Metric Learning for Scene Recognition. Pattern Recognition: The Journal of the Pattern Recognition Society, 126, Article ID: 108589. https://doi.org/10.1016/j.patcog.2022.108589 |
