|
针对斑马鱼幼鱼的微小目标群体轨迹跟踪算法
|
Abstract:
针对斑马鱼幼鱼体积小,外观相似度高,运动模式不稳定等特征导致的目标丢失、目标身份匹配错误、轨迹混乱等问题,本文提出了一种基于卷积神经网络的多目标跟踪算法。算法分为目标检测和目标跟踪两部分。检测部分通过经典的检测算法YOLO (You Look Only Once) v5实现,跟踪部分,主要通过DeepSORT实现对斑马鱼幼鱼位置的跟踪与轨迹连接。针对幼鱼容易被漏检、错检等特点,在YOLOv5m的基础上改进了网络的检测层结构,提升对小目标的检测能力。同时融合双通道注意力机制(Convolutional Block Attention Module, CBAM)对网络对背景噪声的抗噪能力。结果表明,在小样本训练的情况下,本文提出的YOLOv5m-ss对斑马鱼幼鱼群体的检测精度@mAP (mean Average Precision)可达99.9%,相较原网络提升了9.4%。结合DeepSORT后的跟踪精度MOTA可达98.0%,在算法运行速度和精确率上都有一定优势。
In this paper, we propose a multi-object tracking algorithm based on convolutional neural networks aiming at the problems of small size, high appearance similarity, unstable motion pattern and other characteristics of zebrafish larvae, such as target loss, target identity matching error, and trajectory confusion. The algorithm is divided into two parts: object detection and object tracking. The detection part is realized by the classic detection algorithm YOLO (You Look Only Once) v5, and the tracking part is mainly realized by DeepSORT to track and connect the position of zebrafish larvae. Aiming at the characteristics of young fish being easy to be missed and misdetected, the detection layer structure of the network is improved on the basis of YOLOv5m to improve the detection ability of small targets. At the same time, the dual-channel Attention mechanism (Convolutional Block Attention Module, CBAM) is fused to improve the anti-noise ability of the network against background noise. The results show that in the case of small sample training, compared with the original YOLOv5 network, the detection accuracy @mAP (mean Average Precision) of YOLOv5m-ss proposed in this paper for zebrafish juvenile population can reach 99.4%. After combining DeepSORT, the tracking accuracy MOTA can reach 98.0%, which has certain advantages in algorithm running speed and accuracy.
[1] | Choi, T.-Y., Choi, T.-I., Lee, Y.-R., Choe, S.-K. and Kim, C.-H. (2021) Zebrafish as an Animal Model for Biomedical Research. Experimental & Molecular Medicine, 53, 310-317. https://doi.org/10.1038/s12276-021-00571-5 |
[2] | Rosa, J.G.S., Lima, C. and Lopes-Ferreira, M. (2022) Zebrafish Larvae Behavior Models as a Tool for Drug Screenings and Pre-Clinical Trials: A Review. International Journal of Molecular Sciences, 23, Article 6647. https://doi.org/10.3390/ijms23126647 |
[3] | Teame, T., et al. (2019) The Use of Zebrafish (Danio rerio) as Biomedical Models. Animal Frontiers, 9, 68-77. https://doi.org/10.1093/af/vfz020 |
[4] | Fazio, M., et al. (2020) Zebrafish Patient Avatars in Cancer Biology and Precision Cancer Therapy. Nature Reviews Cancer, 20, 263-273. https://doi.org/10.1038/s41568-020-0252-3 |
[5] | Cassar, S., et al. (2019) Use of Zebrafish in Drug Discovery Toxicology. Chemical Research in Toxicology, 33, 95-118. https://doi.org/10.1021/acs.chemrestox.9b00335 |
[6] | Orger, M.B. and de Polavieja, G.G. (2017) Zebrafish Behavior: Opportunities and Challenges. Annual Review of Neuroscience, 40, 125-147. https://doi.org/10.1146/annurev-neuro-071714-033857 |
[7] | 孙智慧, 贾顺姬, 孟安明. 斑马鱼: 在生命科学中畅游[J]. 生命科学, 2006, 18(5): 431-436. |
[8] | Fu, Z., et al. (2021) Zebrafishtracker: A Multi-Zebrafish Tracking Algorithm Can Effectively Solve Cross Occlusion. 2021 IEEE International Conference on Robotics and Biomimetics (ROBIO), Sanya, 27-31 December 2021, 1992-1997. https://doi.org/10.1109/ROBIO54168.2021.9739241 |
[9] | Pérez-Escudero, A., et al. (2014) idTracker: Tracking Individuals in a Group by Automatic Identification of Unmarked Animals. Nature Methods, 11, 743-748. https://doi.org/10.1038/nmeth.2994 |
[10] | Wang, X., et al. (2017) Automatic Multiple Zebrafish Larvae Tracking in Unconstrained Microscopic Video Conditions. Scientific Reports, 7, Article No. 17596. https://doi.org/10.1038/s41598-017-17894-x |
[11] | Sun, M., Li, W., Jiao Z. and Zhao, X. (2019) A Multi-Target Tracking Platform for Zebrafish Based on Deep Neural Network. 2019 IEEE 9th Annual International Conference on Cyber Technology in Automation, Control, and Intelligent Systems (CYBER), Suzhou, 29 July-2 August 2019, 637-642. https://doi.org/10.1109/CYBER46603.2019.9066755 |
[12] | Gore, S.V., et al. (2023) Zebrafish Larvae Position Tracker (Z-LaP Tracker): A High-Throughput Deep-Learning Behavioral Approach for the Identification of Calcineurin Pathway-Modulating Drugs Using Zebrafish Larvae. Scientific Reports, 13, Article No. 3174. https://doi.org/10.1038/s41598-023-30303-w |
[13] | 杨晓帅. 基于DeepSort的斑马鱼轨迹追踪研究与应用[D]: [硕士学位论文]. 成都: 电子科技大学, 2021. |
[14] | Barreiros, M.D.O., et al. (2021) Zebrafish Tracking Using YOLOv2 and Kalman Filter. Scientific Reports, 11, Article No. 3219. https://doi.org/10.1038/s41598-021-81997-9 |
[15] | Jocher, G., et al. (2020) Ultralytics/Yolov5: V3. 0. Zenodo. |
[16] | Azhar, M.I.H., et al. (2020) People Tracking System Using DeepSORT. 2020 10th IEEE International Conference on Control System, Computing and Engineering (ICCSCE), Penang, 21-22 August 2020, 137-141. https://doi.org/10.1109/ICCSCE50387.2020.9204956 |