|
|
基于混合专家零样本异常检测模型的机器人化飞行器起飞前检查系统及方法
|
Abstract:
针对传统飞行器人工检查效率低下,以及现有自动化系统存在检测盲区和难以识别未知缺陷等问题,本文提出了一种新型自主移动机器人检查系统。该系统利用搭载多模态传感器的移动机器人进行全方位数据采集,核心算法采用本文提出的混合专家零样本异常检测(MoE-ZSAD)模型。该模型通过将多维图像特征与正常状态的文本描述进行语义对齐,在无需缺陷样本训练的情况下,实现了对各类已知及潜在未知缺陷的精准识别。实验结果表明,该模型在复杂场景下的缺陷检测中表现优异,实现了超过0.96的像素级平均受试者工作特征曲线下面积(
),在检测精度和泛化能力上均显著优于当前的基准模型。分析显示,该方法有效克服了传统视觉检测对异常样本的依赖局限,验证了利用跨模态技术解决工业检测难题的可行性。该研究不仅为飞行前自动化检查提供了一种高效、客观且具备强适应性的解决方案,显著提升了航空维修保障的安全性与运营效率,也为未来大型装备的智能化运维提供了新的技术路径。
To address the low efficiency of traditional manual aircraft inspection and the issues of detection blind spots and difficulty in identifying unknown defects in existing automated systems, this paper proposes a novel autonomous mobile robotic inspection system. The system employs a mobile robot equipped with multi-modal sensors for comprehensive data acquisition, with the proposed Mixture-of-Experts Zero-Shot Anomaly Detection (MoE-ZSAD) model serving as the core algorithm. By semantically aligning multi-dimensional image features with textual descriptions of normal states, the model achieves precise identification of various known and potential unknown defects without requiring training on defect samples. Experimental results demonstrate that the model performs exceptionally well in defect detection within complex scenarios, achieving a Pixel-Level Area Under the Receiver Operating Characteristic Curve (
) exceeding 0.96. It significantly outperforms current benchmark models in terms of both detection accuracy and generalization ability. Analysis indicates that this method effectively overcomes the limitations of traditional visual detection regarding dependency on anomalous samples and validates the feasibility of utilizing cross-modal technology for industrial inspection. This study not only provides an efficient, objective, and highly adaptive solution for automated pre-flight inspection, significantly enhancing aviation maintenance safety and operational efficiency, but
| [1] | Abbas, J. and Khare, A. (2024) Potential Errors during Final Inspection and Certification Process of an Aircraft Component. Aircraft Engineering and Aerospace Technology, 96, 564-572. https://doi.org/10.1108/aeat-11-2023-0294 |
| [2] | Sharov, V.D., Vorobyov, V.V. and Zatuchny, D.A. (2021) Probabilistic-Statistical Methods for Risk Assessment in Civil Aviation. Springer, 69-113. https://doi.org/10.1007/978-981-16-0092-0 |
| [3] | Rajee Olaganathan, (2024) Human Factors in Aviation Maintenance: Understanding Errors, Management, and Technological Trends. Global Journal of Engineering and Technology Advances, 18, 92-101. https://doi.org/10.30574/gjeta.2024.18.2.0021 |
| [4] | Li, A., Qiu, C., Kloft, M., Smyth, P., Rudolph, M. and Mandt, S. (2023) Zero-Shot Anomaly Detection via Batch Normalization. arXiv: 2302.07849. |
| [5] | Sekelová, I., Korba, P., Koščáková, M. and Stanislavová, L. (2024) Examining Language Communication Difficulties in Aircraft Maintenance. Acta Avionica Journal, 26, 63-72. https://doi.org/10.35116/aa.2024.0008 |
| [6] | Piao, M., Wang, X., Wang, W., Xie, Y. and Lu, B. (2025) A Review of Robotic Aircraft Skin Inspection: From Data Acquisition to Defect Analysis. Mathematics, 13, Article 3161. https://doi.org/10.3390/math13193161 |
| [7] | Jeong, J., Zou, Y., Kim, T., Zhang, D., Ravichandran, A. and Dabeer, O. (2023) WinCLIP: Zero-/Few-Shot Anomaly Classification and Segmentation. 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Vancouver, 17-24 June 2023, 19606-19616. https://doi.org/10.1109/cvpr52729.2023.01878 |
| [8] | Ren, J., Tang, T., Jia, H., Xu, Z., Fayek, H., Li, X., et al. (2025) Foundation Models for Anomaly Detection: Vision and Challenges. AI Magazine, 46, e70045. https://doi.org/10.1002/aaai.70045 |
| [9] | Koch, J., Jevremovic, D., Moenck, K. and Schüppstuhl, T. (2024) A Digital Assistance System Leveraging Vision Foundation Models & 3D Localization for Reproducible Defect Segmentation in Visual Inspection. Procedia CIRP, 130, 387-397. https://doi.org/10.1016/j.procir.2024.10.105 |
| [10] | Xu, J.C., Lo, S.Y., Safaei, B., Patel, V.M. and Dwivedi, I. (2025) Towards Zero-Shot Anomaly Detection and Reasoning with Multimodal Large Language Models. arXiv: 2502.07601. |
| [11] | Mu, S. and Lin, S. (2024) A Comprehensive Survey of Mixture-of-Experts: Algorithms, Theory, and Applications. arXiv: 2503.07137. |
| [12] | Vats, A., Raja, R., Jain, V. and Chadha, A. (2024) The Evolution of Mixture of Experts: A Survey from Basics to Breakthroughs. Journal of IEEE Transactions on Artificial Intelligence, 1. https://doi.org/10.20944/preprints202408.0583.v2 |
| [13] | Srivastava, P.A. (2025) Demystifying Sensor Fusion and Multi-Modal Perception in Robotics. European Journal of Computer Science and Information Technology, 13, 76-90. https://doi.org/10.37745/ejcsit.2013/vol13n267690 |
| [14] | Olufade, M.A., Bankole, E.A., Victor-Igun, O.O. and Junior, A. (2025) Multimodal Sensor Fusion for Autonomous Systems: Integrating Data from Various Sensors to Improve Decision-Making in Autonomous Vehicles and Robotics. Journal of Basic and Applied Research International, 31, 37-54. https://doi.org/10.56557/jobari/2025/v31i49405 |
| [15] | Costanzino, A., Ramirez, P.Z., Lisanti, G. and Di Stefano, L. (2024) Multimodal Industrial Anomaly Detection by Cross-Modal Feature Mapping. 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, 16-22 June 2024, 17234-17243. https://doi.org/10.1109/cvpr52733.2024.01631 |
| [16] | Tu, Y., Zhang, B., Liu, L., Li, Y., Zhang, J., Wang, Y., et al. (2024) Self-Supervised Feature Adaptation for 3D Industrial Anomaly Detection. In: Leonardis, A., Ricci, E., Roth, S., Russakovsky, O., Sattler, T. and Varol, G., Eds., Computer Vision—ECCV 2024, Springer, 75-91. https://doi.org/10.1007/978-3-031-72627-9_5 |
| [17] | Huang, Z., Li, X., Liu, H., Xue, F., Wang, Y. and Zhou, Y. (2025) AnomalyNCD: Towards Novel Anomaly Class Discovery in Industrial Scenarios. 2025 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, 10-17 June 2025, 4755-4765. https://doi.org/10.1109/cvpr52734.2025.00448 |
| [18] | Pan, Y., Wang, L., Chen, Y., Zhu, W., Peng, B. and Chi, M. (2025) PA-CLIP: Enhancing Zero-Shot Anomaly Detection through Pseudo-Anomaly Awareness. arXiv: 2503.01292. |
| [19] | Dou, S., Zhou, E., Liu, Y., Gao, S., Shen, W., Xiong, L., et al. (2024) LoRAMoE: Alleviating World Knowledge Forgetting in Large Language Models via Moe-Style Plugin. Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Bangkok, 11-16 August 2024, 1932-1945. https://doi.org/10.18653/v1/2024.acl-long.106 |
| [20] | Lai, X., Yang, L., He, X., Pang, Y., Song, X. and Sun, W. (2023) Digital Twin-Based Structural Health Monitoring by Combining Measurement and Computational Data: An Aircraft Wing Example. Journal of Manufacturing Systems, 69, 76-90. https://doi.org/10.1016/j.jmsy.2023.06.006 |
| [21] | Liu, T., Blondel, M., Riquelme, C. and Puigcerver, J. (2024) Routers in Vision Mixture of Experts: An Empirical Study. arXiv: 2401.15969. |
| [22] | Jain, G., Hegde, N., Kusupati, A., Nagrani, A., Buch, S., Jain, P., Arnab, A. and Paul, S. (2024) Mixture of Nested Experts: Adaptive Processing of Visual Tokens. arXiv: 2407.19985. |
| [23] | Cao, Y., Zhang, J., Frittoli, L., Cheng, Y., Shen, W. and Boracchi, G. (2024) AdaCLIP: Adapting CLIP with Hybrid Learnable Prompts for Zero-Shot Anomaly Detection. In: Leonardis, A., Ricci, E., Roth, S., Russakovsky, O., Sattler, T. and Varol, G., Eds., Computer Vision—ECCV 2024, Springer, 55-72. https://doi.org/10.1007/978-3-031-72761-0_4 |
| [24] | Ahmed, W. (2025) Artificial Intelligence in Aviation: A Review of Machine Learning and Deep Learning Applications for Enhanced Safety and Security. Premier Journal of Artificial Intelligence. https://doi.org/10.70389/pjai.100013 |
| [25] | Moghadasnian, S. (2025) AI-Powered Predictive Maintenance in Aviation Operations. 16th International Conference on Advanced Research in Science Engineering and Technology, Chennai, 22-23 March 2026. |
| [26] | Sadeghi, A., Bellavista, P., Song, W. and Yazdani-Asrami, M. (2024) Digital Twins for Condition and Fleet Monitoring of Aircraft: Toward More-Intelligent Electrified Aviation Systems. IEEE Access, 12, 99806-99832. https://doi.org/10.1109/access.2024.3371902 |