This paper proposes an augmented reality (AR) strategy in which a Lamb waves based impact detection methodology dynamically interacts with a head portable visualization device allowing the inspector to see the estimated impact position (with its uncertainty) and impact energy directly on the plate-like structure. The impact detection methodology uses a network of piezosensors bonded on the structure to be monitored and a signal processing algorithm (the Warped Frequency Transform) able to compensate for dispersion the acquired waveforms. The compensated waveforms yield to a robust estimation of Lamb waves difference in distance of propagation (DDOP), used to feed hyperbolic algorithms for impact location determination, and allow an estimation of the uncertainty of the impact positioning as well as of the impact energy. The outputs of the impact methodology are passed to a visualization technology that yielding their representation in Augmented Reality (AR) is meant to support the inspector during the on-field inspection/diagnosis as well as the maintenance operations. The inspector, in fact, can see interactively in real time the impact data directly on the surface of the structure. To validate the proposed approach, tests on an aluminum plate are presented. Results confirm the feasibility of the method and its exploitability in maintenance practice. 1. Introduction Augmented reality (AR) is a live, direct or indirect, view of a physical, real-world environment whose elements are augmented (or supplemented) by computer-generated input such as sound, graphics, images, or video data. AR was first used for military, industrial, and medical applications, but it was soon applied to numerous commercial and entertainment areas [1]. Numerous studies, developments and applications of AR have been proposed, as reported in the surveys by Azuma [2], Azuma et al. [3], Krevelen and Poleman [4], and Wang et al. [5], and modern trends on AR can be found in some very recent papers [6–8]. However, to the best of the authors’ knowledge, AR has been scarcely used in nondestructive testing and structural health monitoring (NDT/SHM) applications, probably due to the required multidisciplinary expertises including but not limited to solid mechanics, numerical simulation, signal processing, and data visualization. The idea to harness AR for developing, supporting and improving NDT/SHM is an innovative topic which should be better addressed by the literature. The use of augmented reality (AR), in fact, could boost the usability of some NDT/SHM applications in both technical and
References
[1]
https://en.wikipedia.org/wiki/augmented reality.
[2]
R. T. Azuma, “A survey of augmented reality,” Presence, vol. 6, no. 4, pp. 355–385, 1997.
[3]
R. Azuma, Y. Baillot, R. Behringer, S. Feiner, S. Julier, and B. MacIntyre, “Recent advances in augmented reality,” IEEE Computer Graphics and Applications, vol. 21, no. 6, pp. 34–47, 2001.
[4]
D. Krevelen and R. Poleman, “A survey of augmented reality technologies, applications and limitations,” The International Journal of Virtual Reality, vol. 9, no. 2, pp. 1–20, 2010.
[5]
X. Wang, M. J. Kim, P. E. Love, and S. C. Kang, “Augmented reality in built environment: classification and implications for future research,” Automation in Construction, vol. 32, pp. 1–13, 2013.
[6]
H. L. Chi, S. C. Kang, and X. Wang, “Research trends and opportunities of augmented reality applications in architecture, engineering, and construction,” Automation in Construction, vol. 33, pp. 116–122, 2013.
[7]
S. Benbelkacem, M. Belhocine, A. Bellarbi, N. Zenati-Henda, and M. Tadjine, “Augmented reality for photovoltaic pumping systems maintenance tasks,” Renewable Energy, vol. 55, pp. 428–437, 2013.
[8]
J. M. Antonio, S. R. J. Luis, and S. P. Faustino, “Augmented and virtual reality techniques for footwear,” Computers in Industry, 2013.
[9]
A. Farhidzadeh, E. Dehghan-Niri, A. Moustafa, S. Salamone, and A. Whittaker, “Damage assessment of reinforced concrete structures using fractal analysis of residual crack patterns,” Experimental Mechanics, pp. 1–13, 2012.
[10]
B. Koo, H. Choi, and T. Shon, “Wiva: Wsn monitoring framework based on 3D visualization and augmented reality in mobile devices,” in Ambient Assistive Health and Wellness Management in the Heart of the City, M. Mokhtari, I. Khalil, J. Bauchet, D. Zhang, and C. Nugent, Eds., vol. 5597 of Lecture Notes in Computer Science, pp. 158–165, Springer, Berlin, Germany, 2009.
[11]
J. L. Rose, Ultrasonic Waves in Solid Media, Cambridge University Press, 1999.
[12]
R. Seydel and F.-K. Chang, “Impact identification of stiffened composite panels: I. System development,” Smart Materials and Structures, vol. 10, no. 2, pp. 354–369, 2001.
[13]
B. Wang, J. Takatsubo, Y. Akimune, and H. Tsuda, “Development of a remote impact damage identification system,” Structural Control and Health Monitoring, vol. 12, no. 3-4, pp. 301–314, 2005.
[14]
Z. Su, L. Ye, and Y. Lu, “Guided Lamb waves for identification of damage in composite structures: a review,” Journal of Sound and Vibration, vol. 295, no. 3–5, pp. 753–780, 2006.
[15]
T. Kundu, S. Das, and K. V. Jata, “Point of impact prediction in isotropic and anisotropic plates from the acoustic emission data,” Journal of the Acoustical Society of America, vol. 122, no. 4, pp. 2057–2066, 2007.
[16]
T. Kundu, S. Das, and K. V. Jata, “Detection of the point of impact on a stiffened plate by the acoustic emission technique,” Smart Materials and Structures, vol. 18, no. 3, Article ID 035006, 2009.
[17]
F. Ciampa and M. Meo, “Acoustic emission source localization and velocity determination of the fundamental mode A0 using wavelet analysis and a newton-based optimization technique,” Smart Materials and Structures, vol. 19, no. 4, Article ID 045027, 2010.
[18]
S. Salamone, I. Bartoli, P. di Leo et al., “High-velocity impact location on aircraft panels using macro-fiber composite piezoelectric rosettes,” Journal of Intelligent Material Systems and Structures, vol. 21, no. 9, pp. 887–896, 2010.
[19]
A. Perelli, L. de Marchi, A. Marzani, and N. Speciale, “Acoustic emission localization in plates with dispersion and reverberations using sparse PZT sensors in passive mode,” Smart Materials and Structures, vol. 21, no. 2, Article ID 025010, 2012.
[20]
E. D. Niri, A. Farhidzadeh, and S. Salamone, “Nonlinear kalman filtering for acoustic emission source localization in anisotropic panels,” Ultrasonics, 2013.
[21]
A. Liverani and A. Ceruti, “Interactive GT code management for mechanical part similarity search and cost prediction,” Computer-Aided Design and Applications, vol. 7, no. 1, pp. 1–15, 2010.
[22]
A. Liverani, A. Ceruti, and G. Caligiana, “Tablet-based 3D sketching and curve reverse modelling,” International Journal of Computer Aided Engineering and Technology, vol. 5, no. 2-3, 2013.
[23]
S. Debernardis, M. Fiorentino, M. Gattullo, G. Monno, and A. E. Uva, “Text readability in head-worn displays: color and style optimization in video vs. optical see-through devices,” IEEE Transactions on Visualization and Computer Graphics, vol. PP, no. 99, p. 1, 2013.
[24]
F. Zhou, H. B.-L. Dun, and M. Billinghurst, “Trends in augmented reality tracking, interaction and display: a review of ten years of ISMAR,” in Proceedings of the 7th IEEE International Symposium on Mixed and Augmented Reality (ISMAR '08), pp. 193–202, Cambridge, UK, September 2008.
[25]
G. Welch and E. Foxlin, “Motion tracking: no silver bullet, but a respectable arsenal,” IEEE Computer Graphics and Applications, vol. 22, no. 6, pp. 24–38, 2002.
[26]
M. Pressigout and é. Marchand, “Hybrid tracking algorithms for planar and non-planar structures subject to illumination changes,” in Proceedings of the 5th IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR '06), pp. 52–55, IEEE Computer Society, Santa Barbara, Calif, USA, October 2006.
[27]
P. P. Valentini and E. Pezzuti, “Interactive multibody simulation in augmented reality,” Journal of Theoretical and Applied Mechanics, vol. 48, no. 3, pp. 733–750, 2010.
[28]
A. David and P. Jean, Computer Vision: A Modern Approach, 2002.
[29]
H. Wu, Z. Cai, and Y. Wang, “Vision-based auxiliary navigation method using augmented reality for unmanned aerial vehicles,” in Proceedings of the 10th IEEE International Conference on Industrial Informatics (INDIN '12), pp. 520–525, Beijing, China, July 2012.
[30]
S. Yuen, G. Yaoyuneyong, and E. Johnson, “Augmented reality: an overview and five directions for ar in education,” Journal of Educational Technology Development and Exchange, vol. 4, no. 1, pp. 2119–2140, 2011.
[31]
D. Marquardt, “An algorithm for least-squares estimation of nonlinear parameters,” Journal of the Society For Industrial and Applied Mathematics, vol. 11, no. 2, pp. 431–441, 1963.
[32]
S. Caporale, L. de Marchi, and N. Speciale, “Frequency warping biorthogonal frames,” IEEE Transactions on Signal Processing, vol. 59, no. 6, pp. 2575–2584, 2011.
P. Bocchini, A. Marzani, and E. Viola, “Graphical user interface for guided acoustic waves,” Journal of Computing in Civil Engineering, vol. 25, no. 3, pp. 202–210, 2011.
