Augmented Reality Based on Object Recognition for Piping System Maintenance

Source:
By:Ana Regina Mizrahy Cuperschmid,Mariana Higashi Sakamoto

DOI: https://doi.org/10.30564/jaeser.v4i2.3305

Abstract:

Augmented Reality (AR) applications can be used to improve tasks and mitigate errors during facilities operation and maintenance. This article presents an AR system for facility management using a three-dimensional (3D) object tracking method. Through spatial mapping, the object of interest, a pipe trap underneath a sink, is tracked and mixed onto the AR visualization. From that, the maintenance steps are transformed into visible and animated instructions. Although some tracking issues related to the component parts were observed, the designed AR application results demonstrated the potential to improve facility management tasks.

References:

[1]Milgram P, Takemura H, Utsumi A, Kishino F. Augmented reality: a class of displays on the reality-virtuality continuum. In: Das H, editor. Telemanipulator Telepresence Technol [Internet]. SPIE; 1995. p. 282-92. Available from: DOI: https://doi.org/10.1117/12.197321. [2]Schnabel MA. Framing Mixed Realities. In: Wang X, Schnabel MA, editors. Mix Real Archit Des Constr [Internet]. Dordrecht: Springer Netherlands; 2009. p. 3-11. Available from: DOI: https://doi.org/10.1007/978-1-4020-9088-2_1. [3]Meža S, Turk Ž, Dolenc M. Measuring the potential of augmented reality in civil engineering. Adv Eng Softw [Internet]. 2015;90:1-10. Available from: https://www.sciencedirect.com/science/article/pii/S0965997815000915. [4]Rankohi S, Waugh L. Review and analysis of augmented reality literature for construction industry. Vis Eng. 2013;1:1-18. [5]Diao PH, Shih NJ. BIM-based AR maintenance system (BARMS) as an intelligent instruction platform for complex plumbing facilities. Appl Sci. 2019;9. [6]Pucci A, Conceição D. Estudo Da Incidência De Falhas Visando a Melhoria Da Qualidade Dos Sistemas Prediais Hidráulicos E Sanitários. 2007. [7]Kwiatek C, Sharif M, Li S, Haas C, Walbridge S. Impact of augmented reality and spatial cognition on assembly in construction. Autom Constr. 2019;108. [8]Baek F, Ha I, Kim H. Augmented reality system for facility management using image-based indoor localization. Autom Constr [Internet]. Elsevier; 2019;99:18-26. Available from: DOI: https://doi.org/10.1016/j.autcon.2018.11.034. [9]Morikawa K, Ando T. Reduction of piping management person-hours through use of AR technology at shipbuilding sites. Fujitsu Sci Tech J. 2019;55:20-6. [10]Liu F, Seipel S. Precision study on augmented reality-based visual guidance for facility management tasks. Autom Constr [Internet]. Elsevier; 2018;90:79- 90. Available from: https://doi.org/10.1016/j.autcon.2018.02.020. [11]Han YS, Lee J, Lee J, Lee W, Lee K. 3D CAD data extraction and conversion for application of augmented/virtual reality to the construction of ships and offshore structures. Int J Comput Integr Manuf [Internet]. Taylor & Francis; 2019;32:658- 68. Available from: https://doi.org/10.1080/0951192X.2019.1599440. [12]Alruwaythi O, Goodrum P. A Difference in Perspective: Impact of Different Formats of Engineering Information and Spatial Cognition on Craft-Worker Eye-Gaze Patterns. J Constr Eng Manag. 2019;145:1-14. [13]Shen Z, Jiang L. An Augmented 3D iPad Mobile Application for Communication, Collaboration, and Learning (CCL) of Building MEP Systems. Comput Civ Eng [Internet]. 2012. p. 204- 12. Available from: https://ascelibrary.org/doi/abs/10.1061/9780784412343.0026 [14]PTC Inc. Vuforia Developer Library [Internet]. 2021 [cited 2021 May 31]. Available from: https://library.vuforia.com/ [15]Wikitude GmbH. Wikitude SDK Full Features Overview [Internet]. 2021 [cited 2021 May 31]. Available from: https://www.wikitude.com/products/wikitude-sdk-features/. [16]Visometry GmbH. visionLib Docs [Internet]. 2020 [cited 2021 May 31]. Available from: https://docs.visionlib.com/v20.11.1/index.html. [17] Unity Technologies. Unity - Manual: Unity User Manual 2020.3 (LTS) [Internet]. 2021 [cited 2021 May 31]. Available from: https://docs.unity3d.com/Manual/index.html.