[en] Augmented reality (AR) is a relevant technology, which has demonstrated to be efficient for several applications, especially in the architecture, engineering, construction and operation (AECO) domain, where the integration of building information modeling (BIM) and AR has proved to be optimal in handling construction projects. However, the main challenge when integrating a virtual 3D model in an AR environment is the lack of precision and accuracy of placement that can occur between the real and the virtual environments. Although methods for placement via AR have been reported in the literature, there is a lack of investigations addressing their evaluation. Therefore, this paper proposes a methodology to perform a quantitative and qualitative assessment of several AR placement methods and a discussion about their usability in the specific context of AECO. We adopt root mean square error (RMSE) to quantify the placement accuracy of a 3D model and standard deviation to examine its stability (jittering). The results revealed that the AR placement error range is extremely wide (from a few centimeters up to meters). In marker-based methods, the results showed centimeter-range in both indoor and outdoor environments, compared to other methods (Inertial, Marker-less, etc.), while marker-less methods have widely varying error range from centimeters to a few meters. Other commercial solutions based on placement-sensors (GNSS and IMU), such as Trimble SiteVision, have proven placement performance in manual mode with centimeter order, while for the automatic mode, the order of placement and stability is metric, due to the low coverage of RTX (real time extended) in the study area.
Disciplines :
Computer science Architecture
Author, co-author :
El Barhoumi, Nabil; Hassan II Institute of Agronomy and Veterinary Medicine > College of Geomatic Sciences and Surveying Engineering
Hajji, Rafika ; Université de Liège - ULiège > Département de géographie > Unité de Géomatique - Topographie et géométrologie
Bouali, Zakaria; Hassan II Institute of Agronomy and Veterinary Medicine > College of Geomatic Sciences and Surveying Engineering
Ben Brahim, Youssef; Hassan II Institute of Agronomy and Veterinary Medicine > College of Geomatic Sciences and Surveying Engineering
Kharroubi, Abderrazzaq ; Université de Liège - ULiège > Département de géographie > Unité de Géomatique - Topographie et géométrologie
Language :
English
Title :
Assessment of 3D Models Placement Methods in Augmented Reality
Alternative titles :
[fr] Évaluation des méthodes de placement des modèles 3D dans la réalité augmentée
Original title :
[en] Assessment of 3D Models Placement Methods in Augmented Reality
Ratajczak J. Riedl M. Matt D.T. BIM-based and AR application combined with location-based management system for the improvement of the construction performance Buildings 2019 9 118 10.3390/buildings9050118
Kurniawan T.A. Othman M.H.D. Hwang G.H. Gikas P. Unlocking digital technologies for waste recycling in Industry 4.0 era: A transformation towards a digitalization-based circular economy in Indonesia J. Clean. Prod. 2022 357 131911 10.1016/j.jclepro.2022.131911
Hamood M.M. Hussein H.A. A framework for Exploring Iraqi tourism sites by Augmented Reality application Eurasian J. Eng. Technol. 2022 7 63 79
Bademosi F. Issa R.R. Implementation of Augmented Reality throughout the Lifecycle of Construction Projects Advances in Informatics and Computing in Civil and Construction Engineering Springer Cham, Switzerland 2019 307 313
Machado R.L. Vilela C. Conceptual framework for integrating BIM and augmented reality in construction management J. Civ. Eng. Manag. 2020 26 83 94 10.3846/jcem.2020.11803
Hajirasouli A. Banihashemi S. Drogemuller R. Fazeli A. Mohandes S.R. Augmented reality in design and construction: Thematic analysis and conceptual frameworks Constr. Innov. 2022 22 ahead-of-print 10.1108/CI-01-2022-0007
Feng C.W. Chen C.W. Using BIM and MR to improve the process of job site construction and inspection WIT Trans. Built Environ. 2019 192 21 32
Chen S.M. Chen P.H. Chang L.M. A framework for an automated and integrated project scheduling and management system Autom. Constr. 2013 35 89 110 10.1016/j.autcon.2013.04.002
Darko A. Chan A.P. Yang Y. Tetteh M.O. Building information modeling (BIM)-based modular integrated construction risk management–Critical survey and future needs Comput. Ind. 2020 123 103327 10.1016/j.compind.2020.103327
Belhaoua A. Kohler S. Hirsch E. Estimation of 3D Reconstruction Errors in a Stereo-Vision System Modeling Aspects in Optical Metrology II SPIE Bellingham, DC, USA 2009 Volume 7390 319 328
Valentin J. Kowdle A. Barron J.T. Wadhwa N. Dzitsiuk M. Schoenberg M. Verma V. Csaszar A. Turner E. Dryanovski I. et al. Depth from motion for smartphone AR ACM Trans. Graph. 2018 37 193 10.1145/3272127.3275041
Fenais A. Ariaratnam S.T. Smilovsky N. Assessing the Accuracy of an Outdoor Augmented Reality Solution for Mapping Underground Utilities J. Pipeline Syst. Eng. Pr. 2020 11 04020029 10.1061/(ASCE)PS.1949-1204.0000474
Gomez-Jauregui V. Manchado C. Del-Castillo-Igareda J. Otero C. Quantitative evaluation of overlaying discrepancies in mobile augmented reality applications for AEC/FM Adv. Eng. Softw. 2018 127 124 140 10.1016/j.advengsoft.2018.11.002
Pérez-Pachón L. Poyade M. Lowe T. Gröning F. Image overlay surgery based on augmented reality: A systematic review Biomed. Vis. 2020 1260 175 195
Azuma R. Furmanski C. Evaluating Label Placement for Augmented Reality View Management Proceedings of the Second IEEE and ACM International Symposium on Mixed and Augmented Reality Tokyo, Japan 10 October 2003 66 75
Breen D.E. Whitaker R.T. Rose E. Tuceryan M. Interactive Occlusion and Automatic Object Placement for Augmented Reality Computer Graphics Forum Blackwell Science Ltd. Edinburgh, UK 1996 Volume 15 11 22
Yoo J.S. Patel D.S. Hrynewycz N.M. Brundage T.S. Singh K. The utility of virtual reality and augmented reality in spine surgery Ann. Transl. Med. 2019 7 (Suppl. 5) S171 10.21037/atm.2019.06.38
Azuma R.T. A survey of augmented reality Presence Teleoperators Virtual Environ. 1997 6 355 385 10.1162/pres.1997.6.4.355
Fenais A. Developing an Augmented Reality Solution for Mapping Underground Infrastructure Doctoral Dissertation Arizona State University Tempe, AZ, USA 2020
Bellarbi A. Vers L’immersion Mobile en Réalité Augmentée: Une Approche Basée sur le Suivi Robuste de Cibles Naturelles et Sur L’interaction 3D Doctoral Dissertation Université d’Evry–Université Paris Saclay Évry-Courcouronnes, France 2017
Kharroubi A. Billen R. Poux F. Marker-less mobile augmented reality application for massive 3D point clouds and semantics Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci. 2020 43 255 261 10.5194/isprs-archives-XLIII-B2-2020-255-2020
Kermen A. Aydin T. Ercan A.O. Erdem T. A Multi-Sensor Integrated Head-Mounted Display Setup for Augmented Reality Applications Proceedings of the 2015 3DTV-Conference: The True Vision-Capture, Transmission and Display of 3D Video (3DTV-CON) Lisbon, Portugal 8–10 July 2015 1 4
Chamzas D. Moustakas K. 3D Augmented Reality Tangible User Interface using Commodity Hardware arXiv 2020 2003.01092
Sadeghi-Niaraki A. Choi S.M. A Survey of Marker-Less Tracking and Registration Methods for Health & Environmental Applications to Augmented Reality and Ubiquitous Geospatial Information Systems Sensors 2020 20 2997
Rabbi I. Ullah S. A survey on augmented reality challenges and tracking Acta Graph. Znan. Časopis Za Tisk. I Graf. Komun. 2013 24 29 46
Valencia-Jimenez N. Leal-Junior A. Avellar L. Vargas-Valencia L. Caicedo-Rodríguez P. Ramírez-Duque A.A. Lyra M. Marques C. Bastos T. Frizera A. A Comparative Study of Markerless Systems Based on Color-Depth Cameras, Polymer Optical Fiber Curvature Sensors, and Inertial Measurement Units: Towards Increasing the Accuracy in Joint Angle Estimation Electronics 2019 8 173 10.3390/electronics8020173
Ahn S. Ko H. Yoo B. Webizing mobile augmented reality content New Rev. Hypermed. Multimed. 2014 20 79 100 10.1080/13614568.2013.857727
Zhang J. Walpola M. Roelant D. Zhu H. Yen K. Self-organization of unattended wireless acoustic sensor networks for ground target tracking Pervasive Mob. Comput. 2009 5 148 164 10.1016/j.pmcj.2008.05.003
Lee C.-H. Liu C.-L. Trappey A.J. Mo J.P. Desouza K.C. Understanding digital transformation in advanced manufacturing and engineering: A bibliometric analysis, topic modeling and research trend discovery Adv. Eng. Inform. 2021 50 101428 10.1016/j.aei.2021.101428
Chen W. Yu C. Tu C. Lyu Z. Tang J. Ou S. Fu Y. Xue Z. A Survey on Hand Pose Estimation with Wearable Sensors and Computer-Vision-Based Methods Sensors 2020 20 1074 10.3390/s20041074 32079124
Tang R. Ma L.-F. Rong Z.-X. Li M.-D. Zeng J.-P. Wang X.-D. Liao H.-E. Dong J.-H. Augmented reality technology for preoperative planning and intraoperative navigation during hepatobiliary surgery: A review of current methods Hepatobiliary Pancreat. Dis. Int. 2018 17 101 112 10.1016/j.hbpd.2018.02.002
Opromolla R. Fasano G. Rufino G. Grassi M. A Model-Based 3D Template Matching Technique for Pose Acquisition of an Uncooperative Space Object Sensors 2015 15 6360 6382 10.3390/s150306360
Bimber O. Raskar R. Spatial Augmented Reality: Merging Real and Virtual Worlds CRC Press Boca Raton, FL, USA 2005
Moun C. Netramai C. Localization and Building Identification in Outdoor Environment for Smartphone Using Integrated GPS and Camera Proceedings of the 2014 Fourth International Conference on Digital Information and Communication Technology and Its Applications (DICTAP) Bangkok, Thailand 6–8 May 2014 327 332
Li X. Lei T. Zhao C. Huang J. Yuan M. Wang J. Research on Improved Image Registration Algorithm Based on PROSAC Algorithm Proceedings of the Eleventh International Conference on Digital Image Processing (ICDIP 2019) Guangzhou, China 10–13 May 2019 SPIE Bellingham, DC, USA 2019 Volume 11179 694 700
Reitmayr G. Drummond T. Going Out: Robust Model-Based Tracking for Outdoor Augmented Reality Proceedings of the 5th IEEE and ACM International Symposium on Mixed and Augmented Reality Santa Barbara, CA, USA 22–25 October 2006 109 118
Bae H. Golparvar-Fard M. White J. High-precision vision-based mobile augmented reality system for context-aware architectural, engineering, construction and facility management (aec/fm) applications Vis. Eng. 2013 1 3 10.1186/2213-7459-1-3
Liu F. Jonsson T. Seipel S. Evaluation of Augmented Reality-Based Building Diagnostics Using Third Person Perspective ISPRS Int. J. Geo. Inf. 2020 9 53 10.3390/ijgi9010053
Lothe P. Bourgeois S. Dekeyser F. Royer E. Dhome M. Towards Geographical Referencing of Monocular Slam Reconstruction Using 3d City Models: Application to Real-Time Accurate Vision Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition Miami, FL, USA 20–25 June 2009
Cardoso L.F.D.S. Mariano F.C.M.Q. Zorzal E. A survey of industrial augmented reality Comput. Ind. Eng. 2019 139 106159 10.1016/j.cie.2019.106159
Santana J.M. Wendel J. Trujillo A. Suárez J.P. Simons A. Koch A. Multimodal Location Based Services—Semantic 3D City Data as Virtual and Augmented Reality Progress in Location-Based Services 2016 Springer New York, NY, USA 2017 329 353
Rokhsaritalemi S. Sadeghi-Niaraki A. Choi S.M. A review on mixed reality: Current trends, challenges and prospects Appl. Sci. 2020 10 636 10.3390/app10020636
Saputra M.R.U. Markham A. Trigoni N. Visual SLAM and structure from motion in dynamic environments: A survey ACM Comput. Surv. (CSUR) 2018 51 1 36 10.1145/3177853
Xie W. Liang Y. Johnson J. Mower A. Burns S. Chelini C. Alessandro P.D. Weibel N. Schulze J.P. Interactive multi-user 3D visual analytics in augmented reality arXiv 2020 2002.05305 10.2352/ISSN.2470-1173.2020.13.ERVR-363
Takahashi W. Oshikawa S. Mori S. Real-time markerless tumour tracking with patient-specific deep learning using a personalised data generation strategy: Proof of concept by phantom study Br. J. Radiol. 2020 93 20190420 10.1259/bjr.20190420 32101456
Simon G. Fitzgibbon A.W. Zisserman A. Markerless Tracking Using Planar Structures in the Scene Proceedings of the International Symposium on Augmented Reality (ISAR) Munich, Germany 5–6 October 2000 120 128
Čejka J. Zsíros A. Liarokapis F. Un guide hybride de réalité augmentée pour les sites du patrimoine culturel subaquatique Inform. Pers. Ubiquitaire 2020 24 815 828 10.1007/s00779-019-01354-6
Simon R. Fröhlich P. Anegg H. Beyond Location Based–the Spatially Aware Mobile Phone International Symposium on Web and Wireless Geographical Information Systems Springer Berlin/Heidelberg, Germany 2006 12 21
Nath T. Mathis A. Chen A.C. Patel A. Bethge M. Mathis M.W. Using DeepLabCut for 3D markerless pose estimation across species and behaviors Nat. Protoc. 2019 14 2152 2176 10.1038/s41596-019-0176-0
Adam N. Purnamasari D. Ibrahim A. Implementation of Object Tracking Augmented Reality Markerless Using FAST Corner Detection on User Defined-Extended Target Tracking in Multivarious Intensities Journal of Physics: Conference Series IOP Publishing Bristol, UK 2019 Volume 1201 012041
Shah K. Uhyperlink: An Organized Method to Collect, Manage and Store Object Hyperlinks Using Rfid Available online: https://dalspace.library.dal.ca/handle/10222/15076 (accessed on 19 February 2020)
Kim J. Lee Y. Cha S. Choi C. Lee S. Development of a network rtk positioning and gravity-surveying application with gravity correction using a smartphone Sensors 2013 13 8879 8894 10.3390/s130708879
Holloway L.E. Krogh B.H. Giua A. A survey of Petri net methods for controlled discrete event systems Discret. Event Dyn. Syst. 1997 7 151 190 10.1023/A:1008271916548
Gomez J.F. Simon G. Berger M.O. Calibration Errors in Augmented Reality: A Practical Study Proceedings of the Fourth IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR’05) Vienna, Austria 5–8 October 2005 154 163
Fenais A.S. Ariaratnam S.T. Ayer S. Smilovsky N. A review of augmented reality applied to underground construction J. Inf. Technol. Constr. 2020 25 308 324 10.36680/j.itcon.2020.018
Fenais A. Ariaratnam S.T. Ayer S.K. Smilovsky N. Integrating Geographic Information Systems and Augmented Reality for Mapping Underground Utilities Infrastructures 2019 4 60 10.3390/infrastructures4040060
Ligorio G. Sabatini A.M. Extended kalman filter-based methods for pose estimation using visual, inertial and magnetic sensors: Comparative analysis and performance evaluation Sensors 2013 13 1919 1941 10.3390/s130201919
May K.W. Kc C. Ochoa J.J. Gu N. Walsh J. Smith R.T. Thomas B.H. The Identification, Development, and Evaluation of BIM-ARDM: A BIM-Based AR Defect Management System for Construction Inspections Buildings 2022 12 140 10.3390/buildings12020140
Shin D.H. Dunston P.S. Technology development needs for advancing Augmented Reality-based inspection Autom. Constr. 2010 19 169 182 10.1016/j.autcon.2009.11.001
Cheng J.C. Chen K. Chen W. Comparison of Marker-Based AR and Markerless AR: A case study on Indoor Decoration System Proceedings of the Lean and Computing in Construction Congress (LC3): Proceedings of the Joint Conference on Computing in Construction (JC3) Heraklion, Greece 4–7 July 2017 483 490
Cheng K.H. Parents’ user experiences of augmented reality book reading: Perceptions, expectations, and intentions Educ. Technol. Res. Dev. 2019 67 303 315 10.1007/s11423-018-9611-0
Ahn S. Han S. Al-Hussein M. 2D Drawing Visualization Framework for Applying Projection-Based Augmented Reality in a Panelized Construction Manufacturing Facility: Proof of Concept J. Comput. Civ. Eng. 2019 33 04019032 10.1061/(ASCE)CP.1943-5487.0000843
Pepe M. Costantino D. Garofalo A.R. An efficient pipeline to obtain 3D model for HBIM and structural analysis purposes from 3D point clouds Appl. Sci. 2020 10 1235 10.3390/app10041235
Zollmann S. Hoppe C. Kluckner S. Poglitsch C. Bischof H. Reitmayr G. Augmented Reality for Construction Site Monitoring and Documentation Proc. IEEE 2014 102 137 154 10.1109/JPROC.2013.2294314
Al-Adhami M. Wu S. Ma L. Extended Reality Approach for Construction Quality Control International Council for Research and Innovation in Building and Construction (CIB) Ottawa, ON, Canada 2019
Behzadan A.H. Dong S. Kamat V.R. Augmented reality visualization: A review of civil infrastructure system applications Adv. Eng. Inform. 2015 29 252 267 10.1016/j.aei.2015.03.005
Yalcinkaya B. Aguizo J. Couceiro M. Figueiredo A. A Multimodal Tracking Approach for Augmented Reality Applications Proceedings of the 12th Augmented Human International Conference Geneva, Switzerland 27–28 May 2021 1 8