Video to BrIM: Automated 3D As-Built Documentation of Bridges
Publication: Journal of Performance of Constructed Facilities
Volume 32, Issue 3
Abstract
Labeling and mapping existing infrastructure is one of the grand challenges for civil engineers in the 21st century. The challenge remains in finding an appropriate data collection method that rapidly collects structural and geometrical information of bridges and automatically converts it into three-dimensional (3D) models. Over the last decade, there has been a tremendous effort to develop prototypes for capturing the as-is condition of a bridge and converting it into 3D bridge-information models (BrIMs). Bridge-information models are 3D-information-rich data models that can be used in various phases of bridge design, construction, operations, and maintenance. As an alternative solution, researchers are now studying the processing of videos to capture the required 3D information (videogrammetry) and using algorithms to automatically extract 3D objects and convert the results into a BrIM. This study evaluates the applicability of a novel videogrammetric pipeline for automatically documenting the physical condition of bridges. It also describes the results of three case studies of highway bridge assessment and modeling in which 3D information is extracted from two-dimensional video frames and point cloud data (PCD) are generated. As the next step, the PCD can be converted into a data-rich BrIM object for further processing.
Get full access to this article
View all available purchase options and get full access to this article.
References
Adan, A., and D. Huber. 2011. “3D reconstruction of interior wall surfaces under occlusion and clutter.” In Proc., 2011 Int. Conf. on 3D Imaging, Modeling, Processing, Visualization and Transmission (3DIMPVT), 275–281. New York: IEEE.
Agdas, D., and R. D. Ellis. 2010. “Parametric modeling in transportation construction.” In Proc., Int. Conf. on Computing in Civil and Building Engineering, 189. Nottingham, UK: Nottingham University Press.
Anagnostopoulos, I., V. Pătrăucean, I. Brilakis, and P. Vela. 2016. “Detection of walls, floors, and ceilings in point cloud data.” In Proc., 2016 Construction Research Congress (CRC 2016). Reston, VA: ASCE.
Angst, R., and M. Pollefeys. 2013. “Multilinear factorizations for multi-camera rigid structure from motion problems.” Int. J. Comput. Vision 103 (2): 240–266.
AP (Associated Press). 2013. “Associated press analysis of the federal national bridge inventory.” Accessed by September 15, 2013. https://www.ap.org.
ASCE. 2009. Guiding principles for the nation’s critical infrastructure. Reston, VA: ASCE.
Baatz, G., K. Koeser, D. Chen, R. Grzeszczuk, and M. Pollefeys. 2012. “Leveraging 3D city models for rotation invariant place-of-interest recognition.” Int. J. Comput. Vision 96 (3): 315–334.
Balali, V., M. Golparvar-Fard, and J. M. de la Garza. 2013. “Video-based highway asset recognition and 3D localization.” In Int. Workshop on Computing in Civil Engineering, edited by I. Brilakis, S. Lee, and B. Becerik-Gerber. 379–386. Reston, VA: ASCE.
Bao, S. Y., A. Furlan, L. Fei-Fei, and S. Savarese. 2014. “Understanding the 3D layout of a cluttered room from multiple images.” In Proc., IEEE Winter Conf. on Applications of Computer Vision (WACV). New York: IEEE.
Bosché, F. 2010. “Automated recognition of 3D CAD model objects in laser scans and calculation of as-built dimensions for dimensional compliance control in construction.” Adv. Eng. Inf. 24 (1): 107–118.
Bosché, F., M. Ahmed, Y. Turkan, C. T. Haas, and R. Haas. 2015. “The value of integrating Scan-to-BIM and Scan-vs-BIM techniques for construction monitoring using laser scanning and BIM: The case of cylindrical MEP components.” Autom. Constr. 49: 201–213.
Brilakis, I., H. Fathi, and A. Rashidi. 2011. “Progressive 3D reconstruction of infrastructure with videogrammetry.” J. Autom. Constr. 20 (7): 884–895.
Chen, S., and A. Shirolé. 2006. “Integration of information and automation technologies in bridge engineering and management: Extending the state of the art.” Transp. Res. Rec. 1976: 3–12.
Chen, S. S., J.-W. Li, V.-K. Tangirala, A. Shirole, and T. Sweeney. 2006. “Accelerating the design and delivery of bridges with 3D bridge information modeling: Pilot study of 3D-centric modeling processes for integrated design and construction of highway bridges.”. Washington, DC: Transportation Research Board of the National Academies.
Dai, F., and M. Lu. 2010. “Assessing the accuracy of applying photogrammetry to take geometric measurements on building products.” J. Const. Eng. Manage. 136 (2): 242–250.
Dai, F., A. Rashidi, I. Brilakis, and P. A. Vela. 2011. “Generating the sparse point cloud of a civil infrastructure scene using a single video camera under practical constraints.” In Proc., 2011 Winter Simulation Conf. New York: IEEE.
Dai, F., A. Rashidi, I. Brilakis, and P. A. Vela. 2013. “A comparison of image-based and time-of-flight-based technologies for three-dimensional reconstruction of infrastructure.” J. Const. Eng. Manage. 139 (1): 69–79.
Díaz-Vilariño, L., B. Conde, S. Lagüela, H. Lorenzo, and P. K. Allen. 2015. “Automatic detection and segmentation of columns in as-built buildings from point clouds.” Remote Sens. 7 (12): 15651–15667.
Dick, A. R., P. H. S. Torr, and R. Cipolla. 2004. “Modelling and interpretation of architecture from several images.” Int. J. Comput. Vision 60 (2): 111–134.
Dimitrov, A., R. Gu, and M. Golparvar-Fard. 2016. “Non-uniform b-spline surface fitting from unordered 3D point clouds for as-built modeling.” Comput. Aided Civ. Infrastruct. Eng. 31 (7): 483–498.
Esch, G., M. H. Scott, and E. Zhang. 2009. “Graphical 3D visualization of highway bridge ratings.” J. Comput. Civ. Eng. 23 (6): 355–362.
Fathi, H., and I. Brilakis. 2011. “Automated sparse 3D point cloud generation of infrastructure using its distinctive visual features.” Adv. Eng. Inf. 25 (4): 760–770.
Fathi, H., and I. Brilakis. 2013. “A videogrammetric as-built data collection method for digital fabrication of sheet metal roof panels.” Adv. Eng. Inf. 27 (4): 466–476.
Fathi, H., and I. Brilakis. 2016. “Multistep explicit stereo camera calibration approach to improve Euclidean accuracy of large-scale 3D reconstruction.” J. Comput. Civ. Eng. 30 (1): 04014120.
Fathi, H., F. Dai, and M. Lourakis. 2015. “Automated as-built 3D reconstruction of civil infrastructure using computer vision: Achievements, opportunities, and challenges.” Adv. Eng. Inf. 29 (2): 149–161.
Furukawa, Y., B. Curless, S. Seitz, and R. Szeliski. 2009. “Manhattan-world stereo.” In Proc., IEEE Conf. on Computer Vision and Pattern Recognition. New York: IEEE.
Furukawa, Y., and J. Ponce. 2010. “Accurate, dense, and robust multi-view stereopsis.” IEEE Trans. Pattern Anal. Mach. Intell. 32 (8): 1362–1376.
Gallup, D., J. M. Frahm, and M. Pollefeys. 2010. “A heightmap model for efficient 3D reconstruction from street-level video.” In Proc., 5th Int. Symp. on 3D Data Processing Visualization and Transmission 2010 (3DPVT 2010). New York: IEEE.
Golparvar-Fard, M., F. Peña-Mora, C. A. Arboleda, and C. A. Lee. 2009. “Visualization of construction progress monitoring with 4D simulation model overlaid on time-lapsed photographs.” J. Comput. Civ. Eng. 23 (6): 391–404.
Hähnel, D., W. Burgard, and S. Thrun. 2003. “Learning compact 3D models of indoor and outdoor environments with a mobile robot.” Rob. Auton. Syst. 44 (1): 15–27.
Ham, Y., K. K. Han, J. J. Lin, and M. Golparvar-Fard. 2016. “Visual monitoring of civil infrastructure systems via camera-equipped unmanned aerial vehicles (UAVs): A review of related works.” Visual. Eng. 4 (1): 1–8.
Haque, M., and K. Pongponrat. 2000. “Integrated multimedia uniform bridge element identification system database for bridge inspection and maintenance.” Transp. Res. Rec. 1697: 1–5.
Heng, L., G. H. Lee, F. Fraundorfer, and M. Pollefeys. 2011. “Real-time photo-realistic 3D mapping for micro aerial vehicles.” In Proc., 2011 IEEE/RSJ Int. Conf. on Intelligent Robots and Systems, IROS 2011. New York: IEEE.
Hu, Z.-Z., X.-X. Chen, J.-P. Zhang, and X.-W. Zhang. 2012. “A BIM-based research framework for monitoring and management during operation and maintenance period.” In 14th Int. Conf. on Computing in Civil and Building Engineering, 96–100. Moscow: Moscow State University of Civil Engineering.
Hughes, R. 2004. “Visualization in transportation: Current practice and future directions.” Transp. Res. Rec. 1899: 167–174.
Jáuregui, D., and K. White. 2003. “Implementation of virtual reality in routine bridge inspection.” Transp. Res. Rec. 1827: 29–35.
Jeong, Y.-S., C. Eastman, R. Sacks, and I. Kaner. 2009. “Benchmark tests for BIM data exchanges of precast concrete.” Autom. Constr. 18 (4): 469–484.
Ji, Y., and C. Chang. 2006. “Identification of structural dynamic behavior for continuous system based on videogrammetric technique.” In Smart Structures and Materials 2006: Smart Structures and Integrated Systems, edited by Y. Matsuzaki. San Diego: International Society for Optics and Photonics.
Jung, J., S. Hong, S. Jeong, S. Kim, H. Cho, S. Hong, and J. Heo. 2014. “Productive modeling for development of as-built BIM of existing indoor structures.” Autom. Constr. 42: 68–77.
Karsch, K., M. Golparvar-Fard, and D. Forsyth. 2014. “ConstructAide: Analyzing and visualizing construction sites through photographs and building models.” ACM Trans. Graphics 33 (6): 1–11.
Keoleian, G. A., A. Kendall, J. E. Dettling, V. M. Smith, R. F. Chandler, M. D. Lepech, and V. C. Li. 2005. “Life cycle modeling of concrete bridge design: Comparison of engineered cementitious composite link slabs and conventional steel expansion joints.” J. Infrastruct. Syst. 11 (1): 51–60.
Khaloo, A., and D. Lattanzi. 2017. “Hierarchical dense structure-from-motion reconstructions for infrastructure condition assessment.” J. Comput. Civ. Eng. 31 (1): 04016047.
Kim, S., S. Pakzad, D. Culler, J. Demmel, G. Fenves, S. Glaser, and M. Turon. 2007. “Health monitoring of civil infrastructures using wireless sensor networks.” In Proc., Information Processing in Sensor Networks, 2007. IPSN 2007. 6th Int. Symp. Cambridge, MA: IEEE.
Lafarge, F., R. Keriven, and M. Bredif. 2009. “Combining meshes and geometric primitives for accurate and semantic modeling.” In Proc., British Machine Vision Conf. (BMVC). London: British Machine Vision Association.
Lafarge, F., R. Keriven, and M. Bredif. 2010. “Insertion of 3D-primitives in mesh-based representations: Towards compact models preserving the details.” IEEE Trans. Image Process. 19 (7): 1683–1694.
Lafarge, F., and C. Mallet. 2011. “Building large urban environments from unstructured point data.” In Proc., 2011 IEEE Int. Conf. on Computer Vision (ICCV). New York: IEEE.
Liu, W., H. Guo, H. Li, and Y. Li. 2014. “Using BIM to improve the design and construction of bridge projects: A case study of a long-span steel-box arch bridge project.” Int. J. Adv. Robot Syst. 11 (8): 125.
Lukács, G., R. Martin, and D. Marshall. 1998. “Faithful least-squares fitting of spheres, cylinders, cones and tori for reliable segmentation.” In Proc., 5th European Conf. on Computer Vision, ECCV 1998: Computer Vision—ECCV’98. Berlin: Springer.
Marzouk, M., and M. Hisham. 2011. “Bridge information modeling in sustainable bridge management.” In ICSDC 2011: Integrating Sustainability Practices in the Construction Industry, edited by, W. K. O. Chong and C. Hermreck, 457–466. Reston, VA: ASCE.
Marzouk, M., and M. Hisham. 2014. “Implementing earned value management using bridge information modeling.” KSCE J. Civ. Eng. 18 (5): 1302–1313.
Marzouk, M., M. Hisham, S. Ismail, M. Youssef, and O. Seif. 2010. “On the use of building information modeling in infrastructure bridges.” In Proc., 27th Int. Conf.—Applications of IT in the AEC Industry (CIB W78) Cairo, 1–10. Rotterdam.
NAE (National Academy of Engineering). 2014. Restore and improve urban infrastructure. Washington, DC: NAE.
NBI (National Bridge Inventory). 2016. “National bridge inventory.” Database: Bridges and tunnels in the United States Accessed July 26, 2017.https://www.fhwa.dot.gov/bridge/nbi.cfm.
Nevado, M. M., J. G. García-Bermejo, and E. Z. Casanova. 2004. “Obtaining 3D models of indoor environments with a mobile robot by estimating local surface directions.” Rob. Auton. Syst. 48 (2–3): 131–143.
Partners, S. P., and P. Scarponcini. 2011. Survey of existing XML schemas for incorporation into TransXML., Washington, DC: NCHRP.
Pătrăucean, V., I. Armeni, M. Nahangi, J. Yeung, I. Brilakis, and C. Haas. 2015. “State of research in automatic as-built modelling.” Adv. Eng. Inf. 29 (2): 162–171.
Pollefeys, M., et al. 2008. “Real-time urban 3D reconstruction from video.” Int. J. Comput. Vision 78 (2–3): 143–167.
Poullis, C. 2013. “A framework for automatic modeling from point cloud data.” IEEE Trans. Pattern Anal. Mach. Intell. 35 (11): 2563–2575.
Rashidi, A., and I. Brilakis. 2016. “Point cloud data cleaning and refining for built infrastructure modeling applications.” Proc., 2016 Construction Research Congress (CRC 2016). Reston, VA: ASCE.
Rashidi, A., I. Brilakis, and P. A. Vela. 2015. “Generating absolute-scale point cloud data of built infrastructure scenes using a monocular camera setting.” J. Comput. Civ. Eng. 29 (6): 04014089.
Rashidi, A., F. Dai, I. Brilakis, and P. Vela. 2013. “Optimized selection of key frames for monocular videogrammetric surveying of civil infrastructure.” Adv. Eng. Inf. 27 (2): 270–282.
Rashidi, A., H. Fathi, and I. Brilakis. 2011. “Innovative stereo vision-based approach to generate dense depth map of transportation infrastructure.” Transp. Res. Rec. 2215: 93–99.
Remondino, F., L. Barazzetti, F. Nex, M. Scaioni, and D. Sarazzi. 2011. “UAV photogrammetry for mapping and 3D modeling: Current status and future perspectives.” In Proc., ISPRS. Zurich, Switzerland: International Society of Photogrammetry and Remote Sensing.
Sacks, R., C. M. Eastman, and G. Lee. 2004. “Parametric 3D modeling in building construction with examples from precast concrete.” Autom. Constr. 13 (3): 291–312.
Scaramuzza, D., F. Fraundorfer, M. Pollefeys, and R. Siegwart. 2009. “Absolute scale in structure from motion from a single vehicle mounted camera by exploiting nonholonomic constraints.” In Proc., IEEE 12th Int. Conf. on Computer Vision. New York: IEEE.
Schindler, G., and F. Dellaert. 2012. “4D cities: Analyzing, visualizing, and interacting with historical urban photo collections.” J. Multimedia 7 (2): 124–131.
Schindler, G., P. Krishnamurthy, and F. Dellaert. 2006. “Line-based structure from motion for urban environments.” In Proc., 3DPVT ‘06 Proc., 3rd Int. Symp. on 3D Data Processing, Visualization, and Transmission (3DPVT’06). New York: IEEE.
Schnabel, R., R. Wahl, and R. Klein. 2007. “Efficient RANSAC for point-cloud shape detection.” Comput. Graphics Forum 26 (2): 214–226.
Shim, C., N. Yun, and H. Song. 2011. “Application of 3D bridge information modeling to design and construction of bridges.” Procedia Eng. 14: 95–99.
Silberman, N., D. Hoiem, P. Kohli, and R. Fergus. 2012. “Indoor segmentation and support inference from RGBD images.” In Proc., 12th European Conf. on Computer Vision, ECCV 2012: Computer Vision– ECCV 2012. Berlin: Springer.
Stamos, I., and P. K. Allen. 2002. “Geometry and texture recovery of scenes of large scale.” Comput. Vision Image Understanding 88 (2): 94–118.
Tang, P., D. Huber, B. Akincic, R. Lipman, and A. Lytle. 2010. “Automatic reconstruction of as-built building information models from laser-scanned point clouds: A review of related techniques.” Autom. Constr. 19 (7): 829–843.
Thompson, P. 2004. “Bridge life-cycle costing in integrated environment of design, rating, and management.” Transp. Res. Rec. 1866: 51–58.
Toldo, R., and A. Fusiello. 2010. “Photo-consistent planar patches from unstructured cloud of points.” In Proc., 11th European Conf. on Computer Vision. Berlin: Springer.
Verma, K., T. Siewert, and F. Beckmann. 2006. “Integrated bridge project delivery and life cycle management.” In Proc., 1st South-East Asia IIW Congress, National Institute of Standards and Technology (NIST), 1–10. Gaithersburg, MD: National Institute of Standards and Technology.
Xiao, J., and Y. Furukawa. 2012. “Reconstructing the world’s museums.” In Proc., 12th European Conf. on Computer Vision, ECCV 2012: Computer Vision—ECCV 2012. Berlin: Springer.
Xiong, X., A. Adan, B. Akinci, and D. Huber. 2013. “Automatic creation of semantically rich 3D building models from laser scanner data.” Autom. Constr. 31: 325–337.
Xiong, X., and D. Huber. 2010. “Using context to create semantic 3D models of indoor environments.” In Proc., British Machine Vision Conf. (BMVC). London: BMVA Press.
Yan, D. M., Y. Liu, and W. Wang. 2006. “Quadric surface extraction by variational shape approximation.” In Proc., 4th Int. Conf. on Geometric Modeling and Processing. Berlin: Springer.
Zeibak-Shini, R., R. Sacks, and S. Filin. 2012. “Toward generation of a Building Information Model of a deformed structure using laser scanning technology.” In 14th Int. Conf. on Computing in Civil and Building Engineering (ICCCBE). Moscow: Moscow State University of Civil Engineering.
Zeisl, B., C. Zach, and M. Pollefeys. 2011. “Stereo reconstruction of building interiors with a vertical structure prior.” In Proc., 2011 Int. Conf. on 3D Imaging, Modeling, Processing, Visualization and Transmission (3DIMPVT). New York: IEEE.
Zhang, G., P. A. Vela, and I. Brilakis. 2013. “Detecting, fitting, and classifying surface primitives for infrastructure point cloud data.” In Proc., ASCE Int. Workshop on Computing in Civil Engineering. Reston, VA: ASCE.
Zhang, G., P. A. Vela, I. Brilakis, and P. Karasev. 2015. “A sparsity-inducing optimization based algorithm for planar patches extraction from noisy point-cloud data.” Comput. Aided Civ. Infrastruct. Eng. 30 (2): 85–102.
Ziering, E. 2007. TransXML: XML schemas for exchange of transportation data. NCHRP Project 20-64, Washington, DC: Transportation Research Board.
Information & Authors
Information
Published In
Journal of Performance of Constructed Facilities
Volume 32 • Issue 3 • June 2018
Copyright
©2018 American Society of Civil Engineers.
History
Received: Jul 17, 2017
Accepted: Nov 16, 2017
Published online: Apr 11, 2018
Published in print: Jun 1, 2018
Discussion open until: Sep 11, 2018
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.