Improving 2D Construction Plans with Cycle-Consistent Generative Adversarial Networks
Publication: Computing in Civil Engineering 2021
ABSTRACT
Digital methods such as building information modeling (BIM) offer significant potential in the operation phase of a building. A prerequisite for these methods is the availability of digital as-built models of the existing buildings that are not given for many of them. This makes a retro-digitization, i.e., the generation of a digital representation of an already existing building, necessary. Thereby, computer vision (CV) and machine learning (ML) are essential technologies to extract the information from the data sources of a building. An important data source is 2D construction plans from which the initially planned geometry of existing buildings can be extracted. The extraction requires a highly reliable detection of lines and texts. However, the performance of the CV and ML methods is highly dependent on the quality of the data. Anomalies like discolorations, stains, and fold lines on 2D plans can negatively affect the detection. This is especially the case for old hand-drawn paper plans that are often the only data source available for old buildings. To integrate old 2D plans better in the detection process by CV and ML, their quality recovery is necessary. To achieve this, we propose using the cycle-consistent generative adversarial network (CycleGAN) that enables style transformation with unpaired data. Hereby transformation means the removal of the stated anomalies. Our results show that both text and edge detection methods perform better on improved 2D plans than on the original 2D plans with anomalies.
Get full access to this chapter
View all available purchase options and get full access to this chapter.
REFERENCES
Bortoluzzi, B., Efremov, I., Medina, C., Sobieraj, D., and McArthur, J. J. (2019). “Automating the creation of building information models for existing buildings”. Automation in Construction, Vol. 105.
Gimenez, L., Robert, S., Suard, F., and Zreik, K. (2016). “Automatic reconstruction of 3D building models from scanned 2D floor plans”. Automation in Construction, Vol. 63, pp. 48–56.
Goodfellow, I. J., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., and Bengio, Y. (2014). “Generative adversarial networks”.
Hoque, O. B., Rashid, M. B., and Jawad, K. M. T. (2020). “Autonomous Deblurring Images and Information Extraction from Documents Using CycleGAN and Mask RCNN”. 23rd International Conference on Computer and Information Technology (ICCIT), pp. 1–6.
Lu, B., Chen, J., and Chellappa, R. (2019). “UID-GAN: Unsupervised Image Deblurring via Disentangled Representations” in IEEE Transactions on Biometrics, Behavior, and Identity Science, vol. 2, no. 1, pp. 26–39.
Luo, X., Zhang, X., Yoo, P., Martin-Brualla, R., Lawrence, J., and Seitz, S. (2020). “Time-Travel Rephotography”.
Neji, H., Ben Halima, M., Hamdani, T. M., Nogueras-Iso, J., and Alimi, A. M. (2021). “Blur2Sharp: A GAN-Based Model for Document Image Deblurring”. International Journal of Computational Intelligence Systems, vol 14(1) pp. 1315–1321.
Ronneberger, O., Philipp Fischer, P., and Brox, T. (2015). “U-net: Convolutional networks for biomedical image segmentation.” International Conference on Medical image computing and computer-assisted intervention. Springer, Cham (pp. 234–241).
Wan, Z., Zhang, B., Chen, D., Zhang, P., Chen, D., Liao, J., and Wen, F. (2020). “Old Photo Restoration via Deep Latent Space Translation”.
Wu, Y., Shang, J., Chen, P., Hu, X., and Zhou, Z. (2020). “Indoor mapping and modeling by parsing floorplan images”. International Journal of Geographical Information Science, 1–27.
Zhao, Y., Deng, X., and Lai, H. (2020). “A Deep Learning-Based Method to Detect Components from Scanned Structural Drawings for Reconstructing 3D Models”. Applied Sciences, 10, 2066.
Zhou, X., Yao, C., Wen, H., Wang, Y., Zhou, S., He, W., and Liang, J. (2017). “East: an efficient and accurate scene text detector”. Proceedings of the IEEE conference on Computer Vision and Pattern Recognition (pp. 5551–5560).
Zhu, J. Y., Park, T., Isola, P., and Efros, A. A. (2017). “Unpaired image-to-image translation using cycle-consistent adversarial networks”. Proceedings of the IEEE international conference on computer vision (pp. 2223–2232).
Information & Authors
Information
Published In
History
Published online: May 24, 2022
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.