Chapter
Jan 25, 2024

Deep Reinforcement Learning for Structural Model Updating Using Transfer Learning Mechanism

Publication: Computing in Civil Engineering 2023

ABSTRACT

Structural simulation models using pre-defined assumptions and values of material properties usually produce results that differ from the real structures with varying degree of accuracy. This is commonly attributed to two broad types of uncertainties, namely aleatory (related to inherent randomness) and epistemic (related to lack of knowledge). Sources of such uncertainties include material properties, construction techniques, aging, and natural or man-made hazard-induced damage. Accurate computational models with on-time model updating capabilities are important goals in engineering research and practice for monitoring the structural health during the operation stage and for making rapid and well-informed decisions following extreme events, for example, major earthquakes. Moreover, the advances and recent adoption of artificial intelligence technologies bring effective and innovative solutions for the structural model updating endeavors. In this paper, a novel model updating method is proposed using two deep reinforcement learning algorithms, namely, Advantage Actor-Critic and Asynchronous Advantage Actor-Critic. In addition, transfer learning is adopted, which generalizes the trained model to various scenarios and enhances the computational efficiency. Through several computer experiments, the results demonstrate the high accuracy and computational efficiency of the proposed approach, which brings about its promising potential for practical engineering applications.

Get full access to this article

View all available purchase options and get full access to this chapter.

REFERENCES

Blank, J., and K. Deb. 2020. “Multi-Objective Optimization in Python.” In: IEEE Access 8, 89497–89509.
Bonyadi, M. R., and Z. Michalewicz. 2017. “Particle swarm optimization for single objective continuous space problems: A review.” Evolutionary Computation, 25(1), 1–54.
Ereiz, S., I. Duvnjak, and J. Fernando Jiménez-Alonso. 2022. “Review of finite element model updating methods for structural applications.” In: Structures 41, pp. 684–723.
Gao, Y., and K. M. Mosalam. 2018. “Deep transfer learning for image-based structural damage recognition.” Computer-Aided Civil and Infrastructure Engineering, 33(9), 748–768.
Mnih, V., A. Badia, M. Mirza, A. Graves, T. Lillicrap, T. Harley, D. Silver, and K. Kavukcuoglu. 2016. “Asynchronous methods for deep reinforcement learning.” In International conference on machine learning, pp. 1928–1937.
Sutton, R., and A. Barto. 2018. Reinforcement learning: An introduction. MIT Press.
Silver, D., et al. 2016. “Mastering the game of Go with deep neural networks and tree search.” Nature 529, 484–489.

Information & Authors

Information

Published In

Go to Computing in Civil Engineering 2023
Computing in Civil Engineering 2023
Pages: 364 - 371

History

Published online: Jan 25, 2024

Permissions

Request permissions for this article.

ASCE Technical Topics:

Authors

Affiliations

Issac Kwok-Tai Pang [email protected]
1Structural Artificial Intelligence Research Laboratory, Dept. of Civil and Environmental Engineering, Univ. of California, Berkeley. Email: [email protected]
Yuqing Gao, Ph.D. [email protected]
2Structural Artificial Intelligence Research Laboratory, Dept. of Civil and Environmental Engineering, Univ. of California, Berkeley. Email: [email protected]
Khalid M. Mosalam, Ph.D., P.E., F.ASCE [email protected]
3Taisei Professor of Civil Engineering, Dept. of Civil and Environmental Engineering, Univ. of California, Berkeley. Email: [email protected]

Metrics & Citations

Metrics

Citations

Download citation

If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.

View Options

Get Access

Access content

Please select your options to get access

Log in/Register Log in via your institution (Shibboleth)
ASCE Members: Please log in to see member pricing

Purchase

Save for later Information on ASCE Library Cards
ASCE Library Cards let you download journal articles, proceedings papers, and available book chapters across the entire ASCE Library platform. ASCE Library Cards remain active for 24 months or until all downloads are used. Note: This content will be debited as one download at time of checkout.

Terms of Use: ASCE Library Cards are for individual, personal use only. Reselling, republishing, or forwarding the materials to libraries or reading rooms is prohibited.
ASCE Library Card (5 downloads)
$105.00
Add to cart
ASCE Library Card (20 downloads)
$280.00
Add to cart
Buy Single Paper
$35.00
Add to cart
Buy E-book
$164.00
Add to cart

Get Access

Access content

Please select your options to get access

Log in/Register Log in via your institution (Shibboleth)
ASCE Members: Please log in to see member pricing

Purchase

Save for later Information on ASCE Library Cards
ASCE Library Cards let you download journal articles, proceedings papers, and available book chapters across the entire ASCE Library platform. ASCE Library Cards remain active for 24 months or until all downloads are used. Note: This content will be debited as one download at time of checkout.

Terms of Use: ASCE Library Cards are for individual, personal use only. Reselling, republishing, or forwarding the materials to libraries or reading rooms is prohibited.
ASCE Library Card (5 downloads)
$105.00
Add to cart
ASCE Library Card (20 downloads)
$280.00
Add to cart
Buy Single Paper
$35.00
Add to cart
Buy E-book
$164.00
Add to cart

Media

Figures

Other

Tables

Share

Share

Copy the content Link

Share with email

Email a colleague

Share