History-Dependent Bridge Deck Maintenance and Replacement Optimization with Markov Decision Processes
Publication: Journal of Infrastructure Systems
Volume 13, Issue 3
Abstract
Bridge maintenance and replacement optimization methods use deterioration models to predict the future condition of bridge components. The purpose of this paper is to develop a framework for bridge maintenance optimization using a deterioration model that takes into account aspects of the history of the bridge condition and maintenance, while allowing the use of efficient optimization techniques. Markovian models are widely used to represent bridge component deterioration. In existing Markovian models, the state is the bridge component condition, and the history of the condition is not taken into account, which is seen as a limitation. This paper describes a method to formulate a realistic history-dependent model of bridge deck deterioration as a Markov chain, while retaining aspects of the history of deterioration and maintenance as part of the model. This model is then used to formulate and solve a reliability-based bridge maintenance optimization problem as a Markov decision process. A parametric study is conducted to compare the policies obtained in this research with policies derived using a simpler Markovian model.
Get full access to this article
View all available purchase options and get full access to this article.
Acknowledgments
Partial funding for this research was provided by the University of California Transportation Center (UCTC) to the first author through a dissertation-year fellowship.
References
Ben-Akiva, M., and Gopinath, D. (1995). “Modeling infrastructure performance and user costs.” J. Infrastruct. Syst., 1(1), 33–43.
Bertsekas, D. P. (2001). Dynamic programming and optimal control, 2nd Ed., Athena Scientific, Belmont, Mass.
Durango, P. L., and Madanat, S. M. (2002). “Optimal maintenance and repair policies in infrastructure management under uncertain facility deterioration rates: an adaptive control approach.” Transp. Res., Part A: Policy Pract., 36A(9), 763–778.
Federal Highway Administration (FHwA). (2002). “Status of the nation’s highways, bridges, and transit.” 2002 Conditions and Performance Rep., FHwA, Washington, D.C., ⟨http://www.fhwa.dot.gov/policy/2002cpr⟩ (Oct 12, 2006).
Frangopol, D. M., Kong, J. S., and Gharaibeh, E. S. (2001). “Reliability-based life-cycle management of highway bridges.” J. Comput. Civ. Eng., 15(1), 27–34.
Golabi, K., and Shepard, R. (1997). “Pontis: A system for maintenance optimization and improvement for U.S. bridge networks.” Interfaces, 27(1), 71–88.
Hawk, H. (1994). Bridgit: Technical manual, National Engineering Technology Coporation, Toronto.
Jiang, M., Corotis, R. B., and Ellis, J. H. (2000). “Optimal life-cycle costing with partial observability.” J. Infrastruct. Syst., 6(2), 56–66.
Kong, J. S., and Frangopol, D. M. (2003). “Life-cycle reliability-based maintenance cost optimization of deteriorating structures with emphasis on bridges.” J. Struct. Eng., 129(6), 818–828.
Madanat, S. M. (1993). “Optimal infrastructure management decision under uncertainty.” Transp. Res., Part C: Emerg. Technol., 1C(1), 77–88.
Mishalani, R. G., and Madanat, S. M. (2002). “Computation of infrastructure transition probabilities using stochastic duration models.” J. Infrastruct. Syst., 8(4), 139–148.
Mori, Y., and Ellingwood, B. (1994). “Maintaining reliability of concrete structures. II. Optimum inspection/repair.” J. Struct. Eng., 120(3), 846–862.
Organization for Economic Cooperation and Development (OECD). (1987). “Pavement management systems.” Road Transport Research Rep., OECD, Paris.
Robelin, C. A., and Madanat, S. M. (2006). “A bottom-up, reliability-based bridge inspection, maintenance and replacement optimization model.” Proc., Transportation Research Board (TRB) Meeting 2006 (CD-ROM), Paper 06-0381, TRB, Washington, D.C.
Schweppe, E. (2001). “ISTEA after .” Public Roads, 65(3), 2–6.
Information & Authors
Information
Published In
Journal of Infrastructure Systems
Volume 13 • Issue 3 • September 2007
Pages: 195 - 201
Copyright
© 2007 ASCE.
History
Received: Feb 14, 2006
Accepted: Jul 27, 2006
Published online: Sep 1, 2007
Published in print: Sep 2007
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.