Inspection, Maintenance, and Repair with Partial Observability
Publication: Journal of Infrastructure Systems
Volume 1, Issue 2
Abstract
A partially observable Markov decision process (MDP) model is presented that extends beyond completely observable approaches by recognizing that inspections do not yield perfect estimates of the true internal state of system components. The approach permits the exact solution of problems whose output is inspection and maintenance policies that prescribe when to inspect, how to inspect, when to repair and how to repair, so as to minimize discounted life-cycle costs. The extension to accommodate partial observability does, however, exact a significant computational demand. The model is demonstrated with a one-lane, two-girder bridge inspection, maintenance, and repair application.
Get full access to this article
View all available purchase options and get full access to this article.
References
1.
Ang, A. H.-S., and Tang, W. H. (1984). Probability concepts in engineering planning and design: Vol. 2—decision risk, and reliability, Wiley, New York.
2.
Astrom, K. J.(1965). “Optimal control of Markov processes with incomplete state information.”J. Math. Anal. and Applications, 10, 174–205.
3.
Ben-Akiva, M., Humplick, F., Madanat, S., and Ramaswamy, R.(1993). “Infrastructure management under uncertainty: latent performance approach.”J. Transp. Engrg., ASCE, 119(1), 43–58.
4.
Ben-Akiva, M., and Ramaswamy, R.(1993). “An approach for predicting latent infrastructure facility deterioration.”Transp. Sci, 27(2), 174–193.
5.
Ben-Akiva, M., Humplick, F., Madanat, S. and Ramaswamy, R. (1991). “Latent performance approach to infrastructure management.”Transp. Res. Rec. No. 1311, Transportation Research Board, Washington, D.C., 188–195.
6.
Butt, A. A., Shahin, M. Y., Feighan, K. J., and Carpenter, S. H. (1987). “Pavement performance prediction model using the Markov process.”Transp. Res. Rec. No. 1123, Transportation Research Board, Washington, D.C., 12–19.
7.
Carnahan, J. V.(1988). “Analytical framework for optimizing pavement maintenance.”J. Transp. Engrg., ASCE, 114(3), 307–322.
8.
Carnahan, J. V., Davis, W. J., Shahin, M. Y., White, T. D., and Wu, M. I.(1987). “Optimal maintenance decisions for pavement management.”J. Transp. Engrg., ASCE, 113(5), 554–572.
9.
Eagle, J. N.(1984). “The optimal search for a moving target when the search path is constrained.”Operations Res., 32(5), 1107–1115.
10.
Eckles, J. E.(1968). “Optimum maintenance with incomplete information.”Operations Res., 16, 1058–1067.
11.
Feighan, K. J., Shahin, M. Y., Sinha, K. C., White, T. D. (1988). “An application of dynamic programming and other mathematical techniques to pavement management systems.”Transp. Res. Rec. No. 1200, Transportation Research Board, Washington, D.C., 90–98.
12.
Hillier, F. S., and Lieberman, G. J. (1990). Introduction to operation research, 5th Ed., McGraw-Hill, New York.
13.
Humplick, F. (1992a). “Identifying error-generating factors in infrastructure condition evaluations.”Transp. Res. Rec. No. 1344, Transportation Research Board, Washington, D.C., 106–115.
14.
Humplick, F. (1992b). “Highway pavement distress evaluation: modeling measurement error.”Transp. Res., 26B(2), 135–154.
15.
Jacobs, T. L.(1992). “Optimal long-term scheduling of bridge deck replacement and rehabilitation.”J. Transp. Engrg., ASCE, 118(2), 312–322.
16.
Jiang, M., Ellis, J. H., and Corotis, R. B. “An improved algorithm for solving finite horizon partially observable Markov decision processes.” Submitted to Operations Research.
17.
Kulkarni, R. B. (1984). “Dynamic decision model for a pavement management system.”Transp. Res. Rec. No. 997, Transportation Research Board, Washington, D.C., 11–18.
18.
Lovejoy, W. S.(1991a). “A survey of algorithmic methods for partially observed Markov decision processes.”Ann. Operations Res., 28, 47–66.
19.
Lovejoy, W. S.(1991b). “Computationally feasible bounds for partially observed Markov decision processes.”Operations Res., 39(1), 162–175.
20.
Lovejoy, W. S.(1987). “On the convexity of policy regions in partially observed systems.”Operations Res., 35(4), 619–621.
21.
Madanat, S. (1993). “Incorporating inspection decisions in pavement management.”Transp. Res., 27B(6), 425–438.
22.
Madanat, S., and Ben-Akiva, M.(1994). “Optimal inspection and repair policies for infrastructure facilities.”Transportation Science, 28(1), 55–62.
23.
Markow, M. J., Madanat, S. M. and Gurenich, D. I. (1993). “Optimal rehabilitation times for concrete bridge decks.”Transp. Res. Rec. No. 1392, Transportation Research Board, Washington, D.C. 79–89.
24.
Monahan, G. E.(1982). “A survey of partially observable Markov decision processes: theory, models, and algorithms.”Mgmt. Sci., 28(1), 1–16.
25.
Mukherjee, S., and Seth, K.(1991). “A corrected and improved computational scheme for finite horizon partially observable Markov decision processes.”INFOR, 29(3), 206–212.
26.
Ramaswamy, R., and Ben-Akiva, M. (1990). “Estimation of highway pavement deterioration from in-service pavement data.”Transp. Res. Rec. No. 1272, Transportation Research Board, Washington, D.C., 96–106.
27.
Rosenfield, D.(1976). “Markovian deterioration with uncertain information.”Operations Res., 24(1), 141–155.
28.
Satia, J. K., and Lave, R. E.(1973). “Markovian decision processes with probabilistic observation of states.”Mgmt. Sci., 20(1), 1–13.
29.
Smallwood, R., and Sondik, E. J.(1973). “The optimal control of partially observable Markov processes over a finite horizon.”Operations Res., 21, 1071–1088.
30.
Sondik, E. J.(1978). “The optimal control of partially observable Markov processes over the infinite horizon: discounted costs.”Operations Res., 26(2), 282–304.
31.
Sondik, E. J. (1971). “The optimal control of partially observable Markov processes,” PhD dissertation, Department of Engineering—Economic Systems, Stanford Univ., Stanford, Calif.
32.
Tao, Z. (1993). Reliability-based optimization with Markov decision processes, PhD dissertation, Civil Engineering Dept., The Johns Hopkins Univ., Baltimore.
33.
Tao, Z., Corotis, R. B., and Ellis, J. H.(1995). “Reliability-based structural design with Markov decision processes.”J. Struct. Engrg., ASCE, 121(6), 971–980.
34.
Wang, R. C.(1977). “Optimal replacement policy with unobservable states.”J. Appl. Probability, 14, 340–348.
35.
White, C. C.(1977). “A Markov quality control process subject to partial observation.”Mgmt. Sci., 23(8), 843–852.
36.
White, C. C., and Scherer, W. T.(1989). “Solution procedures for partially observed Markov decision processes.”Operations Res., 37(5), 791–797.
Information & Authors
Information
Published In
Journal of Infrastructure Systems
Volume 1 • Issue 2 • June 1995
Pages: 92 - 99
Copyright
Copyright © 1995 American Society of Civil Engineers.
History
Published online: Jun 1, 1995
Published in print: Jun 1995
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.