Cross-Entropy as an Optimization Method for Bridge Condition Transition Probability Determination
Publication: Journal of Transportation Engineering
Volume 138, Issue 6
Abstract
Much research has been carried out in recent years as to the most appropriate manner in which to obtain suitable transition probabilities for use in Markovian-based infrastructural deterioration models. Although many optimization algorithms have been applied in the process, a review of the literature has shown that the methods in practice may benefit from the use of more sophisticated search algorithms. Consequently, this paper focuses on the applicability of cross-entropy, a previously developed iterative method, as a robust, efficient solver for use in the derivation of these probabilities. An advantage of this method is that through the use of a smoothing parameter, it tends to avoid becoming stuck in the bound constraints of the problem. This value is usually taken to be arbitrarily between 0.6 and 0.9 but was included in this paper as another variable to be optimized, thereby adding to the accuracy of the method. Two different objective functions were compared and the use of stationary versus nonstationary Markov chains was also investigated.
Get full access to this article
View all available purchase options and get full access to this article.
Acknowledgments
This research is funded by the National Roads Authority of Ireland (NRA) and the authors wish to express sincere thanks for the financial support and assistance they have provided.
References
Adey, B., Bernard, O., and Gerard, B. (2003). “Risk-based replacement strategies for deteriorating reinforced concrete pipes.’’ Proc., 2nd Int. RILEM Workshop on Life Prediction and Aging Management of Concrete Structures, RILEM, France.
Adey, B. T., Klatter, L., and Kong, J. S. (2010). “The IABMAS Bridge Management Committee overview of existing bridge management systems.” 5th Int. Conf. on Bridge Maintenance, Safety and Management, Philadelphia.
Ang, A. H.-S., and Tang, W. H. (1984). “Probability concepts in engineering planning and design, volume II decision.” Risk and reliability, Wiley, New York.
Baik, H. S., Jeong, H. S., and Abraham, D. M. (2006). “Estimating transition probabilities in Markov chain-based deterioration models for management of wastewater systems.” J. Water Resour. Plann. Manage.JWRMD5, 132(1), 15–24.
Botev, Z. I., and Kroese, D. P. (2004). “Global likelihood optimization via the cross-entropy method with an application to mixture models.’’ Proc., 2004 Winter Simulation Conf., Institution of Electrical and Electronics Engineers Inc., Washington, DC, 529–535.
Butt, A. A., Shahin, M. Y., Feighan, K. J., and Carpenter, S. H. (1987). “Pavement performance prediction model using the Markov process.” Transportation Research Record 1123, Transportation Research Board, Washington, DC, 12–19.
Carnahan, J. V., Davis, W. J., Shahin, M. Y., Keane, P. L., and Wu, M. I. (1987). “Optimal maintenance decisions for pavement management.” J. Transp. Eng.JTPEDI, 113(5), 554–572.
Cesare, M. A., Santamarina, C., Turkstra, C., and Vanmarcke, E. H. (1992). “Modeling bridge deterioration with Markov chains.” J. Transp. Eng.JTPEDI, 118(6), 820–833.
Chen, C. E., Lorenzelli, F., Hudson, R. E., and Yao, K. (2007). “Acoustic source DOA estimation using the cross-entropy method.” IEEE Int. Conf. on Acoustics, Speech and Signal Processing, 2007 (ICASSP 2007), IEEE, Piscataway, NJ, II–1057–II–1060.
Corotis, R. B., Ellis, J. H., and Jiang, M (2005). “Modeling of risk-based inspection, maintenance and life-cycle cost with partially observable Markov decision processes.” Struct. Infrastruct. Eng., 1(1), 75–84.
Costello, S. B., Ortiz-García, J. J., and Snaith, M. S. (2011). “Analytical tool for calculating transition probabilities for pavement performance prediction.’’ Transportation Research Board 2011 Annual Meeting, Transportation Research Board, Washington, DC.
Czepiel, E. (1995). “Bridge management systems literature review and search.” Technical Rep. No. 11, Northwestern Univ. Infrastructure Technology Institute, Evanston, IL.
De Boer, P. T., Kroese, D. P., Mannor, S., and Rubinstein, R. Y. (2005). “A tutorial on the cross-entropy method.” Ann. Oper. Res.AOREEV, 134(1), 19–67.
Feighan, K. J., Shahin, M. Y., Sinha, K. C., and White, T. D. (1988). “Application of dynamic programming and other mathematical techniques to pavement management systems.” Transportation Research Record 1200, Transportation Research Board, Washington, DC.
Fletcher, R., and Powell, M. (1963). “Rapidly convergent descent method for minimization.” Comput J.CMPJA6, 6(2), 163–168.
Frangopol, D. M., Kong, J. S., and Gharaibeh, E. S. (2001). “Reliability-based life-cycle management of highway bridges.” J. Comput. Civ. Eng.JCCEE5, 15(1), 27–34.
Harris, N. K., Gonzalez, A., OBrien, E. J., and McGetrick, P. (2010). “Characterisation of pavement profile heights using accelerometer readings and a combinatorial optimisation technique.’’ J. Sound Vib.JSVIAG, 329(5), 497–508.
Holst, R. (2010). “From a condition- to a reliability-based bridge management system.” Proc., 3rd Transport Research Arena Europe, TRA 2010, Brussels, Belgium.
Hu, J., and Hu, P. (2009). “On the performance of the cross entropy method.” Proc., 2009 Winter Simulation Conf., IEEE, New York, 459–468.
Isaacson, D. L., and Madsen, R. W. (1976). Markov chains: Theory and applications, Wiley, New York.
Jiang, Y., Saito, M., and Sinha, K. C. (1988). “Bridge performance prediction using the Markov chain.” Transportation Research Record 1180, Transportation Research Board, Washington, DC.
Kallen, M. J. (2007). “Markov processes for maintenance optimization of civil infrastructure in the Netherlands.” Ph.D thesis, Delft Univ. of Technology, Delft, Netherlands.
Kroese, D. P., Porotsky, S., and Rubinstein, R. Y. (2006). “The cross-entropy method for continuous multi-extremal optimization.” Method. Comput. Appl. Probab., 8(3), 383–407.
Li, N., Haas, R., and Xie, W. (1997). “Development of a new asphalt pavement performance prediction model.” Can. J. Civ. Eng.CJCEB8, 24(4), 547–559.
Madanat, S., and Wan Ibrahim, W. H. (1995). “Poisson regression models of infrastructure transition probabilities.” J. Transp. Eng.JTPEDI, 121(3), 267–272.
MATLAB [Computer software]. MathWorks, Natick, MA.
Mohamed, A. Hosny, Abd El Halim, A. O., and Razaqpur, A. G. (1995). “Use of neural networks in bridge management systems.” Transportation Research Record 1490, Transportation Research Board, Washington, DC, 1–8.
Morcous, G. (2006). “Performance prediction of bridge deck systems using Markov chains.” J. Perform. Constr. Facil.JPCFEV, 20(2), 146–155.
Morcous, G., and Lounis, Z. (2005). “Maintenance optimization of infrastructure networks using genetic algorithms.” Autom. Constr.AUCOES, 14(1), 129–142.
Morcous, G., Lounis, Z., and Mirza, M. S. (2003). “Identification of environmental categories for Markovian deterioration models of bridge decks.” J. Bridge Eng.JBENF2, 8(6), 353–361.
National Roads Authority (NRA). (2008). EIRSPAN: The Irish structure management system: System manual No. 3 principal inspection, revision C, Dublin, Ireland.
O’Connor, A., and Enevoldsen, I. (2008). “Probability based modelling and assessment of an existing post-tensioned concrete slab bridge.” Eng. Struct.ENSTDF, 30(5), 1408–1416.
Orcesi, A. D., and Cremona, C. F. (2008). “Optimal inspection and maintenance strategies for bridge network using supply and demand approach.” Proc., 4th Int. IABMAS Conf., CRC, Netherlands.
Orcesi, A. D., and Cremona, C. F. (2011). “Optimization of maintenance strategies for the management of the national bridge stock in France.” J. Bridge Eng.JBENF2, 16(1), 44–52.
Ortiz-Garcia, J. J., Costello, S. B., and Snaith, M. S. (2006). “Derivation of transition probability matrices for pavement deterioration modeling.” J. Transp. Eng.JTPEDI, 132(2), 141–161.
Razaqpur, A. G., Abd El Halim, A. O., and Mohamed, A. (1996). “Bridge management by dynamic programming and neural networks.” Can. J. Civ. Eng.CJCEB8, 23(5), 1064–1069.
Ridder, A. (2005). “Importance sampling simulations of Markovian reliability systems using cross-entropy.” Ann. Oper. Res.AOREEV, 134(1), 119–136.
Rubinstein, R. Y. (1997). “Optimization of computer simulation models with rare events.” Eur. J. Oper. Res.EJORDT, 99(1), 89–112.
Rubinstein, R. Y., and Kroese, D. P. (2008). “Simulation and the monte carlo method.” 2nd Ed., Wiley, New York.
Scherer, W. T., and Glagola, D. M. (1994). “Markovian models for bridge maintenance management.” J. Transp. Eng.JTPEDI, 120(1), 37–51.
Szita, I., and Lörincz, A. (2006). “Learning tetris using the noisy cross-entropy method.” Neural Comput.NEUCEB, 18(12), 2936–2941.
Taimre, T. (2009). “Advances in cross entropy methods.” Ph.D thesis, Dept. of Mathematics, Univ. of Queensland, Brisbane, Australia.
Thompson, P. D., and Sobanjo, J. O. (2010). “Estimation of enhanced pontis deterioration models in Florida.” Proc., 5th Int. Conf. on Bridge Maintenance, Safety and Management, Taylor and Francis, Philadelphia.
Ugray, Z., Plummer, J., and Kelly, J. (2007). “Scatter search and local NLP solvers: A multistart framework for global optimization.” INFORMS J. Comput., 19(3), 328–340.
Yang, Y. N., Pam, H. J., and Kumaraswamy, M. M. (2009). “Framework development of performance prediction models for concrete bridges.” J. Transp. Eng.JTPEDI, 135(8), 545–554.
Information & Authors
Information
Published In
Journal of Transportation Engineering
Volume 138 • Issue 6 • June 2012
Pages: 741 - 750
Copyright
© 2012. American Society of Civil Engineers.
History
Received: Apr 7, 2011
Accepted: Dec 1, 2011
Published online: Dec 7, 2011
Published in print: Jun 1, 2012
Published ahead of production: Jun 15, 2012
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.