Resource Allocation Framework for Optimizing Long-Term Infrastructure Network Resilience
Publication: Journal of Infrastructure Systems
Volume 29, Issue 1
Abstract
With the increase in frequency and severity of extreme weather events, it is essential to incorporate the resilience of infrastructure networks into the decision-making process of resource allocation for maintenance planning. Considering that infrastructure systems are interdependent in nature, the impact of both extreme events and maintenance treatments on infrastructure resilience could be further amplified. Consequently, infrastructure interdependencies should be considered when analyzing the impact of extreme events and maintenance treatments. Additionally, uncertainties (such as uncertainties associated with the occurrence of extreme events and maintenance treatment effects) should also be into consideration. This paper proposes a resource allocation framework that incorporates these factors to optimize long-term resilience of infrastructure networks. The proposed framework capitalizes on integrating agent-based modeling with a double deep Q-network model to support decision-making in resource allocations; it allows infrastructure management agencies to maximize the long-term resilience of infrastructure networks while keeping their physical condition at an acceptable level. The results obtained from the case study show that the proposed framework is effective and can be customized to various local conditions.
Get full access to this article
View all available purchase options and get full access to this article.
Data Availability Statement
Some or all data, models, or code that support the findings of this study are available from the corresponding author upon reasonable request. These include the expanded algorithm used in the case study and the location data of the infrastructure network in the case study.
References
Abadi, M., et al. 2016. “TensorFlow: Large-scale machine learning on heterogeneous distributed systems.” Preprint, submitted March 14, 2016. https://arxiv.org/abs/1603.04467.
Agrawal, A. K., A. Kawaguchi, and Z. Chen. 2010. “Deterioration rates of typical bridge elements in New York.” J. Bridge Eng. 15 (4): 419–429. https://doi.org/10.1061/(ASCE)BE.1943-5592.0000123.
ASSHTO. 2008. Bridging the gap: Restoring and rebuilding the nation’s bridges. Washington, DC: AASHTO.
Borshchev, A., and A. Filippov. 2004. “From system dynamics and discrete event to practical agent based modeling: Reasons, techniques, tools.” In Proc., 22nd Int. Conf. of the System Dynamics Society. Oxford, England: System Dynamics Society.
Brown, T. 2007. “Multiple modeling approaches and insights for critical infrastructure protection.” In NATO security through science series D-information and communication security. Amsterdam, Netherlands: IOP Press.
Bruneau, M., et al. 2003. “A framework to quantitatively assess and enhance the seismic resilience of communities.” Earthquake Spectra 19 (4): 733–752. https://doi.org/10.1193/1.1623497.
Cambridge Systematics Inc. 2002. Transportation asset management guide. Washington, DC: Transportation Research Board.
Daneshkhah, A., N. Stocks, and P. Jeffrey. 2017. “Probabilistic sensitivity analysis of optimised preventive maintenance strategies for deteriorating infrastructure assets.” Reliab. Eng. Syst. Saf. 163 (2): 33–45. https://doi.org/10.1016/j.ress.2017.02.002.
Dehghani, M. S., and H. D. Sherali. 2016. “A resource allocation approach for managing critical network-based infrastructure systems.” IIE Trans. 48 (9): 826–837. https://doi.org/10.1080/0740817X.2016.1147662.
Department of Defense. 2011. FACT SHEET: Resilience of space capabilities. Washington, DC: Department of Defence.
Fang, Y., and E. Zio. 2019. “Game-theoretic decision making for the resilience of interdependent infrastructures exposed to disruptions.” In Critical infrastructure security and resilience, 97–114. Berlin: Springer.
FEMA. 2019. Disaster declarations by state/tribal government. Washington, DC: FEMA.
FHWA (Federal Highway Administration). 1999. Asset management primer. Washington, DC: USDOT.
FHWA (Federal Highway Administration). 2018. Bridge preservation guide: Maintaining a resilient infrastructure to preserve mobility. Washington, DC: USDOT.
Frangopol, D. M., and M. Liu. 2007. “Bridge network maintenance optimization using stochastic dynamic programming.” J. Struct. Eng. 133 (12): 1772–1782. https://doi.org/10.1061/(ASCE)0733-9445(2007)133:12(1772).
Fwa, T. F., and J. Farhan. 2012. “Optimal multiasset maintenance budget allocation in highway asset management.” J. Transp. Eng. 138 (10): 1179–1187. https://doi.org/10.1061/(ASCE)TE.1943-5436.0000414.
Grussing, M. N., D. R. Uzarski, and L. R. Marrano. 2009. “Building infrastructure functional capacity measurement framework.” J. Infrastruct. Syst. 15 (4): 371–377. https://doi.org/10.1061/(ASCE)1076-0342(2009)15:4(371).
Janić, M. 2019. “Modeling the resilience of an airline cargo transport network affected by a large scale disruptive event.” Transp. Res. Part D Transp. Environ. 77 (3): 425–448. https://doi.org/10.1016/j.trd.2019.02.011.
Lin, L.-J. 1992. “Reinforcement learning for robots using neural networks.” Ph.D. thesis, School of Computer Science, Carnegie-Mellon Univ.
Linkov, I., B. Trump, and W. Hynes. 2019. “Resilience-based strategies and policies to address systemic risks.” Organ. Econ. Co-Oper. Dev. 2019 (1): 5.
Madni, A., and S. Jackson. 2009. “Towards a conceptual framework for resilience engineering.” IEEE Syst. J. 3 (2): 181–191. https://doi.org/10.1109/JSYST.2009.2017397.
Masad, D., and J. Kazil. 2015. “Mesa: An agent-based modeling framework.” Accessed May 1, 2015. https://conference.scipy.org/proceedings/scipy2015/pdfs/jacqueline_kazil.pdf.
Mnih, V., et al. 2015. “Human-level control through deep reinforcement learning.” Nature 518 (7540): 529–533. https://doi.org/10.1038/nature14236.
Mnih, V., K. Kavukcuoglu, D. Silver, A. Graves, I. Antonoglou, D. Wierstra, and M. Riedmiller. 2013. “Playing atari with deep reinforcement learning.” Preprint, submitted December 19, 2012. https://arxiv.org/abs/1312.5602.
Mukherjee, S., R. Nateghi, and M. Hastak. 2018. “A multi-hazard approach to assess severe weather-induced major power outage risks in the U.S.” Reliab. Eng. Syst. Saf. 175 (5): 283–305. https://doi.org/10.1016/j.ress.2018.03.015.
Nan, C., and G. Sansavini. 2017. “A quantitative method for assessing resilience of interdependent infrastructures.” Reliab. Eng. Syst. Saf. 157 (Jan): 35–53. https://doi.org/10.1016/j.ress.2016.08.013.
OECD (Organisation for Economic Co-operation and Development). 2001. Asset management for the roads sector. Washington, DC: Road Transport and Intermodal Linkages Research Programme.
O’Rourke, T. D. 2007. “Critical infrastructure, interdependencies, and resilience.” Bridge Acad. Eng. 37 (1): 22.
Ouyang, M. 2014. “Review on modeling and simulation of interdependent critical infrastructure systems.” Reliab. Eng. Syst. Saf. 121 (4): 43–60. https://doi.org/10.1016/j.ress.2013.06.040.
Politis, S. S., Z. Zhang, Z. Han, J. J. Hasenbein, and M. Arellano. 2021. “Stochastic analysis of network-level bridge maintenance needs using Latin hypercube sampling.” J. Risk Uncertainty Eng. Syst. Part A Civ. Eng. 7 (1): 04020049. https://doi.org/10.1061/AJRUA6.0001099.
Porras-Alvarado, J. D. 2016. A methodological framework for cross-asset resource allocations to support infrastructure management. Austin, TX: Univ. of Texas at Austin.
Puterman, M. L. 2005. “Markov decision processes: Discrete stochastic dynamic programming.” In Wiley series in probability and statistics. Hoboken, NJ: Wiley.
Rinaldi, S. M., J. P. Peerenboom, and T. K. Kelly. 2001. “Identifying, understanding, and analyzing critical infrastructure interdependencies.” IEEE Control Syst. 21 (6): 11–25. https://doi.org/10.1109/37.969131.
Robelin, C.-A., and S. M. Madanat. 2007. “History-dependent bridge deck maintenance and replacement optimization with Markov decision processes.” J. Infrastruct. Syst. 13 (3): 195–201. https://doi.org/10.1061/(ASCE)1076-0342(2007)13:3(195).
Sirirangsi, P., A. Amekudzi, and P. Herabat. 2003. “Capturing effects of maintenance practices in highway asset valuation: Replacement-cost approach versus book-value method.” Transp. Res. Rec. 1824 (1): 57–65. https://doi.org/10.3141/1824-07.
Srikanth, I., and M. Arockiasamy. 2020. “Deterioration models for prediction of remaining useful life of timber and concrete bridges: A review.” J. Traffic Transp. Eng. 7 (2): 152–173. https://doi.org/10.1016/j.jtte.2019.09.005.
Sun, J., S. Balakrishnan, and Z. Zhang. 2021. “A resource allocation framework for predisaster resilience management of interdependent infrastructure networks.” Built. Environ. Project Asset Manage. 11 (2): 284–303. https://doi.org/10.1108/BEPAM-06-2020-0109.
Sun, J., and Z. Zhang. 2020. “A post-disaster resource allocation framework for improving resilience of interdependent infrastructure networks.” Transp. Res. Part D Transp. Environ. 85 (Jan): 102455. https://doi.org/10.1016/j.trd.2020.102455.
Uzun Ozsahin, D., H. Gökçekuş, B. Uzun, and J. LaMoreaux. 2021. Application of multi-criteria decision analysis in environmental and civil engineering. Berlin: Springer.
van Hasselt, H., A. Guez, and D. Silver. 2015. “Deep reinforcement learning with double Q-learning.” Preprint, submitted September 22, 2015. https://doi.org/10.48550/arXiv.1509.06461.
Wang, C., P. Ju, S. Lei, Z. Wang, and Y. Hou. 2019. Markov decision process-based resilience enhancement for distribution systems: An approximate dynamic programming approach. New York: IEEE.
Watkins, C. J. C. H., and P. Dayan. 1992. “Q-learning.” Mach. Learn. 8 (3–4): 279–292. https://doi.org/10.1007/BF00992698.
Zhang, Z., G. Claros, L. Manuel, and I. Damnjanovic. 2003. “Development of structural condition index to support pavement maintenance and rehabilitation decisions at network level.” Transp. Res. Rec. 1827 (1): 10–17. https://doi.org/10.3141/1827-02.
Information & Authors
Information
Published In
Journal of Infrastructure Systems
Volume 29 • Issue 1 • March 2023
Copyright
© 2022 American Society of Civil Engineers.
History
Received: Sep 21, 2021
Accepted: Nov 9, 2022
Published online: Dec 30, 2022
Published in print: Mar 1, 2023
Discussion open until: May 30, 2023
ASCE Technical Topics:
- Architectural engineering
- Building management
- Business management
- Case studies
- Construction engineering
- Construction management
- Continuum mechanics
- Decision making
- Disaster risk management
- Disasters and hazards
- Dynamics (solid mechanics)
- Engineering fundamentals
- Engineering mechanics
- Infrastructure
- Infrastructure resilience
- Maintenance and operation
- Methodology (by type)
- Models (by type)
- Motion (dynamics)
- Physical models
- Practice and Profession
- Project management
- Research methods (by type)
- Resource allocation
- Solid mechanics
- Uncertainty principles
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.