A Comparative Analysis of Performance-Based Resilience Metrics via a Quantitative-Qualitative Combined Approach: Are We Measuring the Same Thing?

Junqing Tang; Song Han; Jing Wang; Baojie He; Jinhan Peng

doi:10.1007/s13753-023-00519-5

Volume 14 Issue 5

Nov. 2023

Turn off MathJax

Article Contents

Article Navigation > International Journal of Disaster Risk Science > 2023 > 14(5): 736-750

Junqing Tang, Song Han, Jing Wang, Baojie He, Jinhan Peng. A Comparative Analysis of Performance-Based Resilience Metrics via a Quantitative-Qualitative Combined Approach: Are We Measuring the Same Thing?[J]. International Journal of Disaster Risk Science, 2023, 14(5): 736-750. doi: 10.1007/s13753-023-00519-5

Citation:

Junqing Tang, Song Han, Jing Wang, Baojie He, Jinhan Peng. A Comparative Analysis of Performance-Based Resilience Metrics via a Quantitative-Qualitative Combined Approach: Are We Measuring the Same Thing?[J]. International Journal of Disaster Risk Science, 2023, 14(5): 736-750. doi: 10.1007/s13753-023-00519-5

Citation:

Junqing Tang, Song Han, Jing Wang, Baojie He, Jinhan Peng. A Comparative Analysis of Performance-Based Resilience Metrics via a Quantitative-Qualitative Combined Approach: Are We Measuring the Same Thing?[J]. International Journal of Disaster Risk Science, 2023, 14(5): 736-750. doi: 10.1007/s13753-023-00519-5

PDF

A Comparative Analysis of Performance-Based Resilience Metrics via a Quantitative-Qualitative Combined Approach: Are We Measuring the Same Thing?

doi: 10.1007/s13753-023-00519-5

1. School of Urban Planning and Design, Peking University Shenzhen Graduate School, Shenzhen, 518055, China;
2. School of Architecture and Urban Planning, Chongqing University, Chongqing, 400030, China;
3. Department of Civil and Transportation Engineering, South China University of Technology, Guangzhou, 510641, China

Funds:

and (3) the National Natural Science Foundation of China (Grant No. 42376213). Another special thank is dedicated to Miss Huali Lin for her assistance in the early stage of this research.

(2) Guangdong Basic and Applied Basic Research Foundation (Grant Nos. 2021A1515110537, 2023A1515010979)

This work was supported by (1) the Start-up Funding for New Faculty at Peking University Shenzhen Graduate School (Grant No. 1270110033)

Accepted Date: 2023-10-10

Available Online: 2023-11-23

Publish Date: 2023-10-31

Abstract

Abstract

Since the proposal of the pioneering “resilience triangle” paradigm, various time-series performance-based metrics have been devised for resilience quantification. The numerous choices diversify the toolbox for measuring this compound system concept; however, this multiplicity causes intractable questions for applications, including “Do these metrics measure the same resilience?” and “Which one to pick under what circumstance?” In this study, we attempted to address these two fundamental issues using a comprehensive comparative investigation. Through a quantitative-qualitative combined approach, 12 popular performance-based resilience metrics are compared using empirical data from China’s aviation system under the disturbance of COVID-19. Quantitative results indicate that only 12 of the 66 metric pairs are strongly positively correlated and with no significant differences in quantification outcomes; qualitative results indicate that the majority of the metrics are based on different definition interpretations, basic components, and expression forms, and thus essentially measure different resilience. The advantages and disadvantages of each metric are comparatively discussed, and a “how to choose” guideline for metric users is proposed. This study is an introspective investigation of resilience quantification studies, aiming to offer a new perspective to scrutinize those benchmarking metrics.
- COVID-19,
- Infrastructure system,
- Model comparison,
- Resilience metrics,
- Systemic risk

FullText(HTML)

References(46)

References

[1]	Arjomandi-Nezhad, A., M. Fotuhi-Firuzabad, M. Moeini-Aghtaie, A. Safdarian, P. Dehghanian, and F. Wang. 2020. Modeling and optimizing recovery strategies for power distribution system resilience. IEEE Systems Journal 15(4): 4725-4734.
[2]	Arreguín-Sánchez, F. 2014. Measuring resilience in aquatic trophic networks from supply-demand-of-energy relationships. Ecological Modelling 272: 271-276.
[3]	Attoh-Okine, N.O., A.T. Cooper, and S.A. Mensah. 2009. Formulation of resilience index of urban infrastructure using belief functions. IEEE Systems Journal 3(2): 147-153.
[4]	Ayyub, B.M. 2014. Systems resilience for multihazard environments: Definition, metrics, and valuation for decision making. Risk Analysis 34(2): 340-355.
[5]	Bruneau, M., S.E. Chang, R.T. Eguchi, G.C. Lee, T.D. O’Rourke, A.M. Reinhorn, M. Shinozuka, and K. Tierney et al. 2003. A framework to quantitatively assess and enhance the seismic resilience of communities. Earthquake Spectra 19(4): 733-752.
[6]	Bruyelle, J.L., C. O’Neill, E.M. El-Koursi, F. Hamelin, N. Sartori, and L. Khoudour. 2014. Improving the resilience of metro vehicle and passengers for an effective emergency response to terrorist attacks. Safety Science 62: 37-45.
[7]	Cai, B., M. Xie, Y. Liu, Y. Liu, and Q. Feng. 2018. Availability-based engineering resilience metric and its corresponding evaluation methodology. Reliability Engineering & System Safety 172: 216-224.
[8]	Cai, B., Y. Zhang, H. Wang, Y. Liu, R. Ji, C. Gao, X. Kong, and J. Liu. 2021. Resilience evaluation methodology of engineering systems with dynamic-Bayesian-network-based degradation and maintenance. Reliability Engineering & System Safety. 209: Article 107464.
[9]	Chen, L., and E. Miller-Hooks. 2012. Resilience: An indicator of recovery capacity in intermodal freight transport. Transportation Science 46(1): 109-123.
[10]	Civil Aviation Administration of China. 2021. Statistical bulletin on the development of the civil aviation industry in 2020. http://www.caac.gov.cn/XXGK/XXGK/TJSJ/202106/t20210610_207915.html. Accessed 9 Oct 2023 (in Chinese).
[11]	Clédel, T., N. Cuppens, F. Cuppens, and R. Dagnas. 2020. Resilience properties and metrics: How far have we gone?. Journal of Surveillance, Security and Safety 1(2): 119-139.
[12]	Cutter, S.L. 2016. Resilience to what? Resilience for whom?. The Geographical Journal 182(2): 110-113.
[13]	Cutter, S.L., L. Barnes, M. Berry, C. Burton, E. Evans, E. Tate, and J. Webb. 2008. A place-based model for understanding community resilience to natural disasters. Global Environmental Change 18(4): 598-606.
[14]	Francis, R., and B. Bekera. 2014. A metric and frameworks for resilience analysis of engineered and infrastructure systems. Reliability Engineering & System Safety 121: 90-103.
[15]	Ghaffarpour, R., B. Mozafari, A.M. Ranjbar, and T. Torabi. 2018. Resilience oriented water and energy hub scheduling considering maintenance constraint. Energy 158: 1092-1104.
[16]	Gheorghe, A.V., D.V. Vamanu, P.F. Katina, and R. Pulfer. 2018. Critical infrastructures, key resources, and key assets. In Critical infrastructures, key resources, key assets: Risk, vulnerability, resilience, fragility, and perception governance, ed. A.V. Gheorghe, D.V. Vamanu, P.F. Katina, and R. Pulfer, 3-37. Cham: Springer.
[17]	Henry, D., and J.E. Ramirez-Marquez. 2012. Generic metrics and quantitative approaches for system resilience as a function of time. Reliability Engineering & System Safety 99: 114-122.
[18]	Huck, A., and J. Monstadt. 2019. Urban and infrastructure resilience: Diverging concepts and the need for cross-boundary learning. Environmental Science & Policy 100: 211-220.
[19]	Jiang, Q., B. Cai, Y. Zhang, M. Xie, and C. Liu. 2023. Resilience assessment methodology of natural gas network system under random leakage. Reliability Engineering & System Safety 234: Article 109134.
[20]	Liu, W., and Z. Song. 2020. Review of studies on the resilience of urban critical infrastructure networks. Reliability Engineering & System Safety 193: Article 106617.
[21]	Mao, Q., and N. Li. 2018. Assessment of the impact of interdependencies on the resilience of networked critical infrastructure systems. Natural Hazards 93(1): 315-337.
[22]	Martišauskas, L., J. Augutis, and R. Krikštolaitis. 2018. Methodology for energy security assessment considering energy system resilience to disruptions. Energy Strategy Reviews 22: 106-118.
[23]	Meerow, S., and J.P. Newell. 2019. Urban resilience for whom, what, when, where, and why?. Urban Geography 40(3): 309-329.
[24]	Najarian, M., and G.J. Lim. 2019. Design and assessment methodology for system resilience metrics. Risk Analysis 39(9): 1885-1898.
[25]	Nan, C., and G. Sansavini. 2017. A quantitative method for assessing resilience of interdependent infrastructures. Reliability Engineering & System Safety 157: 35-53.
[26]	National Health Commission of the People’s Republic of China. 2021. The latest situation of the COVID-19 as of 24:00 on March 21. http://www.nhc.gov.cn/xcs/yqtb/202103/3309504a6f044ecaa2bc506179d52d5b.shtml. Accessed 9 Oct 2023 (in Chinese).
[27]	Nishimi, K., K.W. Choi, J. Cerutti, A. Powers, B. Bradley, and E.C. Dunn. 2021. Measures of adult psychological resilience following early-life adversity: How congruent are different measures?. Psychological Medicine 51(15): 2637-2646.
[28]	Ouyang, M., and L. Duenas-Osorio. 2012. Time-dependent resilience assessment and improvement of urban infrastructure systems. Chaos: An Interdisciplinary Journal of Nonlinear Science 22(3): Article 033122.
[29]	Panteli, M., P. Mancarella, D.N. Trakas, E. Kyriakides, and N.D. Hatziargyriou. 2017. Metrics and quantification of operational and infrastructure resilience in power systems. IEEE Transactions on Power Systems 32(6): 4732-4742.
[30]	Patriarca, R., A. De Paolis, F. Costantino, and G. Di Gravio. 2021. Simulation model for simple yet robust resilience assessment metrics for engineered systems. Reliability Engineering & System Safety 209: Article 107467.
[31]	Pettit, T.J., J. Fiksel, and K.L. Croxton. 2010. Ensuring supply chain resilience: Development of a conceptual framework. Journal of Business Logistics 31(1): 1-21.
[32]	Raoufi, H., and V. Vahidinasab. 2021. Power system resilience assessment considering critical infrastructure resilience approaches and government policymaker criteria. IET Generation, Transmission & Distribution 15(20): 2819-2834.
[33]	Serdar, M.Z., M. Koç, and S.G. Al-Ghamdi. 2022. Urban transportation networks resilience: Indicators, disturbances, and assessment methods. Sustainable Cities and Society 76: Article 103452.
[34]	Sherwani, R.A.K., H. Shakeel, W.B. Awan, M. Faheem, and M. Aslam. 2021. Analysis of COVID-19 data using neutrosophic Kruskal Wallis H test. BMC Medical Research Methodology 21(1): 1-7.
[35]	Shirali, G.A., I. Mohammadfam, and V. Ebrahimipour. 2013. A new method for quantitative assessment of resilience engineering by PCA and NT approach: A case study in a process industry. Reliability Engineering & System Safety 119: 88-94.
[36]	Tang, J., H. Heinimann, K. Han, H. Luo, and B. Zhong. 2020. Evaluating resilience in urban transportation systems for sustainability: A systems-based Bayesian network model. Transportation Research Part C: Emerging Technologies 121: Article 102840.
[37]	Tang, J., S. Wei, D. Li, and X. Li. 2023. Optimizing systemic redundancy of traffic sensor networks while maintaining resilience: New evidence from using graph learning. IEEE Systems Journal 17(3): 4567-4578.
[38]	Tang, J., P. Zhao, Z. Gong, H. Zhao, F. Huang, J. Li, Z. Chen, Y. Ling, and J. Chen. 2023. Resilience patterns of human mobility in response to extreme urban floods. National Science Review 10(8): Article nwad097.
[39]	Tierney, K., and M. Bruneau. 2007. Conceptualizing and measuring resilience: A key to disaster loss reduction. TR News 250: 14-17.
[40]	Toroghi, S.S.H., and V.M. Thomas. 2020. A framework for the resilience analysis of electric infrastructure systems including temporary generation systems. Reliability Engineering & System Safety 202: Article 107013.
[41]	Vishnu, N., S. Kameshwar, and J.E. Padgett. 2023. Road transportation network hazard sustainability and resilience: Correlations and comparisons. Structure and Infrastructure Engineering 19(3): 345-365.
[42]	Wang, J., J. Zhao, S. Deng, T. Sun, Y. Du, K. Li, and Y. Xu. 2019. Integrated assessment for solar-assisted carbon capture and storage power plant by adopting resilience thinking on energy system. Journal of Cleaner Production 208: 1009-1021.
[43]	Xu, Z., and S.S. Chopra. 2022. Network-based assessment of metro infrastructure with a spatial-temporal resilience cycle framework. Reliability Engineering & System Safety 223: Article 108434.
[44]	Yarveisy, R., C. Gao, and F. Khan. 2020. A simple yet robust resilience assessment metrics. Reliability Engineering & System Safety 197: Article 106810.
[45]	Yin, J., X. Ren, R. Liu, T. Tang, and S. Su. 2022. Quantitative analysis for resilience-based urban rail systems: A hybrid knowledge-based and data-driven approach. Reliability Engineering & System Safety 219: Article 108183.
[46]	Zobel, C.W., and L. Khansa. 2014. Characterizing multi-event disaster resilience. Computers & Operations Research 42: 83-94.