Predicting Hurricane Evacuation Decisions with Interpretable Machine Learning Methods

Yuran Sun; Shih-Kai Huang; Xilei Zhao

doi:10.1007/s13753-024-00541-1

Volume 15 Issue 1

Feb. 2024

Turn off MathJax

Article Contents

Article Navigation > International Journal of Disaster Risk Science > 2024 > 15(1): 134-148

Yuran Sun, Shih-Kai Huang, Xilei Zhao. Predicting Hurricane Evacuation Decisions with Interpretable Machine Learning Methods[J]. International Journal of Disaster Risk Science, 2024, 15(1): 134-148. doi: 10.1007/s13753-024-00541-1

Citation:

Yuran Sun, Shih-Kai Huang, Xilei Zhao. Predicting Hurricane Evacuation Decisions with Interpretable Machine Learning Methods[J]. International Journal of Disaster Risk Science, 2024, 15(1): 134-148. doi: 10.1007/s13753-024-00541-1

Citation:

PDF

Predicting Hurricane Evacuation Decisions with Interpretable Machine Learning Methods

doi: 10.1007/s13753-024-00541-1

1. Department of Civil and Coastal Engineering, University of Florida, Gainesville, FL, 32611, USA;
2. Department of Emergency Management and Public Administration, Jacksonville State University, Jacksonville, AL, 36265, USA

Accepted Date: 2024-02-04

Available Online: 2024-03-14

Publish Date: 2024-03-05

Abstract

Abstract

Facing the escalating effects of climate change, it is critical to improve the prediction and understanding of the hurricane evacuation decisions made by households in order to enhance emergency management. Current studies in this area often have relied on psychology-driven linear models, which frequently exhibited limitations in practice. The present study proposed a novel interpretable machine learning approach to predict household-level evacuation decisions by leveraging easily accessible demographic and resource-related predictors, compared to existing models that mainly rely on psychological factors. An enhanced logistic regression model (that is, an interpretable machine learning approach) was developed for accurate predictions by automatically accounting for nonlinearities and interactions (that is, univariate and bivariate threshold effects). Specifically, nonlinearity and interaction detection were enabled by low-depth decision trees, which offer transparent model structure and robustness. A survey dataset collected in the aftermath of Hurricanes Katrina and Rita, two of the most intense tropical storms of the last two decades, was employed to test the new methodology. The findings show that, when predicting the households’ evacuation decisions, the enhanced logistic regression model outperformed previous linear models in terms of both model fit and predictive capability. This outcome suggests that our proposed methodology could provide a new tool and framework for emergency management authorities to improve the prediction of evacuation traffic demands in a timely and accurate manner.
- Artificial Intelligence (AI),
- Decision-making modeling,
- Hurricane evacuation,
- Interpretable machine learning,
- Nonlinearity and interaction detection

FullText(HTML)

References(59)

References

[1]	Ahmed, M.A., A.M. Sadri, and M. Hadi. 2020. Modeling social network influence on hurricane evacuation decision consistency and sharing capacity. Transportation Research Interdisciplinary Perspectives 7: Article 100180.
[2]	Alawadi, R., P. Murray-Tuite, D. Marasco, S. Ukkusuri, and Y. Ge. 2020. Determinants of full and partial household evacuation decision making in Hurricane Matthew. Transportation Research Part D: Transport and Environment 83: Article 102313.
[3]	Anyidoho, P.K., X. Ju, R.A. Davidson, and L.K. Nozick. 2023. A machine learning approach for predicting hurricane evacuee destination location using smartphone location data. Computational Urban Science 3(1): Article 30.
[4]	Bagloee, S.A., K.H. Johansson, and M. Asadi. 2019. A hybrid machine-learning and optimization method for contraflow design in post-disaster cases and traffic management scenarios. Expert Systems with Applications 124: 67–81.
[5]	Baker, E.J. 1991. Hurricane evacuation behavior. International Journal of Mass Emergencies & Disasters 9(2): 287–310.
[6]	Bhavan, A., P. Chauhan, and R.R. Shah. 2019. Bagged support vector machines for emotion recognition from speech. Knowledge-Based Systems 184: Article 104886.
[7]	Burris, J.W., R. Shrestha, B. Gautam, and B. Bista. 2015. Machine learning for the activation of contraflows during hurricane evacuation. In Proceedings of the 2015 IEEE global humanitarian technology conference (GHTC), 8–11 October 2015, Seattle, WA, USA, 254–258.
[8]	Cahyanto, I., L. Pennington-Gray, B. Thapa, S. Srinivasan, J. Villegas, C. Matyas, and S. Kiousis. 2014. An empirical evaluation of the determinants of tourist’s hurricane evacuation decision making. Journal of Destination Marketing & Management 2(4): 253–265.
[9]	Census Bureau, U.S. 2019. Coastline America. http://www.ncdc.noaa.gov/billions. Accessed 8 Dec 2023.
[10]	Dash, N., and H. Gladwin. 2007. Evacuation decision making and behavioral responses: Individual and household. Natural Hazards Review 8(3): 69–77.
[11]	Davidson, R.A., L.K. Nozick, T. Wachtendorf, B. Blanton, B. Colle, R.L. Kolar, S. DeYoung, and K.M. Dresback et al. 2020. An integrated scenario ensemble-based framework for hurricane evacuation modeling: Part 1 – Decision support system. Risk Analysis 40(1): 97–116.
[12]	Dillman, D.A. 2011. Mail and Internet surveys: The tailored design method – 2007 update with new Internet, visual, and mixed-mode guide. Hoboken, NJ: Wiley.
[13]	Dumitrescu, E., S. Hué, C. Hurlin, and S. Tokpavi. 2022. Machine learning for credit scoring: Improving logistic regression with non-linear decision-tree effects. European Journal of Operational Research 297(3): 1178–1192.
[14]	Ersing, R.L., C. Pearce, J. Collins, M.E. Saunders, and A. Polen. 2020. Geophysical and social influences on evacuation decision-making: The case of hurricane Irma. Atmosphere 11(8): Article 851.
[15]	Fraser, T. 2022. Fleeing the unsustainable city: Soft policy and the dual effect of social capital in hurricane evacuation. Sustainability Science 17(5): 1995–2011.
[16]	Gladwin, H. 1997. Warning and evacuation: A night for hard houses. In Hurricane Andrew: Ethnicity, gender and the sociology of disasters, ed. W. Gillis Peacock, H. Gladwin, and B. Hearn Morrow, 52–74. London: Taylor & Francis.
[17]	Gladwin, H., J.K. Lazo, B.H. Morrow, W.G. Peacock, and H.E. Willoughby. 2007. Social science research needs for the hurricane forecast and warning system. Natural Hazards Review 8(3): 87–95.
[18]	Hasan, S., S. Ukkusuri, H. Gladwin, and P. Murray-Tuite. 2011. Behavioral model to understand household-level hurricane evacuation decision making. Journal of Transportation Engineering 137(5): 341–348.
[19]	Horney, J.A., P.D.M. MacDonald, M. Van Willigen, P.R. Berke, and J.S. Kaufman. 2010. Factors associated with evacuation from Hurricane Isabel in North Carolina, 2003. International Journal of Mass Emergencies & Disasters 28(1): 33–58.
[20]	Huang, S.-K., M.K. Lindell, C.S. Prater, H.-C. Wu, and L.K. Siebeneck. 2012. Household evacuation decision making in response to Hurricane Ike. Natural Hazards Review 13(4): 283–296.
[21]	Huang, S.-K., M.K. Lindell, and C.S. Prater. 2016. Who leaves and who stays? A review and statistical meta-analysis of hurricane evacuation studies. Environment and Behavior 48(8): 991–1029.
[22]	Huang, S.-K., M.K. Lindell, and C.S. Prater. 2017. Multistage model of hurricane evacuation decision: Empirical study of Hurricanes Katrina and Rita. Natural Hazards Review 18(3): Article 05016008.
[23]	Kildow, J.T., C.S. Colgan, and J. Pat. 2016. State of the U.S. ocean and coastal economies 2016 update. https://cbe.miis.edu/noep_publications/18. Accessed 30 Dec 2023.
[24]	Kim, P.B. 2015. Interactive and interpretable machine learning models for human machine collaboration. Ph.D. thesis. Massachusetts Institute of Technology, Cambridge, MA, USA.
[25]	Kim, H., J.-H. Park, D. Lee, and Y.-S. Yang. 2004. Establishing the methodologies for human evacuation simulation in marine accidents. Computers & Industrial Engineering 46(4): 725–740.
[26]	Knabb, R.D., D.P. Brown, and J.R. Rhome. 2006. Tropical cyclone report: Hurricane Rita 18–26 September 2005. https://www.nhc.noaa.gov/data/tcr/AL182005_Rita.pdf. Accessed 30 Dec 2023.
[27]	Knabb, R.D., J.R. Rhome, and D.P. Brown. 2023. Tropical cyclone report: Hurricane Katrina, 23–30 August 2005. https://www.nhc.noaa.gov/data/tcr/AL122005_Katrina.pdf. Accessed 30 Dec 2023.
[28]	Lazo, J.K., A. Bostrom, R.E. Morss, J.L. Demuth, and H. Lazrus. 2015. Factors affecting hurricane evacuation intentions. Risk Analysis 35(10): 1837–1857.
[29]	Lee, D., J.-H. Park, and H. Kim. 2004. A study on experiment of human behavior for evacuation simulation. Ocean Engineering 31(8–9): 931–941.
[30]	Li, D., Z. Zhang, B. Alizadeh, Z. Zhang, N. Duffield, M.A. Meyer, C.M. Thompson, H. Gao, and A.H. Behzadan. 2023. A reinforcement learning-based routing algorithm for large street networks. International Journal of Geographical Information Science. https://doi.org/10.1080/13658816.2023.2279975.
[31]	Lindell, M.K. 2013. Evacuation planning, analysis, and management. In Handbook of emergency response: A human factors and systems engineering approach, ed. A.B. Badiru, and L. Racz, 121–149. Boca Raton, FL: CRC Press.
[32]	Lindell, M.K. 2018. Communicating imminent risk. In Handbook of disaster research, ed. H. Rodríguez, W. Donner, and J.E. Trainor, 449–477. Cham: Springer.
[33]	Lindell, M.K. 2019. The Routledge handbook of urban disaster resilience: Integrating mitigation, preparedness, and recovery planning. London: Routledge.
[34]	Lindell, M.K., and R.W. Perry. 2012. The protective action decision model: Theoretical modifications and additional evidence. Risk Analysis 32(4): 616–632.
[35]	Lindell, M.K., J.-C. Lu, and C.S. Prater. 2005. Household decision making and evacuation in response to Hurricane Lili. Natural Hazards Review 6(4): 171–179.
[36]	Ling, L., S.V. Ukkusuri, P. Murray-Tuite, S. Lee, and Y. Ge. 2022. Modeling the causality of received information, certainty, and decision making in hurricane evacuations. SSRN Electronic Journal. https://doi.org/10.2139/ssrn.4127811.
[37]	Lo, S.M., M. Liu, P.H. Zhang, and R.K. Yuen. 2009. An artificial neural-network based predictive model for pre-evacuation human response in domestic building fire. Fire Technology 45: 431–449.
[38]	Metaxa-Kakavouli, D., P. Maas, and D.P. Aldrich. 2018. How social ties influence hurricane evacuation behavior. In Proceedings of the ACM on Human-Computer Interaction 2(CSCW): Article 122.
[39]	Meyer, M.A., B. Mitchell, J.C. Purdum, K. Breen, and R.L. Iles. 2018. Previous hurricane evacuation decisions and future evacuation intentions among residents of southeast Louisiana. International Journal of Disaster Risk Reduction 31: 1231–1244.
[40]	Molnar, C. 2020. Interpretable machine learning. https://christophm.github.io/interpretable-ml-book/. Accessed 5 Feb 2024.
[41]	Morss, R.E., J.L. Demuth, J.K. Lazo, K. Dickinson, H. Lazrus, and B.H. Morrow. 2016. Understanding public hurricane evacuation decisions and responses to forecast and warning messages. Weather and Forecasting 31(2): 395–417.
[42]	Nara, A., S.G. Machiani, N. Luo, A. Ahmadi, K. Robinett, K. Tominaga, A. Ahmadi, and K. Robinett et al. 2021. Learning dependence relationships of evacuation decision making factors from Tweets. In Empowering human dynamics research with social media and geospatial data analytics, ed. A. Nara, and M.-H. Tsou, 113–138. Cham: Springer.
[43]	Petty, R.E., and J.T. Cacioppo. 1986. The elaboration likelihood model of persuasion. Cham: Springer.
[44]	Ramaguru, G.P., and V.D.K. Pasupuleti. 2019. Human evacuation simulation during disaster: A web tool. In Innovative research in transportation infrastructure: Proceedings of ICIIF 2018, ed. D. Deb, V.E. Balas, R. Dey, and J. Shah, 33–43. Singapore: Springer.
[45]	Roy, K.C., S. Hasan, A. Culotta, and N. Eluru. 2021. Predicting traffic demand during hurricane evacuation using real-time data from transportation systems and social media. Transportation Research Part C: Emerging Technologies 131: Article 103339.
[46]	Rudin, C. 2019. Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead. Nature Machine Intelligence 1(5): 206–215.
[47]	Sadri, A.M., S.V. Ukkusuri, and H. Gladwin. 2017. The role of social networks and information sources on hurricane evacuation decision making. Natural Hazards Review 18(3): Article 04017005.
[48]	Sarwar, M.T., PCh. Anastasopoulos, S.V. Ukkusuri, P. Murray-Tuite, and F.L. Mannering. 2018. A statistical analysis of the dynamics of household hurricane-evacuation decisions. Transportation 45: 51–70.
[49]	Schorr, J.P. 2015. Bridging the gap between social and transportation networks: An integrated, dynamic evacuation decision making model. https://scholarspace.library.gwu.edu/concern/gw_etds/c534fn99d. Accessed 30 Dec 2023.
[50]	Sorensen, J.H. 2000. Hazard warning systems: Review of 20 years of progress. Natural Hazards Review 1(2): 119–125.
[51]	Sun, W., P. Bocchini, and B.D. Davison. 2020. Applications of artificial intelligence for disaster management. Natural Hazards 103(3): 2631–2689.
[52]	Tanim, S.H., B.M. Wiernik, S. Reader, and Y. Hu. 2022. Predictors of hurricane evacuation decisions: A meta-analysis. Journal of Environmental Psychology 79: Article 101742.
[53]	Vreugdenhil, B.J., N. Bellomo, and P.S. Townsend. 2015. Using crowd modelling in evacuation decision making. In Proceedings of the ISCRAM 2015 conference. https://idl.iscram.org/files/bjvreugdenhil/2015/1288_B.J.Vreugdenhil_etal2015.pdf. Accessed 6 Feb 2024.
[54]	Xu, N., R. Lovreglio, E.D. Kuligowski, T.J. Cova, D. Nilsson, and X. Zhao. 2023. Predicting and assessing wildfire evacuation decision-making using machine learning: Findings from the 2019 Kincade Fire. Fire Technology 59(2): 793–825.
[55]	Yang, K., R.A. Davidson, B. Blanton, B. Colle, K. Dresback, R. Kolar, L.K. Nozick, J. Trivedi, and T. Wachtendorf. 2019. Hurricane evacuations in the face of uncertainty: Use of integrated models to support robust, adaptive, and repeated decision-making. International Journal of Disaster Risk Reduction 36: Article 101093.
[56]	Yang, J., R. Shi, and B. Ni. 2021. MedMNIST classification decathlon: A lightweight AutoML benchmark for medical image analysis. In Proceedings of the 2021 IEEE 18th International symposium on biomedical imaging (ISBI), 13–16 April 2021, Nice, France, 191–195.
[57]	Zhao, X., R. Lovreglio, E. Kuligowski, and D. Nilsson. 2021. Using artificial intelligence for safe and effective wildfire evacuations. Fire Technology 57: 483–485.
[58]	Zhao, X., R. Lovreglio, and D. Nilsson. 2020. Modelling and interpreting pre-evacuation decision-making using machine learning. Automation in Construction 113: Article 103140.
[59]	Zhu, R., B. Becerik-Gerber, J. Lin, and N. Li. 2023. Behavioral, data-driven, agent-based evacuation simulation for building safety design using machine learning and discrete choice models. Advanced Engineering Informatics 55: Article 101827.