Modified Usability Framework for Disaster Apps: A Qualitative Thematic Analysis of User Reviews

Marion Lara Tan; Raj Prasanna; Kristin Stock; Emma E. H. Doyle; Graham Leonard; David Johnston

doi:10.1007/s13753-020-00282-x

Volume 11 Issue 5

Dec. 2020

Turn off MathJax

Article Contents

Article Navigation > International Journal of Disaster Risk Science > 2020 > 11(5): 615-629

Marion Lara Tan, Raj Prasanna, Kristin Stock, Emma E. H. Doyle, Graham Leonard, David Johnston. Modified Usability Framework for Disaster Apps: A Qualitative Thematic Analysis of User Reviews[J]. International Journal of Disaster Risk Science, 2020, 11(5): 615-629. doi: 10.1007/s13753-020-00282-x

Citation:

Marion Lara Tan, Raj Prasanna, Kristin Stock, Emma E. H. Doyle, Graham Leonard, David Johnston. Modified Usability Framework for Disaster Apps: A Qualitative Thematic Analysis of User Reviews[J]. International Journal of Disaster Risk Science, 2020, 11(5): 615-629. doi: 10.1007/s13753-020-00282-x

Citation:

Marion Lara Tan, Raj Prasanna, Kristin Stock, Emma E. H. Doyle, Graham Leonard, David Johnston. Modified Usability Framework for Disaster Apps: A Qualitative Thematic Analysis of User Reviews[J]. International Journal of Disaster Risk Science, 2020, 11(5): 615-629. doi: 10.1007/s13753-020-00282-x

PDF

Modified Usability Framework for Disaster Apps: A Qualitative Thematic Analysis of User Reviews

doi: 10.1007/s13753-020-00282-x

1 Joint Centre for Disaster Research, Massey University, Wellington 6021, New Zealand;
2 School of Natural and Computational Sciences, Massey University, Albany 0632, New Zealand;
3 GNS Science, Avalon, Lower Hutt 5010, New Zealand

Available Online: 2021-04-26
Publish Date: 2020-12-01

Abstract

Abstract

The public has access to a range of mobile applications (apps) for disasters. However, there has been limited academic research conducted on disaster apps and how the public perceives their usability. This study explores end-users’ perceptions of the usability of disaster apps. It proposes a conceptual framework based on insights gathered from thematically analyzing online reviews. The study identifies new usability concerns particular to disaster apps’ use: (1) content relevance depends on the app’s purpose and the proximate significance of the information to the hazard event’s time and location; (2) app dependability affects users’ perceptions of usability due to the lifesafety association of disaster apps; (3) users perceive advertisements to contribute to their cognitive load; (4) users expect apps to work efficiently without unnecessary consumption of critical phone resources; (5) appropriate audio interface can improve usability, as sounds can boost an app’s alerting aspect; and, finally (6) in-app browsing may potentially enhance users’ impression of the structure of a disaster app. As a result, this study argues for focussed research and development on public-facing disaster apps. Future research should consider the conceptual framework and concerns presented in this study when building design guidelines and theories for disaster apps.
- Disaster apps,
- End-user perspective,
- Human-computer interaction,
- Usability

FullText(HTML)

References(49)

References

Apple Inc. 2016. The app store. https://www.apple.com/nz/ios/app-store/. Accessed 9 Aug 2019.

Appleby-Arnold, S., N. Brockdorff, L. Fallou, and R. Bossu. 2019. Truth, trust, and civic duty: Cultural factors in citizens’ perceptions of mobile phone apps and social media in disasters. Journal of Contingencies and Crisis Management 29(4): 293–305.

Bachmann, D.J., N.K. Jamison, A. Martin, J. Delgado, and N.E. Kman. 2015. Emergency preparedness and disaster response: There’s an app for that. Prehospital and Disaster Medicine 30(5): 486–490.

Balapour, A., and S.M. Walton. 2017. Usability of apps and websites: A meta-regression study. In Proceedings of the Twenty-third Americas Conference on Information Systems, 10–12 August 2017, Boston, MA, USA, ed. AMCIS 2017 organization, 1–10. Atlanta, GA: AIS

Bopp, E., J. Douvinet, and D. Serre. 2019. Sorting the good from the bad smartphone applications to alert residents facing disasters—Experiments in France. In Proceedings of the 16th International Conference on Information Systems for Crisis Response and Management (ISCRAM), ed. Z. Franco, J.J. Gonzales, and J.H. Canós, 435–449. València: ISCRAM

Brajnik, G., and S. Gabrielli. 2010. A review of online advertising effects on the user experience. International Journal of Human-Computer Interaction 26(10): 971–997.

Braun, V., and V. Clarke. 2006. Using thematic analysis in psychology. Qualitative Research in Psychology 3(2): 77–101.

Braun, V., and V. Clarke. 2013. Moving towards analysis. In Successful qualitative research: A practical guide for beginners, ed. V. Braun, and V. Clarke, 173–200. London: SAGE.

Cosgrove, S. 2018. Exploring usability and user-centered design through emergency management websites. Communication Design Quarterly Review 6(2): 93–102.

Coursaris, C., and D. Kim. 2011. A meta-analytical review of empirical mobile usability studies. Journal of Usability Studies 6(3): 117–171.

Ding, Y., and K.H. Chai. 2015. Emotions and continued usage of mobile applications. Industrial Management & Data Systems 115(5): 833–852.

Dou, W., K.H. Lim, C. Su, N. Zhou, and N. Cui. 2010. Brand positioning strategy using search engine marketing. MIS Quarterly 34(2): 261–279.

Estuar, M.R.J., M. De Leon, M.D. Santos, J.O. Ilagan, and B.A. May. 2014. Validating UI through UX in the context of a mobile-web crowdsourcing disaster management application. In Proceedings of 2014 International Conference on IT Convergence and Security (ICITCS), 28–30 October 2014, Beijing, China, ed. D. Lee, F. He, and H. Kim, 1–4. Red Hook, NY: IEEE.

Ettinger, K.M., H. Pharaoh, R.Y. Buckman, H. Conradie, and W. Karlen. 2016. Building quality mHealth for low resource settings. Journal of Medical Engineering & Technology 40(7–8): 431–443.

Fallou, L., L. Petersen, and F. Roussel. 2019. Efficiently allocating safety tips after an earthquake—Lessons learned from the smartphone application LastQuake. In Proceedings of the 16th International Conference on Information Systems for Crisis Response and Management (ISCRAM), ed. Z. Franco, J.J. Gonzales, and J.H. Canós, 263–275. València: ISCRAM.

Felt, A.P., S. Egelman, and D. Wagner. 2012. I’ve got 99 problems, but vibration ain’t one: A survey of smartphone users’ concerns. In Proceedings of the Second ACM Workshop on Security and Privacy in Smartphones and Mobile Device, ed. T. Yu, W. Enck, and X. Jiang, 33–44. Raleigh: ACM.

Ferreira, D., A.K. Dey, and V. Kostakos. 2011. Understanding human-smartphone concerns: A study of battery life. In International Conference on Pervasive Computing, ed. K. Lyons, J. Hightower, and E.M. Huang, 19–33. Berlin, Heidelberg: Springer.

Gebauer, J., Y. Tang, and C. Baimai. 2008. User requirements of mobile technology: Results from a content analysis of user reviews. Information Systems and E-Business Management 6(4): 361–384.

Gómez, D., A.M. Bernardos, J.I. Portillo, P. Tarrío, and J.R. Casar. 2013. A review on mobile applications for citizen emergency management. In Proceedings of International Conference on Practical Applications of Agents and Multi-Agent Systems–PAAMS, ed. J.M. Corchado, J. Bajo, J. Kozlak, P. Pawlewski, J.M. Molina, V. Julian, R.A. Silveira, R. Unland, and S. Giroux, 190–201. Berlin: Springer.

Google. 2016. Google play. https://play.google.com/store/apps?hl=en. Accessed 9 Aug 2019.

Gu, B., F. Hu, and H. Liu. 2000. Sampling and its application in data mining: A survey. Singapore: National University of Singapore.

Harrison, R., D. Flood, and D. Duce. 2013. Usability of mobile applications: Literature review and rationale for a new usability model. Journal of Interaction Science 1: Article 1.

Hedegaard, S., and J.G. Simonsen. 2013. Extracting usability and user experience information from online user reviews. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems—CHI’13, ed. W.E. Mackay, S. Brewster, and S. Bødker, 2089–2098. New York: Association for Computing Machinery.

Hertzum, M. 2010. Images of usability. International Journal of Human-Computer Interaction 26(6): 567–600.

Hiltz, S.R., B.V. de Walle, and M. Turoff. 2010. The domain of emergency management information. In Information systems for emergency management, ed. B.V. de Walle, M. Turoff, and S.R. Hiltz, 3–20. New York: Routledge.

Hoehle, H., and V. Venkatesh. 2015. Mobile application usability: Conceptualization and instrument development. MIS Quarterly 39(2): 435–472.

Houston, J.B., J. Hawthorne, M.F. Perreault, E.H. Park, M.G. Hode, M.R. Halliwell, S.E.T. McGowen, R. Davis, et al. 2015. Social media and disasters: A functional framework for social media use in disaster planning, response, and research. Disasters 39(1): 1–22.

ISO (International Organization for Standardization). 1998. ISO 9241-11:1998 Ergonomic requirements for office work with visual display terminals (VDTs)—Part 11: Guidance on usability. Geneva: ISO.

Karl, I., K. Rother, and S. Nestler. 2015. Crisis-related apps: Assistance for critical and emergency situations. International Journal of Information Systems for Crisis Response and Management 7(2): 19–35.

Korhonen, H., J. Holm, and M. Heikkinen. 2007. Utilizing sound effects in mobile user interface design. In Human-Computer Interaction–INTERACT 2007: Proceedings of the 11th IFIP TC 13 International Conference, Rio de Janeiro, Brazil, 10–14 September 2007, ed. C. Baranauskas, P. Palanque, J. Abascal, S.D.J. Borbosa, 283–296. Berlin: Springer.

Kwee-Meier, S.T., M. Wiessmann, and A. Mertens. 2017. Integrated information visualization and usability of user interfaces for safety-critical contexts. In Lecture notes in computer science, ed. D. Harris, 71–85. Berlin: Springer.

Landis, J.R., and G.G. Koch. 1977. The measurement of observer agreement for categorical data. International Biometric Society 33(1): 159–174.

Mashhadi, A., A. Mathur, and F. Kawsar. 2014. The myth of subtle notifications. In Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct publication, ed. A.J. Brush, and A. Friday, 111–114. New York: Association for Computing Machinery.

McCurdie, T., S. Taneva, M. Casselman, M. Yeung, C. Mcdaniel, W. Ho, and J. Cafazzo. 2012. mHealth consumer apps: The case for user-centered design. Biomedical Instrumentation & Technology: Mobile Health 46(s2): 49–56.

McIlroy, S., N. Ali, H. Khalid, and A.E. Hassan. 2015. Analyzing and automatically labelling the types of user issues that are raised in mobile app reviews. Empirical Software Engineering 21(3): 1067–1106.

Mills, A., R. Chen, J. Lee, and H.R. Rao. 2009. Web 2.0 emergency applications: How useful can Twitter be for emergency response? Journal of Information Privacy & Security 5(3): 3–26.

Nielsen, J. 1994. Usability engineering. Amsterdam: Elsevier.

Oxford Dictionary. 2019. Definition of usability in English. Oxford: Oxford University Press.

Palomba, F., M. Linares-Vasquez, G. Bavota, R. Oliveto, M.D. Penta, D. Poshyvanyk, and A. De Lucia. 2015. User reviews matter! Tracking crowdsourced reviews to support evolution of successful apps. In Proceedings of IEEE 31st International Conference on Software Maintenance and Evolution, 29 September–1 October 2015, Bremen, Germany, ed. R. Koschke, J. Krinke, and M. Robillard, 291–300. Bassau: IEEE.

Reuter, C., and T. Spielhofer. 2017. Towards social resilience: A quantitative and qualitative survey on citizens’ perception of social media in emergencies in Europe. Technological Forecasting and Social Change 121: 168–180.

Reuter, C., M.-A. Kaufhold, T. Spielhofer, and A.S. Hahne. 2017. Social media in emergencies: A representative study on citizens’ perception in Germany. PACM on Human-Computer Interaction 1(2): Article 90.

Rosenthal, S., A.K. Dey, and M. Veloso. 2011. Using decision-theoretic experience sampling to build personalized mobile phone interruption models. In Proceedings of the 9th International Conference on Pervasive Computing, 12–15 June 2011, San Francisco, CA, USA, ed. K. Lyons, J. Hightower, and E.M. Huang, 170–187. Berlin: Springer.

Sarshar, P., V. Nunavath, and J. Radianti. 2015. On the usability of smartphone apps in emergencies: An HCI analysis of GDACSmobile and SmartRescue apps. In Human-computer interaction: Interaction technologies, ed. M. Kurosu, 765–774. Cham: Springer.

Schimak, G., D. Havlik, and J. Pielorz. 2015. Crowdsourcing in crisis and disaster management—Challenges and considerations. In Environmental software systems. Infrastructures, services and applications, ed. R. Denzer, R.M. Argent, G. Schimak, and J. Hřebíček, 56–70. Cham: Springer.

Stratmann, T.C., and S. Boll. 2016. Demon hunt—The role of Endsley’s demons of situation awareness in maritime accidents. In Human-centered and error-resilient systems development, ed. C. Bogdan, J. Gulliksen, S. Sauer, P. Forbrig, M. Winckler, C. Johnson, P. Palanque, R. Bernhaupt, and F. Kis, 203–212. Berlin: Springer.

Tan, M.L., R. Prasanna, K. Stock, E. Hudson-Doyle, G. Leonard, and D. Johnston. 2017. Mobile applications in crisis informatics literature: A systematic review. International Journal of Disaster Risk Reduction 24: 297–311.

Westermann, T. 2017. Permission requests and notification settings. In User acceptance of mobile notifications, ed. T. Westermann, 81–102. Singapore: Springer.

Zahra, F., A. Hussain, and H. Mohd. 2017. Usability evaluation of mobile applications; where do we stand? In Proceedings of the 2nd International Conference on Applied Science and Technology, ed. F.A.A. Nifa, K.L. Chong, and A. Hussain, Vol. 1891, Article 020056. Melville, NY: AIP Publishing.

Zhang, D., and B. Adipat. 2005. Challenges, methodologies, and issues in the usability testing of mobile applications. International Journal of Human-Computer Interaction 18(3): 293–308.

Relative Articles

Supplements(0)

Cited By

Proportional views