Technical Papers
Jan 25, 2023

Ember Alerts: Assessing Wireless Emergency Alert Messages in Wildfires Using the Warning Response Model

Publication: Natural Hazards Review
Volume 24, Issue 2

Abstract

When evacuation is necessary in a wildfire event, affected communities must be alerted and warned of the imminent danger and instructed on what to do to protect themselves. One channel available to message providers in the United States is Wireless Emergency Alerts (WEAs) disseminated via the Integrated Public Alert and Warning System (IPAWS). Recent wildfire events have shed light on the need to improve WEA strategies and messages when alerting exposed populations of imminent fire threat. The purpose of this article is to assess how, when, and where WEAs have been used in US wildfires; whether they comply with guidance set out by Mileti and Sorensen’s Warning Response Model (WRM); and whether the expansion in characters (from 90 to 360) of WEA messages has influenced compliance with the WRM. A quantitative content analysis was conducted of WEA messages sent during US wildfires from January 2020–April 2022. A total of 1,284 messages were manually coded based upon the content and style categories identified in the WRM. Descriptive analyses (and Chi-square tests) were performed to illustrate how 90-character and 360-character WEA messages differ by key content and style features. Results showed that certain content features (i.e., location, guidance, and the name of the hazard) were included more often than others (i.e., source, hazard description, hazard consequences, and timing information) and that the inclusion of most content features increased with increasing message character length. Additionally, when assessing message ‘completeness,’ the use of acronyms was prevalent in both 90- and 360-character wildfire WEAs; whereas the inclusion of URLs was linked to increased message length. Wildfire WEAs also displayed inconsistency both within and across states in their use of terminology to trigger evacuation. These findings, among others, have implications for theory highlighting a growing need to confirm that message receivers understand and can act on the messages sent, regardless of the language used. In addition, for message creators, recommendations for effective WEA messages for wildfires are provided.

Get full access to this article

View all available purchase options and get full access to this article.

Data Availability Statement

Anonymized data, models, or code that support the findings of this study are available from the corresponding author upon reasonable request.

Acknowledgments

This material is based upon work supported by FEMA-IPAWS (70FA5021C00000016) awarded to Sutton.

References

Averill, J. D., D. S. Mileti, R. D. Peacock, E. D. Kuligowski, N. Groner, G. Proulx, P. A. Reneke, and H. E. Nelson. 2005. Occupant behavior, egress, and emergency communications. Gaithersburg, MD: National Institute of Standards and Technology.
Barrett, K. 2020. “Wildfires destroy thousands of structures each year.” Accessed July 29, 2022. https://headwaterseconomics.org/natural-hazards/structures-destroyed-by-wildfire/.
Bean, H. 2019. Mobile technology and the transformation of public alert and warning. Santa Barbara, CA: Praeger Security International.
Bean, H., N. Grevstad, A. Koutsoukos, and A. Meyer. 2021. “Exploring the use of wireless emergency alerts for notifications regarding COVID-19: Initial lines of inquiry.” Nat. Hazards Rev. 22 (2): 06021001. https://doi.org/10.1061/(ASCE)NH.1527-6996.0000472.
Bean, H., B. F. Liu, S. Madden, J. Sutton, M. M. Wood, and D. S. Mileti. 2016. “Disaster warnings in your pocket: How audiences interpret mobile alerts for an unfamiliar hazard.” J. Contingencies Crisis Manage. 24 (3): 136–147. https://doi.org/10.1111/1468-5973.12108.
Bean, H., and S. Madden. 2019. “Mobile crisis communication: Temporality, rhetoric, and the case of wireless emergency alerts.” In New media in times of crisis, edited by Keri K. Stephens. New York: Routledge.
Bean, H., J. Sutton, B. F. Liu, S. Madden, M. M. Wood, and D. S. Mileti. 2015. “The study of mobile public warning messages: A research review and agenda.” Rev. Commun. 15 (1): 60–80. https://doi.org/10.1080/15358593.2015.1014402.
Berlin, G., and M. Hieb. 2019. Wildland urban interface fire operational requirements and capability analysis: Report of findings. Washington, DC: Dept. of Homeland Security’s Science and Technology Directorate.
Bowman, D. M. J. S., C. A. Kolden, J. T. Abatzoglou, F. H. Johnston, G. R. van der Werf, and M. Flannigan. 2020. “Vegetation fires in the anthropocene.” Nature Rev. Earth Environ. 1 (10): 500–515. https://doi.org/10.1038/s43017-020-0085-3.
Bullock, O. M., D. Colón Amill, H. C. Shulman, and G. N. Dixon. 2019. “Jargon as a barrier to effective science communication: Evidence from metacognition.” Public Understanding Sci. 28 (7): 845–853. https://doi.org/10.1177/0963662519865687.
Burgeno, J. N., and S. L. Joslyn. 2020. “The impact of weather forecast inconsistency on user trust.” Weather Clim. Soc. 12 (4): 679–694. https://doi.org/10.1175/WCAS-D-19-0074.1.
California OES Wireless Emergency Alerts. 2020. “Evacuation guidelines: Standard statewide evacuation terminology.” Accessed August 18, 2021. https://calalerts.org/evacuations.html.
Comfort, L., K. Soga, M. Stacey, M. McElwee, C. Ecosse, J. Dressler, and B. Zhao. 2019. Collective action in communities exposed to recurring hazards: The camp fire, Butte County, California, November 8, 2018. In Vol. 300 of Natural hazards center quick response grant report series, 19. Boulder, CO: Univ. of Colorado Boulder.
County of Sonoma. 2020. 2019 Kincade fire after action report. Sonoma County, CA: Sonoma County Dept. of Emergency Management.
DeYoung, S. E., J. N. Sutton, A. K. Farmer, D. Neal, and K. A. Nichols. 2019. “‘Death was not in the agenda for the day’: Emotions, behavioral reactions, and perceptions in response to the 2018 Hawaii wireless emergency alert.” Int. J. Disaster Risk Reduct. 36 (May): 101078. https://doi.org/10.1016/j.ijdrr.2019.101078.
Doermann, J. L., E. D. Kuligowski, and J. Milke. 2020. “From social science research to engineering practice: Development of a short message creation tool for wildfire emergencies.” Fire Technol. 57: 815–837. https://doi.org/10.1007/s10694-020-01008-7.
FEMA. 2020. “WEA fact sheet.” Accessed July 29, 2022. https://www.ready.gov/sites/default/files/2020-08/wea-fact-sheet.pdf.
Gordon, A., and E. Chimenti. n.d. Crafting effective public safety messages for wildfire and subsequent debris flow risks. Los Angeles: National Weather Service.
Hoover, K., and L. A. Hanson. 2021. Wildfire statistics. Washington, DC: Library of Congress, Congressional Research Service.
Kaltenberger, R., A. Schaffhauser, and M. Staudinger. 2020. “‘What the weather will do’: Results of a survey on impact-oriented and impact-based warnings in European NMHSs.” Adv. Sci. Res. 17: 29–38. https://doi.org/10.5194/asr-17-29-2020.
Karels, J. R. 2022. Wildland urban interface: A look at issues and resolutions: A report of recommendations for elected officials, policymakers and all levels of government, tribal and response agencies. Washington, DC: US Federal Emergency Management Agency.
Kim, G., A. Martel, D. Eisenman, M. Prelip, A. Arevian, K. L. Johnson, and D. Glik. 2019. “Wireless emergency alert messages: Influences on protective action behavior.” J. Contingencies Crisis Manage. 27 (4): 374–386. https://doi.org/10.1111/1468-5973.12278.
Kim, S., and M. S. Wogalter. 2015. “Effects of emphasis terminology in warning instructions on compliance intent and understandability.” J. Saf. Res. 55 (Dec): 41–51. https://doi.org/10.1016/j.jsr.2015.07.008.
Kington, W. 2019. Australian fire danger rating system: Social research summary. Melbourne, Australia: AFAC.
Krippendorff, K. 2011. “Agreement and information in the reliability of coding.” Commun. Methods Meas. 5 (2): 93–112. https://doi.org/10.1080/19312458.2011.568376.
Kuligowski, E. D., E. H. Walpole, R. Lovreglio, and S. McCaffrey. 2020. “Modelling evacuation decision-making in the 2016 Chimney Tops 2 fire in Gatlinburg, TN.” Int. J. Wildland Fire 29 (12): 1120–1132. https://doi.org/10.1071/WF20038.
Lewis, S. 2022. “Colorado Springs City Council approves new emergency evacuation ordinance despite concerns from residents.” Accessed July 30, 2022. https://www.cpr.org/2022/07/12/colorado-springs-city-council-unanimously-approves-new-emergency-evacuation-ordinance-despite-concerns-from-residents/.
Liu, B. F., M. M. Wood, M. Egnoto, H. Bean, J. Sutton, D. Mileti, and S. Madden. 2017. “Is a picture worth a thousand words? The effects of maps and warning messages on how publics respond to disaster information.” Public Relations Rev. 43 (3): 493–506. https://doi.org/10.1016/j.pubrev.2017.04.004.
Marshall Fire Operational After-Action Report (AAR). 2022. “Marshall fire operational after-action report.” Accessed December 30, 2022. https://www.superiorcolorado.gov/home/showpublisheddocument/20708/637908398510630000#:~:text=On%20Thursday%2C%20December%2030%2C%202021,along%20the%20Front%20Range%20Foothills.
Mileti, D. 2018. PrepTalks: Modernizing public warning messaging. Washington, DC: US Federal Emergency Management Agency.
Mileti, D. S., and E. M. Beck. 1975. “Communication in crisis: Explaining evacuation symbolically.” Commun. Res. 2 (1): 24–49. https://doi.org/10.1177/009365027500200102.
Mileti, D. S., and C. Fitzpatrick. 1992. “The causal sequence of risk communication in the parkfield earthquake prediction experiment.” Risk Anal. 12 (3): 393–400. https://doi.org/10.1111/j.1539-6924.1992.tb00691.x.
Mileti, D. S., and J. H. Sorensen. 1990. Communication of emergency public warnings: A social science perspective and state-of-the-art assessment. Oak Ridge, TN: Oak Ridge National Laboratory, US Dept. of Energy.
Mileti, D. S., and J. H. Sorensen. 2019. A guide to public alerts and warnings for dam and levee emergencies. Washington, DC: Dept. of the Army, Corps of Engineers.
Potter, S., S. Harrison, and P. Kreft. 2021. “The benefits and challenges of implementing impact-based severe weather warning systems: Perspectives of weather, flood, and emergency management personnel.” Weather Clim. Soc. 13 (2): 303–314. https://doi.org/10.1175/WCAS-D-20-0110.1.
Potter, S. H., P. V. Kreft, P. Milojev, C. Noble, B. Montz, A. Dhellemmes, R. J. Woods, and S. Gauden-Ing. 2018. “The influence of impact-based severe weather warnings on risk perceptions and intended protective actions.” Int. J. Disaster Risk Reduct. 30 (Part A): 34–43. https://doi.org/10.1016/j.ijdrr.2018.03.031.
Sorensen, J. H. 2000. “Hazard warning systems: Review of 20 years of progress.” Nat. Hazard. Rev. 1 (2): 119–125. https://doi.org/10.1061/(ASCE)1527-6988(2000)1:2(119).
Sorensen, J. H., and D. S. Mileti. 2018. Warning issuance, diffusion, and public protective action initiation during the February 2017 Oroville Dam event. Davis, CA: USACE.
Sutton, J., L. Fischer, L. E. James, and S. E. Sheff. 2020. “Earthquake early warning message testing: Visual attention, behavioral responses, and message perceptions.” Int. J. Disaster Risk Reduct. 49 (Oct): 101664. https://doi.org/10.1016/j.ijdrr.2020.101664.
Sutton, J., L. Fischer, and M. M. Wood. 2021. “Tornado warning guidance and graphics: Implications of the inclusion of protective action information on perceptions and efficacy.” Weather Clim. Soc. 13 (4): 1003–1014. https://doi.org/10.1175/WCAS-D-21-0097.1.
Sutton, J., and E. D. Kuligowski. 2019. “Alerts and warnings on short messaging channels: Guidance from an expert panel process.” Nat. Hazards Rev. 20 (2): 04019002. https://doi.org/10.1061/(ASCE)NH.1527-6996.0000324.
Sutton, J., S. C. Vos, M. M. Wood, and M. Turner. 2018. “Designing effective tsunami messages: Examining the role of short messages and fear in warning response.” Weather Clim. Soc. 10 (1): 75–87. https://doi.org/10.1175/WCAS-D-17-0032.1.
Sutton, J., and C. Woods. 2016. “Tsunami warning message interpretation and sense making: Focus group insights.” Weather Clim. Soc. 8 (4): 389–398. https://doi.org/10.1175/WCAS-D-15-0067.1.
Sutton, J., and M. Woods. 2022. Testing the effects of increased message specificity for earthquake early warning: Collaborative research with the University at Albany, SUNY and California State University, Fullerton. USGS Earthquake Hazards Program.
Weick, K. E., and K. M. Sutcliffe, eds. 2015. Managing the unexpected. Hoboken, NJ: Wiley.
Weyrich, P., A. Scolobig, D. N. Bresch, and A. Patt. 2018. “Effects of impact-based warnings and behavioral recommendations for extreme weather events.” Weather Clim. Soc. 10 (4): 781–796. https://doi.org/10.1175/WCAS-D-18-0038.1.
Weyrich, P., A. Scolobig, and A. Patt. 2019. “Dealing with inconsistent weather warnings: Effects on warning quality and intended actions.” Meteorol. Appl. 26 (4): 569–583. https://doi.org/10.1002/met.1785.
Williams, C. A., and G. M. Eosco. 2021. “Is a consistent message achievable?: Defining ‘message consistency’ for weather enterprise researchers and practitioners.” Bull. Am. Meteorol. Soc. 102 (2): 279–295. https://doi.org/10.1175/BAMS-D-18-0250.1.
Williams, C. A., P. W. Miller, A. W. Black, and J. A. Knox. 2017. “Throwing caution to the wind: National weather service wind products as perceived by a weather-salient sample.” J. Oper. Meteor. 05 (9): 103–120. https://doi.org/10.15191/nwajom.2017.0509.
Willoughby, S. D., K. Johnson, and L. Sterman. 2020. “Quantifying scientific jargon.” Public Understanding Sci. 29 (6): 634–643. https://doi.org/10.1177/0963662520937436.
Wood, M. M., H. Bean, B. F. Liu, and M. Boyd. 2015. Comprehensive testing of imminent threat public messages for mobile devices: Updated findings. Washington, DC: US Dept. of Homeland Security, START Center.
Wood, M. M., D. S. Mileti, H. Bean, B. F. Liu, J. Sutton, and S. Madden. 2018. “Milling and public warnings.” Environ. Behav. 50 (5): 535–566. https://doi.org/10.1177/0013916517709561.
Wood, M. M., D. S. Mileti, M. Kano, M. M. Kelley, R. Regan, and L. B. Bourque. 2012. “Communicating actionable risk for terrorism and other hazards.” Risk Anal. 32 (4): 601–615. https://doi.org/10.1111/j.1539-6924.2011.01645.x.

Information & Authors

Information

Published In

Go to Natural Hazards Review
Natural Hazards Review
Volume 24Issue 2May 2023

History

Received: Jul 31, 2022
Accepted: Dec 2, 2022
Published online: Jan 25, 2023
Published in print: May 1, 2023
Discussion open until: Jun 25, 2023

Permissions

Request permissions for this article.

ASCE Technical Topics:

Authors

Affiliations

Vice-Chancellor’s Senior Research Fellow, School of Engineering, STEM College, RMIT Univ., Melbourne, VIC 3000, Australia (corresponding author). ORCID: https://orcid.org/0000-0001-6121-4983. Email: [email protected]
Nicholas A. Waugh [email protected]
Research Associate, College of Emergency Preparedness, Homeland Security and Cybersecurity, Univ. at Albany, State Univ. of New York, 1220 Washington Ave., Albany, NY 12226. Email: [email protected]
Jeannette Sutton [email protected]
Associate Professor, College of Emergency Preparedness, Homeland Security and Cybersecurity, Univ. at Albany, State Univ. of New York, 1220 Washington Ave., Albany, NY 12226. Email: [email protected]
Thomas J. Cova [email protected]
Professor, Center for Natural & Technological Hazards, Dept. of Geography, Univ. of Utah, Salt Lake City, UT 84112. Email: [email protected]

Metrics & Citations

Metrics

Citations

Download citation

If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.

Cited by

  • The Legacy of Dennis S. Mileti and the Future of Public Alert and Warning Research, Natural Hazards Review, 10.1061/NHREFO.NHENG-2113, 25, 3, (2024).
  • The Warning Lexicon: A Multiphased Study to Identify, Design, and Develop Content for Warning Messages, Natural Hazards Review, 10.1061/NHREFO.NHENG-1900, 25, 1, (2024).
  • Information Dissemination, Diffusion, and Response during Hurricane Harvey: Analysis of Evolving Forecast and Warning Imagery Posted Online, Natural Hazards Review, 10.1061/NHREFO.NHENG-1802, 25, 3, (2024).
  • Systemic Vulnerabilities in Hispanic and Latinx Immigrant Communities Led to the Reliance on an Informal Warning System in the December 10–11, 2021, Tornado Outbreak, Natural Hazards Review, 10.1061/NHREFO.NHENG-1755, 25, 2, (2024).

View Options

Get Access

Access content

Please select your options to get access

Log in/Register Log in via your institution (Shibboleth)
ASCE Members: Please log in to see member pricing

Purchase

Save for later Information on ASCE Library Cards
ASCE Library Cards let you download journal articles, proceedings papers, and available book chapters across the entire ASCE Library platform. ASCE Library Cards remain active for 24 months or until all downloads are used. Note: This content will be debited as one download at time of checkout.

Terms of Use: ASCE Library Cards are for individual, personal use only. Reselling, republishing, or forwarding the materials to libraries or reading rooms is prohibited.
ASCE Library Card (5 downloads)
$105.00
Add to cart
ASCE Library Card (20 downloads)
$280.00
Add to cart
Buy Single Article
$35.00
Add to cart

Get Access

Access content

Please select your options to get access

Log in/Register Log in via your institution (Shibboleth)
ASCE Members: Please log in to see member pricing

Purchase

Save for later Information on ASCE Library Cards
ASCE Library Cards let you download journal articles, proceedings papers, and available book chapters across the entire ASCE Library platform. ASCE Library Cards remain active for 24 months or until all downloads are used. Note: This content will be debited as one download at time of checkout.

Terms of Use: ASCE Library Cards are for individual, personal use only. Reselling, republishing, or forwarding the materials to libraries or reading rooms is prohibited.
ASCE Library Card (5 downloads)
$105.00
Add to cart
ASCE Library Card (20 downloads)
$280.00
Add to cart
Buy Single Article
$35.00
Add to cart

Media

Figures

Other

Tables

Share

Share

Copy the content Link

Share with email

Email a colleague

Share