Statistical Semantic Classification of Crisis Information

The rise of social media as an information channel during crisis has become key to community response. However, existing crisis awareness applications, often struggle to identify relevant information among the high volume of data that is generated over social platforms. A wide range of statistical features and machine learning methods have been researched in recent years to automatically classify this information. In this paper we aim to complement previous studies by exploring the use of semantics as additional features to identify relevant crisis in- formation. Our assumption is that entities and concepts tend to have a more consistent correlation with relevant and irrelevant information, and therefore can enhance the discrimination power of classifiers. Our results, so far, show that some classification improvements can be obtained when using semantic features, reaching +2.51% when the classifier is applied to a new crisis event (i.e., not in training set)

Evaluating the application of research-based guidance to the design of an emergency preparedness leaflet.

Guidelines for the design of emergency communications were derived from primary research and interrogation of the literature. The guidelines were used to re-design a nuclear emergency preparedness leaflet routinely distributed to households in the local area. Pre-test measures of memory for, and self-reported understanding of, nuclear safety information were collected. The findings revealed high levels of non-receipt of the leaflet, and among those who did receive it, memory for safety advice was poor. Subjective evaluations of the trial leaflet suggested that it was preferred and judged easier to understand than the original. Objective measures of memory for the two leaflets were also recorded, once after the study period, and again one week or four weeks later. Memory for the advice was better, at all time periods, when participants studied the trial leaflet. The findings showcase evaluation of emergency preparedness literature and suggest that extant research findings can be applied to the design of communications to improve memory and understandability. STATEMENT OF RELEVANCE: Studies are described that showcase the use of research-based guidelines to design emergency communications and provide both subjective and objective data to support designing emergency communications in this way. In addition, the research evaluates the effectiveness of emergency preparedness leaflets that are routinely distributed to households. This work is of relevance to academics interested in risk communication and to practitioners involved in civil protection and emergency preparedness

Comprehension and trust in crises: investigating the impact of machine translation and post-editing

We conducted a survey to understand the impact of machine translation and postediting awareness on comprehension of and trust in messages disseminated to prepare the public for a weather-related crisis, i.e. flooding. The translation direction was English–Italian. Sixty-one participants—all native Italian speakers with different English proficiency levels— answered our survey. Each participant read and evaluated between three and six crisis messages using ratings and openended questions on comprehensibility and trust. The messages were in English and Italian. All the Italian messages had been machine translated and post-edited. Nevertheless, participants were told that only half had been post-edited, so that we could test the impact of post-editing awareness. We could not draw firm conclusions when comparing the scores for trust and comprehensibility assigned to the three types of messages—English, post-edits, and purported raw outputs. However, when scores were triangulated with open-ended answers, stronger patterns were observed, such as the impact of fluency of the translations on their comprehensibility and trustworthiness. We found correlations between comprehensibility and trustworthiness, and identified other factors influencing these aspects, such as the clarity and soundness of the messages. We conclude by outlining implications for crisis preparedness, limitations, and areas for future research

Machine Learning for Readability Assessment and Text Simplification in Crisis Communication: A Systematic Review

In times of social media, crisis managers can interact with the citizens in a variety of ways. Since machine learning has already been used to classify messages from the population, the question is, whether such technologies can play a role in the creation of messages from crisis managers to the population. This paper focuses on an explorative research revolving around selected machine learning solutions for crisis communication. We present systematic literature reviews of readability assessment and text simplification. Our research suggests that readability assessment has the potential for an effective use in crisis communication, but there is a lack of sufficient training data. This also applies to text simplification, where an exact assessment is only partly possible due to unreliable or non-existent training data and validation measures

Does clarity make central banks more engaging? Lessons from ECB communications

Despite increasing communication efforts, it may be difficult for central banks to engage the public, as their language is often too difficult to understand for most citizens. Focusing on the case of the European Central Bank (ECB), we hypothesise that greater communication clarity is conducive to stronger engagement. We rely on readability metrics to measure the clarity of ECB communications. We show that communication clarity is a significant and robust predictor of the media engagement generated by the ECB with its speeches, press conferences and tweets. Our findings are validated by a placebo test and have significant policy implications for central bank communication

Communications in the time of a pandemic: The readability of documents for public consumption

© 2021 The Authors Objective: Government communications in a crisis can influence public health outcomes. This research aimed to investigate if written communications of the most commonly sought sources of COVID-19 information available on the internet have readability levels commensurate with those of the general public. Methods: Online documents from the World Health Organization (WHO), and the governments of Australia, the UK and the US were assessed for readability using an online instrument that calculated scores for the Flesch Reading Ease Score, the SMOG Index and the Readability Consensus Grade Level. Results: Similar to the previous research, most documents assessed had a readability standard that was at or above the recommended grade level, and as such inaccessible to substantial portions of the general public. A one-way ANOVA with post hoc tests revealed significant differences among the data, with Australian documents significantly more difficult to read than those from the UK and US. Conclusions: Government departments need to consider their audience and monitor readability of the documents they produce to ensure that readers can understand them. Implications for public health: Health communications need to be written at a level appropriate for the targeted population in order to be fit for purpose

Health Information on COVID-19 Vaccination: Readability of Online Sources and Newspapers in Singapore, Hong Kong, and the Philippines

To address the COVID-19 pandemic, as with other infectious diseases, a key intervention is vaccination. Health communications are thus of vital importance for informing the public on the benefits and risks of vaccines. This in turn makes the readability of media content fundamental. Previous studies of COVID-19-related information have found the readability of online information considerably more difficult than recommended. However, studies on the readability of information related to COVID-19 vaccination in Asian contexts have yet to be carried out. Furthermore, especially in the case of the current pandemic, health information is communicated by a variety of information channels, including the internet and mass media. This paper investigates the readability of textual information on COVID-19 vaccination found online and in newspaper articles in parts of Asia where English is one of the main languages, namely Singapore, Hong Kong, and the Philippines. Readability was assessed using a set of readability tests (Flesch–Kincaid Reading Ease, Flesch–Kincaid Grade Level, Gunning Fog Index, Coleman–Liau Index, and Simple Measure of Gobbledygook Grade level). It was found that a low proportion of URLs scored within recommended readability thresholds, and did so consistently across locations and types of sources. Furthermore, a relatively low proportion of web searches returned information from local sources; most URLs linked to sources outside of Singapore, Hong Kong, or the Philippines. Further, local online and newspaper sources scored similarly poorly on readability on average compared to non-local sources. Understanding of fast-evolving health communications concerning COVID-19 vaccination encompasses information about vaccine development and deployment from other locations, as well as locally. Nevertheless, these findings indicated a fairly low proportion of local sources among the top search results, and relatively low (i.e., difficult-to-read) readability scores for top search results and for local newspapers. An important issue for health communications strategies addressing COVID-19 vaccination will therefore be to consider different types of media sources in order to achieve the right mix of local and non-local sources while also ensuring appropriate readability

Health Information on COVID-19 Vaccination: Readability of Online Sources and Newspapers in Singapore, Hong Kong, and the Philippines

To address the COVID-19 pandemic, as with other infectious diseases, a key intervention is vaccination. Health communications are thus of vital importance for informing the public on the benefits and risks of vaccines. This in turn makes the readability of media content fundamental. Previous studies of COVID-19-related information have found the readability of online information considerably more difficult than recommended. However, studies on the readability of information related to COVID-19 vaccination in Asian contexts have yet to be carried out. Furthermore, especially in the case of the current pandemic, health information is communicated by a variety of information channels, including the internet and mass media. This paper investigates the readability of textual information on COVID-19 vaccination found online and in newspaper articles in parts of Asia where English is one of the main languages, namely Singapore, Hong Kong, and the Philippines. Readability was assessed using a set of readability tests (Flesch–Kincaid Reading Ease, Flesch–Kincaid Grade Level, Gunning Fog Index, Coleman–Liau Index, and Simple Measure of Gobbledygook Grade level). It was found that a low proportion of URLs scored within recommended readability thresholds, and did so consistently across locations and types of sources. Furthermore, a relatively low proportion of web searches returned information from local sources; most URLs linked to sources outside of Singapore, Hong Kong, or the Philippines. Further, local online and newspaper sources scored similarly poorly on readability on average compared to non-local sources. Understanding of fast-evolving health communications concerning COVID-19 vaccination encompasses information about vaccine development and deployment from other locations, as well as locally. Nevertheless, these findings indicated a fairly low proportion of local sources among the top search results, and relatively low (i.e., difficult-to-read) readability scores for top search results and for local newspapers. An important issue for health communications strategies addressing COVID-19 vaccination will therefore be to consider different types of media sources in order to achieve the right mix of local and non-local sources while also ensuring appropriate readability