Data-to-Text Generation Improves Decision-Making Under Uncertainty

Decision-making is often dependent on uncertain data, e.g. data associated with confidence scores or probabilities. This article presents a comparison of different information presentations for uncertain data and, for the first time, measures their effects on human decision-making, in the domain of weather forecast generation. We use a game-based setup to evaluate the different systems. We show that the use of Natural Language Generation (NLG) enhances decision-making under uncertainty, compared to state-of-the-art graphical-based representation methods.In a task-based study with 442 adults, we found that presentations using NLG led to 24% better decision-making on average than the graphical presentations, and to 44% better decision-making when NLG is combined with graphics. We also show that women achieve significantly better results when presented with NLG output (an 87% increase on average compared to graphical presentations). Finally, we present a further analysis of demographic data and its impact on decision-making, and we discuss implications for future NLG systems

Explainable Hopfield Neural Networks Using an Automatic Video-Generation System

Hopfield Neural Networks (HNNs) are recurrent neural networks used to implement associative memory. They can be applied to pattern recognition, optimization, or image segmentation. However, sometimes it is not easy to provide the users with good explanations about the results obtained with them due to mainly the large number of changes in the state of neurons (and their weights) produced during a problem of machine learning. There are currently limited techniques to visualize, verbalize, or abstract HNNs. This paper outlines how we can construct automatic video-generation systems to explain its execution. This work constitutes a novel approach to obtain explainable artificial intelligence systems in general and HNNs in particular building on the theory of data-to-text systems and software visualization approaches. We present a complete methodology to build these kinds of systems. Software architecture is also designed, implemented, and tested. Technical details about the implementation are also detailed and explained. We apply our approach to creating a complete explainer video about the execution of HNNs on a small recognition problem. Finally, several aspects of the videos generated are evaluated (quality, content, motivation and design/presentation).University of the Bio-Bio. Vicerrectoria de Investigacion. Facultad de Ciencias Empresariales. Departamento de Sistemas de Informacion

Building a Persuasive Virtual Dietitian

This paper describes the Multimedia Application for Diet Management (MADiMan), a system that supports users in managing their diets while admitting diet transgressions. MADiMan consists of a numerical reasoner that takes into account users’ dietary constraints and automatically adapts the users’ diet, and of a natural language generation (NLG) system that automatically creates textual messages for explaining the results provided by the reasoner with the aim of persuading users to stick to a healthy diet. In the first part of the paper, we introduce the MADiMan system and, in particular, the basic mechanisms related to reasoning, data interpretation and content selection for a numeric data-to-text NLG system. We also discuss a number of factors influencing the design of the textual messages produced. In particular, we describe in detail the design of the sentence-aggregation procedure, which determines the compactness of the final message by applying two aggregation strategies. In the second part of the paper, we present the app that we developed, CheckYourMeal!, and the results of two human-based quantitative evaluations of the NLG module conducted using CheckYourMeal! in a simulation. The first evaluation, conducted with twenty users, ascertained both the perceived usefulness of graphics/text and the appeal, easiness and persuasiveness of the textual messages. The second evaluation, conducted with thirty-nine users, ascertained their persuasive power. The evaluations were based on the analysis of questionnaires and of logged data of users’ behaviour. Both evaluations showed significant results

Conversational Agents for Energy Awareness and Efficiency: A Survey

The need to reduce greenhouse gas emissions and promote energy efficiency is crucial to achieve the energy transition and sustainable development goals. The availability of tools that provide clear information on energy consumption plays a key role in this transition, enabling users to monitor, manage, and optimize their energy use. This process, commonly referred to as energy feedback or eco-feedback, involves delivering information regarding energy usage and potentially suggesting more sustainable practices. Within the range of available tools, conversational agents can represent a valuable channel to receive detailed information about energy consumption and tailored advice for improving energy efficiency. The aim of this article is thus to explore the application of conversational agents, focusing on eco-feedback, as these tools are primarily devised to foster user awareness of energy usage and enhance more participatory conservation strategies. To this end, we conducted a keyword-based search of major scientific article databases, applying strict criteria to select relevant studies. The results of the collection showed that there is a very diverse landscape with respect to this topic. The surveyed works exhibit a high versatility in feedback goals. Furthermore, while predominantly applied domestically, they also show potential in commercial and industrial settings. Implementation choices also vary to a great extent, while evaluation practices lack a systematic approach and highlight the need for greater consistency. In light of these remarks, we also outline possible future extensions of this type of application, exploring in particular the emerging challenges associated with the increased use of renewable sources and the rise of local decentralized energy communities