Planning multisentential English text using communicative acts

The goal of this research is to develop explanation presentation mechanisms for knowledge based systems which enable them to define domain terminology and concepts, narrate events, elucidate plans, processes, or propositions and argue to support a claim or advocate action. This requires the development of devices which select, structure, order and then linguistically realize explanation content as coherent and cohesive English text. With the goal of identifying generic explanation presentation strategies, a wide range of naturally occurring texts were analyzed with respect to their communicative sttucture, function, content and intended effects on the reader. This motivated an integrated theory of communicative acts which characterizes text at the level of rhetorical acts (e.g., describe, define, narrate), illocutionary acts (e.g., inform, request), and locutionary acts (e.g., ask, command). Taken as a whole, the identified communicative acts characterize the structure, content and intended effects of four types of text: description, narration, exposition, argument. These text types have distinct effects such as getting the reader to know about entities, to know about events, to understand plans, processes, or propositions, or to believe propositions or want to perform actions. In addition to identifying the communicative function and effect of text at multiple levels of abstraction, this dissertation details a tripartite theory of focus of attention (discourse focus, temporal focus, and spatial focus) which constrains the planning and linguistic realization of text. To test the integrated theory of communicative acts and tripartite theory of focus of attention, a text generation system TEXPLAN (Textual EXplanation PLANner) was implemented that plans and linguistically realizes multisentential and multiparagraph explanations from knowledge based systems. The communicative acts identified during text analysis were formalized as over sixty compositional and (in some cases) recursive plan operators in the library of a hierarchical planner. Discourse, temporal, and spatial focus models were implemented to track and use attentional information to guide the organization and realization of text. Because the plan operators distinguish between the communicative function (e.g., argue for a proposition) and the expected effect (e.g., the reader believes the proposition) of communicative acts, the system is able to construct a discourse model of the structure and function of its textual responses as well as a user model of the expected effects of its responses on the reader's knowledge, beliefs, and desires. The system uses both the discourse model and user model to guide subsequent utterances. To test its generality, the system was interfaced to a variety of domain applications including a neuropsychological diagnosis system, a mission planning system, and a knowledge based mission simulator. The system produces descriptions, narrations, expositions, and arguments from these applications, thus exhibiting a broader range of rhetorical coverage than previous text generation systems

Generating Visual Arguments: a Media-independent Approach

... In this paper, we take the position that certain types of arguments that can be presented visually in information graphics (e.g., bar charts and scatter plots) can be generated from an underlying media-independent representation of a presentation. In support of this claim, first we briefly describe the architecture we are developing for the generation of integrated text and information graphics presentations. In this architecture, mediaindependent communicative acts are transformed into user task specifications which are the basis for the automatic design of the presentation's graphics. Then we present an example showing correspondences between the media-independent representation of an argument and the tasks that would be used to design a graphic expressing the argument

Sharedness and privateness in human early social life

This research is concerned with the innate predispositions underlying human intentional communication. Human communication is currently defined as a circular and overt attempt to modify a partner's mental states. This requires each party involved to posse ss the ability to represent and understand the other's mental states, a capability which is commonly referred to as mindreading, or theory of mind (ToM). The relevant experimental literature agrees that no such capability is to be found in the human speci es at least during the first year of life, and possibly later. This paper aims at advancing a solution to this theoretical problem. We propose to consider sharedness as the basis for intentional communication in the infant and to view it as a primitive, i nnate component of her cognitive architecture. Communication can then build upon the mental grounds that the infant takes as shared with her caregivers. We view this capability as a theory of mind in a weak sense.

THE RHETORICAL STRUCTURE AND COMMUNICATIVE STRATEGIES OF THESTUDENTS’ REQUESTS IN THE WEB DISCUSSION FORUM

This paper is to describe the rhetorical structure and the communicative strategies that students use in the web discussion forum of Ma Chung University. This web discussion forum allows the participants, especially students, to share their ideas, opinions about the current issues in the campus in the form of written texts. Among 11 students who get involved in discussing two issues, the campus bell and hair coloring, they are most likely to attend to directive based rhetorical structure when they have the same opinions. By contrast, representative based rhetorical structure becomes more obviously apparent when they have diverse opinions among themselves. In order to strengthen the perlocutionary force of the utterance, the students are also most likely to use some communicative strategies such as a colloquial and native language, abbreviation, capitalized letters and emoticon

Communicative Actions

Communicative actions in the broad sense of communicationattempts ­ are special cases of instrumental actions, i.e. actions by means of which one tries to achieve some ends, their differentia specifica being that in the case of communicative actions the speaker expects to achieve her primary (communicative) aim iff this aim is recognized by her addressee. In short, from the speaker's viewpoint communication coincides with understanding, where understanding is to be identified with recognition of the relevant speaker's intentions. This idea is, using some elementary formal machinery from intentional logic, expounded in more detail, related to proposals of Paul Grice's (speaker's meaning), and compared to the alternative approach of classical speech act theory

The relation between language and theory of mind in development and evolution

Considering the close relation between language and theory of mind in development and their tight connection in social behavior, it is no big leap to claim that the two capacities have been related in evolution as well. But what is the exact relation between them? This paper attempts to clear a path toward an answer. I consider several possible relations between the two faculties, bring conceptual arguments and empirical evidence to bear on them, and end up arguing for a version of co-evolution. To model this co-evolution, we must distinguish between different stages or levels of language and theory of mind, which fueled each other’s evolution in a protracted escalation process

Collaborating on Referring Expressions

This paper presents a computational model of how conversational participants collaborate in order to make a referring action successful. The model is based on the view of language as goal-directed behavior. We propose that the content of a referring expression can be accounted for by the planning paradigm. Not only does this approach allow the processes of building referring expressions and identifying their referents to be captured by plan construction and plan inference, it also allows us to account for how participants clarify a referring expression by using meta-actions that reason about and manipulate the plan derivation that corresponds to the referring expression. To account for how clarification goals arise and how inferred clarification plans affect the agent, we propose that the agents are in a certain state of mind, and that this state includes an intention to achieve the goal of referring and a plan that the agents are currently considering. It is this mental state that sanctions the adoption of goals and the acceptance of inferred plans, and so acts as a link between understanding and generation.Comment: 32 pages, 2 figures, to appear in Computation Linguistics 21-

How do interactive tabletop systems influence collaboration?

This paper examines some aspects of the usefulness of interactive tabletop systems, if and how these impact collaboration. We chose creative problem solving such as brainstorming as an application framework to test several collaborative media: the use of pen-and-paper tools, the ‘‘around-the-table’’ form factor, the digital tabletop interface, the attractiveness of interaction styles. Eighty subjects in total (20 groups of four members) participated in the experiments. The evaluation criteria were task performance, collaboration patterns (especially equity of contributions), and users’ subjective experience. The ‘‘aroundthe-table’’ form factor, which is hypothesized to promote social comparison, increased performance and improved collaboration through an increase of equity. Moreover, the attractiveness of the tabletop device improved subjective experience and increased motivation to engage in the task. However, designing attractiveness seems a highly challenging issue, since overly attractive interfaces may distract users from the task