A discriminative approach to grounded spoken language understanding in interactive robotics

Spoken Language Understanding in Interactive Robotics provides computational models of human-machine communication based on the vocal input. However, robots operate in specific environments and the correct interpretation of the spoken sentences depends on the physical, cognitive and linguistic aspects triggered by the operational environment. Grounded language processing should exploit both the physical constraints of the context as well as knowledge assumptions of the robot. These include the subjective perception of the environment that explicitly affects linguistic reasoning. In this work, a standard linguistic pipeline for semantic parsing is extended toward a form of perceptually informed natural language processing that combines discriminative learning and distributional semantics. Empirical results achieve up to a 40% of relative error reduction

Presupposition, perceptional relativity and translation theory

The intertwining of assertions and presuppositions in utterances affects the way a text is perceived in the source language (SL) and the target language (TL). Presuppositions can be thought of as shared assumptions that form the background of the asserted meaning. To translate presuppositions as assertions, or vice versa, can distort the thematic meaning of the SL text and produce a text with a different information structure. Since a good translation is not simply concerned with transferring the propositional content of the SL text, but also its other semantic and pragmatic components, including thematic meaning, a special attention should be accorded to the translation of presupposition. This article examines the intrinsic relation between presupposition and thematic meaning, why the concept is relevant to translation theory, and how presupposition can affect the structure and understanding of discourse. Unshared presuppositions are major obstacles in translation, as cultural concepts may be conveyed through expressions that yield presuppositions. To attain an optimal proximity to the SL text, presupposition needs to be singled out as a distinct aspect of meaning, and distinctions need to be made between definite and indefinite meaning, topic and comment, topic and focus, presupposition and entailment, and presupposition and implicature

Perspectival Plurality, Relativism, and Multiple Indexing

In this paper I focus on a recently discussed phenomenon illustrated by sentences containing predicates of taste: the phenomenon of " perspectival plurality " , whereby sentences containing two or more predicates of taste have readings according to which each predicate pertains to a different perspective. This phenomenon has been shown to be problematic for (at least certain versions of) relativism. My main aim is to further the discussion by showing that the phenomenon extends to other perspectival expressions than predicates of taste and by proposing a general solution to the problem raised by it on behalf of the relativist. The core claim of the solution (" multiple indexing ") is that utterances of sentences containing perspectival expressions should be evaluated with respect to (possibly infinite) sequences of perspective parameters

Learning to Act Properly: Predicting and Explaining Affordances from Images

We address the problem of affordance reasoning in diverse scenes that appear in the real world. Affordances relate the agent's actions to their effects when taken on the surrounding objects. In our work, we take the egocentric view of the scene, and aim to reason about action-object affordances that respect both the physical world as well as the social norms imposed by the society. We also aim to teach artificial agents why some actions should not be taken in certain situations, and what would likely happen if these actions would be taken. We collect a new dataset that builds upon ADE20k, referred to as ADE-Affordance, which contains annotations enabling such rich visual reasoning. We propose a model that exploits Graph Neural Networks to propagate contextual information from the scene in order to perform detailed affordance reasoning about each object. Our model is showcased through various ablation studies, pointing to successes and challenges in this complex task

A Formal Context Representation Framework for Network-Enabled Cognition

Network-accessible resources are inherently contextual with respect to the specific situations (e.g., location and default assumptions) in which they are used. Therefore, the explicit conceptualization and representation of contexts is required to address a number of problems in Network- Enabled Cognition (NEC). We propose a context representation framework to address the computational specification of contexts. Our focus is on developing a formal model of context for the unambiguous and effective delivery of data and knowledge, in particular, for enabling forms of automated inference that address contextual differences between agents in a distributed network environment. We identify several components for the conceptualization of contexts within the context representation framework. These include jurisdictions (which can be used to interpret contextual data), semantic assumptions (which highlight the meaning of data), provenance information and inter-context relationships. Finally, we demonstrate the application of the context representation framework in a collaborative military coalition planning scenario. We show how the framework can be used to support the representation of plan-relevant contextual information

Moderate Holism: Answering to Criticism and Explaining Linguistic Phenomena

In this paper I present a version of meaning holism proposed by Henry Jackman (1999a, 1999b, 2005 and 2015) entitled "moderate holism". I will argue that this moderate version of holism, in addition to responding to much of the criticism attributed to traditional semantic holism (such as translation, disagreement, change of mind and communication), is also extremely useful to explain the occurrence of several, such as vagueness and polysemy