Hybrid Reasoning and the Future of Iconic Representations

We give a brief overview of the main characteristics of diagrammatic reasoning, analyze a case of human reasoning in a mastermind game, and explain why hybrid representation systems (HRS) are particularly attractive and promising for Artificial General Intelligence and Computer Science in general.Comment: pp. 299-31

Beyond the Spoken Word: Examining the Nature of Teacher Gesturing in the Context of an Elementary Engineering Curriculum for English-Learner Students

Our research team performed an exploratory analysis of teacher gesturing via a case study of an elementary teacher. We focused on gesturing, a practice found to support both bilingual English learner students’ linguistic development and mathematics achievement, during the teacher’s engineering and science lessons. The research team systematically analyzed teacher video data using McNeill’s gestural dimensions framework and found variation of gesturing types and rates when comparing engineering and baseline science lessons. Additionally, specific types of teacher-gestures appear to be associated with either behavioral or classroom management practices, procedural instructions, and discussion facilitation. We suggest that teacher-gestures such as these have the potential to facilitate bilingual English learners’ language acquisition, while also developing their STEM literacy in general and engineering capacity in particular. Further exploration of teacher-gestures in elementary engineering curricula could lead to an integrated STEM pedagogy that incorporates gesturing as a fundamental teaching strategy, bridging STEM instruction with linguistically responsive instructional practices.Educatio

Perceptual Pluralism

Perceptual systems respond to proximal stimuli by forming mental representations of distal stimuli. A central goal for the philosophy of perception is to characterize the representations delivered by perceptual systems. It may be that all perceptual representations are in some way proprietarily perceptual and differ from the representational format of thought (Dretske 1981; Carey 2009; Burge 2010; Block ms.). Or it may instead be that perception and cognition always trade in the same code (Prinz 2002; Pylyshyn 2003). This paper rejects both approaches in favor of perceptual pluralism, the thesis that perception delivers a multiplicity of representational formats, some proprietary and some shared with cognition. The argument for perceptual pluralism marshals a wide array of empirical evidence in favor of iconic (i.e., image-like, analog) representations in perception as well as discursive (i.e., language-like, digital) perceptual object representations

On the simulation of interactive non-verbal behaviour in virtual humans

Development of virtual humans has focused mainly in two broad areas - conversational agents and computer game characters. Computer game characters have traditionally been action-oriented - focused on the game-play - and conversational agents have been focused on sensible/intelligent conversation. While virtual humans have incorporated some form of non-verbal behaviour, this has been quite limited and more importantly not connected or connected very loosely with the behaviour of a real human interacting with the virtual human - due to a lack of sensor data and no system to respond to that data. The interactional aspect of non-verbal behaviour is highly important in human-human interactions and previous research has demonstrated that people treat media (and therefore virtual humans) as real people, and so interactive non-verbal behaviour is also important in the development of virtual humans. This paper presents the challenges in creating virtual humans that are non-verbally interactive and drawing corollaries with the development history of control systems in robotics presents some approaches to solving these challenges - specifically using behaviour based systems - and shows how an order of magnitude increase in response time of virtual humans in conversation can be obtained and that the development of rapidly responding non-verbal behaviours can start with just a few behaviours with more behaviours added without difficulty later in development

The semiotics of models

The paper sheds light on the concept of model in ordinary language and in scientific discourse from the perspective of C. S. Peirce’s semiotics. It proposes a general Peircean framework for the definition of models of all kinds, including mental models. A survey of definitions of scientific models that have been influential in the philosophy of science and of the typologies proposed in this context is given. The author criticizes the heterogeneity of the criteria applied in these typologies and the lack of a semiotic foundation in typological distinctions between formal, symbolic, theoretical, metaphorical, and iconic models, among others. The paper argues that the application of Peirce’s subdivision of signs into the trichotomies of the sign itself, its object, and its interpretant can offer a deeper understanding of the nature of models. Semiotic topics in the focus of the paper are (1) the distinction between models as signs and (mental) models as the interpretants of signs; (2) models considered as a type (or legisign) and models considered as tokens (or replicas) of a type; (3) the iconicity of models, including diagrammatic and metaphorical icons; (4) the contribution of indices and symbols to the informativity of models; and (5) the rhetorical qualities of models in scientific discourse. The paper argues in conclusion that informative models are hybrid signs in which a diagram incorporates indices and symbols in a rhetorically efficient way

Visual iconic object-oriented programming to advance computer science education and novice programming

Learning how to program a computer is difficult for most people. Computer programming is a cognitively challenging, time consuming, labor intensive, and frustrating endeavor. Years of formal study and training are required to learn a programming language\u27s world of algorithms and data structures. Instructions are coded in advance before the computer demonstrates the desired behavior. Seeing all the programming steps and instruction code is complicated. There exists a tremendous gap between the representations the human brain uses when thinking about a problem and the representations used in programming a computer. Often people are much better at dealing with specific, concrete objects than working with abstract ideas. Concrete and specific programming examples and demonstrations can be very useful. When cleverly chosen and properly used, programming examples and demonstrations help people understand the abstract concepts. Programming by example or demonstration attempts to extend these novel ideas to novice programming

NITELIGHT: A Graphical Tool for Semantic Query Construction

Query formulation is a key aspect of information retrieval, contributing to both the efficiency and usability of many semantic applications. A number of query languages, such as SPARQL, have been developed for the Semantic Web; however, there are, as yet, few tools to support end users with respect to the creation and editing of semantic queries. In this paper we introduce a graphical tool for semantic query construction (NITELIGHT) that is based on the SPARQL query language specification. The tool supports end users by providing a set of graphical notations that represent semantic query language constructs. This language provides a visual query language counterpart to SPARQL that we call vSPARQL. NITELIGHT also provides an interactive graphical editing environment that combines ontology navigation capabilities with graphical query visualization techniques. This paper describes the functionality and user interaction features of the NITELIGHT tool based on our work to date. We also present details of the vSPARQL constructs used to support the graphical representation of SPARQL queries

Tangible user interfaces : past, present and future directions

In the last two decades, Tangible User Interfaces (TUIs) have emerged as a new interface type that interlinks the digital and physical worlds. Drawing upon users' knowledge and skills of interaction with the real non-digital world, TUIs show a potential to enhance the way in which people interact with and leverage digital information. However, TUI research is still in its infancy and extensive research is required in or- der to fully understand the implications of tangible user interfaces, to develop technologies that further bridge the digital and the physical, and to guide TUI design with empirical knowledge. This paper examines the existing body of work on Tangible User In- terfaces. We start by sketching the history of tangible user interfaces, examining the intellectual origins of this field. We then present TUIs in a broader context, survey application domains, and review frame- works and taxonomies. We also discuss conceptual foundations of TUIs including perspectives from cognitive sciences, phycology, and philoso- phy. Methods and technologies for designing, building, and evaluating TUIs are also addressed. Finally, we discuss the strengths and limita- tions of TUIs and chart directions for future research

Topological Foundations of Cognitive Science

A collection of papers presented at the First International Summer Institute in Cognitive Science, University at Buffalo, July 1994, including the following papers: ** Topological Foundations of Cognitive Science, Barry Smith ** The Bounds of Axiomatisation, Graham White ** Rethinking Boundaries, Wojciech Zelaniec ** Sheaf Mereology and Space Cognition, Jean Petitot ** A Mereotopological Definition of 'Point', Carola Eschenbach ** Discreteness, Finiteness, and the Structure of Topological Spaces, Christopher Habel ** Mass Reference and the Geometry of Solids, Almerindo E. Ojeda ** Defining a 'Doughnut' Made Difficult, N .M. Gotts ** A Theory of Spatial Regions with Indeterminate Boundaries, A.G. Cohn and N.M. Gotts ** Mereotopological Construction of Time from Events, Fabio Pianesi and Achille C. Varzi ** Computational Mereology: A Study of Part-of Relations for Multi-media Indexing, Wlodek Zadrozny and Michelle Ki