A methodology for the capture and analysis of hybrid data: a case study of program debugging

No description supplie

Knowledge-based vision and simple visual machines

The vast majority of work in machine vision emphasizes the representation of perceived objects and events: it is these internal representations that incorporate the 'knowledge' in knowledge-based vision or form the 'models' in model-based vision. In this paper, we discuss simple machine vision systems developed by artificial evolution rather than traditional engineering design techniques, and note that the task of identifying internal representations within such systems is made difficult by the lack of an operational definition of representation at the causal mechanistic level. Consequently, we question the nature and indeed the existence of representations posited to be used within natural vision systems (i.e. animals). We conclude that representations argued for on a priori grounds by external observers of a particular vision system may well be illusory, and are at best place-holders for yet-to-be-identified causal mechanistic interactions. That is, applying the knowledge-based vision approach in the understanding of evolved systems (machines or animals) may well lead to theories and models that are internally consistent, computationally plausible, and entirely wrong

Interactive semantic mapping: Experimental evaluation

Robots that are launched in the consumer market need to provide more effective human robot interaction, and, in particular, spoken language interfaces. However, in order to support the execution of high level commands as they are specified in natural language, a semantic map is required. Such a map is a representation that enables the robot to ground the commands into the actual places and objects located in the environment. In this paper, we present the experimental evaluation of a system specifically designed to build semantically rich maps, through the interaction with the user. The results of the experiments not only provide the basis for a discussion of the features of the proposed approach, but also highlight the manifold issues that arise in the evaluation of semantic mapping

A Framework for Exploring and Evaluating Mechanics in Human Computation Games

Human computation games (HCGs) are a crowdsourcing approach to solving computationally-intractable tasks using games. In this paper, we describe the need for generalizable HCG design knowledge that accommodates the needs of both players and tasks. We propose a formal representation of the mechanics in HCGs, providing a structural breakdown to visualize, compare, and explore the space of HCG mechanics. We present a methodology based on small-scale design experiments using fixed tasks while varying game elements to observe effects on both the player experience and the human computation task completion. Finally we discuss applications of our framework using comparisons of prior HCGs and recent design experiments. Ultimately, we wish to enable easier exploration and development of HCGs, helping these games provide meaningful player experiences while solving difficult problems.Comment: 11 pages, 5 figure

Helmholtz’s Physiological Psychology

Hermann von Helmholtz (1821-1894) established results both controversial and enduring: analysis of mixed colors and of combination tones, arguments against nativism, and the analysis of sensation and perception using the techniques of natural science. The paper focuses on Helmholtz’s account of sensation, perception, and representation via “physiological psychology”. Helmholtz emphasized that external stimuli of sensations are causes, and sensations are their effects, and he had a practical and naturalist orientation toward the analysis of phenomenal experience. However, he argued as well that sensation must be interpreted to yield representation, and that representation is geared toward objective representation (the central thesis of contemporary intentionalism). The interpretation of sensation is based on “facts” revealed in experiment, but extends to the analysis of the quantitative, causal relationships between stimuli and responses. A key question for Helmholtz’s theory is the extent to which mental operations are to be ascribed a role in interpreting sensation