Visualization/animation of programs based on abstract representations and formal mappings

In the context of Alma (a system for program visualization and algorithm animation), we use an internal representation-based on the concept of an attributed abstract syntax tree decorated with attribute values, a DAST-to associate (static) figures to grammar rules (productions) and to step over program dynamics executing state changes in order to perform its animation. We do not rely upon any source program annotations (visual/animation statements, or parameters), neither on any special visual data types. On account of such principle, the approach becomes source language independent. It means that we can apply the same visualizer and animator, that is the Alma's back-end, to different programming languages; all that we need is different front-ends to parse each program into the DAST we use. In this paper we discuss Alma design goals and architecture, and we present the two mappings that associate to productions figures and rewriting rules to systematically draw a visual representation (exhibiting data and control flow) of a given source program and to animate its execution.FC

Model-based engineering of animated interactive systems for the interactive television environment

Les interfaces graphiques étaient la plupart du temps statiques, et représentaient une succession d'états logiciels les uns après les autres. Cependant, les transitions animées entre ces états statiques font partie intégrante des interfaces utilisateurs modernes, et leurs processus de design et d'implémentations constituent un défi pour les designers et les développeurs. Cette thèse propose un processus de conception de systèmes interactifs centré sur les animations, ainsi qu'une architecture pour la définition et l'implémentation d'animations au sein des interfaces graphiques. L'architecture met en avant une approche à deux niveaux pour définir une vue haut niveau d'une animation (avec un intérêt particulier pour les objets animés, leurs propriétés à être animé et la composition d'animations) ainsi qu'une vue bas niveau traitant des aspects détaillés des animations tels que les timings et les optimisations. Concernant les spécifications formelles de ces deux niveaux, nous utilisons une approche qui facilite les réseaux de Petri orientés objets pour la conception, l'implémentation et la validation d'interfaces utilisateurs animées en fournissant une description complète et non-ambiguë de l'ensemble de l'interface utilisateur, y compris les animations. Enfin, nous décrivons la mise en pratique du processus présenté, illustré par un cas d'étude d'un prototype haute-fidélité d'une interface utilisateur, pour le domaine de la télévision interactive. Ce processus conduira à une spécification formelle et détaillée du système interactif, et incluera des animations utilisant des réseaux de Petri orientés objet (conçus avec l'outil PetShop CASE).Graphical User Interfaces used to be mostly static, representing one software state after the other. However, animated transitions between these static states are an integral part in modern user interfaces and processes for both their design and implementation remain a challenge for designers and developers. This thesis proposes a process for designing interactive systems focusing on animations, along with an architecture for the definition and implementation of animation in user interfaces. The architecture proposes a two levels approach for defining a high-level view of an animation (focusing on animated objects, their properties to be animated and on the composition of animations) and a low-level one dealing with detailed aspects of animations such as timing and optimization. For the formal specification of these two levels, we are using an approach facilitating object-oriented Petri nets to support the design, implementation and validation of animated user interfaces by providing a complete and unambiguous description of the entire user interface including animations. Finally, we describe the application of the presented process exemplified by a case study for a high-fidelity prototype of a user interface for the interactive Television domain. This process will lead to a detailed formal specification of the interactive system, including animations using object-oriented Petri nets (designed with the PetShop CASE tool)

SEAFACT: Semantic Analysis for Animation of Cooking Tasks

SEAFACT is a natural language interface to a computer-generated animation system. SEAFACT operates in the domain of cooking tasks. The domain is limited to a mini-world consisting of a small set of verbs which were chosen because they involve rather complex arm movements which will be interesting to animate. A linguistic analysis of the language found in recipes, included here, was used to define the domain. SEAFACT allows the user to specify tasks in this domain, using a small subset of English. The system then analyzes the English input and produces a representation of the task which can drive lower level motion synthesis procedures. The output of the system contains sufficient non-geometric information needed to schedule task start and end times, describe concurrent actions, and provide reach, grasp, and motion goals

Aesthetics of computation : unveiling the visual machine

Thesis (S.M.)--Massachusetts Institute of Technology, School of Architecture and Planning, Program in Media Arts and Sciences, 2001."September 2001."Includes bibliographical references (p. 106-110).This thesis presents a new paradigm for the design of visual programming languages, with the goal of making computation visible and, in turn, more accessible. The Visual Machine Model emphasizes the need for clear visual representations of both machines and materials, and the importance of continuity. Five dynamic visual programming languages were designed and implemented according to the specification of the Visual Machine Model. In addition to individual analysis, a comparative evaluation of all five design experiments is conducted with respect to several ease of use metrics and Visual Machine qualities. While formal user tests have not been conducted, preliminary results from general user experiences indicate that being able to see and interact with computation does enhance the programming process.Jared Schiffman.S.M

Proceedings of the Second Program Visualization Workshop, 2002

The Program Visualization Workshops aim to bring together researchers who design and construct program visualizations and, above all, educators who use and evaluate visualizations in their teaching. The first workshop took place in July 2000 at Porvoo, Finland. The second workshop was held in cooperation with ACM SIGCSE and took place at HornstrupCentret, Denmark in June 2002, immediately following the ITiCSE 2002 Conference in Aarhus, Denmark

Waves and Words: Oscillatory activity and language processing

Successful language comprehension depends not only on the involvement of different domain-specific linguistic processes, but also on their respective time-courses. Both aspects of the comprehension process can be examined by means of event-related brain potentials (ERPs), which not only provide a direct reflection of human brain activity within the millisecond range, but also allow for a qualitative dissociation between different language-related processing domains. However, recent ERP findings indicate that the desired one-to-one mapping between ERP components and linguistic processes cannot be upheld, thus leading to an interpretative uncertainty. This thesis presents a fundamentally new analysis technique for language-based ERP components, which aims to address the ambiguity associated with traditional language-related ERP effects. It is argued that this new method, which supplements ERP measures with corresponding frequency-based analyses, not only allows for a differentiation of ERP components on the basis of activity in distinct frequency bands and underlying dynamic behaviour (in terms of power changes and/or phase locking), but also provides further insights into the functional organisation of the language comprehension system and its inherent complexity. On the basis of 5 EEG experiments, I show (1) that it is possible to dissociate two superficially indistinguishable language-related ERP components on the basis of their respective underlying frequency characteristics (Experiment 1), thereby resolving the vagueness of interpretation inherent to the ERP components themselves; (2) that the processing nature of the ‘classical’ semantic N400 effect can be unambiguously specified in terms of its underlying frequency characteristics, i.e. in terms of (evoked and whole) power and phase-locking differences in specific frequency bands, thereby allowing for a first interpretative categorisation of the N400 effect with respect to its underlying neuronal processing dynamics; and (3) that frequency-based analyses may be employed to distinguish the semantic N400 effect from N400-like effects that appear in contexts which cannot readily be characterised as semantic-interpretative processes. Experiments 2 – 5 investigated the processing of antonym relations under different task conditions. Whereas in Experiment 2, the processing of antonym pairs (black – white) was compared to that of related (black – yellow) and non-related (black – nice) word pairs in a sentence context, Experiments 3 to 5 presented isolated word pairs. The frequency-based analysis showed that the observed N400 effects were not uniform in nature, but rather resulted from the superposition of functionally different frequency components. Task-relevant targets elicited a specific frequency modulation, which showed up as a P300-like positivity in terms of ERP measures. In addition, lexical-semantic processing elicited a pronounced increase in a different frequency range that was independent of the experimental context. For antonyms (Experiments 2 and 3), the task-related positive component appeared almost simultaneously to the N400 deflection for non-related words, thereby giving rise to a substantial N400 effect. In contrast, for pseudowords (Experiment 5), this positivity appeared in temporal succession to the N400. In sum, in the present results provide converging evidence that N400 effects should not be regarded as functionally uniform. Depending on the respective task and stimulus manipulations, the N400 effect appears as a result of the superposition of functionally different activities, which can be clearly distinguished in terms of their underlying frequency characteristics. In this way, the proposed frequency-based methods directly bear upon the interpretation of language-related ERP effects and thus have straightforward consequences for psycholinguistic theory. In view of the phenomenon that language-related processes have, in a number of cases, been directly attributed to the lexical-semantic processing domain on account of the observation of an N400, these results not only call for a reinterpretation of previous findings but also for a reinterpretation of their theoretical consequences

Application of definitive scripts to computer aided conceptual design

The creative phases of design are based upon the human ability to conceptualise or abstract ideas from physical observations of the real world. That ability comes from experience, based on experiment: discerning patterns of behaviour in particular sets of observations. In this work it is shown that the process of identification, experiment and abstraction may be modelled accurately on a computer by definitive, or agent-oriented, programming, so forming a powerful aid to conceptual design. A new computer modelling language, called EdenLisp, has been developed by the author around Definitive Notations and interfaced to a commercial Computer Aided Design package. It provides a tool whereby computer models of systems can be originated that have state and on which state change can be made, not only by the designer but also by other autonomous agents of change Experiments with the language are described that show that scripts of definitions can have characteristics that permit the design to proceed as if there were an engineering prototype of the physical system being designed. The explicit representation of state at the lowest levels permits experimentation, observation of properties and addition of further observations. The interactive construction of EdenLisp is analogous to the conceptual design process It is used to illustrate and test design meta-theories for modelling conceptual design. It is shown to have potential for concurrent or multi-agent design, and is also an excellent vehicle for design education

IEEE/NASA Workshop on Leveraging Applications of Formal Methods, Verification, and Validation

This volume contains the Preliminary Proceedings of the 2005 IEEE ISoLA Workshop on Leveraging Applications of Formal Methods, Verification, and Validation, with a special track on the theme of Formal Methods in Human and Robotic Space Exploration. The workshop was held on 23-24 September 2005 at the Loyola College Graduate Center, Columbia, MD, USA. The idea behind the Workshop arose from the experience and feedback of ISoLA 2004, the 1st International Symposium on Leveraging Applications of Formal Methods held in Paphos (Cyprus) last October-November. ISoLA 2004 served the need of providing a forum for developers, users, and researchers to discuss issues related to the adoption and use of rigorous tools and methods for the specification, analysis, verification, certification, construction, test, and maintenance of systems from the point of view of their different application domains

Design Concepts for Automating Maintenance Instructions

This research task was performed under the Technology for Readiness and Sustainment (TRS) contract (F33615-99-D-6001) for the Air Force Research Laboratory (AFRL), Sustainment Logistics Branch (HESS) at Wright-Patterson AFB, OH. The period of performance spanned one year starting 29 January 1999. The objective of this task was to develop and demonstrate a framework that can support the automated validation and verification of aircraft maintenance Technical Orders (TOs). The research team examined all stages ofTO generation to determine which tasks most warranted further research. From that investigation, validation and verification of appropriate, safe, and correct procedure steps emerged as the primary research target. This process would be based on available computer-aided design (CAD) data, procedure step ordering from existing sources, and human models. This determination was based on which tasks could yield the greatest impact on the authoring process and offer the greatest potential economic benefits. The team then developed a research roadmap and outlined specific technologies to be addressed in possible subsequent Air Force research tasks. To focus on the potential technology integration of the validation and verification component into existing or future TO generation procedures, we defined a demonstration scenario. Using the Front Uplock Hook assembly from an F/A-18 as the subject, we examined task procedure steps and failures that could be exposed by automated validation tools. These included hazards to personnel, damage to equipment, and incorrect disassembly order. Using the Parameterized Action Representation (PAR) developed on previous projects for actions and equipment behaviors, we characterized procedure steps and their positive and negative consequences. Finally, we illustrated a hypothetical user interface extension to a typical Interactive Electronic Technical Manual (IETM) authoring system to demonstrate how this process might appear to the TO author