Automating the transformation-based analysis of visual languages

The final publication is available at Springer via http://dx.doi.org/10.1007/s00165-009-0114-yWe present a novel approach for the automatic generation of model-to-model transformations given a description of the operational semantics of the source language in the form of graph transformation rules. The approach is geared to the generation of transformations from Domain-Specific Visual Languages (DSVLs) into semantic domains with an explicit notion of transition, like for example Petri nets. The generated transformation is expressed in the form of operational triple graph grammar rules that transform the static information (initial model) and the dynamics (source rules and their execution control structure). We illustrate these techniques with a DSVL in the domain of production systems, for which we generate a transformation into Petri nets. We also tackle the description of timing aspects in graph transformation rules, and its analysis through their automatic translation into Time Petri netsWork sponsored by the Spanish Ministry of Science and Innovation, project METEORIC (TIN2008-02081/TIN) and by the Canadian Natural Sciences and Engineering Research Council (NSERC)

Mashing up Visual Languages and Web Mash-ups

Research on web mashups and visual languages share an interest in human-centered computing. Both research communities are concerned with supporting programming by everyday, technically inexpert users. Visual programming environments have been a focus for both communities, and we believe that there is much to be gained by further discussion between these research communities. In this paper we explore some connections between web mashups and visual languages, and try to identify what each might be able to learn from the other. Our goal is to establish a framework for a dialog between the communities, and to promote the exchange of ideas and our respective understandings of humancentered computing.published or submitted for publicationis peer reviewe

An evolutionary approach to determining hidden lines from a natural sketch

This paper focuses on the identification of hidden lines and junctions from natural sketches of drawings that exhibit an extended-trihedral geometry. Identification of hidden lines and junctions is essential in the creation of a complete 3D model of the sketched object, allowing the interpretation algorithms to infer what the unsketched back of the object should look like. This approach first labels the sketched visible edges of the object with a geometric edge label, obtaining a labelled junction at each of the visible junctions of the object. Using a dictionary of junctions with visible and hidden edges, these labelled visible junctions are then used to deduce the edge interpretation and orientation of some of the hidden edges. A genetic algorithm is used to combine these hidden edges into hidden junctions, evolving the representation of the hidden edges and junctions until a feasible hidden view representation of the object is obtained.peer-reviewe

Event-driven grammars: Relating abstract and concrete levels of visual languages

The final publication is available at Springer via http://dx.doi.org/10.1007/s10270-007-0051-2In this work we introduce event-driven grammars, a kind of graph grammars that are especially suited for visual modelling environments generated by meta-modelling. Rules in these grammars may be triggered by user actions (such as creating, editing or connecting elements) and in their turn may trigger other user-interface events. Their combination with triple graph transformation systems allows constructing and checking the consistency of the abstract syntax graph while the user is building the concrete syntax model, as well as managing the layout of the concrete syntax representation. As an example of these concepts, we show the definition of a modelling environment for UML sequence diagrams. A discussion is also presented of methodological aspects for the generation of environments for visual languages with multiple views, its connection with triple graph grammars, the formalization of the latter in the double pushout approach and its extension with an inheritance concept.This work has been partially sponsored by the Spanish Ministry of Education and Science with projects MOSAIC (TSI2005-08225-C07-06) and MODUWEB (TIN 2006-09678)

Supporting user-oriented analysis for multi-view domain-specific visual languages

This is the post-print version of the final paper published in Information and Software Technology. The published article is available from the link below. Changes resulting from the publishing process, such as peer review, editing, corrections, structural formatting, and other quality control mechanisms may not be reflected in this document. Changes may have been made to this work since it was submitted for publication. Copyright @ 2008 Elsevier B.V.The integration of usable and flexible analysis support in modelling environments is a key success factor in Model-Driven Development. In this paradigm, models are the core asset from which code is automatically generated, and thus ensuring model correctness is a fundamental quality control activity. For this purpose, a common approach is to transform the system models into formal semantic domains for verification. However, if the analysis results are not shown in a proper way to the end-user (e.g. in terms of the original language) they may become useless. In this paper we present a novel DSVL called BaVeL that facilitates the flexible annotation of verification results obtained in semantic domains to different formats, including the context of the original language. BaVeL is used in combination with a consistency framework, providing support for all steps in a verification process: acquisition of additional input data, transformation of the system models into semantic domains, verification, and flexible annotation of analysis results. The approach has been validated analytically by the cognitive dimensions framework, and empirically by its implementation and application to several DSVLs. Here we present a case study of a notation in the area of Digital Libraries, where the analysis is performed by transformations into Petri nets and a process algebra.Spanish Ministry of Education and Science and MODUWEB

On Comments in Visual Languages

Visual languages based on node-link diagrams can be used to develop software and, like textual languages, offer the possibility to write explanatory comments. Which node a comment refers to is usually not made explicit, but is implicitly clear to readers through placement and content. While automatic layout algorithms can make working with diagrams more productive, they tend to destroy such implicit clues because they are not aware of them and thus do not preserve the relative placement of comments and the nodes they refer to. Implicit clues thus need to be inferred and made explicit to be taken into account by layout algorithms. This is what we call the comment attachment problem. In this paper, we improve upon a previous paper on the subject [9], introducing further heuristics that aim to describe relations between comments and nodes. Based on an analysis of comment placement in a set of example diagrams, we develop a general comment attachment framework and evaluate the quality of its inferred attachments

Syntax-directed Interpretation Of Visual Languages

Recent trends suggest that it will soon be practical to implement graphical user interfaces wherein a large part of the communication between human and computer will take the form of structured graphics, i.e., diagrams, notations, etc., which have come to be called visual languages in the literature. This thesis argues that implementation of such interfaces will be greatly facilitated by the development and use of syntax-directed translation methods for visual languages, and the embodiment of such methods in automated tools for application development, as has been done for compilers. An algebraic formalism to express syntax and semantics for visual languages is developed, and compared with similar formalisms developed by others. Tractability and algorithms for parsing are considered, and test implementations described. Several examples are presented, showing how real notations may be captured and parsed using the formalism. The design of interactive, visual language based application programs is considered in some detail, with emphasis on notations such as directed graph diagrams

Designing the automatic transformation of visual languages

AbstractThe design process of complex systems requires a precise checking of the functional and dependability attributes of the target design. The growing complexity of systems necessitates the use of formal methods, as the exhaustiveness of checks performed by the traditional simulation and testing is insufficient.For this reason, the mathematical models of various formal verification tools are automatically derived from UML-diagrams of the model by mathematical transformations guaranteeing a complete consistency between the target design and the models of verification and validation tools.In the current paper, a general framework for an automated model transformation system is presented. The method starts from a uniform visual description and a formal proof concept of the particular transformations by integrating the powerful computational paradigm of graph transformation, planner algorithms of artificial intelligence, and various concepts of computer engineering