Abmash: Mashing Up Legacy Web Applications by Automated Imitation of Human Actions

Many business web-based applications do not offer applications programming interfaces (APIs) to enable other applications to access their data and functions in a programmatic manner. This makes their composition difficult (for instance to synchronize data between two applications). To address this challenge, this paper presents Abmash, an approach to facilitate the integration of such legacy web applications by automatically imitating human interactions with them. By automatically interacting with the graphical user interface (GUI) of web applications, the system supports all forms of integrations including bi-directional interactions and is able to interact with AJAX-based applications. Furthermore, the integration programs are easy to write since they deal with end-user, visual user-interface elements. The integration code is simple enough to be called a "mashup".Comment: Software: Practice and Experience (2013)

A Survey on ML4VIS: Applying Machine Learning Advances to Data Visualization

Inspired by the great success of machine learning (ML), researchers have applied ML techniques to visualizations to achieve a better design, development, and evaluation of visualizations. This branch of studies, known as ML4VIS, is gaining increasing research attention in recent years. To successfully adapt ML techniques for visualizations, a structured understanding of the integration of ML4VISis needed. In this paper, we systematically survey 88 ML4VIS studies, aiming to answer two motivating questions: "what visualization processes can be assisted by ML?" and "how ML techniques can be used to solve visualization problems?" This survey reveals seven main processes where the employment of ML techniques can benefit visualizations:Data Processing4VIS, Data-VIS Mapping, InsightCommunication, Style Imitation, VIS Interaction, VIS Reading, and User Profiling. The seven processes are related to existing visualization theoretical models in an ML4VIS pipeline, aiming to illuminate the role of ML-assisted visualization in general visualizations.Meanwhile, the seven processes are mapped into main learning tasks in ML to align the capabilities of ML with the needs in visualization. Current practices and future opportunities of ML4VIS are discussed in the context of the ML4VIS pipeline and the ML-VIS mapping. While more studies are still needed in the area of ML4VIS, we hope this paper can provide a stepping-stone for future exploration. A web-based interactive browser of this survey is available at https://ml4vis.github.ioComment: 19 pages, 12 figures, 4 table

Spacecraft software training needs assessment research

The problems were identified, along with their causes and potential solutions, that the management analysts were encountering in performing their jobs. It was concluded that sophisticated training applications would provide the most effective solution to a substantial portion of the analysts' problems. The remainder could be alleviated through the introduction of tools that could help make retrieval of the needed information from the vast and complex information resources feasible

Towards Generation of Visual Attention Map for Source Code

Program comprehension is a dominant process in software development and maintenance. Experts are considered to comprehend the source code efficiently by directing their gaze, or attention, to important components in it. However, reflecting the importance of components is still a remaining issue in gaze behavior analysis for source code comprehension. Here we show a conceptual framework to compare the quantified importance of source code components with the gaze behavior of programmers. We use "attention" in attention models (e.g., code2vec) as the importance indices for source code components and evaluate programmers' gaze locations based on the quantified importance. In this report, we introduce the idea of our gaze behavior analysis using the attention map, and the results of a preliminary experiment.Comment: 4 pages, 2 figures; APSIPA 2019 ACCEPTE

Conceptual Model of Game Aesthetics for Perceived Learning in Narrative Games

Narrative games may offer reasoning on players’ behaviour or make-believe on players’ personation as a pursuit to achieve specific goals. One of the goals is probably the intention to instil learning, which subconsciously provide information on the content of the game. However, there is lack of studies on the contribution of game aesthetics towards player’s perceived learning. By means of expert review, this article reports on conceptual model of game aesthetics towards perceived learning and the degree of importance of each attributes in perceived learning.  Findings reveal that all experts agreed on the contribution of game aesthetics towards perceived learning. In additon, expert recommends three other factors that may contribute to learning: player’s motivation, learning content, and gameplay. Future work will continue to design and develop the game prototype and to investigate the relationship between game aesthetics and perceived learning

Towards a Generalised Pedagogical Framework for Creating Mixed-Mode Role-Play in a 3D Virtual Environment

Role-play has proved itself to be an effective teaching method, and role-play within a virtual environment has been found to be more especially so. Thus, there have been many studies concerned with role-play and computer simulation used together; however, up to this point, limitations may still be found with respect to the work which has been done in this area. Some of the major outstanding problems associated with creating virtual environments for learning are: finding the simplest way to model and represent abstract concepts as 3D objects; and implementing the students’ interactions - with each other, with their instructor, and with the represented objects. Also, many projects have focused on only one pedagogical topic. My vision is to introduce a generalized method that facilitates the construction of learning scenarios and renders them as message-passing role-play activities. Then, these activities could be deployed in a virtual environment (VE) in order to help students to become more immersed in the learning process. Each such activity is to be constructed by humanizing a ‘non-human’ object, whereby the students embody and imitate an (often abstract) object which is part of a technological system and which occurs in a virtual world. This can lead to many benefits, such as being able to better support the students’ ability to imagine and visualize such objects, making them more engaged with their learning, enhancing their conceptual understanding, strengthening their reasoning when solving problems related to the topic area, and reinvigorating their interest in learning. This research presents an evaluation of an approach for the creation of a role-play simulation in a role-play supporting virtual environment, which harnesses the advantages of 3D virtual environments in an effective way - in order to benefit the students’ learning in terms of improving their understanding of abstract concepts. Moreover, this approach is generalized and thus extends the previous studies by offering a system that can be applied to a wide range of topics - that involve message-passing role-play scenarios. The approach is presented within a conceptual pedagogical framework that is supported by an analysis of the findings and results from experiments that were conducted in order to validate the framework from both the learning and technical perspectives

The design-by-adaptation approach to universal access: learning from videogame technology

This paper proposes an alternative approach to the design of universally accessible interfaces to that provided by formal design frameworks applied ab initio to the development of new software. This approach, design-byadaptation, involves the transfer of interface technology and/or design principles from one application domain to another, in situations where the recipient domain is similar to the host domain in terms of modelled systems, tasks and users. Using the example of interaction in 3D virtual environments, the paper explores how principles underlying the design of videogame interfaces may be applied to a broad family of visualization and analysis software which handles geographical data (virtual geographic environments, or VGEs). One of the motivations behind the current study is that VGE technology lags some way behind videogame technology in the modelling of 3D environments, and has a less-developed track record in providing the variety of interaction methods needed to undertake varied tasks in 3D virtual worlds by users with varied levels of experience. The current analysis extracted a set of interaction principles from videogames which were used to devise a set of 3D task interfaces that have been implemented in a prototype VGE for formal evaluation

A Thick Industrial Design Studio Curriculum

This presentation was part of the session : Pedagogy: Procedures, Scaffolds, Strategies, Tactics24th National Conference on the Beginning Design StudentThis paper describes an industrial design studio course based in a private university in Izmir, Turkey where second year industrial design students, for the first time, engage in a studio project. The design studio course emphasises three distinct areas of competence in designing that are the focus of the curriculum. They are; design process: the intellectual act of solving a design problem; design concept: the imagination and sensibility to conceive of appropriate design ideas; and presentation: the ability to clearly and evocatively communicate design concepts. The studio is 'thick' with materials, tasks and activities that are intentionally sequenced to optimise learning in a process that is known as educational 'scaffolding.' The idea of a process--a patient journey toward it's destination, is implicit in the studio that is full of opportunities for reflection-in-action. A significant feature is the importance placed on drawing and model making. An exemplary design process should show evidence of 'breadth'--meaning a wide search for solutions where a range of alternatives explored throughout; followed by an incremental refinement of the chosen solution where elements of the final design concept are developed thoroughly and in detail--called 'depth.' Learning to design is predicated on an engagement in and manipulation of the elements of the design problem. Evidence of that learning will be found by examining the physical materials and results of the design process. The assessment criteria are published with the brief at the outset of design project and outcomes are spelt out at the end. Students are remind throughout project of the criteria, which is to say they are reminded of pedagogical aims of the studio. Assessment criteria are detailed and the advantages of summative assessment are described