Model-based user interface testing with Spec Explorer and ConcurTaskTrees

Analytic usability analysis methods have been proposed as an alternative to user testing in early phases of development due to the cost of the latter approach. By working with models of the systems, analytic models are not capable of identifying implementation related problems that might have an impact on usability. Model-based testing enables the testing of an implemented software artefact against a model of what it should be (the oracle). In the case of model-based user interface testing, the models should be expressed at an adequate level of abstraction, adequately modelling the interaction process. This paper describes an effort to develop tool support enabling the use of task models as oracles for model-based testing of user interfaces.FCT -Fuel Cell Technologies Program(POSC/EIA/56646/2004

A Model-based Approach for Test Cases Generation

International audienceThe analytical methods based on evaluation models of interactive systems were proposed as an alternative to user testing in the last stages of the software development due to its costs. However, the use of isolated behavioral models of the system limits the results of the analytical methods. An example of these limitations relates to the fact that they are unable to identify implementation issues that will impact on usability. With the introduction of model-based testing we are enable to test if the implemented software meets the specified model. This paper presents an model-based approach for test cases generation from the static analysis of source code

Geração de casos de teste a partir de modelos de tarefas

Tese de mestrado integrado. Engenharia Informática e Computação. Faculdade de Engenharia. Universidade do Porto. 201

Model-Based Testing of GUI-Driven Applications

While thorough testing of reactive systems is essential to ensure device safety, few testing methods center on GUI-driven applications. In this paper we present one approach for the model-based testing of such systems. Using the AHLTA-Mobile case study to demonstrate our approach, we first introduce a high-level method of modeling the expected behavior of GUI-driven applications. We show how to use the NModel tool to generate test cases from this model and present a way to execute these tests within the application, highlighting the challenges of using an API-geared tool in a GUI-based setting. Finally we present the results of our case study

Picture-based task definition and parameterization support system

Applications for task definition and automation are valuable tools to automated software engineering area. This paper describes a solution to support a parameterized task definition using screen capture images. The approach allows the capture of a sequence of actions defined by the user. Through the captured sequence of actions, the approach assists in the implementation of task automation processes. Based on picture-driven computing the proposed tool aims to reduce the challenges that users face while trying to define tasks. This approach provides also a foundation for the creation of picture-driven based tests for interactive systems, enabling to test any interactive system but also allowing for the definition, parameterization and execution of tests that might involve the use of several independent interactive systems.info:eu-repo/semantics/acceptedVersio

Automated specification-based testing of graphical user interfaces

Tese de doutoramento. Engenharia Electrónica e de Computadores. 2006. Faculdade de Engenharia. Universidade do Porto, Departamento de Informática, Escola de Engenharia. Universidade do Minh

Development of GUI test coverage analysis and enforcement tools

Tese de mestrado integrado. Engenharia Informática e Computação. Faculdade de Engenharia. Universidade do Porto. 200

Development of an environment for the generation, mutation and execution of test cases

Dissertação de mestrado em Engenharia InformáticaTesting graphic user interfaces (GUI) involves, mainly, lengthy and expensive processes involving user testing. Finding simpler and easier alternatives to use than these processes becomes an exciting proposal. This project presents an alternative to existing processes through the use of Model-based Testing - MBT. The MBT technique takes advantage of models that describe the correct operation of the system (for this project task models). The use of MBT may thus become a new approach to testing GUI's, since the implemented GUI is tested against the model that specifies it the correct behavior. All inconsistencies found during the tests will be treated as potential errors that must be corrected. This report describes the development of a prototype for an environment able to generate and execute test cases applying MBT to GUI's.A realização de testes a interfaces gráficas (GUI) envolve, maioritariamente, processos morosos e dispendiosos. Encontrar alternativas mais simples e fáceis de utilizar do que estes processos torna-se uma proposta aliciante. Este projeto apresenta uma solução alternativa aos processos já existentes através da utilização de casos de teste baseados em modelos (Modelbased Testing - MBT). Esta técnica tira partido de modelos que descrevem o correto funcionamento do sistema (no caso particular do projecto modelos de tarefas). A utilização do MBT pode assim transformarse numa nova abordagem aos testes realizados sobre GUI’s, uma vez que a GUI implementada será testada contra o modelo especificado que contém o funcionamento correto desta. As incoerências encontradas nos testes apontam para potenciais erros que deverão ser corrigidos. Este relatório descreve o desenvolvimento de um protótipo para um ambiente capaz de gerar, mutar e executar casos de teste para GUI’s aplicando o MBT.Fundação para a Ciência e a Tecnologia (FCT) - Project FCOMP-01-0124-FEDER-020554.FEDER funds through the Programa Operacional Factores de Competitividade- COMPETE.The work of the author was also supported by a grant with reference PTDC/EIAEIA/119479/2010_UMINHO

Systematic automation of scenario-based testing of user interfaces

Ensuring the effectiveness factor of usability consists in ensuring that the application allows users to reach their goals and perform their tasks. One of the few means for reaching this goal relies on task analysis and proving the compatibility between the interactive application and its task models. Synergistic execution enables the validation of a system against its task model by co-executing the system and the task model and comparing the behavior of the system against what is prescribed in the model. This allows a tester to explore scenarios in order to detect deviations between the two behaviors. Manual exploration of scenarios does not guarantee a good coverage of the analysis. To address this, we resort to model-based testing (MBT) techniques to automatically generate scenarios for automated synergistic execution. To achieve this, we generate, from the task model, scenarios to be co-executed over the task model and the system. During this generation step we explore the possibility of including considerations about user error in the analysis. The automation of the execution of the scenarios closes the process. We illustrate the approach with an example.José Campos acknowledges support from project "NORTE01-0145-FEDER-000016", financed by the North Portugal Regional Operational Programme (NORTE 2020), under the PORTUGAL 2020 Partnership Agreement, and through the European Regional Development Fund (ERDF

Comparing GUI Functional System Testing with Functional System Logic Testing - An Experiment

The practitioner interested in reducing software verification effort may found herself lost in the many alternative definitions of Graphical User Interface (GUI) testing that exist and their relation to the notion of system testing. One result of these many definitions is that one may end up testi ng twice the same parts of the Software Under Test (SUT), specifically the application logic code. To clarify two important testing activities for the avoidance of duplicate testing effort, this paper studies possible differences between GUI testing and system testing experimentally. Specifically, we selected a SUT equipped with system tests that directly exercise the application code; We used GUITAR, a well-known GUI testing software to GUI test this SUT. Experimental results show important differences between system testing and GUI testing in terms of structural coverage and test cost