Challenges in Automated Model-Based HMI Testing

Abstract: We describe our approach to automated model-based HMI testing. The paper is divided into two parts. In the first part, we summarize the current status of our work. In the second part, we describe a number of research areas that need to be worked on in order to achieve true model-based HMI test automation. 1 Test Automation in the HMI Domain The task of test automation involves two subtasks: (1) automated test case selection, and (2) automated test case execution. The long-term goal of test automation is to test against a complete formal specification of the unit under test. To be useful for test automation, a specification must comprise the static states and the dynamic behavior of the unit under test. The specification must be formal and sufficiently detailed in order to allow for automatic processing. We call such a comprehensive and formal specification a “model. ” At present, such models are, in general, not available in the HMI domain. The design of the syntax and semantics of an appropriate specification language (i.e., modeling language) needs to take into account the requirements of automated testing. In order to be able to state these requirements, we need to start gaining experience wit