Influence of diagram layout and scrolling on understandability of BPMN processes: an eye tracking experiment with BPMN diagrams

Business process modeling is an important activity for developing software systems—especially within digitization projects and when realizing digital business models. Specifying requirements and building executable workflows is often done by using BPMN 2.0 process models. Although there are several style guides available for BPMN, e.g., by Silver and Richard (BPMN method and style, vol 2, Cody-Cassidy Press, Aptos, 2009), there has not been much empirical research done into the consequences of the diagram layout. In particular, layouts that require scrolling have not been investigated yet. The aim of this research is to establish layout guidelines for business process modeling that help business process modelers to create more understandable business process diagrams. For establishing benefits and penalties of different layouts, a controlled eye tracking experiment was conducted, in which data of 21 professional software developers was used. Our results show that horizontal layouts are less demanding and that as many diagram elements as possible should be put on the initially visible screen area because such diagram elements are viewed more often and longer. Additionally, diagram elements related to the reader’s task are read more often than those not relevant to the task. BPMN modelers should favor a horizontal layout and use a more complex snake or multi-line layout whenever the diagrams are too large to fit on one page in order to support BPMN model comprehension

Detection and quantification of flow consistency in business process models

Business process models abstract complex business processes by representing them as graphical models. Their layout, as determined by the modeler, may have an effect when these models are used. However, this effect is currently not fully understood. In order to systematically study this effect, a basic set of measurable key visual features is proposed, depicting the layout properties that are meaningful to the human user. The aim of this research is thus twofold: first, to empirically identify key visual features of business process models which are perceived as meaningful to the user and second, to show how such features can be quantified into computational metrics, which are applicable to business process models. We focus on one particular feature, consistency of flow direction, and show the challenges that arise when transforming it into a precise metric. We propose three different metrics addressing these challenges, each following a different view of flow consistency. We then report the results of an empirical evaluation, which indicates which metric is more effective in predicting the human perception of this feature. Moreover, two other automatic evaluations describing the performance and the computational capabilities of our metrics are reported as well

USER EVALUATION OF SYMBOLS FOR CORE BUSINESS PROCESS MODELING CONCEPTS

Process modeling notations are visual languages that use symbols to represent their main concepts. This study investigates the quality of such symbols from users’ perspective. The design of a symbol influences whether it is easy to spot in a model and is correctly associated with the concept it represents. In an empirical study with 188 participants, the normative ratings of process model symbols (for the basic concepts of start, end, task, AND, XOR) were gathered on the dimensions of perceptual pop-out, semantic transparency, perceptual discriminability, and aesthetics. Overall, the results are consistent with our predictions based on the theoretical analyses of the designs of the symbols. Prior familiarity with process modeling notations led to more clear-cut evaluations of routing symbols (AND, XOR) and a reduced tendency to prefer middle rating options, but it did not affect the evaluations of the other symbols. Standardization organizations and academic developers of notations can use insights from the study to enhance the usability of process modeling notations

Collaborative Business Process Management - A Literature-based Analysis of Methods for Supporting Model Understandability

Due to the growing amount of cooperative business scenarios, collaborative Business Process Management (cBPM) has emerged. The increased number of stakeholders with minor expertise in process modeling leads to a high relevance of model understandability in cBPM contexts. Despite extensive works in the research fields of cBPM and model understandability in BPM, there is no analysis and comprehensive overview of methods supporting process model understandability in cBPM scenarios. To address this research gap, this paper presents the results of a literature review. The paper identifies concepts for supporting model understandability in BPM, provides an overview of methods implementing these concepts, and discusses the methods’ applicability in cBPM. The four concepts process model transformation, process model visualization, process model description, and modeling support are introduced. Subsequently, 69 methods are classified and discussed in the context of cBPM. Results contribute to revealing existing academic voids and can guide practitioners in cBPM scenarios

An overview of process model quality literature - The Comprehensive Process Model Quality Framework

The rising interest in the construction and the quality of (business) process models resulted in an abundancy of emerged research studies and different findings about process model quality. The lack of overview and the lack of consensus hinder the development of the research field. The research objective is to collect, analyse, structure, and integrate the existing knowledge in a comprehensive framework that strives to find a balance between completeness and relevance without hindering the overview. The Systematic Literature Review methodology was applied to collect the relevant studies. Because several studies exist that each partially addresses this research objective, the review was performed at a tertiary level. Based on a critical analysis of the collected papers, a comprehensive, but structured overview of the state of the art in the field was composed. The existing academic knowledge about process model quality was carefully integrated and structured into the Comprehensive Process Model Quality Framework (CPMQF). The framework summarizes 39 quality dimensions, 21 quality metrics, 28 quality (sub)drivers, 44 (sub)driver metrics, 64 realization initiatives and 15 concrete process model purposes related to 4 types of organizational benefits, as well as the relations between all of these. This overview is thus considered to form a valuable instrument for both researchers and practitioners that are concerned about process model quality. The framework is the first to address the concept of process model quality in such a comprehensive way

BIPMIN: A Gamified Framework for Process Modeling Education

Business Process Modeling is a skill that is becoming sought after for computer engineers, with Business Process Modeling Notation (BPMN) being one example of the tools used in modeling activities. Students of the Master of Computer Engineering course at Politecnico di Torino learn about BPMN in dedicated courses but often underperform on BPMN-related exercises due to difficulties understanding how to model processes. In recent years, there has been a surge of studies that employ gamification (using game elements in non-recreative contexts to obtain benefits) as a tool in Computer Engineering education to increase students’ engagement with the learning process. This study aims to use the principles of gamification to design a supplementary learning tool for the teaching of information systems technology. In particular, to improve student understanding and use of BPMN diagrams. This study also analyzes the usability and motivation of the participants in using different game elements in increasing student motivation and performance. As part of the study, a prototype web application was developed, which implemented three different designs, each incorporating different game elements relating to either progress, competition, or rewards. An evaluation was then conducted on the prototype to evaluate the performance of the practitioners in performing BPMN modeling tasks with the gamified tool, the usability of the proposed mechanics and the enjoyment of the individual game mechanics that were implemented. With the usage of the gamified tool, the users of the experimental sample were able to complete BPMN modeling tasks with performances compatible with estimates made through expert judgement (i.e., gamification had no negative effect on performance), and were motivated to check the correctness of their models many times during the task execution. The system was evaluated as highly usable (85.8 System Usability Score); the most enjoyed game elements were rewards, levels, progress bars and aesthetics