Rosenthal, Kristina

Strecker, Stefan

English

AIS Electronic Library (AISeL)

Association for Information Systems AIS Electronic Library (AISeL) ICIS 2022 TREOs TREO Papers 12-12-2022 Conducting Online Studies in Conceptual Modeling Research: Benefits and Challenges Kristina Rosenthal University of Hagen, kristina.rosenthal@fernuni-hagen.de Stefan Strecker University of Hagen, stefan.strecker@fernuni-hagen.de Follow this and additional works at: https://aisel.aisnet.org/treos_icis2022 Recommended Citation Rosenthal, Kristina and Strecker, Stefan, "Conducting Online Studies in Conceptual Modeling Research: Benefits and Challenges" (2022). ICIS 2022 TREOs. 51. https://aisel.aisnet.org/treos_icis2022/51 This material is brought to you by the TREO Papers at AIS Electronic Library (AISeL). It has been accepted for inclusion in ICIS 2022 TREOs by an authorized administrator of AIS Electronic Library (AISeL). For more information, please contact elibrary@aisnet.org. TREO Technology, Research, Education, Opinion Presentation at TREO Talks in conjunction with the 43rd International Conference on Information Systems, ICIS 2022 TREO Talks are not peer-reviewed and not a formal part of the ICIS 2022 Proceedings All TREO Talks are available in the TREO Talks section of the AIS e-Library Conducting Online Studies in Conceptual Modeling Research Benefits and Challenges Kristina Rosenthal kristina.rosenthal@fernuni-hagen.de;  Stefan Strecker stefan.strecker@fernuni-hagen.de   Conceptual modeling is an essential activity during information systems development and organizational analysis, and has been a central IS research area for the last decades (Recker et al. 2021). Despite its relevance, the process of modeling has for long received limited attention in conceptual modeling research, with little consideration of human factors and cognitive aspects. Hence, further research on modeling processes is needed to better understand the reasoning of modelers, modeling difficulties and modeling styles (Rosenthal et al. 2022, Strecker et al. 2021). We pursue a research program to contribute to a richer and more complete understanding of individual modeling processes aiming to add to the empirical and theoretical foundation of conceptual modeling research (Strecker et al. 2021). As part of this program, we have been conducting a series of observation studies on modeling processes applying a multimodal observation setup that integrates recording think-aloud protocols and videos of modelers, tracking modeler-tool interactions and surveying modelers. Multimodal observations and analysis are supported by a modeling tool integrated with a modeling research observatory. To continue our research despite the restrictions imposed by the COVID-19 pandemic, we have adapted the research setup to an online setting using a video communication software: Subjects work on a modeling task in the web-based modeling tool while the modeling processes are recorded remotely, including the recording of think aloud protocols and screen recordings, tracking modeler-tool interactions and surveying modelers—observation methods similar to the earlier within-the-same-room observation studies. A pilot study in January 2022 demonstrated methodological challenges of the online setup, e.g., with regard to think-aloud and introducing the used modeling language and modeling tool, as well as  technical challenges. However, the setup offers benefits that go beyond coping with pandemic restrictions: For example, subjects are able to participate from any place, allowing to recruit individuals with diverse backgrounds, e.g., regarding first language and modeling experience. In this talk, we would like to discuss benefits and challenges of conducting online studies on individual modeling processes.  References Recker, J., Lukyanenko, R., Jabbari, M., Samuel, B. M., and Castellanos, A. 2021. “From Representation to Mediation: A New Agenda for Conceptual Modeling Research in a Digital World,” MIS Quarterly (45:1), pp. 269–300. Rosenthal, K., Wagner, J., and Strecker, S. 2022. “Modeling Styles in Conceptual Data Modeling: Reflecting Observations in a Series of Multimodal Studies,” in 30th European Conference on Information Systems (ECIS 2022), Timisoara, Romania, Research Paper 73. Strecker, S., Rosenthal, K., and Ternes, B. 2021. “Studying Conceptual Modeling Processes: A Modeling Tool, Research Observatory, and Multimodal Observation Setup,” in Market Engineering, Cham: Springer International Publishing, pp. 99–111. 

Conducting Online Studies in Conceptual Modeling Research: Benefits and Challenges

https://aisel.aisnet.org/cgi/viewcontent.cgi?article=1050&context=treos_icis2022

Conducting Online Studies in Conceptual Modeling Research: Benefits and Challenges

Abstract

Similar works

Full text

Available Versions

AIS Electronic Library (AISeL)