Conducting Experimental Research in Information Systems

This article presents a summary of key success factors for publishing research in top-tier IS journals; it is not intended to be an introduction to research, but to go beyond the rational model presented by most introductory works. The paper begins by discussing the processes by which research projects are identified and developed, specifically focusing on where project ideas are found and how projects are selected and refined. Next, we discuss the fundamental role that theory development, testing and refinement plays in research. This discussion is followed by an examination of several interrelated research design issues, including maximizing publication potential, and executing the study\u27s activities. Next, the importance of writing quality as well as the cultivation and refinement of a project\u27s message is discussed. Finally, a checklist is provided on how to be rejected which summarizes the central themes of this article

Creating a Realistic Experimental Scenario for HCI-Based Deception Detection Research with Ground Truth and Unsanctioned Malicious Acts

This research-in-progress note reports on the design and execution of a study in HCI-based deception detection. The objective of the study is to examine the impact of knowledge of tracking and countermeasures on the neuro- motor changes detected when subjects commit a malfeasant act. To examine this, an experimental context and design was required that would afford the subjects an opportunity to commit an un-sanctioned malicious act while tracking ground truth in an unobtrusive manner. The experimental design, study execution, and preliminary results are presented

The Effect Of Perceived Transparency, Perceived Reputation And Perceived Security On Consumer Trust And Purchase Intention

Transparency, seller’s reputation and website security are considered to be important factors of the website hat influence customer purchasing decisions in Internet shopping in China. This paper empirically examines the relative influence they have on online purchasing decisions for customers. We perform structural equation analysis with a sample of 306 observations. The results of this study revealed that perceived security and perceived reputation are critical factors affecting consumer trust, perceived transparency is the factor most closely associated with purchase intention. These findings suggest that perceived transparency plays a significant role in increasing consumer’s purchase intention. The knowledge of their relative impacts in their relative roles over customer transaction experience is useful in developing customized sales strategies. The results of this study revealed that perceived transparency exerted a stronger effect than perceived reputation on purchase intentions for customers of an online store

Designing Experimental Studies

In the last years, experiments became more and more widely applied - be it in academic research or A/B testing in companies. Due to their high internal validity, experiments are an important part of the methods ecosystem and researchers will benefit from integrating them into their methodological tool kit. This paper aims to summarize the most important content of the ICIS 2019 Professional Development Workshop. The workshop targets researchers with no or very basic training in experimental methods. It introduces the essentials of understanding and planning state-of-the-art experimental research and covers common pitfalls and challenges. Acknowledgment This work has been funded by the Federal Ministry of Education and Research of Germany (BMBF) under grant no. 16DII116 (“Deutsches Internet-Institut”)

Enterprise Readiness for IT Innovation: A Study of Mobile Computing in Healthcare

This research posits that enterprise-wide information technology (IT) innovation initiatives in uncertain economic times amplify the need and importance for decision makers to systemically evaluate their organization’s capabilities, competencies, and potential risk areas that could either accelerate or impede adoption and implementation. The purpose of this research is to develop a theoretically-grounded, conceptual framework of healthcare enterprise readiness for IT innovation that will aid health IT decision makers with this complex task. We study this in the context of mobile computing which is poised to fundamentally transform healthcare delivery by improving patient care and lowering costs. Preliminary findings of our multi-phase exploratory empirical study with healthcare CIOs reveal the relative importance of several key assessment dimensions and indicators. Our research has important implications for both adopters and providers of health IT and contributes to our broader understanding of IT-enabled transformation of healthcare

How Human-AI Collaboration Affects Attribution of Responsibility for Failure and Success

Individuals increasingly seek algorithmic advice to optimize their decision making. This study aims to investigate the effects of receiving algorithmic advice on individuals’ attribution of responsibility for their achievements. The study is based on an experiment with a 2 x 5 design of two dimensions: achievement (success vs. failure) and advice (no advice; human-based advice with high and low expertise; and algorithmic advice with high and low accuracy). The findings from a pilot study suggest that the experimental design is largely appropriate, given that we found answers to our hypotheses. This short paper provides valuable insights for future research on the attribution of responsibility for success and failure when receiving algorithmic advice

You are an Idiot! – How Conversational Agent Communication Patterns Influence Frustration and Harassment

Conversational Agents (CA) in the form of digital assistants on smartphones, chatbots on social media, or physical embodied systems are an increasingly often applied new form of user interfaces for digital systems. The human-like design of CAs (e.g., having names, greeting users, and using self-references) leads to users subconsciously reacting to them as they were interacting with a human. In recent research, it has been shown that this social component of interacting with a CA leads to various benefits, such as increased service satisfaction, enjoyment, and trust. However, numerous CAs were discontinued because of inadequate responses to user requests or only making errors because of the limited functionalities and knowledge of a CA, which can lead to frustration. Therefore, investigating the causes of frustration and other related emotions and reactions highly relevant. Against this background, this study investigates via an online experiment with 169 participants how different communication patterns influence user’s perception, frustration, and harassment behavior of an error producing CA

Exploring the Behavioral Sprouts of Smart Home Farming

In times of climate change and growing urbanization, the way food is produced and consumed also changes. Meanwhile, digitization is transforming farming practices, which also applies to the domestic growing of crops. More and more so-called smart home farms (SHF) are finding their way into private households. This paper conceptualizes the unique nature of enabled smart services and their underlying technology. Following an inductive interpretive approach, this study explores the antecedents of smart home farming practices. Our sample consists of eleven actual smart home farmers. We found six constructs to be of salient importance: expected outcomes related to harvesting, positive feelings, and sustainability; a combination of one\u27s affinity for green and novel technologies; and the smartness and visibility of the enabled services. In the outlook, we present some preliminary thoughts for testing our qualitative findings

Communicating with Machines: Conversational Agents with Personality and the Role of Extraversion

Communication with conversational agents (CA) has become increasingly important. It therefore is crucial to understand how individuals perceive interaction with CAs and how the personality of both the CA and the human can affect the interaction experience. As personality differences are manifested in language cues, we investigate whether different language style manifestations of extraversion lead to a more anthropomorphized perception (specifically perceived humanness and social presence) of the personality bots. We examine, whether individuals rate communication satisfaction of a CA similar to their own personality as higher (law of attraction). The results of our experiment indicate that highly extraverted CAs are generally better received in terms of social presence and communication satisfaction. Further, incorporating personality into CAs increases perceived humanness. Although no significant effects could be found in regard to the law of attraction, interesting findings about ambiverts could be made. The outcomes of the experiment contribute towards designing personality-adaptive CAs