On the Merits and Limits of Replication and Negation for IS Research

A simple idea underpins the scientific process: All results should be subject to continued testing and questioning. Given the particularities of our international IS discipline, different viewpoints seem to be required to develop a picture of the merits and limits of testing and replication. Hence, the authors of this paper approach the topic from different perspectives. Following the ongoing discourse in neighbouring disciplines, we start by highlighting the significance of testing, replication and negation for scientific discourse as well as for the sponsors of research initiatives. Next, we discuss types of replication research and the challenges associated with each. In the third section, challenging questions are raised in the light of the ability of IS research for self-correction. Then, we address publication issues related to types of replications that require shifting editorial behaviors. The fifth section reflects on the possible use and interpretation of replication results in the light of contingency. As a key takeaway, the paper suggests ways to identify studies worth replicating in our field and reflects on possible roles of replication and testing for future IS research

The Dangers of Dance for the Information Systems Discipline

Neil McBride (2018) asks if information systems (IS) is a science. He perceives several problems with current research practice and attitudes in information systems and proposes that we should treat it as a discipline in the humanities akin to dance studies. However, his proposal does not recognize that IS deals with both technology and humans. Further, he does not consider the different views of science and that one can view information systems as a science of the artificial in which one develops actionable knowledge in accordance with available evidence and uses scientific techniques in part. Failure to apply well-founded knowledge in building and applying technology can have significant adverse societal consequences, and professionals would see it as unethical. Since these considerations scarcely apply to dance studies, it appears a poor model for information systems

Continuance Intention on Using Mobile Banking Applications: A Replication Study of Information Systems Continuance Model

One of the most significant factors to the survival of many service-based firms such as banks and insurance companies is customers’ continuous use of their IT services. The focus of this paper is on replicating IS Continuance Model (Bhattacherjee, 2001) in the mobile banking context. We collected data by surveying 256 college students who were users of mobile banking applications of multiple banks in the U.S. The hypotheses were also tested using Structural Equation Modeling technique (SEM), with AMOS version 23. All five hypotheses of the model were supported, with 67% explained variance for the “continuance intention,” as the dependent variable. Our findings show that the IS Continuance Model, which was originally tested by surveying the users of web-based banking services of one bank, is supported in a modern related context and is generalizable to the mobile banking applications users

Misalignment between research hypotheses and statistical hypotheses: A threat to evidence-based medicine?

Evidence-based medicine frequently uses statistical hypothesis testing. In this paradigm, data can only disconfirm a research hypothesis’ competitors: One tests the negation of a statistical hypothesis that is supposed to correspond to the research hypothesis. In practice, these hypotheses are often misaligned. For instance, directional research hypotheses are often paired with non-directional statistical hypotheses. Prima facie, one cannot gain proper evidence for one’s research hypothesis employing a misaligned statistical hypothesis. This paper sheds lights on the nature of and the reasons for such misalignments and it provides a thorough analysis of whether they pose a threat to evidence-based medicine. The upshots are that the misalignments are often hidden for clinicians and that although some cases of misalignments can be partially counterbalanced, the overall threat is non-negligible. The counterbalances either lead to methodological inadequacy (in addition to the misalignment), loss of statistical power, or involve a (potential) lack of information that could be crucial for decision making. This result casts doubt on various findings of medical studies in addition to issues associated with under-powered studies or the replication crisis

Misalignment between research hypotheses and statistical hypotheses – A threat to evidence-based medicine?

Evidence-based medicine frequently uses statistical hypothesis testing. In this paradigm, data can only disconfirm a research hypothesis’ competitors: One tests the negation of a statistical hypothesis that is supposed to correspond to the research hypothesis. In practice, these hypotheses are often misaligned. For instance, directional research hypotheses are often paired with non-directional statistical hypotheses. Prima facie, one cannot gain proper evidence for one’s research hypothesis employing a misaligned statistical hypothesis. This paper sheds lights on the nature of and the reasons for such misalignments and it provides a thorough analysis of whether they pose a threat to evidence-based medicine. The upshots are that the misalignments are often hidden for clinicians and that although some cases of misalignments can be partially counterbalanced, the overall threat is non-negligible. The counterbalances either lead to methodological inadequacy, loss of statistical power, or involve a lack of information that could be crucial for decision making. This result casts doubt on various findings of medical studies in addition to issues associated with under-powered studies or the replication crisis

Space applications of Automation, Robotics and Machine Intelligence Systems (ARAMIS). Volume 3: ARAMIS overview

An overview of automation, robotics, and machine intelligence systems (ARAMIS) is provided. Man machine interfaces, classification, and capabilities are considered

Exhaustion from Information System Career Experience: Are the Implications for Turn-Away Intention Different for Millennials?

As evidence suggests that exhaustion is particularly pronounced in Millennials, we investigate if generational differences affect the drivers of information systems (IS) career turn-away intention (TAI). An indication of such differences would be of importance toward retaining professionals in the IS workforce as Millennials will soon become the largest generation in the U.S. workforce. To elucidate such differences, this paper presents a methodological replication of Exhaustion from Information System Career Experience: Implications for Turn-Away Intention by Armstrong, Brooks, and Riemenschneider (2015). While we did not determine significant generational differences, our findings contrast from the original study. Specifically, we found support for the impact of exhaustion from IS career experience on TAI, while an evaluation of resources no longer influences career-level exhaustion

Pcm telemtry- a new approach using all- magnetic techniques

Digital all-magnetic circuit technique used in pulse code modulation telemetry system

A SOCIO-TECHNICAL PERSPECTIVE ON REPRODUCIBILITY IN RESEARCH DATA MANAGEMENT

The Open Science paradigm has brought the dissemination of experimental artifacts on the agenda of funding agencies, research institutions, and academic publishers. Managing research data is a crucial part of guaranteeing the reusability and reproducibility of published results. In this research, we suggest a conceptualization of reproducibility based on threats, risks, and vulnerabilities identified in current research data management (RDM) practices. By doing so, we can describe a range of threats to reproducibility and pinpoint areas where current RDM practices and the scholarly communication infrastructure insufficiently address these threats. Further, we elaborate on a socio-technical approach to reproducibility in RDM by collecting evidence from researchers and scientific publications. We show that the STS approach complements current IS research on RDM by offering a holistic view of reproducibility challenges in RDM