Quality criteria for interpretive research in information systems: a reflection on Klein and Myers' set of principles

In the last two decades, interpretive research has become more established and more popular in information systems (IS) field (Walsham 2006), (Walsham 1995a). Publications with detailed information and practical guidelines for conducting this type of studies have contributed to grow confidence in interpretive methods, as for example (Walsham 1995b), (Walsham 2006), (Myers 1997), and (Klein & Myers 1999). The work of Klein and Myers (1999) consists of a set of principles for conducting and evaluating interpretive research, which provide fair and appropriate criteria for judging the validity and reliability of such studies. In this article we focus on understanding how this set of principles has informed research articles published in the highest-ranked IS journals (according to Association of Information Systems): Management Information Systems Quarterly and Information Systems Research. We question if these principles have been translated into common practices when conducting interpretive research in the field of information systems and whether authors incorporate them explicitly when they communicate the results of their research. Articles published in these two journals are recognized as finest exemplars of rigorously conducted research and thus represent a relevant sample for this exploratory study. This work can be extended in the future to include more journals. This research is empirical and the analysis is done at the level of articles published in those two journals. We browsed the entire collection of articles published in these journals between 1999 and 2009 and selected research papers reporting field studies of interpretive nature. Selected articles were read, with particular focus in the methodology section, and explicit or implicit evidence of quality criteria that informed the research was collected. Direct or indirect reference to Klein and Myers' set of principles was highlighted. We summarize and compare our findings in a comprehensive table, and note that, apparently, the principle of hermeneu

Looking at the past to enrich the future: a reflection on Klein and Myers’ quality criteria for interpretive research

In the last two decades, interpretive research has become more established and more popular in information systems field. The work of Klein and Myers (1999) consists of a set of principles for conducting and evaluating interpretive research, which provide fair and appropriate criteria for assessing the validity and reliability of such studies and, given the number of citations, has had a significant impact in the interpretive research literature. Our article focuses on understanding how this set of principles has informed research articles published in two of the highest-ranked information systems journals and, specifically, questions if these principles have been translated into common practices when conducting interpretive research in the field of information systems and whether authors incorporate them explicitly when they communicate the results of their research. We reviewed articles published in Management Information Systems Quarterly and Information Systems Research, collected any explicit or implicit evidence of quality criteria that informed the research, and highlighted direct or indirect reference to Klein and Myers criteria. We summarize and compare our findings in a comprehensive table, and note that, apparently, the principle of hermeneutic circle and the principle of suspicion are the most explicitly discussed in this sample. Moreover, Klein and Myers’ set of principles seem to have had a greater influence in the papers published in the period from 2002 to 2006. This study provides a reflexion about methodological rigor in interpretive research that, to our knowledge, had never been done. Thus, the findings here presented may be useful for junior researchers and doctorate level students to understand how validity and quality criteria are enacted in high-quality interpretive research and, we hope, may encourage them to build on the exemplary work of the authors we reviewed and thus to contribute to enriching the literature of qualitative research methodology in information systems field.(undefined

Designing an information system for updating land records in Bangladesh: action design ethnographic research (ADER)

Open Access. This article is distributed under the terms of the Creative Commons Attribution License which permits any use, distribution, and reproduction in any medium, provided the original author(s) and the source are credited.This article has been made available through the Brunel Open Access Publishing Fund.Information Systems (IS) has developed through adapting, generating and applying diverse methodologies, methods, and techniques from reference disciplines. Further, Action Design Research (ADR) has recently developed as a broad research method that focuses on designing and redesigning IT and IS in organizational contexts. This paper reflects on applying ADR in a complex organizational context in a developing country. It shows that ADR requires additional lens for designing IS in such a complex organizational context. Through conducting ADR, it is seen that an ethnographic framework has potential complementarities for understanding complex contexts thereby enhancing the ADR processes. This paper argues that conducting ADR with an ethnographic approach enhances design of IS and organizational contexts. Finally, this paper aims presents a broader methodological framework, Action Design Ethnographic Research (ADER), for designing artefacts as well as IS. This is illustrated through the case of a land records updating service in Bangladesh

Revealing the Vicious Circle of Disengaged User Acceptance: A SaaS Provider's Perspective

User acceptance tests (UAT) are an integral part of many different software engineering methodologies. In this paper, we examine the influence of UATs on the relationship between users and Software-as-a-Service (SaaS) applications, which are continuously delivered rather than rolled out during a one-off signoff process. Based on an exploratory qualitative field study at a multinational SaaS provider in Denmark, we show that UATs often address the wrong problem in that positive user acceptance may actually indicate a negative user experience. Hence, SaaS providers should be careful not to rest on what we term disengaged user acceptance. Instead, we outline an approach that purposefully queries users for ambivalent emotions that evoke constructive criticism, in order to facilitate a discourse that favors the continuous innovation of a SaaS system. We discuss theoretical and practical implications of our approach for the study of user engagement in testing SaaS applications

Making choices: research paradigms and information management: practical applications of philosophy in IM research

Purpose – The purpose of this paper is to examine a variety of research approaches which information managers may find useful to meet the needs of working in the networked, digitized age. Design/methodology/approach – This is achieved by a discussion of the research paradigms inherent within both information theory and social theory. Findings – The findings work towards a final justification for an interpretist approach as the most appropriate context in which to work, in order to meet the emerging trends and current challenges of information technology management. Practical implications – The central theme of this paper is that research which deals primarily with people and information in a world of change, competition, and fluid communications technology should take into account and allow for an understanding of human behaviour. This understanding helps to highlight different contexts, backgrounds, and cultures and therefore provides assistance in making appropriate choices concerning research paradigms and information management, which in turn will ensure thoughtful methodology and justifiable research results. Originality/value – This paper examined questions regarding the choices of research paradigms and the practical application of philosophy to the life of professional information managers

Reconsidering the Role of Research Method Guidelines for Qualitative, Mixed-methods, and Design Science Research

Guidelines for different qualitative research genres have been proposed in information systems (IS). As these guidelines are outlined for conducting and evaluating good research, studies may be denied publication simply because they do not follow a prescribed methodology. This can result in “checkbox” compliance, where the guidelines become more important than the study. We argue that guidelines can only be used to evaluate what good research is if there is evidence that they lead to certain good research outcomes. Currently, the guidelines do not present such evidence. Instead, when it is presented, the evidence is often an authority argument or evidence of popularity with usability examples. We further postulate that such evidence linking guidelines and outcomes cannot be presented. Therefore, it may be time for the IS research community to acknowledge that many research method principles we regard as authoritative may ultimately be based on speculation and opinion, and thus, they should be taken less seriously as absolute guidelines in the review process

Contextuality and Information Systems: how the interplay between paradigms can help

Through this paper, we theorize on the meanings and roles of context in the study of information systems. The literatures of information systems and information science both explicitly conceptualize information systems (and there are multiple overlapping definitions). These literatures also grapple with the situated and generalizable natures of an information system. Given these shared interests and common concerns, this paper is used as a vehicle to explore the roles of context and suggests how multi-paradigmatic research ??? another shared feature of both information science and information systems scholarship ??? provides a means to carry forward more fruitful studies of information systems. We discuss the processes of reconstructed logic and logic-in-use in terms of studying information systems. We argue that what goes on in the practice of researchers, or the logic-in-practice, is typified by what we are calling the contextuality problem. In response, we envision a reconstructed logic, which is an idealization of academic practices regarding context. The logic-in-use of the field is then further explained based on two different views on context. The paper concludes by proposing a model for improving the logic-in-use for the study of information systems

Learning lessons from evaluating eGovernment: Reflective case experiences that support transformational government

Central Government strategy of e-inclusion is being manifested in the form of eGovernment. Given that it is the public purse that funds such investments, there is increasingly attention being paid to the evaluation of these investments, such that value for money and organisation learning can be realised. In this paper the authors report the findings from three interpretive in-depth organisational case studies that explore eGovernment evaluation within a UK public sector setting. The paper elicits insights to organisational and managerial aspects with the purpose of improving knowledge and understanding of eGovernment evaluation. The findings that are extrapolated from the case study analysis are presented in terms of lessons that gravitate around social factors, evaluation, adoption, ownership, prioritisation sponsorship and, responsibility. These lessons are extrapolated from the empirical enquiry to improve eGovernment evaluation practice. The paper concludes that eGovernment evaluation is an under developed area, with most work being developmental in nature and as a result calls for decision makers to engage with the eGovernment agenda and commission eGovernment evaluation exercises to improve evaluation practice such that transformational Government can realise its full potential. The paper ends by highlighting political, economic, technical and social issues as the drivers of the evaluation cycle

Research Methodologies for Management Sciences & Interdisciplinary Research in Contemporary World

The charismatic trend attributed in the domain of interdisciplinary research and management sciences has resulted in the notable increase of research activities in these fields. The manifesto of this paper is to identify the major research methodologies in the management sciences in the contemporary world and specifically in Asian academic space. Based upon the research findings, this paper categorically presents the specific categories of research classification with empirical evidence and further explains various new trends in contemporary scientific publications in context to management sciences and interdisciplinary research.Research Methodology, Management Sciences, Interdisciplinary Research, Contemporary Scientific Publications