Criteria as a Prelude for Guiding Taxonomy Evaluation

Taxonomies are design science artifacts used by researchers and practitioners to describe and classify existing or future objects of a domain. As such, they constitute a necessary foundation for theory building. Yet despite the great interest in taxonomies, there is virtually no guidance on how to rigorously evaluate them. Based on a literature review and a sample of 446 articles, this study explores the criteria currently employed in taxonomy evaluations. Surprisingly, we find that only a minority of taxonomy building projects actually evaluate their taxonomies and that there is no consistency across the multiplicity of criteria used. Our study provides a structured overview of the taxonomy evaluation criteria used by IS researchers and proposes a set of potential guidelines to support future evaluations. The purposeful and rigorous taxonomy evaluation our study advances contributes to DSR by bridging the gap between generic evaluation criteria and concrete taxonomy evaluation criteria

TAXONOMY RESEARCH IN INFORMATION SYSTEMS: A SYSTEMATIC ASSESSMENT

Today’s world is changing at unprecedent speed and scale becoming more complex to understand. Taxonomies represent an important tool for understanding and analyzing complex domains based on the classification of objects. In the Information Systems (IS) domain, Nickerson et al. (2013) were the first to propose a taxonomy development method, addressing the observation that many taxonomies have been developed in an ‘ad-hoc’ approach. More than five years after Nickerson et al.’s (2013) publication, we examined to what extent recently published taxonomy articles account for existing methodological guidance. Therefore, we identified and reviewed 33 taxonomy articles published between 2013 and 2018 in leading Information Systems journals. Our results were sobering: We found few taxonomy articles that followed any specific development method. Although most articles correctly understood taxonomies as conceptually or empirically derived groupings of dimensions and characteristics, our study revealed that the development process often remained opaque and that taxonomies were hardly evaluated. We discuss these findings and potential root causes related to method design, method adoption, and the general positioning of taxonomy research in the IS domain. Our study proposes stimulating questions for future research and contributes to the IS community’s progress towards methodologically well-founded taxonomies

UNDERSTANDING THE VALUE OF SOCIAL MEDIA IN ORGANISATIONS: A TAXONOMIC APPROACH

While organizations strive to leverage the vast information generated daily from social media platforms and both decision makers and consultants are keen to identify and exploit this information’s value, there has been little research into social media in the business context. Social media are diverse, varying in scope and functionality, this diversity entailing a complex of attributes and characteristics, resulting in confusion for both researchers and organizations. Taxonomies are important precursors in emerging fields and are foundational for rigorous theory building. Though aspects of social media have been studied from various discipline perspectives, this work has been largely descriptive. Thus, while the need for a rigorous taxonomy of social media is strong, previous efforts to classify social media suffer limitations – e.g. lack of a systematic taxonomic method, overreliance on intuition, disregard for the users’ perspective, and inadequate consideration of purpose. Thus, this study was mainly initiated by the overarching question “How can social media in the business context be usefully classified?” In order to address this gap, the current paper proposes a systematic method for developing a taxonomy appropriate to study social media in organizations context, combining Nickerson et al,’s (2012) IS taxonomy building guidelines and a Repertory grid (RepGrid) approach

Exploring foundations for using simulations in IS research

Simulation has been adopted in many disciplines as a means for understanding the behavior of a system by imitating it through an artificial object that exhibits a nearly identical behavior. Although simulation approaches have been widely adopted for theory building in disciplines such as engineering, computer science, management, and social sciences, their potential in the IS field is often overlooked. The aim of this paper is to understand how different simulation approaches are successfully used in IS research, thereby providing hypotheses that allow deriving methodological guidelines for subsequent studies. A survey of 46 pieces of IS research provides the grounding for defining a taxonomy of simulation approaches and for identifying possible application patterns linking simulation approaches to their theory contributions, research domains and information views

An Update for Taxonomy Designers

Taxonomies are classification systems that help researchers conceptualize phenomena based on their dimensions and characteristics. To address the problem of ‘ad-hoc’ taxonomy building, Nickerson et al. (2013) proposed a rigorous taxonomy development method for information systems researchers. Eight years on, however, the status quo of taxonomy research shows that the application of this method lacks consistency and transparency and that further guidance on taxonomy evaluation is needed. To fill these gaps, this study (1) advances existing methodological guidance and (2) extends this guidance with regards to taxonomy evaluation. Informed by insights gained from an analysis of 164 taxonomy articles published in information systems outlets, this study presents an extended taxonomy design process together with 26 operational taxonomy design recommendations. Representing an update for taxonomy designers, it contributes to the prescriptive knowledge on taxonomy design and seeks to augment both rigorous taxonomy building and evaluation

Exploring Purposes of Using Taxonomies

Taxonomies are artifacts that can be used for numerous purposes, including gap spotting, decision-making, and theory building. Despite the variety of usage purposes, we can observe that designers state that their taxonomies help to ‘classify something’; leaving the full potential of taxonomies rather untapped. In order to lay attention on questions of for what taxonomies can be used, this short paper (1) raises awareness of the actual problem space and motivate the relevance of an overview of taxonomy use purposes, (2) outlines the overall project’s research design to identify and structure the set of use purposes, and (3) proposes preliminary purposes extracted from analyzing a corpus of articles that built upon—and use—previously published taxonomies. In doing this, we seek to complement available methodological guidance to make more informed decisions in terms of a taxonomy’s usage potential

Introducing an Evaluation Method for Taxonomies

Background: Taxonomies are crucial for the development of a research field, as they play a major role in structuring a complex body of knowledge and help to classify processes, approaches, and solutions. While there is an increasing interest in taxonomies in the software engineering (SE) research field, we observe that SE taxonomies are rarely evaluated. Aim: To raise awareness and provide operational guidance on how to evaluate a taxonomy, this paper presents a three step evaluation method evaluating its structure, applicability, and purpose. Method: To show the feasibility and applicability of our approach, we provide a running example and additionally illustrate our approach to a practical case study in SE research. Results and Conclusion: Our method with operational guidance enables SE researchers to systematically evaluate and improve the quality of their taxonomies and support reviewers to systematically assess a taxonomy\u27s quality