Toward a taxonomy of methodological perspectives in artificial intelligence research

This paper is an attempt to explain apparent confusion of efforts in the field of artificial intelligence (AI) research in terms of differences between underlying methodological perspectives held by practicing researchers. A review of such perspectives discussed in the existing literature will be presented, followed by consideration of what a relatively specific and usable taxonomy of differing research perspectives in AI might include. An argument will be developed that researchers should make their methodological orientations explicit when communicating research results, both as an aid to comprehensibility for other practicing researchers and as a step towards providing a coherent intellectual structure which can be more easily assimilated by newcomers to the field

Design Research and Domain Representation

While diverse theories about the nature of design research have been proposed, they are rarely considered in relation to one another across the broader disciplinary field. Discussions of design research paradigms have tended to use overarching binary models for understanding differing knowledge frameworks. This paper focuses on an analysis of theories of design research and the use of Web 3 and open content systems to explore the potential of building more relational modes of conceptual representation. The nature of this project is synthetic, building upon the work of other design theorists and researchers. A number of theoretical frameworks will be discussed and examples of the analysis and modelling of key concepts and information relationships, using concept mapping software, collaborative ontology building systems and semantic wiki technologies will be presented. The potential of building information structures from content relationships that are identified by domain specialists rather than the imposition of formal, top-down, information hierarchies developed by information scientists, will be considered. In particular the opportunity for users to engage with resources through their own knowledge frameworks, rather than through logically rigorous but largely incomprehensible ontological systems, will be explored in relation to building resources for emerging design researchers. The motivation behind this endeavour is not to create a totalising meta-theory or impose order on the ‘ill structured’ and ‘undisciplined’, domain of design. Nor is it to use machine intelligence to ‘solve design problems’. It seeks to create dynamic systems that might help researchers explore design research theories and their various relationships with one another. It is hoped such tools could help novice researchers to better locate their own projects, find reference material, identify knowledge gaps and make new linkages between bodies of knowledge by enabling forms of data-poesis - the freeing of data for different trajectories. Keywords: Design research; Design theory; Methodology; Knowledge systems; Semantic web technologies.</p

A Common Protocol for Agent-Based Social Simulation

Traditional (i.e. analytical) modelling practices in the social sciences rely on a very well established, although implicit, methodological protocol, both with respect to the way models are presented and to the kinds of analysis that are performed. Unfortunately, computer-simulated models often lack such a reference to an accepted methodological standard. This is one of the main reasons for the scepticism among mainstream social scientists that results in low acceptance of papers with agent-based methodology in the top journals. We identify some methodological pitfalls that, according to us, are common in papers employing agent-based simulations, and propose appropriate solutions. We discuss each issue with reference to a general characterization of dynamic micro models, which encompasses both analytical and simulation models. In the way, we also clarify some confusing terminology. We then propose a three-stage process that could lead to the establishment of methodological standards in social and economic simulations.Agent-Based, Simulations, Methodology, Calibration, Validation, Sensitivity Analysis

A Standardised Procedure for Evaluating Creative Systems: Computational Creativity Evaluation Based on What it is to be Creative

Computational creativity is a flourishing research area, with a variety of creative systems being produced and developed. Creativity evaluation has not kept pace with system development with an evident lack of systematic evaluation of the creativity of these systems in the literature. This is partially due to difficulties in defining what it means for a computer to be creative; indeed, there is no consensus on this for human creativity, let alone its computational equivalent. This paper proposes a Standardised Procedure for Evaluating Creative Systems (SPECS). SPECS is a three-step process: stating what it means for a particular computational system to be creative, deriving and performing tests based on these statements. To assist this process, the paper offers a collection of key components of creativity, identified empirically from discussions of human and computational creativity. Using this approach, the SPECS methodology is demonstrated through a comparative case study evaluating computational creativity systems that improvise music

Feature weighting techniques for CBR in software effort estimation studies: A review and empirical evaluation

Context : Software effort estimation is one of the most important activities in the software development process. Unfortunately, estimates are often substantially wrong. Numerous estimation methods have been proposed including Case-based Reasoning (CBR). In order to improve CBR estimation accuracy, many researchers have proposed feature weighting techniques (FWT). Objective: Our purpose is to systematically review the empirical evidence to determine whether FWT leads to improved predictions. In addition we evaluate these techniques from the perspectives of (i) approach (ii) strengths and weaknesses (iii) performance and (iv) experimental evaluation approach including the data sets used. Method: We conducted a systematic literature review of published, refereed primary studies on FWT (2000-2014). Results: We identified 19 relevant primary studies. These reported a range of different techniques. 17 out of 19 make benchmark comparisons with standard CBR and 16 out of 17 studies report improved accuracy. Using a one-sample sign test this positive impact is significant (p = 0:0003). Conclusion: The actionable conclusion from this study is that our review of all relevant empirical evidence supports the use of FWTs and we recommend that researchers and practitioners give serious consideration to their adoption

The view from elsewhere: perspectives on ALife Modeling

Many artificial life researchers stress the interdisciplinary character of the field. Against such a backdrop, this report reviews and discusses artificial life, as it is depicted in, and as it interfaces with, adjacent disciplines (in particular, philosophy, biology, and linguistics), and in the light of a specific historical example of interdisciplinary research (namely cybernetics) with which artificial life shares many features. This report grew out of a workshop held at the Sixth European Conference on Artificial Life in Prague and features individual contributions from the workshop's eight speakers, plus a section designed to reflect the debates that took place during the workshop's discussion sessions. The major theme that emerged during these sessions was the identity and status of artificial life as a scientific endeavor

Archipelagic Human-Machine Communication: Building Bridges amidst Cultivated Ambiguity

In this commentary, I call for maintaining the archipelagic character of human-machine communication (HMC). Utilizing the metaphor of the archipelago or a chain of connected islands indicates that HMC entails a variety of islands differing in shape, size, location, and proximity to one another. Rather than aiming for conceptual unity and definitional homogeneity, I call for embracing a cultivated ambiguity related to HMC key concepts. Ambiguity in the sense of allowing these concepts to be flexible enough to be explored in different contexts. Cultivated in the sense of demanding resonance across individual studies and theoretical lineages to allow for cumulative and collaborative theorizing. My hope is that HMC scholars can continue to build bridges that traverse the paradigmatic, methodological, theoretical, and technological archipelago of HMC

Agent-based Computational Economics: a Methodological Appraisal

This paper is an overview of "Agent-based Computational Economics (ACE)", an emerging approach to the study of decentralized market economies, in methodological perspective. It summarizes similarities and differences with respect to conventional economic models, outlines the unique methodological characteristics of this approach, and discusses its implications for economic methodology as a whole. While ACE rejoins the reflection on the unintended social consequences of purposeful individual action which is constitutive of economics as a discipline, the paper shows that it complements state-of the-art research in experimental and behavioral economics. In particular, the methods and techniques of ACE have reinforced the laboratory finding that fundamental economic results rely less on rational choice theory than is usually assumed, and have provided insight into the importance of market structures and rules in addition to individual choice. In addition, ACE has enlarged the range of inter-individual interactions that are of interest for economists. In this perspective, ACE provides the economist‘s toolbox with valuable supplements to existing economic techniques rather than proposing a radical alternative. Despite some open methodological questions, it has potential for better integration into economics in the future.Agent-based Computational Economics, Economic Methodology, Experimental Economics.