More Enduring Questions in Cognitive IS Research

In the April 2012 issue of the Journal of the Association for Information Systems, Michael Davern, Teresa Shaft, and Dov Te’eni published an article titled “Cognition Matters: Enduring Questions in IS Research”. Their paper reviewed much of the history of cognitive research in the IS discipline, especially that related to human-computer interaction and decision support systems. While we believe their article is excellent in many respects, we also believe that it omitted a great deal of the most basic cognitive research performed in the IS domain over the past 10-15 years, especially work in the area of systems analysis and design. Our purpose in this paper is to supplement the work of Davern et al. by discussing much of this recent work. We use two theoretical lenses to organize our review: basic cognition and behavioral decision-making research. Our review provides many illustrations of IS research in these areas, including memory and categorization (basic cognition) and heuristics and biases (behavioral decision making). The result, we believe, is a fuller picture of the breadth of cognition-based work in the IS discipline in general and systems analysis and design in particular. The paper provides further evidence of the importance of cognitive research in IS and suggests additional enduring questions for future investigations

Developing Measurable Cross-Departmental Learning Objectives for Requirements Elicitation in an Information Systems Curriculum

The ability to elicit information systems requirements is a necessary learning objective for students in a contemporary information systems curriculum, and is a skill vital to their careers. Common challenges in teaching this skill include both the lack of structure and guidance in information systems textbooks as well as the view that a student’s education consists of a disparate set of unrelated courses. These challenges are exacerbated by faculty who focus only on their taught courses and by textbooks that often promote an isolated, passing glance at both the importance of and the idea behind requirements elicitation. In this paper, we describe a multi-year, faculty-led effort to create and refine learning activities that are aligned to requirements elicitation learning objectives both within and scaffolded across courses in a modern information systems curriculum. To achieve success in developing this marketable skill within information systems students, learning activities were integrated across the entire information systems major in a process we call Bloomification, where learning objectives, aligned learning activities, and courses are related and connected across the curriculum. This cross-departmental process is presented and lessons learned by the faculty are discussed

Beyond a Reasonable Doubt: A Discourse Analysis of Forensic and Psychological Truth in Child Narratives

This dissertation draws on a hermeneutically-informed modification of Potter and Wetherell’s (1987) discourse analysis methodology to explore how child memory and experience are conceptualized in two widely-used forensic psychology training manuals. Current research about child testimony tends to focus on how well children can factually recount their experiences, or on optimizing interviewer performance so as to obtain accurate accounts and minimize the risk of distorting children’s memories. Results of this discourse analysis include: 1) frequent advisement of evaluator caution, objectivity, and thoroughness, since evaluators are understood as responsible for preserving the accuracy of children’s memories during the evaluation process; and 2) use of the suggestibility model of memory, which assumes memory is a predominantly cognitive process in which people—especially children—are vulnerable to external influences that will distort their accounts and thereby render them invalid. These findings were then put into dialogue with a phenomenological conceptualization of child memory and experience. Though both approaches present child memory/experience as fluid and easily influenced by other people, phenomenology does not view these qualities as inherently problematic. Rather, this orientation assumes that all experience is interrelated as a given, and that factual truth is similarly important to experiential truth. Socio-historical context is also discussed, namely how American and European legal practices have shifted over time to reflect broader societal views of children as either vulnerable or autonomous. Finally, practical implications of the handbook discourse are elaborated, including ways a phenomenological perspective could improve how children are supported in forensic settings. Integrating non-verbal communication, exploring experiential truth as well as fact truth, and drawing on research that does not assume a suggestibility model of memory are three principal suggestions for evaluators

Enhancing Analysts’ Mental Models for Improving Requirements Elicitation: A Two-stage Theoretical Framework and Empirical Results

Research has extensively documented the importance of accurate system requirements in avoiding project delays, cost overruns, and system malfunctions. Requirement elicitation (RE) is a critical step in determining system requirements. While much research on RE has emerged, a deeper understanding of three aspects could help significantly improve RE: 1) insights about the role and impacts of support tools in the RE process, 2) the impact of using support tools in multiple stages of the RE process, and 3) a clear focus on the multiplicity of perspectives in assessing RE outcomes. To understand how using support tools could improve RE, we rely on the theoretical lens of mental models (MM) to develop a dynamic conceptual model and argue that analysts form mental models (MMs) of the system during RE and these MMs impact their outcome performance. We posit that one can enhance analysts’ MMs by using a knowledge-based repository (KBR) of components and services embodying domain knowledge specific to the target application during two key stages of RE, which results in improved RE outcomes. We measured the RE outcomes from user and analyst perspectives. The knowledge-based component repository we used in this research (which we developed in collaboration with a multi-national company) focused on insurance claim processing. The repository served as the support tool in RE in a multi-period lab experiment with multiple teams of analysts. The results supported the conceptualized model and showed the significant impacts of such tools in supporting analysts and their performance outcomes at two stages of RE. This work makes multiple contributions: it offers a theoretical framework for understanding and enhancing the RE process, develops measures for analysts’ mental models and RE performance outcomes, and shows the process by which one can improve analysts’ RE performance through access to a KBR of components at two key stages of the RE process

Improving Requirements Generation Thoroughness in User-Centered Workshops: The Role of Prompting and Shared User Stories

The rise of stakeholder centered software development has led to organizations engaging users early in the development process to help define system requirements. To facilitate user involvement in the requirements elicitation process, companies can use Group Support Systems (GSS) to conduct requirements elicitation workshops. The effectiveness of these workshops for generating a valuable set of requirements for system developers has been previously demonstrated. However, a more representative measure of progress towards a system that will meet users’ needs-- the completeness of the requirements generated by such groups has not been explored. We explore two process design considerations for increasing the completeness of requirements generated by these users: increased sharing of user stories (individual electronic brainstorming groups vs. shared user stories electronic brainstorming groups), and the use of reflective inducement prompts (unprompted vs. prompted groups). Using the Search for Ideas in Active Memory model, we predict that prompted electronic brainstorming groups will outperform any other group, including prompted, shared user stories groups at generating a more thorough set of requirements. To test the hypotheses an experiment with 56 groups consisting of 197 users was conducted. The users were asked to generate requirements for a fictitious online textbook exchange website. All hypotheses received support. The study has implications for GSS-Supported workshop design and for future research on collaborative performance in requirements elicitation

Towards a B2B E-Commerce Evaluation Management Model to Assess Organizational Drivers in Hospitals

Effective utilization of business-to-business (B2B) electronic commerce (e-commerce) in hospitals may lead to many benefits such as increased accessibility to healthcare providers, improved process efficiency, enhanced quality of healthcare services, increased responses to changes, decreased scheduling conflicts, and reduction in administrative costs. However, many hospitals have found that they have not yet fully reaped the expected benefits from their B2B e-commerce investments. Despite this, there has not been much discussion in the literature with respect to the relationship between the organizational drivers on B2B e-commerce benefits for hospitals. Hence, a mixed-method of case study and survey was conducted to examine the relationships between B2B e-commerce benefits, IT evaluation resources allocation, IT investment evaluation methodologies, IT maturity, and user information requirements determination process. A B2B e-commerce evaluation management model was developed to test these relationships. The results provided empirical evidence in support of our proposed model and revealed that hospitals’ IT evaluation resources allocation practices mediated the relationship of IT investment evaluation methodologies, IT maturity, and user information requirements determination process with B2B e-commerce benefits. The results also showed that the level of IT maturity had a significant impact on the adoption of IT investment evaluation methodologies