A multidimensional framework for group decision support system research and design

Groups are a fundamental and essential part of organizational decision making. A group decision support system (GDSS) attempts to use computer and communications technology to help a group make better decisions. In this paper, previous GDSS research is extended to develop a better framework for future GDSS research and design. Six situational factors are identified; group size, member proximity, task type, group environment, and group development stage; so that a given group decision making situation can be accurately described. To standardize the features across different GDSS, six different levels of GDSS features are also identified. The paper then presents a multidimensional framework for conducting future GDSS research, and argues that future GDSS research needs to identify the appropriate GDSS features for the appropriate group decision situation. It is also suggested that researchers take a long-term, holistic approach while analyzing the results of using a GDSS

Knowledge Quality in Knowledge-Based Systems: An Investigation in a Group Decision Making Environment

Group decision making has been studied for almost five decades. In recent years research has focused on information technology like Group Support Systems (GSS) that help groups make decisions. In this paper we look at another kind of information technology, knowledge-based systems and its impact on groups. In addition, we investigate the impact of knowledge quality on group decision making processes and outcomes

Helping people help themselves - toward a theory of autonomy-compatible help

If development is seen basically as autonomous self-development, then there is a subtle paradox in the whole notion of development assistance: How can an outside party ("helper") assist those undertaking autonomous activities (the"doers") without overriding, or undercutting their autonomy? This conundrum is the challenge facing a theory of autonomy-compatible development assistance - that is, helping theory. Starting from a simple model of non-distortionary aid, the author explores several themes of a broader helping theory, and shows how these themes arise in the work of"gurus"in different fields - John Dewey in pedagogy and social philosophy, Douglas McGregor in management theory, Carl Rogers in psychotherapy, Soren Kierkegaard in spiritual counseling, Saul Alinsky in community organizing, Paulo Freire in community education, and Albert Hirschman, and E.F. Schumacher in economic development. That such diverse thinkers in such different fields, arrive at very similar conclusions, increases confidence in the common principles. The points of commonality are summarized as follows: 1) Help must start from the present situation of the doers. 2) Helpers must see the situation through the eyes of the doers. 3) Help cannot be imposed on the doers, as that directly violates their autonomy. 4) Nor can doers receive help as a benevolent gift, as that increases dependency. 5) Doers must be in the driver seat. One major application of helping theory is to the problems of knowledge-based development assistance. The standard approach is that the helper, a knowledge-based development agency, has the"answers", and disseminates them to the doers. This corresponds to the standard teacher-centered pedagogy. The alternative under helping theory is the learner-centered approach. The teacher plays the role of midwife, catalyst, and facilitator, building learning capacity in the learner-doers, so that they can learn from any source, including their own experience. Development assistance is further complicated by the local, or tacit nature of much relevant knowledge. A knowledge-based development agency might function better, not simply as a source of knowledge, but as a broker connecting those who face problems with those in similar situations, who have learned to address the problems. Changing to the approach of helping theory, entails changing the helping agency itself, transforming it into an organization that fosters learning internally, as well as externally - as in a university, where professors engage in learning, and foster learning in students, but the organization does not adopt official views on the complex questions of the day. This means fostering competition in the marketplace of ideas within the organization, and taking a more Socratic stance with clients, who will then have to take responsibility for, and have ownership of their decisions.Economic Theory&Research,Decentralization,Health Economics&Finance,Development Economics&Aid Effectiveness,Labor Policies,Health Monitoring&Evaluation,Educational Sciences,Economic Theory&Research,Health Economics&Finance,Development Economics&Aid Effectiveness

Improving the Analysis of Foreign Affairs: Evaluating Structured Analytic Techniques

Research suggests that foreign affairs analysis is weak—even the best analysts are accurate less than 35 percent of the time (Tetlock 2005). To compensate for analytic weaknesses, some have called for the use of structured analytic techniques, that is, formalized judgement-driven methods. This imperative was enshrined in the Intelligence Reform and Terrorism Prevention Act (2004), which mandates that analysts use these techniques. This research investigates how the techniques have been applied in the U.S. intelligence community (IC) while making a modest attempt to evaluate 12 core techniques. The investigation of how the techniques are applied is based on semi-structured interviews with 5 intelligence experts and a survey of 80 analysts at an IC agency, along with follow-up interviews with 15 analysts. Interestingly, 1 in 3 analysts reported never using the techniques. Two factors were related to the use of the techniques: analytic training (p=0.001, Cramer's V=0.41) and the perception of their value (p=.049, Cramér's V= 0.23). There was not a statistically significant relation between the time pressure under which analysts work and their use of the techniques (p=0.74). Questions about the effectiveness of the techniques were answered in part by employing a “systematic review,” a novel methodology for synthesizing a large body of research. A random sample of more than 2,000 studies, suggests that there is moderate to strong evidence affirming the efficacy of using three techniques: Analysis of Competing Hypotheses, Brainstorming, and Devil’s Advocacy. There were three main findings: face-to-face collaboration decreases creativity, evidence weighting appears to be more important than seeking disconfirming evidence, and conflict tends to improve the quality of analysis. This research also employed an experiment with 21 graduate intelligence studies students, which confirmed the first two findings of the systematic review. The findings of the dissertation represent a contribution to “evidence-based intelligence analysis,” the systematic effort to develop a robust evidence-base linking the use of specific analytic techniques to the improvement of analysis in foreign affairs. Future research might build on the evidence-base presented here to improve intelligence analysis, one of the most important areas of judgment in foreign affairs

Influence of Feedback and Comment Labels on Information Sharing in a Computer Mediated Collaborative Environment

A group support system (GSS) uses a combination of networked personal computers, software, and human facilitation to improve the group decision-making process. Group support Systems are being used in the Air Force today in a variety of capacities and in particular by the Warner-Robins Air Logistics Center (WR-ALC) to assess acquisition risks. Prior GSS research has found that certain structural and social dimensions of GSS designs might influence whether optimal process improvements take place. However, the dimensions that positively influence group performance have continued to be a matter of debate. This thesis looked at several structural and social contingencies to explore possible explanations for the mixed results found in GSS research. The study examined the effect of: anonymity, identification, self-regulation, and facilitator provided feedback on user information sharing behavior, quality of the group decision, unequal participation among group members, and user attitudes with the GSS meeting. The results of the study indicated that the anonymity theory was partially supported since users in an anonymous condition provided more intellective comments than any other condition. In addition, the self-regulation theory was partially supported since users were found to have more satisfaction with the GSS meeting in this treatment

Digital Government Systems: Tackling The Legacy Problem Through A Game-Based Approach To Business Requirements Analysis

Government agency reliance on legacy systems is problematic: they are costly to maintain, difficult to integrate with and they hinder innovation. However, the replacement of legacy systems is not a straightforward endeavor, and it often results in technology substitution that is not accompanied by business process change. The focus of this dissertation is on the phenomenon of legacy system replication wherein the requirements for applications replacing outdated technologies mimic legacy features and reflect status quo operational processes that have been historically shaped by the legacy system itself. This problem is referred to throughout the dissertation as the “legacy problem.” The dissertation investigates its roots and proposes an approach to overcome it. Specifically, a mixed method research approach is taken, including a survey of public sector practitioners to explore the extent of the legacy problem, and a series of semi-structured interviews with government information technology and management professionals to delve into the dynamics of legacy system replacement projects. Findings indicate that the legacy problem often stems from a lack of critical analysis of business requirements and the desire to minimize the risks associated with organizational change, which often result in missed opportunities for digital government innovation. As a consequence, the dissertation proposes a candidate approach to deal with the legacy problem in the development of a requirements game (RE-PROVO) which supports requirements discussions structured around the themes of legacy (or heritage) preservation and innovation. The game is evaluated by local government practitioners through several iterations and their feedback is analysed to gauge the potential utility of the approach. The results indicate that with a streamlined user interface and accentuated game elements RE-PROVO can be a valuable and effective tool for requirements analysis in legacy system replacement projects

Design and evaluation of a list gathering tool in a web-based collaborative environment

This research focuses on how to build a list structure to combine individual items of information into some sort of structure that converts the individual items of information into a structure of knowledge relative to the problem. Software was designed to provide relationships among and comparisons of the contributions in a list structure, so that individual members of a group process will be able to understand the contributions of information made by the group as a whole. A List Gathering Tool was designed and implemented, which is one component in a Web-based Social Decision Support System (SDSS) Toolkit. Then, a two-by-two factorial design (list tool support vs. no list tool support, and voting tool support vs. no voting tool support, respectively) controlled experiment and several field studies were carried out to assess the effects of this List Gathering Tool in a group problem solving process. Overall, the evaluation results are encouraging. The utilization of the List Gathering Tool or the SDSS Toolkit does tend to improve the ability to discover valid alternatives. An additional set of field trials illustrated how the SDSS Toolkit can be utilized in a collaborative learning environment to improve teaching and students\u27 learning experience. This system will also work for very practical applications in large group settings

Dialectic approach to multidisciplinary practice in requirements engineering

This thesis develops an approach that supports multidisciplinary practice in requirements engineering. It is argued that multidisciplinary requirements engineering practice is ineffective, and some specific problems for multidisciplinary practice are identified. It is also suggested that the incommensurability of conflicting paradigms is an underlying cause of the problems in multidisciplinary practice, and a number of criteria for support to overcome such problems are proposed. A form of methodological support, which it is claimed may help overcome some of the problems associated with multidisciplinary practice in requirements engineering, is developed. This methodological support takes the form of a dialectic process, and its associated products, which is conceptualised and then operationalised. As an illustration of the methodological support offered to multidisciplinary practice, the operationalisation of the dialectic process is applied to requirements constructed by the use of two different requirements engineering techniques from two different disciplines (representing two different paradigms), in the domain of Accident and Emergency healthcare. Finally, the application of the operationalisation of the dialectic process is assessed with respect to the criteria for support for multidisciplinary practice proposed earlier, and this assessment is used to reconceptualise the dialectic process. The limitations of the research are identified, and possibilities for future work proposed. This thesis is aimed primarily at the requirements engineering community, and in particular the practising requirements engineer. It makes two contributions to knowledge supporting the practices of requirements engineering. First, the thesis contributes two types of substantive discipline knowledge: an explanation of why multidisciplinary practice in requirements engineering is problematic; and the proposal of criteria for support to allay the difficulties of multidisciplinary practice. It is suggested that these criteria might be used in the development of new types of support to overcomes such difficulties, or in the assessmment of new requirements engineering techniques that claim to address multidisciplinary practice. Second, the thesis contributes methodological knowledge in the form of a dialectic approach that offers a new way of reasoning about requirements engineering. This methodological knowledge takes two forms: a generic dialectic approach that might be applied by requirements engineering practitioners to requirements, generated by a wide range of requirements engineering techniques, representing alternative paradigms; and a specific instantiation of the dialectic approach using the MUSE method and the Grounded Theory method, that might be used in its current form by requirements engineering practitioners to support their own multidisciplinary practice

Investigation into the feasibilty of providing intelligent support for computer mediation decision making groups

This thesis investigated the claim that the adaptation to the keyboard interface of a computer-mediated (CM) decision making group leads to differences in the style of communication when compared to that of a face-to-face (FTF) group. More importantly it examined the possibility that changes in satisfaction with the process and the decision outcome are determined not by the mode of communication, but rather the style of communication the decision makers employed in response to the keyboard interface. The decision processes of CM and FTF groups were examined using a simulated panel of enquiry presented via computer databases and containing inconsistent and incomplete shared information that could only be resolved through collaboration between the group members. An analysis of the communication styles employed in real-time CM and FTF groups (Experiment 1) revealed a tendency of CM discussions to exhibit a preference for a normative style of communication exchanging a proportionally high number of value statements and indications of preference, and for. FTF groups to rely proportionally more heavily upon factual and inferential statements. A paradigm for enabling intervention into the decision making process through the monitoring and coding of all group communication was developed (Chapter 2) which permitted the real-time analysis of the differences in communication style and aimed to reduce the differences in communication style. Using this paradigm and the norms for communication of the two forms of group (CM and FTF) established in Experiment 1, a series of studies examining the communication process were undertaken. Experiment 2 explored the possibility of intervening into the communication process using e-mail based support messages that conveyed the discrepancies between a CM groups communication style and the style a group might be expected to employ where it communicating FTF. Two configurations of support messages that each attempted to shape the communication style of CM decision panels to resemble those of FTF panels were considered. It was found that alerting users to their communication style and instructing them to increase or decrease certain styles of communication enabled them to more closely resemble the communication process and satisfaction levels of FTF groups. Experiment 3 considered the possibility that the presence of a monitoring system, rather than the content of the support messages provided, was the key issue in securing changes in the communication style of CM groups. Having established that it was indeed the content of the support messages that enabled CM groups to operate as if communicating FTF, attention turned to effects of the support. By easing the interpretation of the feedback through two configurations of visual feedback, Experiment 4 attempted to increase decision makers adherence to the content of the support messages. This study suggested that visual feedback alone was not sufficient to elicit the desired changes in communication style and that the text-based communication was required. Moreover, Experiment 4 considered the impact of support messages themselves, considering whether the support acted as continual assistance to the users or whether it merely trained the users to communicate in the desired way Conclusions from this study were slightly inconclusive, however, given that changes in communication styles had been achieved a further analysis of the content of the messages was undertaken. This final analysis (Chapter 7) revealed effects of confirmation bias within the communication and intervention steps that can on occasionally overcame such biases. The possibilities for the development of real-time intervention into these processes are considered and the findings interpreted in the light of existing theories of CM communication and recent developments in computer-based communication