Quality as a function of quantity in electronic brainstorming

The quality of ideas a team generates constitutes an upper limit on the quality of the problem solving process. Much research has been done about causes of idea quantity and causes of idea quality. It has been noted by some researchers that idea quality appears to correlate with idea quantity, and several have argued that it is not necessary to go to expense and effort required to evaluate idea quality since it correlates with quantity. This paper draws on Team Theory to develop a causal link between quantity and quality. It then presents a low-cognitive-load, high-reliability method for evaluating idea quality. It reports on a study that addresses the question, “Will an increase in idea quantity cause more good ideas to be generated?”. The results support the hypothesis that there is a modest causal connection between quantity and quality, but the data suggest other factors are far more important for determining the number of good ideas a team generates. It concludes that researchers must continue to measure the effects of their brainstorming treatments on idea quality; it is not sufficient to assume that quality will always track quantity. Other factors not accounted for by the quality-quantity model may well counter and outweigh this effect.published_or_final_versio

Evaluating the Impacts of Different Interventions on Quality in Concept Generation

Producing ideas of high quality has great importance in engineering design. Although concept generation is sometimes one of the shorter phases of a project, concept generation that leads to viable and unique solutions can greatly contribute to a product’s final outcomes. Concept generation also has importance as a tool for engineering education and academic research. Because the quality of solutions can vary from individual to individual and from circumstance to circumstance, it would be useful to better understand how different interventions influence the outcomes of the ideation process in the concept generation stage of engineering design. In this work, we investigated the impacts of the problem context and three specific interventions designed to increase the ideation flexibility for the outcomes of concept generation. The three interventions were problem framing, design tools, and teaming. Our results show that both problem framing and teaming impact several aspects of quality, while design tools only impact the quantity of ideas produced

Peer-reviewed Brainstorming to Facilitate Large Group Collaboration

This paper examines the impact of peer-reviewed brainstorming on the quality of brainstorming ideas. Peer-reviewed brainstorming aims to improve the quality of the brainstorming ideas and reduce the number of noisy comments. A pilot study was conducted that compared traditional, free brainstorming to a peer-reviewed brainstorming process, which requires each idea to be reviewed and edited by peers. The peer-review process did reduce the number of low quality ideas. This process was also rated higher in satisfaction ratings than traditional brainstorming

Introducing Collaboration in Single-user Applications through the Centralized Control Architecture

In this paper we describe a novel Model-View­ Controller based architecture, Centralized Control, that intro­duces collaboration in single-users applications. The architecture is able to add collaboration with no need to modify the source code of the original single-user application, and providing also the capability to introduce group semantics into the new, collab­orative application that is obtained. The architecture is shown in practice, by introducing CollabXMind, a collaborative mind map tool, that is based on a well-known single-user tool, XMind

Conquering the Challenge of Continuous Business Model Improvement - Design of a Repeatable Process

In an atmosphere of rapidly changing business environments and intense competition, adequate and timely business models are crucial for companies. Current research mainly focuses on business model development that often neglects the legacy of established companies. The paper at hand addresses this research gap by a process design which allows established companies to rethink, improve, and continually innovate their business models. Following a design science research approach, require- ments for improving business models are identified by the analysis of existing literature and by expert interviews. Collaboration Engineering and a multilevel evaluation are applied to create a continuous and implementable process design for business model improvement – including specific activities, instructions, and tools. The process design represents a nascent design theory in form of an ‘‘invention’’ type of knowledge contribution. Moreover, going beyond existing literature, the importance of col- laboration between participants in a business model improvement project is highlighted. From a practical per- spective, the developed process design enables companies for continuous and recurring business model improvement without the ongoing support of professional moderators or consultants

Assessing the effectiveness of electronic brainstorming in an industrial setting : experimental design document.

An experiment is proposed which will compare the effectiveness of individual versus group brainstorming in addressing difficult, real world challenges. Previous research into electronic brainstorming has largely been limited to laboratory experiments using small groups of students answering questions irrelevant to an industrial setting. The proposed experiment attempts to extend current findings to real-world employees and organization-relevant challenges. Our employees will brainstorm ideas over the course of several days, echoing the real-world scenario in an industrial setting. The methodology and hypotheses to be tested are presented along with two questions for the experimental brainstorming sessions. One question has been used in prior work and will allow calibration of the new results with existing work. The second question qualifies as a complicated, perhaps even wickedly hard, question, with relevance to modern management practices

Brainstorming under constraints: why software developers brainstorm in groups

Group brainstorming is widely adopted as a design method in the domain of software development. However, existing brainstorming literature has consistently proven group brainstorming to be ineffective under the controlled laboratory settings. Yet, electronic brainstorming systems informed by the results of these prior laboratory studies have failed to gain adoption in the field because of the lack of support for group well-being and member support. Therefore, there is a need to better understand brainstorming in the field. In this work, we seek to understand why and how brainstorming is actually practiced, rather than how brainstorming practices deviate from formal brainstorming rules, by observing brainstorming meetings at Microsoft. The results of this work show that, contrary to the conventional brainstorming practices, software teams at Microsoft engage heavily in the constraint discovery process in their brainstorming meetings. We identified two types of constraints that occur in brainstorming meetings. Functional constraints are requirements and criteria that define the idea space, whereas practical constraints are limitations that prioritize the proposed solutions

Identifying Quality, Novel, and Creative Ideas: Constructs and Scales for Idea Evaluation

Researchers and practitioners have an abiding interest in improving tools and methods to support idea generation. In studies that go beyond merely enumerating ideas, researchers typically select one or more of the following three constructs, which are often operationalized as the dependent variable(s): 1) idea quality, 2) idea novelty, which is sometimes referred to as rarity or unusualness, and 3) idea creativity. It has been chronically problematic to compare findings across studies because these evaluation constructs have been variously defined and the constructs have been sampled in different ways. For example, some researchers term an idea \u27creative\u27 if it is novel, while others consider an idea to be creative only if it is also applicable, effective, and implementable. This paper examines 90 studies on creativity and idea generation. Within the creativity studies considered here, the novelty of ideas was always measured, but in some cases the ideas had to also meet additional requirements to be considered creative. Some studies that examined idea quality also assessed novelty, while others measured different quality attributes, such as effectiveness and implementability, instead. This paper describes a method for evaluating ideas with regard to four dimensions--novelty, workability, relevance, and specificity--and has identified two measurable sub-dimensions for each of the four main dimensions. An action-research approach was used to develop ordinal scales anchored by clearly differentiable descriptions for each sub-dimension. Confirmatory factor analysis revealed high loadings among the sub-dimensions that comprise each dimension as well as high discriminant validity between dimensions. Application of this method resulted in high inter-rater reliability even when the method was applied by different raters to different problems and to ideas produced by both manual methods and group support systems (GSS)