Wheeler, Bradley C.

English

AIS Electronic Library (AISeL)

Association for Information SystemsAIS Electronic Library (AISeL)ICIS 1993 Proceedings International Conference on Information Systems(ICIS)1993PANEL 8 THE RIGHT RESEARCH TASK: ACRITICAL LOOK AT THE TRADEOFFS OFEXPERIMENTAL TASK DIVERSITY IN ISRESEARCHBradley C. WheelerUniversity of Maryland at College ParkFollow this and additional works at: http://aisel.aisnet.org/icis1993This material is brought to you by the International Conference on Information Systems (ICIS) at AIS Electronic Library (AISeL). It has been acceptedfor inclusion in ICIS 1993 Proceedings by an authorized administrator of AIS Electronic Library (AISeL). For more information, please contactelibrary@aisnet.org.Recommended CitationWheeler, Bradley C., "PANEL 8 THE RIGHT RESEARCH TASK: A CRITICAL LOOK AT THE TRADEOFFS OFEXPERIMENTAL TASK DIVERSITY IN IS RESEARCH" (1993). ICIS 1993 Proceedings. 29.http://aisel.aisnet.org/icis1993/29PANEL 8THE RIGHT RESEARCH TASK: A CRITICAL LOOK ATTHE TRADEOFFS OF EXPERIMENTAL TASK DIVERSITYIN IS RESEARCHPanel Chair:' Bradley C. Wheeler, University of Maryland at College ParkPanelists: Izak Benbasat, University of British ColumbiaNancy P. Melone, Carnegie Mellon UniversityK. S. Raman, National University of SingaporeThe objective of this panel is to discuss the critical issue:; of experimental tasks in information systems (IS) research.Creating or selecting an experimental task presents a troubling dilemma for information systems researchers and the IScommunity as a whole. The utility of our research is severely limited when our tasks are unrepresentative of real worldproblems or contain systematic biases toward some cultures or genders. Yet, broad diversity in task selection may impedethe development of a coherent body of knowledge. This represents an important, and all too often, overlooked problem forresearch in the area of technology design and assessment.Specifically, the task confronting a computer user has proven to be a chief moderator of how systems are used. Both thegenerators and consumers of experimental IS research have often criticized the field for our selection of research tasks. Thecriticisms suggest that our experimental tasks have• lacked meaningful context relative to the subject populations.• been biased toward certain genders and cultures,• been too simple or excessively complex,• been ill-suited to the research question.• lacked proper experimental control or been unrepresentative of how systems are really used in organizations,• lacked meaningful measures of assessing perfonnance,• not facilitated useful comparison between studies and across research streams.Are these criticisms valid? If they are, how should they guide our interpretation of past research and shape our selection oftasks for the future?One response has been to use "classic" tasks that are common across many studies. For example, SA&D research hasoften used a task of searching for a known set of errors. Much GSS research has used a value-based task, such as thefoundation task, or an intellective task, such as the campus parking problem. Another response is to use a more diverse mixof tasks.Researchers must make Iradeoffs when selecting or developing an experimental task. The critical choices made at theseuadeoffs pose serious implications for the long-term development of the IS field.The panelists will address lilese criticisms and tradeoffs in the following manner. Fich panelist will identify what she or hesees as the critical issues for selecting or creating experimental tasks.Nancy Melonc will argue that critical issues must balance ci),ilextual realism with experimental control.'Brian E. Mennecke, East Carolina University, coauthored the development of this panel.400Izak Benbasat will contend that control and uniformity across multiple studies is a critical issue if the field of IS research isto build a coherent body of knowledge.K. S. Raman will argue that task diversity is a critical issue if we wish to avoid sowing systematic biases in the field'sevolving body of knowledge.As panel chair, Brad Wheeler will frame the task dilemma and will moderate the discussion. The audience will beencouraged to ask questions and suggest other critical issues which are important for experimental tasks.Attendees will benefit by gaining a better understanding of the critical issues in experimental task design and selection, Thepanel's discussion should also help scholars to understand the tradeoffs associated with experimental tasks when they assessstreams of experimental IS research.401

PANEL 8 THE RIGHT RESEARCH TASK: A CRITICAL LOOK AT THE TRADEOFFS OF EXPERIMENTAL TASK DIVERSITY IN IS RESEARCH

https://aisel.aisnet.org/cgi/viewcontent.cgi?article=1036&amp;context=icis1993

PANEL 8 THE RIGHT RESEARCH TASK: A CRITICAL LOOK AT THE TRADEOFFS OF EXPERIMENTAL TASK DIVERSITY IN IS RESEARCH

Abstract

Similar works

Full text

Available Versions

AIS Electronic Library (AISeL)