A Meta-Analysis of Survey-Based Research in MIS Field from 1992-2006

Survey research is among the most common methodologies employed in MIS research. However there is an increasing concern over the rigor of research method in MIS field. Based on a review and comparative analysis of the literature this paper provides a critical analysis of trends in the conduct of survey research in the MIS field. Some 651 survey-based studies reported in three leading MIS journals between 1992 and 2006 are reviewed. The finding indicate that there has been an over-reliance on the conduct of cross-sectional studies whereas more emphasis on the use of longitudinal studies would have been appropriate. In terms of unit of analysis, most of the articles reviewed had focused on the individual leading to some concern about potential mismatch between respondents and the unit of analysis

AN ASSESSMENT OF THE CONTINGENCY THEORY OF MIS

The purpose of this paper is to define and critique the use of contingency theory in the field of Management Information Systems (MIS). The existence of such a theory is demonstrated through a detailed review of the MIS literature. The development of contingency theory in MIS is compared to the development of Organization Theory. The developments in the two fields have been remarkably similar and the field of MIS can benefit from the experiences of organization theorists. We argue that since MIS is at an early stage of development, it is now repeating some of the unproductive assumptions and lines of development of contingency theory. The conclusion from this analysis is that the contingency theory implicit in MIS research is inadequate. Progress in the field has been hampered by the adoption of a naive meta-theory and a narrow research perspective. This has resulted in highly mixed empirical results, a premature quantification strategy, and ill-defined concepts of performance and fit. A series of recommendations for improving the theoretical basis of MIS are given. These recommendations include relaxing the assumptions that constitute the naive meta-theory of a contingency theory in MIS. A more subjectivist, less functional, less unreflexive and less deterministic approach is advocated. In addition, changes in research methodologies are recommended. An increased emphasis on training in case study methodologies, longitudinal research and ethnographic approaches is suggested.Information Systems Working Papers Serie

Prediction Markets: A Systematic Review and Meta-Analysis

Prediction markets (PM) have drawn considerable attention in recent years as a tool for forecasting events. Studies surveying and examining relevant the trends of PM using traditional approaches have been reported in the literature. However, research using meta-analysis to review Prediction markets systems is very limited in Management Information System (MIS). This paper aimed to fill this gap by using Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) method to study Prediction markets trends over the past decades. Our results are as follows. First, we find that shows that more than 64% of academic studies on Prediction markets are published in top journals such as Journal of the Association for Information Systems, Journal of Consumer Research and Information Systems Research. Second, we showed that Prediction markets applications can be can be divided into two groups: internal use PMS and general public usage. Finally, our significant meta-analysis result show that on average prediction markets is 79% more accurate than alternative forecast methods based

Lessons from the Trenches of Metatriangulation Research

In this paper we describe our application of a relatively untried research approach called metatriangulation. Metatriangulation is a three-phased, qualitative meta-analysis process that may be used to explore variations in the assumptions of alternative paradigms, gain insights into these multiple paradigms, and address emerging themes and the resulting theories. In applying this method we encountered difficulties in selecting a sample, in reaching agreement among coders, and in our attempts to build theory from our results. From our experiences we developed a modified version of the metatriangulation method. We did find metatriangulation to be an excellent tool in understanding theoretical perspectives in MIS research and believe the use of our modified method will aid future researchers in this pursuit

Brief motivational interventions for college student drinking may not be as powerful as we think: An individual participant-level data meta-analysis

Background For over two decades, brief motivational interventions (BMIs) have been implemented on college campuses to reduce heavy drinking and related negative consequences. Such interventions include in-person motivational interviews (MIs), often incorporating personalized feedback (PF), and stand-alone PF interventions delivered via mail, computer, or the Web. Both narrative and meta-analytic reviews using aggregate data from published studies suggest at least short-term efficacy of BMIs, although overall effect sizes have been small. Method The present study was an individual participant-level data (IPD) meta-analysis of 17 randomized clinical trials evaluating BMIs. Unlike typical meta-analysis based on summary data, IPD meta-analysis allows for an analysis that correctly accommodates the sampling, sample characteristics, and distributions of the pooled data. In particular, highly skewed distributions with many zeroes are typical for drinking outcomes, but have not been adequately accounted for in existing studies. Data are from Project INTEGRATE, one of the largest IPD meta-analysis projects to date in alcohol intervention research, representing 6,713 individuals each with two to five repeated measures up to 12 months post-baseline. Results We used Bayesian multilevel over-dispersed Poisson hurdle models to estimate intervention effects on drinks per week and peak drinking, and Gaussian models for alcohol problems. Estimates of overall intervention effects were very small and not statistically significant for any of the outcomes. We further conducted post hoc comparisons of three intervention types (Individual MI with PF, PF only, and Group MI) vs. control. There was a small, statistically significant reduction in alcohol problems among participants who received an individual MI with PF. Short-term and long-term results were similar. Conclusions The present study questions the efficacy and magnitude of effects of BMIs for college drinking prevention and intervention and suggests a need for the development of more effective intervention strategies

Nägemistaju automaatsete protsesside eksperimentaalne uurimine

Väitekirja elektrooniline versioon ei sisalda publikatsiooneVäitekiri keskendub nägemistaju protsesside eksperimentaalsele uurimisele, mis on suuremal või vähemal määral automaatsed. Uurimistöös on kasutatud erinevaid eksperimentaalseid katseparadigmasid ja katsestiimuleid ning nii käitumuslikke- kui ka ajukuvamismeetodeid. Esimesed kolm empiirilist uurimust käsitlevad liikumisinformatsiooni töötlust, mis on evolutsiooni käigus kujunenud üheks olulisemaks baasprotsessiks nägemistajus. Esmalt huvitas meid, kuidas avastatakse liikuva objekti suunamuutusi, kui samal ajal toimub ka taustal liikumine (Uurimus I). Nägemistaju uurijad on pikka aega arvanud, et liikumist arvutatakse alati mõne välise objekti või tausta suhtes. Meie uurimistulemused ei kinnitanud taolise suhtelise liikumise printsiibi paikapidavust ning toetavad pigem seisukohta, et eesmärkobjekti liikumisinformatsiooni töötlus on automaatne protsess, mis tuvastab silma põhjas toimuvaid nihkeid, ja taustal toimuv seda eriti ei mõjuta. Teise uurimuse tulemused (Uurimus II) näitasid, et nägemissüsteem töötleb väga edukalt ka seda liikumisinformatsiooni, millele vaatleja teadlikult tähelepanu ei pööra. See tähendab, et samal ajal, kui inimene on mõne tähelepanu hõlmava tegevusega ametis, suudab tema aju taustal toimuvaid sündmusi automaatselt registreerida. Igapäevaselt on inimese nägemisväljas alati palju erinevaid objekte, millel on erinevad omadused, mistõttu järgmiseks huvitas meid (Uurimus III), kuidas ühe tunnuse (antud juhul värvimuutuse) töötlemist mõjutab mõne teise tunnusega toimuv (antud juhul liikumiskiiruse) muutus. Näitasime, et objekti liikumine parandas sama objekti värvimuutuse avastamist, mis viitab, et nende kahe omaduse töötlemine ajus ei ole päris eraldiseisev protsess. Samuti tähendab taoline tulemus, et hoolimata ühele tunnusele keskendumisest ei suuda inimene ignoreerida teist tähelepanu tõmbavat tunnust (liikumine), mis viitab taas kord automaatsetele töötlusprotsessidele. Neljas uurimus keskendus emotsionaalsete näoväljenduste töötlusele, kuna need kannavad keskkonnas hakkamasaamiseks vajalikke sotsiaalseid signaale, mistõttu on alust arvata, et nende töötlus on kujunenud suuresti automaatseks protsessiks. Näitasime, et emotsiooni väljendavaid nägusid avastati kiiremini ja kergemini kui neutraalse ilmega nägusid ning et vihane nägu tõmbas rohkem tähelepanu kui rõõmus (Uurimus IV). Väitekirja viimane osa puudutab visuaalset lahknevusnegatiivsust (ingl Visual Mismatch Negativity ehk vMMN), mis näitab aju võimet avastada automaatselt erinevusi enda loodud mudelist ümbritseva keskkonna kohta. Selle automaatse erinevuse avastamise mehhanismi uurimisse andsid oma panuse nii Uurimus II kui Uurimus IV, mis mõlemad pakuvad välja tõendusi vMMN tekkimise kohta eri tingimustel ja katseparadigmades ning ka vajalikke metodoloogilisi täiendusi. Uurimus V on esimene kogu siiani ilmunud temaatilist teadustööd hõlmav ülevaateartikkel ja metaanalüüs visuaalsest lahknevusnegatiivsusest psühhiaatriliste ja neuroloogiliste haiguste korral, mis panustab oluliselt visuaalse lahknevusnegatiivsuse valdkonna arengusse.The research presented and discussed in the thesis is an experimental exploration of processes in visual perception, which all display a considerable amount of automaticity. These processes are targeted from different angles using different experimental paradigms and stimuli, and by measuring both behavioural and brain responses. In the first three empirical studies, the focus is on motion detection that is regarded one of the most basic processes shaped by evolution. Study I investigated how motion information of an object is processed in the presence of background motion. Although it is widely believed that no motion can be perceived without establishing a frame of reference with other objects or motion on the background, our results found no support for relative motion principle. This finding speaks in favour of a simple and automatic process of detecting motion, which is largely insensitive to the surrounding context. Study II shows that the visual system is built to automatically process motion information that is outside of our attentional focus. This means that even if we are concentrating on some task, our brain constantly monitors the surrounding environment. Study III addressed the question of what happens when multiple stimulus qualities (motion and colour) are present and varied, which is the everyday reality of our visual input. We showed that velocity facilitated the detection of colour changes, which suggests that processing motion and colour is not entirely isolated. These results also indicate that it is hard to ignore motion information, and processing it is rather automatically initiated. The fourth empirical study focusses on another example of visual input that is processed in a rather automatic way and carries high survival value – emotional expressions. In Study IV, participants detected emotional facial expressions faster and more easily compared with neutral facial expressions, with a tendency towards more automatic attention to angry faces. In addition, we investigated the emergence of visual mismatch negativity (vMMN) that is one of the most objective and efficient methods for analysing automatic processes in the brain. Study II and Study IV proposed several methodological gains for registering this automatic change-detection mechanism. Study V is an important contribution to the vMMN research field as it is the first comprehensive review and meta-analysis of the vMMN studies in psychiatric and neurological disorders

Efficacy of musical interventions on social, maladaptive and language outcomes in children with autism spectrum disorder, a systematic review and meta-analysis

Un nombre croissant d’études indique que les interventions musicales (IMs) ont des effets bénéfiques sur les enfants et adolescents atteints d’un trouble du spectre de l’autisme (TSA). À ce jour, aucune revue systématique utilisant une approche méta-analytique n’a investigué l’efficacité des IMs sur trois des symptômes prédominants du TSA, soit le fonctionnement social, les comportements mal-adaptés et le langage. Dans ce mémoire, tous les 17 articles scientifiques comparant les IMs à des interventions non-musicales (INMs) ont été décrits systématiquement et évalués selon les lignes directrices de CONSORT. Onze études répondaient aux critères d’inclusion des présentes méta-analyses, chacune rapportant des mesures d’évaluations longitudinales ou d’évaluations pendant les sessions. Les résultats des méta-analyses ont démontré un bénéfice des IMs chez le TSA, particulièrement pour les mesures des comportements sociaux mal-adaptés. Une comparaison entre les IMs et les INMs indiquait un avantage pour les IMs comparément aux INMs en ce qui concerne les comportements sociaux, mais aucun avantage pour les comportements mal-adaptés non-sociaux et le langage. La revue systématique a révélé des lacunes méthodologiques des études évaluées, telles que des tailles d’échantillons restreintes, des durées et intensités d’interventions limitées, un manque d’information à propos des échantillons et des critères d’appariement, puis le biais d’attrition. La combinaison de cette revue systématique et des méta-analyses a permis une mise à jour de l’évaluation des preuves de l’efficacité des IMs pour les jeunes ayant un TSA, ainsi que de donner des recommandations aux chercheurs et cliniciens afin d’améliorer la pratique dans ce domaine.There is considerable interest in using music interventions (MIs) to address core impairments present in children and adolescents with autism spectrum disorder (ASD). An increasing number of studies suggest that MIs have positive outcomes in this population, but no systematic review employing meta-analysis to date has investigated the efficacy of MIs across three of the predominant symptoms in ASD, specifically social functioning, maladaptive behaviors and language impairments. In this thesis, all available peer-reviewed studies (n = 17) comparing active MIs to non-music interventions (NMIs) were systematically summarized and evaluated using quality assessment based on the CONSORT statement. Eleven studies fulfilled inclusion criteria for meta-analysis, which differentiated between within-session and longitudinal outcomes. The quantitative analyses results supported the effectiveness of MI in ASD, and particularly for measures sensitive to social maladaptive behaviors. Comparing between MI and NMI, the results were generally suggestive of benefits of MI over NMI for social outcomes, but did not find benefits for non-social maladaptive behaviors or language outcomes. The systematic review revealed important methodological issues present in these studies, such as small sample sizes, restricted durations and intensities of interventions, missing sample information and matching criteria, and attrition bias. Together, the combined systematic review and meta-analyses provided an up-to-date evaluation of the evidence for MI’s benefits in ASD children and provide key recommendations for future clinical interventions and research about best practice in the domain

Classification of information systems research revisited: A keyword analysis approach

A number of studies have previously been conducted on keyword analysis in order to provide a comprehensive scheme to classify information systems (IS) research. However, these studies appeared prior to 1994, and IS research has clearly developed substantially since then with the emergence of areas such as electronic commerce, electronic government, electronic health and numerous others. Furthermore, the majority of European IS outlets - such as the European Journal of Information Systems and Information Systems Journal - were founded in the early 1990s, and keywords from these journals were not included in any previous work. Given that a number of studies have raised the issue of differences in European and North American IS research topics and approaches, it is arguable that any such analysis must consider sources from both locations to provide a representative and balanced view of IS classification. Moreover, it has also been argued that there is a need for further work in order to create a comprehensive keyword classification scheme reflecting the current state of the art. Consequently, the aim of this paper is to present the results of a keyword analysis utilizing keywords appearing in major peer-reviewed IS publications after the year 1990 through to 2007. This aim is realized by means of the two following objectives: (1) collect all keywords appearing in 24 peer reviewed IS journals after 1990; and (2) identify keywords not included in the previous IS keyword classification scheme. This paper also describes further research required in order to place new keywords in appropriate IS research categories. The paper makes an incremental contribution toward a contemporary means of classifying IS research. This work is important and useful for researchers in understanding the area and evolution of the IS field and also has implications for improving information search and retrieval activities

Journal Rakings 2008: A Synthesis of Studies

New journal rankings studies seem to be almost as prevalent as new MIS journals, recently. As doctoral students in our field become new colleagues and approach the publication process for tenure and promotion, they are in need of guidance in the selection of publication outlets at which to target their work as emerging scholars. Moreover, our colleagues in IS frequently publish in allied disciplines, and can benefit from guidance on the relative rankings of non-IS journals for use in their evaluation and promotions processes. In the past 5 years, numerous articles presenting alternative journal ranking schemes have been published, yet there are often contradictions and oversights between individual studies, with little attempt to synthesize between various ranking schemes, and across related disciplines of research. With the burgeoning number of ISrelated and IS-friendly research journals, a clear need exists for a synthesis across ranking studies in order to provide a broadly consistent and converged listing of journals suitable for the interdisciplinary IS researcher’s publication requirements. This study provides this synthesis, combining in an informal meta-analysis the results of the leading journal rankings in recent years, using the degree of agreement and consistency between ranking studies for determining relative rankings of journals across a variety of fields