Countering method bias in questionnaire-based user studies

Purpose - This paper seeks to discuss reliability problems associated with questionnaires, commonly employed in library and information science. It aims to focus on the effects of "common method variance" (CMV), which is a form of bias, and ways of countering these effects. Design/methodology/approach - The paper critically reviews the use of existing tools for demonstrating reliability in questionnaire-based studies. In particular, it focuses on Cronbach's alpha, "Harman's single factor test" and Lindell and Whitney's "marker variable" approach. The paper introduces an illustrative case study based on the work on metacognition and web searching. It goes on to make recommendations for researchers considering using a questionnaire-based approach. Findings - CMV is a problem affecting questionnaire-based studies in different disciplines across social and information science. Where questionnaire items are more abstract, CMV has been found to be more of a problem. The widely used Cronbach alpha measure, of the reliability of a questionnaire, may often be affected by CMV. Where method bias dominates the results, a high alpha score may do no more than indicate that the questionnaire consistently allows participants to accede to their biases. "Harman's single factor test" is criticised as lacking sufficient foundation, and it is concluded that it should not be used. The marker variable approach is a useful option but must be applied with caution. Practical implications - A number of practical implications for researchers are drawn. Questionnaire-based work investigating abstract constructs should be assumed to carry a high likelihood of CMV, and therefore should attempt to avoid it and demonstrate the degree of success in this regard. Otherwise, interpretation of the results should assume CMV. A number of approaches to assessing and isolating CMV are discussed. Originality/value - The paper draws attention to a problem that is arguably often overlooked in questionnaire-based studies, namely method bias. It discusses a number of approaches whereby it may be identified and controlled

Method or Madness? Textual analysis in media studies

Scholarly analyses of media have tended to view the media text (e.g. film / programme / article) as the logical site of enquiry. However, this focus on the text has often resulted in a privileging of the text as the locus of meaning. The validity of textual analysis as a research method has increasingly been called into question due to the influence of poststructuralist theories and the critique of textually-based research emerging from the ‘new audience studies’. In this paper I examine the debates surrounding texts, audiences and meanings from a poststructuralist perspective. I argue that the rethinking of subjectivity achieved by discourse theory provides the key to a new conception of textual analysis, which remains a vital and rewarding approach to the study of media and culture

Identity as Theory and Method for Ethnic Studies

The question of identity is fundamental to human life. Who am I, as a biological and psychological being; as a member of a human group with a particular style and history; as a participant in the common human values, perceptions, and processes which transcend any particular group? Ethnic studies should have as its focus the whole human being, articulated in the biological, socio/cultural, and psycho/personal categories, and the methodology for ethnic studies should reflect the process by which people live and move within the named categories. The interaction of people who are self-consciously engaged in exploring their lives biologically, culturally, and personally, and the articulation of the boundaries at which these interactions take place, determines the scope and content of ethnic studies

An Active Instance-based Machine Learning method for Stellar Population Studies

We have developed a method for fast and accurate stellar population parameters determination in order to apply it to high resolution galaxy spectra. The method is based on an optimization technique that combines active learning with an instance-based machine learning algorithm. We tested the method with the retrieval of the star-formation history and dust content in "synthetic" galaxies with a wide range of S/N ratios. The "synthetic" galaxies where constructed using two different grids of high resolution theoretical population synthesis models. The results of our controlled experiment shows that our method can estimate with good speed and accuracy the parameters of the stellar populations that make up the galaxy even for very low S/N input. For a spectrum with S/N=5 the typical average deviation between the input and fitted spectrum is less than 10**{-5}. Additional improvements are achieved using prior knowledge.Comment: 14 pages, 25 figures, accepted by Monthly Notice

Biocompatible parylene neurocages developing a robust method for live neural network studies

We present a refined method and design for fabricating parylene neurocages for in vitro studies of live neural networks. Parylene neurocages are biocompatible and very robust, making them ideally suited for studying the synaptic connections netween individual neurons to gain insight into learning and memory. The neurocage fabrication process is significantly less complex than earlier versions. Previous neurocage designs achieved limited neuronal outgrowth; however, the long-term cell survival rate was 50%

A New Method for Exposing Deposit Feeders to Contaminated Sediments for Food Chain Studies

(excerpt) The ubiquity and refractory nature of certain organic compounds, such as chlorinated pesticides and polychlorinated biphenyls (PCB\u27s), results in their accumulation in aquatic sediments (Holdrinet et al. 1978, Peck et al. 1980, Wang et al. 1979). Their continuous release from this reservoir through physico-chemical and biogenic processes to the overlying water column results in the accumulation of xenobiotic compounds in the food chain

Extraction of Spectral Functions from Dyson-Schwinger Studies via the Maximum Entropy Method

It is shown how to apply the Maximum Entropy Method (MEM) to numerical Dyson-Schwinger studies for the extraction of spectral functions of correlators from their corresponding Euclidean propagators. Differences to the application in lattice QCD are emphasized and, as an example, the spectral functions of massless quarks in cold and dense matter are presented.Comment: 16 pages, 7 figure