BlogForever D5.3: User Questionnaires and Reports

This report presents the feedback gathered from third party users during the BlogForever Case Studies. Therefore, the research framework is defined and the case studies results are presented, followed by a summary of conclusions and remarks

The Convergence of Player Experience Questionnaires

Player experience is an important field of digital games research to understand how games influence players. A common way to directly measure players’ reported experiences is through questionnaires. However, the large number of questionnaires currently in use introduces several challenges both in terms of selecting suitable measures and comparing results across studies. In this paper, we review some of the most widely known and used questionnaires and focus on the immersive experience questionnaire (IEQ), the game engagement questionnaire (GEQ), and the player experience of need satisfaction (PENS), with the aim to position each of them in relation to each other. This was done through an online survey, in which we gathered 270 responses from players about their most recent experience of a digital game. Our findings show considerable convergence between these three questionnaires and that there is room to refine them into a more widely applicable measure of general game engagement

Readability and understandability of andrology questionnaires

Objective: Medical questionnaires, which enable collection, comparison and analysis of appropriate data as a means of written communication between a patient and a doctor, must be easily readable, and understandable. Here, we measure the readability and understandability of questionnaires used in andrology and examine the relationship between the educational status of the patients and the understandability of the forms. Material and methods: Seven questionnaires used to diagnose andological diseases were selected from the European Association of Urology guidelines. The number of syllables per word, the number of words in a sentence, and the average word and sentence lengths were calculated for each Turkish validated form. Readability scores were calculated, and closet tests were used to measure the understandability of the texts. Results: Three hundred and twenty-seven male volunteers participated in the study. Two hundred and sixteen of the participants (66%) had a high school or college education. The readability level of the seven forms was determined to be ''Difficult'' or ''Very Difficult,'' and at least a high school education level was required to understand the forms. As education level and monthly income increased, the understandability of the forms increased; as the readability of the forms became more difficult, their understandability decreased (p<0.001). Conclusion: The readability levels of questionnaires used in andrology are well above the reading level of Turkey. Health providers can help patients to fill out forms to increase doctor-patient communication

Shorter Personality Questionnaires—A User's Guide Part 1

In this two part series, James Bywater and Anna Brown summarise some of the issues involved in determining the correct length of assessment in a personality questionnaire (PQ). In the first instalment they discuss the general issues that test designers face, and in the second they cover some more modern solutions to these, with associated disadvantages. It is aimed at practitioners rather than hard core psychometricians and can not be exhaustive. However wherever possible it attempts to distil out practical messages for the audience

Internet Versus Mailed Questionnaires: A Randomized Comparison (2)

BACKGROUND Low response rates among surgeons can threaten the validity of surveys. Internet technologies may reduce the time, effort, and financial resources needed to conduct surveys. OBJECTIVE We investigated whether using Web-based technology could increase the response rates to an international survey. METHODS We solicited opinions from the 442 surgeon–members of the Orthopaedic Trauma Association regarding the treatment of femoral neck fractures. We developed a self-administered questionnaire after conducting a literature review, focus groups, and key informant interviews, for which we used sampling to redundancy techniques. We administered an Internet version of the questionnaire on a Web site, as well as a paper version, which looked similar to the Internet version and which had identical content. Only those in our sample could access the Web site. We alternately assigned the participants to receive the survey by mail (n=221) or an email invitation to participate on the Internet (n=221). Non-respondents in the mail arm received up to three additional copies of the survey, while non-respondents in the Internet arm received up to three additional requests, including a final mailed copy. All participants in the Internet arm had an opportunity to request an emailed Portable Document Format (PDF) version. RESULTS The Internet arm demonstrated a lower response rate (99/221, 45%) than the mail questionnaire arm (129/221, 58%) (absolute difference 13%, 95% confidence interval 4%-22%, P<0.01). CONCLUSIONS. Our Internet-based survey to surgeons resulted in a significantly lower response rate than a traditional mailed survey. Researchers should not assume that the widespread availability and potential ease of Internet-based surveys will translate into higher response rates.Department of Surgery, McMaster University, Hamilton, Ontario, Canad

Questionnaires for Lung Health in Africa across the Life Course.

Respiratory infections remain a leading cause of morbidity and mortality in many low and middle-income countries but non-communicable disease rates are rising fast. Prevalence studies have been primarily symptom-focused, with tools developed in countries in the Global North such as the United States and the United Kingdom. Systematic study in sub-Saharan African populations is necessary to accurately reflect disease risk factors present in these populations. We present tools for such studies, developed as part of the International Multidisciplinary Programme to Address Lung Health and TB in Africa ('IMPALA'), which includes lay representatives. At a preliminary meeting, the adequacy and suitability of existing tools was discussed and a new questionnaire set proposed. Individual questionnaires were developed, and an expert panel considered content and criterion validity. Questionnaires underwent a cross-cultural adaptation process, incorporating translation and contextual 'sense-checking', through the use of pre-established lay focus groups in Malawi, before consensus-approval by project collaborators. The complete set of research questionnaires, providing information on lung health symptoms and a relevant range of potential risk factors for lung disease, is now available online. In developing the tools, cultural and contextual insights were important, as were translational considerations. The process benefitted from a foundation in expert knowledge, starting with validated tools and internationally respected research groups, and from a coordinated collaborative approach. We present and discuss a newly devised, contextually appropriate set of questionnaires for non-communicable lung disease research in Africa that are now available in open access for all to use

Routinely administered questionnaires for depression and anxiety : systematic review

Objectives To examine the effect of routinely administered psychiatric questionnaires on the recognition, management, and outcome of psychiatric disorders in non-psychiatric settings. Data sources Embase, Medline, PsycLIT, Cinahl, Cochrane Controlled Trials Register,and hand searches of key journals. Methods A systematic review of randomised controlled trials of the administration and routine feedback of psychiatric screening and outcome questionnaires to clinicians in non-psychiatric settings. narrative overview of key design features and end points, together with a random effects quantitative synthesis of comparable studies. Main outcome measures Recognition of psychiatric disorders after feedback of questionnaire results; interventions for psychiatric disorders and outcome of psychiatric disorders. Results Nine randomised studies were identified that examined the use of common psychiatric instruments in primary care and general hospital settings. Studies compared the effect of the administration of these instruments followed by the feedback of the results to clinicians, with administration with no feedback. Meta-analytic pooling was possible for four of these studies (2457 participants), which measured the effect of feedback on the recognition of depressive disorders. Routine administration and feedback of scores for all patients (irrespective of score) did not increase the overall rate of recognition of mental disorders such as anxiety and depression (relative risk of detection of depression by clinician after feedback 0.95, 95% confidence interval 0.83 to 1.09). Two studies showed that routine administration followed by selective feedback for only high scores increased the rate of recognition of depression (relative risk of detection of depression after feedback 2.64, 1.62 to 4.31). This increased recognition, however, did not translate into an increased rate of intervention. Overall, studies of routine administration of psychiatric measures did not show an effect on patient outcome. Conclusions The routine measurement of outcome is a costly exercise. Little evidence shows that it is of benefit in improving psychosocial outcomes of those with psychiatric disorder managed in non-psychiatric settings

Questionnaires in clinical trials: guidelines for optimal design and administration.

A good questionnaire design for a clinical trial will minimise bias and maximise precision in the estimates of treatment effect within budget. Attempts to collect more data than will be analysed may risk reducing recruitment (reducing power) and increasing losses to follow-up (possibly introducing bias). The mode of administration can also impact on the cost, quality and completeness of data collected. There is good evidence for design features that improve data completeness but further research is required to evaluate strategies in clinical trials. Theory-based guidelines for style, appearance, and layout of self-administered questionnaires have been proposed but require evaluation