Reaching Hard-to-Survey Populations: Mode Choice and Mode Preference

This study assesses the effect of response-mode choices on response rates, and responsemode preferences of hard-to-survey populations: young adults, full-time workers, big city inhabitants, and non-Western immigrants. Using address-based sampling, a stratified sample of 3,496 households was selected. The first group of sample members was contacted face to face and could choose between a CAPI and web response mode. The second group, contacted by telephone, could choose between CATI and web. The third group, contacted by telephone, was randomly allocated to a response mode. Our address-based sampling technique was successful in reaching most of the hard-to-survey groups. Insufficient numbers of non- Western immigrants were reached; therefore this group was excluded from our analyses. In our mixed-effect models, no significant effects on the willingness to participate were found for mode choice. We found that full-time workers and young adults were significantly more likely to choose web over CAPI when contacted face to face

Patients’ views on the implementation of artificial intelligence in radiology:Development and validation of a standardized questionnaire

Objectives The patients’ view on the implementation of artificial intelligence (AI) in radiology is still mainly unexplored territory. The aim of this article is to develop and validate a standardized patient questionnaire on the implementation of AI in radiology. Methods Six domains derived from a previous qualitative study were used to develop a questionnaire, and cognitive interviews were used as pretest method. One hundred fifty-five patients scheduled for CT, MRI, and/or conventional radiography filled out the questionnaire. To find underlying latent variables, we used exploratory factor analysis with principal axis factoring and oblique promax rotation. Internal consistency of the factors was measured with Cronbach’s alpha and composite reliability. Results The exploratory factor analysis revealed five factors on AI in radiology: (1) distrust and accountability (overall, patients were moderately negative on this subject), (2) procedural knowledge (patients generally indicated the need for their active engagement), (3) personal interaction (overall, patients preferred personal interaction), (4) efficiency (overall, patients were ambiguous on this subject), and (5) being informed (overall, scores on these items were not outspoken within this factor). Internal consistency was good for three factors (1, 2, and 3), and acceptable for two (4 and 5). Conclusions This study yielded a viable questionnaire to measure acceptance among patients of the implementation of AI in radiology. Additional data collection with confirmatory factor analysis may provide further refinement of the scale. Key Points • Although AI systems are increasingly developed, not much is known about patients’ views on AI in radiology. • Since it is important that newly developed questionnaires are adequately tested and validated, we did so for a questionnaire measuring patients’ views on AI in radiology, revealing five factors. • Successful implementation of AI in radiology requires assessment of social factors such as subjective norms towards the technology

Do People Favor Artificial Intelligence Over Physicians? A Survey Among the General Population and Their View on Artificial Intelligence in Medicine

Objectives: To investigate the general population's view on artificial intelligence (AI) in medicine with specific emphasis on 3 areas that have experienced major progress in AI research in the past few years, namely radiology, robotic surgery, and dermatology. Methods: For this prospective study, the April 2020 Online Longitudinal Internet Studies for the Social Sciences Panel Wave was used. Of the 3117 Longitudinal Internet Studies For The Social Sciences panel members contacted, 2411 completed the full questionnaire (77.4% response rate), after combining data from earlier waves, the final sample size was 1909. A total of 3 scales focusing on trust in the implementation of AI in radiology, robotic surgery, and dermatology were used. Repeated-measures analysis of variance and multivariate analysis of variance was used for comparison. Results: The overall means show that respondents have slightly more trust in AI in dermatology than in radiology and surgery. The means show that higher educated males, employed or student, of Western background, and those not admitted to a hospital in the past 12 months have more trust in AI. The trust in AI in radiology, robotic surgery, and dermatology is positively associated with belief in the efficiency of AI and these specific domains were negatively associated with distrust and accountability in AI in general. Conclusions: The general population is more distrustful of AI in medicine unlike the overall optimistic views posed in the media. The level of trust is dependent on what medical area is subject to scrutiny. Certain demographic characteristics and individuals with a generally positive view on AI and its efficiency are significantly associated with higher levels of trust in AI

The integrated nuclear medicine and radiology residency program in the Netherlands:strengths and potential areas for improvement according to nuclear medicine physicians and radiologists

PURPOSE: To evaluate the Dutch integrated nuclear medicine and radiology residency program from the perspective of nuclear medicine physicians and radiologists. METHODS: A survey was distributed among nuclear medicine physicians and radiologists in hospitals that participate in the Dutch integrated nuclear medicine and radiology training program. RESULTS: A total of 139 completed questionnaires were included. Nuclear medicine physicians (n = 36) assigned a mean score of 5.7 ± 2.0, and radiologists (n = 103) assigned a mean score of 6.5 ± 2.8 (on a 1-10 scale) to the success of the integrated training program in their hospital. On multiple regression, female gender of the survey participant (B = 2.22, P = 0.034), musculoskeletal radiology as subspecialty of the survey participant (B = 3.36, P = 0.032), and the survey participant's expectancy of resident's ability to handle workload after completion of residency were significantly associated with perceived success of the integrated training program (B = 1.16, P = 0.023). Perceived strengths of the integrated training program included broadening of expertise, a better preparation of future imaging specialists for hybrid imaging, increased efficiency in training residents, and increased efficiency in multidisciplinary meetings. Perceived weaknesses of the integrated training program included reduced exposure to nuclear medicine, less time for research and innovation, and concerns about its international recognition. CONCLUSION: This study provided insights into the experiences of nuclear medicine physicians and radiologists with the Dutch integrated nuclear medicine and radiology residency program, which may be helpful to improve the program and similar residency programs in other countries

Understanding people’s interactions with urban greenspace: Case studies in Eastern Europe

This study explored and compared people’s interactions with urban greenspace (UGS) using case studies in three Eastern European countries – Armenia, Georgia and Ukraine. These countries have experienced radical changes in governance systems and socio-economic structures, characteristic of a transition from planned to market economies. Recently, Armenia, Georgia and Ukraine have been arenas for armed conflicts, which have dramatically heightened instability throughout the region. Urban planners in Eastern Europe therefore urgently need context-relevant knowledge to facilitate the critical work of (re-)building more inclusive, safe, resilient and sustainable cities. An unrestricted, self-selected online survey was used to collect data in 2021–2022. A total of 3573 respondents completed the survey (N = 1142 in Armenia, N = 1069 in Georgia and N = 1362 in Ukraine). We identified 12 key explanatory factors linked to the frequency of people’s interactions with UGS using multiple ordinal logistic regressions. The core findings are: (i) most factors are country-specific; (ii) age of respondents had a large effect on the frequency of UGS use in Armenia and Georgia, where older people were mostly infrequent users of UGS; (iii) those who lived further from UGS or could not access it on foot were less likely to use it often; and (iv) the only common key factor across three countries was that people who ‘do not want’ to use UGS are infrequent users. The study shows that only 10–18% of respondents were satisfied with the UGS availability and quality. Among many constraints related to UGS use, litter in UGS and lack of time were the most mentioned. Large parks were the most preferred types of UGS. Our findings confirm the need for urban planners in Eastern Europe to consider and integrate diverse factors influencing people’s willingness to interact with urban nature. A priority is to understand how to bring infrequent users to UGS, particularly older people in various cultural settings in Eastern European countries

Question-answer sequences in survey interviews

Interaction analysis was used to analyze a total of 14,265 question-answer sequences of (Q-A Sequences) 80 questions that originated from two face-to-face and three telephone surveys. The analysis was directed towards the causes and effects of particular interactional problems. Our results showed that problematic respondent behavior is affected by the questionnaire design, whereas inadequate interviewer behavior is affected by respondent behavior, rather than directly by the questionnaire design. Two surveys used questions for which validating information was available. It appeared that the occurrence of such irregularities of interviewer and respondent behavior was related to the validity of the eventual responses. Explanations for the occurrence of problematic respondent behavior were proposed, concerning both cognitive and conversational factors, related to the wording of questions and response alternatives. © Springer 2006

Just you wait… and fill out this survey. Discussion of the methodological aspects of waiting room surveys

A method commonly used in health care research is the waiting room (WR) survey. While patients are waiting for their appointment, they are asked to complete a questionnaire measuring their attitudes, behaviors and other characteristics. In this paper we synthesize practical guidelines for WR surveys by comparing the method with two similar approaches: public intercept (PI) surveys and drop-off-pick-up (DOPU) surveys. In this comparison we use the Total Survey Error approach Groves (Survey Methodology, Wiley, New York, 2004); (Groves in Public Opinion Quarterly 74(5): 849-879, 2010) and apply it to three case examples in which one of the three surveys is used. We take into account measurement (validity, measurement- and processing error) and representation (coverage-, sampling- and nonresponse error). From our review, we conclude that waiting room surveys, though limited to patients and their caregivers, can provide useful information on patients’ perspective on health care. Response rates in waiting rooms are usually high, but often not even reported. We recommend adjustment for sampling bias by taking into account the number of visits to the hospital per respondent and sample times proportionate to the number of sample members expected on a particular time. These surveys also allow for collection of para-data; i.e., relevant information in the circumstances of a request to participate in survey research, and behavior of surveyors can easily be controlled, or investigated in an experimental design