Methods for evaluating dropout attrition in survey data

As researchers increasingly use web-based surveys, the ease of dropping out in the online setting is a growing issue in ensuring data quality. One theory is that dropout or attrition occurs in phases that can be generalized to phases of high dropout and phases of stable use. In order to detect these phases, several methods are explored. First, existing methods and user-specified thresholds are applied to survey data where significant changes in the dropout rate between two questions is interpreted as the start or end of a high dropout phase. Next, survey dropout is considered as a time-to-event outcome and tests within change-point hazard models are introduced. Performance of these change-point hazard models is compared. Finally, all methods are applied to survey data on patient cancer screening preferences, testing the null hypothesis of no phases of attrition (no change-points) against the alternative hypothesis that distinct attrition phases exist (at least one change-point)

Identifying Attrition Phases in Survey Data: Applicability and Assessment Study

Background: Although Web-based questionnaires are an efficient, increasingly popular mode of data collection, their utility is often challenged by high participant dropout. Researchers can gain insight into potential causes of high participant dropout by analyzing the dropout patterns. Objective: This study proposed the application of and assessed the use of user-specified and existing hypothesis testing methods in a novel setting—survey dropout data—to identify phases of higher or lower survey dropout. Methods: First, we proposed the application of user-specified thresholds to identify abrupt differences in the dropout rate. Second, we proposed the application of 2 existing hypothesis testing methods to detect significant differences in participant dropout. We assessed these methods through a simulation study and through application to a case study, featuring a questionnaire addressing decision-making surrounding cancer screening. Results: The user-specified method set to a low threshold performed best at accurately detecting phases of high attrition in both the simulation study and test case application, although all proposed methods were too sensitive. Conclusions: The user-specified method set to a low threshold correctly identified the attrition phases. Hypothesis testing methods, although sensitive at times, were unable to accurately identify the attrition phases. These results strengthen the case for further development of and research surrounding the science of attrition

Methods for Evaluating Respondent Attrition in Web-Based Surveys

Background: Electronic surveys are convenient, cost effective, and increasingly popular tools for collecting information. While the online platform allows researchers to recruit and enroll more participants, there is an increased risk of participant dropout in Web-based research. Often, these dropout trends are simply reported, adjusted for, or ignored altogether. Objective: To propose a conceptual framework that analyzes respondent attrition and demonstrates the utility of these methods with existing survey data. Methods: First, we suggest visualization of attrition trends using bar charts and survival curves. Next, we propose a generalized linear mixed model (GLMM) to detect or confirm significant attrition points. Finally, we suggest applications of existing statistical methods to investigate the effect of internal survey characteristics and patient characteristics on dropout. In order to apply this framework, we conducted a case study; a seventeen-item Informed Decision-Making (IDM) module addressing how and why patients make decisions about cancer screening. Results: Using the framework, we were able to find significant attrition points at Questions 4, 6, 7, and 9, and were also able to identify participant responses and characteristics associated with dropout at these points and overall. Conclusions: When these methods were applied to survey data, significant attrition trends were revealed, both visually and empirically, that can inspire researchers to investigate the factors associated with survey dropout, address whether survey completion is associated with health outcomes, and compare attrition patterns between groups. The framework can be used to extract information beyond simple responses, can be useful during survey development, and can help determine the external validity of survey results

Comorbid Medical Conditions as Predictors of Overall Survival in Glioblastoma Patients

Glioblastoma (GBM) is an aggressive central nervous system tumor with a poor prognosis. This study was conducted to determine any comorbid medical conditions that are associated with survival in GBM. Data were collected from medical records of all patients who presented to VCU Medical Center with GBM between January 2005 and February 2015. Patients who underwent surgery/biopsy were considered for inclusion. Cox proportional hazards regression modeling was performed to assess the relationship between survival and sex, race, and comorbid medical conditions. 163 patients met inclusion criteria. Comorbidities associated with survival on individual-characteristic analysis included: history of asthma (Hazard Ratio [HR]: 2.63; 95% Confidence Interval [CI]: 1.24–5.58; p = 0.01), hypercholesterolemia (HR: 1.95; 95% CI: 1.09–3.50; p = 0.02), and incontinence (HR: 2.29; 95% CI: 0.95–5.57; p = 0.07). History of asthma (HR: 2.22; 95% CI: 1.02–4.83; p = 0.04) and hypercholesterolemia (HR: 1.99; 95% CI: 1.11–3.56; p = 0.02) were associated with shorter survival on multivariable analysis. Surgical patients with GBM who had a prior history of asthma or hypercholesterolemia had significantly higher relative risk for mortality on individual-characteristic and multivariable analyses

Prescribing Patterns of Oral Antibiotics and Isotretinoin for Acne in a Colorado Hospital System: Retrospective Cohort Study

BackgroundGuidelines established by the American Academy of Dermatology recommend oral antibiotics as first-line therapy for mild, moderate, and severe acne. However, it is recommended to minimize the duration of oral antibiotic use, and there is increasing support for other systemic agents for acne. ObjectiveWe sought to characterize the use of oral antibiotics and isotretinoin for the treatment of acne in the pediatric and young adult population aged 10 through 20 years and the adult population aged 21 to 45 years from 2011 to 2019. MethodsWe conducted a retrospective, observational cohort study using electronic data from the enterprise data warehouse of the University of Colorado Anschutz Medical Campus and its affiliates, with data in the format of the Observational Health Data Sciences and Informatics (OHDSI) Observational Medical Outcomes Partnership (OMOP) common data model. Categorical values (sex, race, and ethnicity) were compared using chi-square tests, and continuous variables (age) were compared using 2-tailed t tests. ResultsOur cohort of 15,704 patients was composed of mostly White (12,776/15,704, 81.4%), non-Hispanic or Latino (13,307/15,704, 84.7%), and female (11,093/15,704, 70.6%) patients. Among the 4605 male patients in the eligible cohort, 1810 (39%) received an oral antibiotic treatment, in comparison to 3109 (28%) of the 11,093 eligible women (P<.001). Among the 4605 men who were eligible for treatment with isotretinoin in this population, 988 (21.5%) received a course of isotretinoin, compared to only 10.4% (1159/11,093) eligible women (P<.001). Male patients were 1.67 times more likely to have received an antibiotic prescription (odds ratio [OR] 1.67, 95% CI 1.55-1.79) and over twice as likely to have received an isotretinoin prescription (OR 2.34, 95% CI 2.13-2.57) than female patients. ConclusionsMinocycline was the most frequently prescribed antibiotic for the treatment of acne in this study cohort. From 2015 to 2019, there was no significant change in the number of antibiotic prescriptions over time. Men were significantly more likely to receive both oral antibiotics and isotretinoin than female patients. Multiple factors could be contributing to this discrepancy, including the burden of iPLEDGE, additional systemic treatment options for female patients, and the difference in acne severity across sexes. We could not determine the difference in severity of acne between male and female patients in our cohort, and further research is needed to ascertain the variation across sexes

Informed Consent among Clinical Trial Participants with Different Cancer Diagnoses

IMPORTANCE: Informed consent is essential to ethical, rigorous research and is important to recruitment and retention in cancer trials. OBJECTIVE: To examine cancer clinical trial (CCT) participants\u27 perceptions of informed consent processes and variations in perceptions by cancer type. DESIGN AND SETTING AND PARTICIPANTS: Cross-sectional survey from mixed-methods study at National Cancer Institute-designated Northeast comprehensive cancer center. Open-ended and forced-choice items addressed: (1) enrollment and informed consent experiences and (2) decision-making processes, including risk-benefit assessment. Eligibility: CCT participant with gastro-intestinal or genitourinary, hematologic-lymphatic malignancies, lung cancer, and breast or gynecological cancer ( = 334). MAIN OUTCOME MEASURES: Percentages satisfied with consent process and information provided; and assessing participation\u27s perceptions of risks/benefits. Multivariable logistic or ordinal regression examined differences by cancer type. RESULTS: Most patient-participants felt well informed by the consent process (more than 90% overall and by cancer type) and. most (87.4%) reported that the consent form provided all the information they wanted, although nearly half (44.8%) reported that they read the form somewhat carefully or less. More than half (57.9%) said that talking to research staff (i.e., the consent process) had a greater impact on participation decisions than reading the consent form (2.1%). A third (31.1%) were very sure of joining in research studies before the informed consent process (almost half of lung cancer patients did-47.1%). Most patients personally assessed the risks and benefits before consenting. However, trust in physicians played an important role in the decision to enroll in CCT. CONCLUSIONS AND RELEVANCE: Cancer patients rely less on written features of the informed consent process than on information obtained from the research staff and their own physicians. Research should focus on information and communication strategies that support informed consent from referring physicians, researchers, and others to improve patient risk-benefit assessment and decision-making

Association of Perceived Benefit or Burden of Research Participation With Participants\u27 Withdrawal From Cancer Clinical Trials

IMPORTANCE: Attrition in cancer clinical trials (CCTs) can lead to systematic bias, underpowered analyses, and a loss of scientific knowledge to improve treatments. Little attention has focused on retention, especially the role of perceived benefits and burdens, after participants have experienced the trial. OBJECTIVES: To examine the association between patients\u27 perceived benefits and burdens of research participation and CCT retention. DESIGN, SETTING, AND PARTICIPANTS: This survey study was conducted at a National Cancer Institute-designated comprehensive cancer center in the Northeast region of the US. The sample included adult patients with a cancer diagnosis participating in cancer therapeutic trials. Data were collected from September 2015 to June 2019. Analysis of study data was ongoing since November 2019 through October 2022. EXPOSURES: Self-reported validated survey instrument with a list of 22 benefits and 23 burdens of research participation that can be rated by patients with a 5-point Likert scale ranging from 1 (strongly disagree) to 5 (strongly agree). MAIN OUTCOMES AND MEASURES: A primary outcome was actual withdrawal from the CCT, and a composite outcome was composite withdrawal that included both actual withdrawal and thoughts of withdrawing. Bivariate and multivariable logistic regressions were used. RESULTS: Among the 334 participants in the sample, the mean (SD) age was 61.9 (11.5) years and 174 women (52.1%) were included. Top-cited benefits included both aspirational and action-oriented goals, including helping others (94.2%), contributing to society (90.3%), being treated respectfully (86.2%), and hoping for a cure (86.0%). Worry over receiving a placebo (61.3%), rearranging one\u27s life (41.9%), and experiencing bothersome adverse effects (41.6%) were notable burdens. An increased burden score was associated with a higher probability of actual withdrawal (adjusted odds ratio [OR], 1.86; 95% CI, 1.1-3.17; P = .02) or composite withdrawal (adjusted OR, 3.44; 95% CI, 2.09-5.67; P \u3c .001). An increased benefit score was associated with lower composite withdrawal (adjusted OR, 0.40; 95% CI, 0.24-0.66; P \u3c .001). For participants who reported the benefits as being equal to or greater than the burdens, 13.4% withdrew. For those who perceived the benefits as being less than the burdens, 33.3% withdrew (adjusted OR, 3.38; 95% CI, 1.13-10.14; P = .03). The risk of withdrawal was even higher for the composite outcome (adjusted OR, 7.70; 95% CI, 2.76-21.48; P \u3c .001). CONCLUSIONS AND RELEVANCE: This survey study found that patients perceived important benefits from CCT participation, and this perception was associated with trial retention, even among those who also perceived substantial burdens. A broader dialogue among stakeholders can inform an ethical and patient-centric focus on benefits throughout the course of a CCT to increase retention