Addressing Hidden Imperfections in Online Experimentation

Technology companies are increasingly using randomized controlled trials (RCTs) as part of their development process. Despite having fine control over engineering systems and data instrumentation, these RCTs can still be imperfectly executed. In fact, online experimentation suffers from many of the same biases seen in biomedical RCTs including opt-in and user activity bias, selection bias, non-compliance with the treatment, and more generally, challenges in the ability to test the question of interest. The result of these imperfections can lead to a bias in the estimated causal effect, a loss in statistical power, an attenuation of the effect, or even a need to reframe the question that can be answered. This paper aims to make practitioners of experimentation more aware of imperfections in technology-industry RCTs, which can be hidden throughout the engineering stack or in the design process.Comment: Presented at CODE@MIT 202

Traumatic brain injury in later life increases risk for Parkinson disease

Peer Reviewedhttp://deepblue.lib.umich.edu/bitstream/2027.42/111787/1/ana24396.pd

The associations between serum brain-derived neurotrophic factor, potential confounders, and cognitive decline: A longitudinal study

Brain-derived neurotrophic factor (BDNF) plays a role in the maintenance and function of neurons. Although persons with Alzheimer's disease have lower cortical levels of BDNF, evidence regarding the association between circulating BDNF and cognitive function is conflicting. We sought to determine the correlates of BDNF level and whether BDNF level was prospectively associated with cognitive decline in healthy older adults. We measured serum BDNF near baseline in 912 individuals. Cognitive status was assessed repeatedly with the modified Mini-Mental Status Examination and the Digit Symbol Substitution test over the next 10 years. We evaluated the association between BDNF and cognitive decline with longitudinal models. We also assessed the association between BDNF level and demographics, comorbidities and health behaviors. We found an association between serum BDNF and several characteristics that are also associated with dementia (race and depression), suggesting that future studies should control for these potential confounders. We did not find evidence of a longitudinal association between serum BDNF and subsequent cognitive test trajectories in older adults, although we did identify a potential trend toward a cross-sectional association. Our results suggest that serum BDNF may have limited utility as a biomarker of prospective cognitive decline

Pediatric obesity management in rural clinics in California and the role of telehealth in distance education.

ObjectiveTo determine health care provider needs related to pediatric obesity management in rural California and to explore strategies to improve care through telehealth.MethodsCross-sectional survey of health care providers who treated children and adolescents at 41 rural clinics with existing telehealth connectivity.ResultsMost of the 135 respondents were family physicians at designated rural health clinics serving low-income families. Respondents had practiced in rural areas for an average of 10 years. Most providers rated their self-efficacy in managing pediatric obesity as 2 or 3 on a 5-point scale. The barriers most frequently reported by health care providers were lack of local weight management programs, lack of patient motivation, and lack of family involvement in treatment. Providers reported that the resources they would find most helpful were readily accessible patient education materials, strategies to link patients with community treatment programs and training in brief, focused counseling skills. Three-quarters of providers already used telehealth for distance learning. Providers reported very high interest in participating in continuing education on pediatric obesity delivered by telehealth, specifically Internet communication with specialists, web-based education, and interactive video case-conferencing.ConclusionsRural health care providers face several barriers related to pediatric obesity management. Targeted interventions provided via telehealth to rural health care providers may enhance the care of obese children and adolescents. The results of this study provide directions and priorities for the design of appropriate interventions

Impact of electronic health record clinical decision support on the management of pediatric obesity.

Clinicians vary significantly in their adherence to clinical guidelines for overweight/obesity. This study assessed the impact of electronic health record-based clinical decision support in improving the diagnosis and management of pediatric obesity. The study team programmed a point-of-care alert linked to a checklist and standardized documentation templates to appear during health maintenance visits for overweight/obese children in an outpatient teaching clinic and compared outcomes through medical record reviews of 574 (287 control and 287 intervention) visits. The results demonstrated a statistically significant increase in the diagnosis of overweight/obesity, scheduling of follow-up appointments, frequency of ordering recommended laboratory investigations, and assessment and counseling for nutrition and physical activity. Although clinical guideline adherence increased significantly, it was far from universal. It is unknown if modest improvements in adherence to clinical guidelines translate to improvements in children's health. However, this intervention was relatively easy to implement and produced measurable improvements in health care delivery

Impact of electronic health record clinical decision support on the management of pediatric obesity.

Clinicians vary significantly in their adherence to clinical guidelines for overweight/obesity. This study assessed the impact of electronic health record-based clinical decision support in improving the diagnosis and management of pediatric obesity. The study team programmed a point-of-care alert linked to a checklist and standardized documentation templates to appear during health maintenance visits for overweight/obese children in an outpatient teaching clinic and compared outcomes through medical record reviews of 574 (287 control and 287 intervention) visits. The results demonstrated a statistically significant increase in the diagnosis of overweight/obesity, scheduling of follow-up appointments, frequency of ordering recommended laboratory investigations, and assessment and counseling for nutrition and physical activity. Although clinical guideline adherence increased significantly, it was far from universal. It is unknown if modest improvements in adherence to clinical guidelines translate to improvements in children's health. However, this intervention was relatively easy to implement and produced measurable improvements in health care delivery

Do Family Responsibilities and a Clinical Versus Research Faculty Position Affect Satisfaction with Career and Work–Life Balance for Medical School Faculty?

BackgroundBalancing career and family obligations poses challenges to medical school faculty and contributes to dissatisfaction and attrition from academics. We examined the relationship between family setting and responsibilities, rank, and career and work-life satisfaction for faculty in a large U.S. medical school.MethodsBaseline faculty surveys were analyzed from the first year of a 4-year National Institutes of Health-funded study to evaluate awareness, knowledge, attitudes, and use of family friendly policies and career satisfaction. The study focus was on the impact of family responsibilities and characteristics of the faculty position (rank, clinical vs. nonclinical, and academic series) in multivariate comparisons between primary predictors and outcomes of interest.ResultsBoth clinical and family responsibilities for children under 18 play a major and interacting role in satisfaction with career and work-life balance. Clinical faculty respondents without children at home reported significantly greater career satisfaction and better work-life balance than their nonclinical counterparts. Nonclinical faculty respondents with children reported greater satisfaction and better balance than counterparts without family responsibilities. However, the advantage in career satisfaction and work-life balance for clinical faculty respondents disappeared for those with responsibility for young children. No gender-based differences were noted in the results or across faculty rank for respondents; however, for women, reaching associate professor resulted in greater career satisfaction.ConclusionThis study suggests that both work-related factors and family responsibilities influence satisfaction with career and work-life balance, but the predictors appear to interact in complex and nuanced ways. Further research is needed to delineate more clearly these interactions and to explore other factors that may play important additional roles