Mixed-method approaches to strengthen economic evaluations in implementation research

Abstract Background Guidance from economic evaluations on which implementation strategies represent the best return on investment will be critical to advancing the Triple Aim of health care: improving patient care and population health while minimizing per-capita cost. The results of traditional (quantitative) economic evaluations are limited by a remaining “qualitative residual” of contextual information and stakeholders perspectives, which cannot be captured by monetary values alone and is particularly prevalent in implementation science research. The emergence of qualitative methods for economic evaluation offers a promising solution. Main body To maximize the contributions of economic evaluations to implementation science, we recommend that researchers embrace a mixed-methods research agenda that merges traditional quantitative approaches with innovative, contextually grounded qualitative methods. Such studies are exceedingly rare at present. To assist implementation scientists in making use of mixed methods in this research context, we present an adapted taxonomy of mixed-method studies relevant to economic evaluation. We then illustrate the application of mixed methods in a recently completed cost-effectiveness evaluation, making use of an adapted version of reporting standards for economic evaluations. Conclusions By incorporating qualitative methods, implementation researchers can enrich their economic evaluations with detailed, context-specific information that tells the full story of the costs and impacts of implementation. We end by providing suggestions for building a research agenda in mixed-method economic evaluation, along with more resources and training to support investigators who wish to answer our call to action.https://deepblue.lib.umich.edu/bitstream/2027.42/146781/1/13012_2018_Article_850.pd

UUnderstanding Program Engagement and Attrition in Child Abuse Prevention

Engaging and retaining families is a common challenge when serving families at high risk. McCurdy and Daro’s (2001) Integrated Theory of Parental Involvement (ITPI) proposes factors that impact engagement and retention in services. While several studies have found varying family demographic and risk factors to be associated with family engagement in home-based services, (withheld citation for purpose of review) identified program and provider characteristics that predicted engagement and retention (withheld citation for purpose of review). Specifically, SafeCare (SC) had greater enrollment (4 times) and retention (8.5 times) rates than services as usual (SAU), likely due to SC’s skill-based approach targeting desired topics. As a follow-up to this quantitative study, we conducted separate focus groups with parents who engaged and who failed to engage in SC (N= 16) and SAU (N=18). Provider characteristics (e.g., caring, experienced with children, nonjudgmental) was the strongest themes for engagement across groups. Program and provider flexibility and providers’ persistent support for parents despite life chaos facilitated retention. Results suggest that provider characteristics and program approach are key in engagement of families in home-based services. These results suggest expansion of the ITPI to address social context. Results suggestfocusing on specific provider characteristics and program approach for work force and program development to increase program engagement and decrease attrition

Barriers to Accessing Treatment Services: Child Victims of Youths with Problematic Sexual Behavior

Child sexual abuse (CSA) remains a significant public health problem. Although the deleterious effects on the child victims could be mitigated through evidence-based interventions, victims often fail to be identified and receive clinical assessment and therapy services, particularly when they have been victimized by another youth. Given that at least a third of CSA cases are committed by another youth, understanding the process of identifying and addressing the needs of CSA victims of youth is the focus of the present study. Factors impacting services for child victims of youths with problematic sexual behavior (PSB) were examined through qualitative interviews (N = 226) with mental health agency administrators, direct service providers, and community stakeholders from eight geographically diverse communities across the United States. Responses focused on macro and micro level barriers to the identification and service provision for child victims of PSB of youths. Implications for clinicians and policymakers are discussed, along with strategies to enhance access and provision of services to meet the needs of the child victims

Parenting Challenges and Opportunities among Families Living in Poverty

Poverty-related stressors have been found to impact parenting behaviors which can result in adverse outcomes for children. The current qualitative study focused on understanding the challenges of caregivers (N = 70) living in poverty. The sample was diverse and included mothers, fathers, and grandparents raising grandchildren. Stories of caregivers were gathered to improve the understanding of families living in poverty in an effort to work towards changing how our world supports families that are vulnerable. Results indicate that families experiencing poverty and related risk factors experience challenges in the realm of child safety, education, and racism/prejudice. Families also discussed ways to improve their environment which included increased financial resources, increased access to high-quality healthcare and childcare, and positive environmental change. Note that the current study outlines the complexity of parenting in poverty and that associated challenges are intertwined. Recommendations are made to address systemic barriers at the individual and community level in an effort to better support caregivers experiencing adversity and parenting in the 21st century

Best Practices for Engaging Pregnant and Postpartum Women at Risk of Substance Use in Longitudinal Research Studies: a Qualitative Examination of Participant Preferences

There are significant barriers in engaging pregnant and postpartum women that are considered high-risk (e.g., those experiencing substance use and/or substance use disorders (SUD)) into longitudinal research studies. To improve recruitment and retention of this population in studies spanning from the prenatal period to middle childhood, it is imperative to determine ways to improve key research engagement factors. The current manuscript uses a qualitative approach to determine important factors related to recruiting, enrolling, and retaining high-risk pregnant and postpartum women. The current sample included 41 high-risk women who participated in focus groups or individual interviews. All interviews were analyzed to identify broad themes related to engaging high-risk pregnant and parenting women in a 10-year longitudinal research project. Themes were organized into key engagement factors related to the following: (1) recruitment strategies, (2) enrollment, and (3) retention of high-risk pregnant and parenting women in longitudinal research studies. Results indicated recruitment strategies related to ideal recruitment locations, material, and who should share research study information with high-risk participants. Related to enrollment, key areas disclosed focused on enrollment decision-making, factors that create interest in joining a research project, and barriers to joining a longitudinal research study. With regard to retention, themes focused on supports needed to stay in research, barriers to staying in research, and best ways to stay in contact with high-risk participants. Overall, the current qualitative data provide preliminary data that enhance the understanding of a continuum of factors that impact engagement of high-risk pregnant and postpartum women in longitudinal research with current results indicating the need to prioritize recruitment, enrollment, and retention strategies in order to effectively engage vulnerable populations in research

Best Practices for Engaging Pregnant and Postpartum Women at Risk of Substance Use in Longitudinal Research Studies: a Qualitative Examination of Participant Preferences.

There are significant barriers in engaging pregnant and postpartum women that are considered high-risk (e.g., those experiencing substance use and/or substance use disorders (SUD)) into longitudinal research studies. To improve recruitment and retention of this population in studies spanning from the prenatal period to middle childhood, it is imperative to determine ways to improve key research engagement factors. The current manuscript uses a qualitative approach to determine important factors related to recruiting, enrolling, and retaining high-risk pregnant and postpartum women. The current sample included 41 high-risk women who participated in focus groups or individual interviews. All interviews were analyzed to identify broad themes related to engaging high-risk pregnant and parenting women in a 10-year longitudinal research project. Themes were organized into key engagement factors related to the following: (1) recruitment strategies, (2) enrollment, and (3) retention of high-risk pregnant and parenting women in longitudinal research studies. Results indicated recruitment strategies related to ideal recruitment locations, material, and who should share research study information with high-risk participants. Related to enrollment, key areas disclosed focused on enrollment decision-making, factors that create interest in joining a research project, and barriers to joining a longitudinal research study. With regard to retention, themes focused on supports needed to stay in research, barriers to staying in research, and best ways to stay in contact with high-risk participants. Overall, the current qualitative data provide preliminary data that enhance the understanding of a continuum of factors that impact engagement of high-risk pregnant and postpartum women in longitudinal research with current results indicating the need to prioritize recruitment, enrollment, and retention strategies in order to effectively engage vulnerable populations in research

Best Practices for Engaging Pregnant and Postpartum Women at Risk of Substance Use in Longitudinal Research Studies: a Qualitative Examination of Participant Preferences

There are significant barriers in engaging pregnant and postpartum women that are considered high-risk (e.g., those experiencing substance use and/or substance use disorders (SUD)) into longitudinal research studies. To improve recruitment and retention of this population in studies spanning from the prenatal period to middle childhood, it is imperative to determine ways to improve key research engagement factors. The current manuscript uses a qualitative approach to determine important factors related to recruiting, enrolling, and retaining high-risk pregnant and postpartum women. The current sample included 41 high-risk women who participated in focus groups or individual interviews. All interviews were analyzed to identify broad themes related to engaging high-risk pregnant and parenting women in a 10-year longitudinal research project. Themes were organized into key engagement factors related to the following: (1) recruitment strategies, (2) enrollment, and (3) retention of high-risk pregnant and parenting women in longitudinal research studies. Results indicated recruitment strategies related to ideal recruitment locations, material, and who should share research study information with high-risk participants. Related to enrollment, key areas disclosed focused on enrollment decision-making, factors that create interest in joining a research project, and barriers to joining a longitudinal research study. With regard to retention, themes focused on supports needed to stay in research, barriers to staying in research, and best ways to stay in contact with high-risk participants. Overall, the current qualitative data provide preliminary data that enhance the understanding of a continuum of factors that impact engagement of high-risk pregnant and postpartum women in longitudinal research with current results indicating the need to prioritize recruitment, enrollment, and retention strategies in order to effectively engage vulnerable populations in research