Partnership Development Among Mental Health Organizations

Mental health organizations can play a key role in enhancing youths\u27 access to care by working together to bridge gaps in service delivery systems. This dissertation study examines partnerships among a network of children\u27s behavioral health organizations. The specific aims are to (1) describe and understand the network of partnerships among members of the Children\u27s Services Coalition, (2) assess the capacity of the system to provide coordinated service delivery, and (3) test how patterns of organizational characteristics influence conditions that facilitate and inhibit partnerships among the Children\u27s Service Coalition organizations. This dissertation is a predominantly quantitative cross-sectional network study of 36 children\u27s mental health organizations in St. Louis County that are members of the newly formed Children\u27s Services Coalition. Network data on relationships and archival data from IRS 990 forms were collected and used to explain how organizational characteristics might lead certain organizations to partner, but create conditions that simultaneously facilitate and hinder the degree to which organizations partner. Overall, the key findings describe partnership behavior at the network, small-group, and dyadic-level. First, children\u27s behavioral health organizations in the CSC maintain a complex set of partnerships, which are expected to grow as new opportunities emerge. Second, although partnerships are very common, the larger network may not be well coordinated as evidenced by the few systematic partnership patterns uncovered using descriptive network analysis techniques including sub-group analysis and blockmodeling. However there is potential for coordination at the sub-group level among small groups of similar organizations. Finally, at the dyadic-level, results of a path analysis demonstrate how similar competing organizations depend on one another for resources and benefit from their collaboration, which drives partnerships. Results suggest that organizational interests drive partnership development in this network, and bring together competing organizations that provide similar resources potentially as a strategy for managing competition, or creating efficiencies. This trend runs counter to system reform goals for bridging organizations with complementary services to facilitate access to quality care

Defining Service Coordination: A Social Work Perspective

To address fragmentation, social workers are encouraged to “coordinate.” This pilot study explores the meaning of, and factors that facilitate or prevent “coordination” and is intended as a first step toward future conceptual refinement, theory development, and system interventions. Using data from treatment guidelines archived by the National Guideline Clearinghouse (n=9) and semi-structured interviews with social workers (n=4), themes related to the definition, indicators, and perceptions of coordination were explored using a grounded theory approach. Data suggest the need for coordination is driven by complex client needs, but the quality of providers’ personal relationships influence coordination. Future research might examine the impact of standardization of roles, referral procedures, and treatment philosophies

Facilitating mental health service use for caregivers: Referral strategies among child welfare caseworkers

Unmet needs for mental health care are common among caregivers involved in the child welfare system. Although child welfare caseworkers are well positioned to identify service needs and refer caregivers to treatment, little is known about the types of referral strategies used in practice, or their effectiveness for promoting mental health service use. The current study examined child welfare caseworkers’ use of different referral strategies and the extent to which these strategies are associated with caregivers’ receipt of mental health services within a national sample of child welfare cases. Analyses of the second cohort of families from the National Survey of Child and Adolescent Well-Being suggest that child welfare workers more often use informational strategies for referring caregivers, including suggesting treatment or providing information about treatment options. However, social referral strategies such as providing caregivers with direct assistance in completing applications and making and attending appointments were associated with a greater likelihood of caregivers receiving mental health services. Findings support evidence from other service contexts that service use is facilitated by caseworkers’ direct support for arranging services. Implications for research and for child welfare managers and administrators are discussed

Context matters: measuring implementation climate among individuals and groups

Abstract Background It has been noted that implementation climate is positively associated with implementation effectiveness. However, issues surrounding the measurement of implementation climate, or the extent to which organizational members perceive that innovation use is expected, supported and rewarded by their organization remain. Specifically, it is unclear whether implementation climate can be measured as a global construct, whether individual or group-referenced items should be used, and whether implementation climate can be assessed at the group or organizational level. Methods This research includes two cross-sectional studies with data collected via surveys at the individual level. The first study assessed the implementation climate perceptions of physicians participating in the National Cancer Institute’s (NCI) Community Clinical Oncology Program (CCOP), and the second study assessed the perceptions of children’s behavioral health clinicians implementing a treatment innovation. To address if implementation climate is a global construct, we used confirmatory factor analysis. To address how implementation climate should be measured and at what level, we followed a five-step framework outlined by van Mierlo and colleagues. This framework includes exploratory factor analysis and correlations to assess differences between individual and group-referenced items and intraclass correlations, interrater agreements, and exploratory factor analysis to determine if implementation climate can be assessed at the organizational level. Results The confirmatory factor analysis demonstrated that implementation climate is a global construct consisting of items related to expectations, support and rewards. There are mixed results, however, as to whether implementation climate should be measured using individual or group-referenced items. In our first study, where physicians were geographically dispersed and practice independently, there were no differences based on the type of items used, and implementation climate was an individual level construct. However, in the second study, in which clinicians practice in a central location and interact more frequently, group-referenced items may be appropriate. In addition, implementation climate could be considered an organizational level construct. Conclusions The results are context-specific. Researchers should carefully consider the study setting when measuring implementation climate. In addition, more opportunities are needed to validate this measure and understand how well it predicts and explains implementation effectiveness

Advice-seeking during implementation: a network study of clinicians participating in a learning collaborative

Abstract Background Successful implementation depends on the transfer of knowledge and expertise among clinicians, which can occur when professionals seek advice from one another. This study examines advice-seeking patterns among mental health clinicians participating in learning collaboratives (a multi-component implementation and quality improvement strategy) to implement trauma-focused cognitive behavioral therapy (TF-CBT). We apply transactive memory system theory, which explains how professionals access and retrieve knowledge, to examine factors associated with the evolution of advice-seeking relationships during implementation. Our aim is to unpack learning collaboratives’ mechanisms by investigating how and why advice-seeking networks change, which may help us understand how implementation strategies can best target networks. Methods Using social network analysis and a pretest-post-test design, we examined patterns in general and treatment-specific advice-seeking among 146 participants (including five clinical experts) from 27 agencies participating in a regional scale-up of TF-CBT. Surveys were administered in-person at the first and last of three in-person learning sessions (10 months apart) that comprise a core component of learning collaboratives. Participants nominated up to five individuals from whom they seek general and treatment-specific advice. Exponential random graph models (ERGMs) tested the likelihood of maintaining or forming advice-seeking relationships based on indicators of expertise quality, accessibility, need, and prior advice-seeking relationships. Results Participants formed or maintained advice-seeking relationships with those who possess perceived expertise (e.g., learning collaborative faculty experts, supervisors, and those with greater field experience than themselves). Participants also tended to seek advice from those within the same organization and with similar disciplinary training, highlighting the importance of expertise accessibility. Prior relationships and network structural features were associated with advice-seeking, indicating that participants built on existing social ties. Advice-seeking did not vary based on participants’ role or experience. Conclusions Given the importance of accessible clinical expertise and ongoing supervision for delivering treatment with fidelity, learning collaboratives may support implementation by promoting clinicians’ awareness of and access to others’ expertise, especially those with substantial expertise to share (e.g., faculty experts and supervisors). Future controlled studies are needed to verify the effectiveness of learning collaboratives for building networks that connect clinicians and experts and for improving implementation

Child Welfare Workers’ Connectivity to Resources and Youth’s Receipt of Services

Youth involved in the child welfare system are at high risk for mental illness, substance abuse, and other behavioral health issues, which child welfare workers are expected to address through referrals. Child welfare workers (N=27) who participated in Project IMPROVE (Intervention for Multisector Provider Enhancement) reported on services they provided to youth (N=307) in their caseloads. Using survey and administrative data, this paper examines workers’ service actions on behalf of youth. Results were consistent with the Gateway Provider Model and showed that youths received help from a greater variety of service sectors when their workers were able to identify behavioral health problems, and were familiar with and connected to other providers in the community. Improving service delivery to youth in child welfare may be accomplished by training workers in the signs and symptoms of behavioral health problems and familiarizing them with providers in the community

Public health program capacity for sustainability: A new framework

Abstract Background Public health programs can only deliver benefits if they are able to sustain activities over time. There is a broad literature on program sustainability in public health, but it is fragmented and there is a lack of consensus on core constructs. The purpose of this paper is to present a new conceptual framework for program sustainability in public health. Methods This developmental study uses a comprehensive literature review, input from an expert panel, and the results of concept-mapping to identify the core domains of a conceptual framework for public health program capacity for sustainability. The concept-mapping process included three types of participants (scientists, funders, and practitioners) from several public health areas (e.g., tobacco control, heart disease and stroke, physical activity and nutrition, and injury prevention). Results The literature review identified 85 relevant studies focusing on program sustainability in public health. Most of the papers described empirical studies of prevention-oriented programs aimed at the community level. The concept-mapping process identified nine core domains that affect a program’s capacity for sustainability: Political Support, Funding Stability, Partnerships, Organizational Capacity, Program Evaluation, Program Adaptation, Communications, Public Health Impacts, and Strategic Planning. Concept-mapping participants further identified 93 items across these domains that have strong face validity—89% of the individual items composing the framework had specific support in the sustainability literature. Conclusions The sustainability framework presented here suggests that a number of selected factors may be related to a program’s ability to sustain its activities and benefits over time. These factors have been discussed in the literature, but this framework synthesizes and combines the factors and suggests how they may be interrelated with one another. The framework presents domains for public health decision makers to consider when developing and implementing prevention and intervention programs. The sustainability framework will be useful for public health decision makers, program managers, program evaluators, and dissemination and implementation researchers

Eight Characteristics of Rigorous Multilevel Implementation Research: A Step-by-Step Guide

Background Although healthcare is delivered in inherently multilevel contexts, implementation science has no widely endorsed methodological standards defining the characteristics of rigorous, multilevel implementation research. We identify and describe eight characteristics of high-quality, multilevel implementation research to encourage discussion, spur debate, and guide decision-making around study design and methodological issues. Recommendations Implementation researchers who conduct rigorous multilevel implementation research demonstrate the following eight characteristics. First, they map and operationalize the specific multilevel context for defined populations and settings. Second, they define and state the level of each construct under study. Third, they describe how constructs relate to each other within and across levels. Fourth, they specify the temporal scope of each phenomenon at each relevant level. Fifth, they align measurement choices and construction of analytic variables with the levels of theories selected (and hypotheses generated, if applicable). Sixth, they use a sampling strategy consistent with the selected theories or research objectives and sufficiently large and variable to examine relationships at requisite levels. Seventh, they align analytic approaches with the chosen theories (and hypotheses, if applicable), ensuring that they account for measurement dependencies and nested data structures. Eighth, they ensure inferences are made at the appropriate level. To guide implementation researchers and encourage debate, we present the rationale for each characteristic, actionable recommendations for operationalizing the characteristics in implementation research, a range of examples, and references to make the characteristics more usable. Our recommendations apply to all types of multilevel implementation study designs and approaches, including randomized trials, quantitative and qualitative observational studies, and mixed methods. Conclusion These eight characteristics provide benchmarks for evaluating the quality and replicability of multilevel implementation research and promote a common language and reference points. This, in turn, facilitates knowledge generation across diverse multilevel settings and ensures that implementation research is consistent with (and appropriately leverages) what has already been learned in allied multilevel sciences. When a shared and integrated description of what constitutes rigor is defined and broadly communicated, implementation science is better positioned to innovate both methodologically and theoretically

Tracking implementation strategies: a description of a practical approach and early findings

Abstract Background Published descriptions of implementation strategies often lack precision and consistency, limiting replicability and slowing accumulation of knowledge. Recent publication guidelines for implementation strategies call for improved description of the activities, dose, rationale and expected outcome(s) of strategies. However, capturing implementation strategies with this level of detail can be challenging, as responsibility for implementation is often diffuse and strategies may be flexibly applied as barriers and challenges emerge. We describe and demonstrate the development and application of a practical approach to identifying implementation strategies used in research and practice that could be used to guide their description and specification. Methods An approach to tracking implementation strategies using activity logs completed by project personnel was developed to facilitate identification of discrete strategies. This approach was piloted in the context of a multi-component project to improve children’s access to behavioural health services in a county-based child welfare agency. Key project personnel completed monthly activity logs that gathered data on strategies used over 17 months. Logs collected information about implementation activities, intent, duration and individuals involved. Using a consensus approach, two sets of coders categorised each activity based upon Powell et al.’s (Med Care Res Rev 69:123–57, 2012) taxonomy of implementation strategies. Results Participants reported on 473 activities, which represent 45 unique strategies. Initial implementation was characterised by planning strategies followed by educational strategies. After project launch, quality management strategies predominated, suggesting a progression of implementation over time. Together, these strategies accounted for 1594 person-hours, many of which were reported by the leadership team that was responsible for project design, implementation and oversight. Conclusions This approach allows for identifying discrete implementation strategies used over time, estimating dose, describing temporal ordering of implementation strategies, and pinpointing the major implementation actors. This detail could facilitate clear reporting of a full range of implementation strategies, including those that may be less observable. This approach could lead to a more nuanced understanding of what it takes to implement different innovations, the types of strategies that are most useful during specific phases of implementation, and how implementation strategies need to be adaptively applied throughout the course of a given initiative

Collaboration, competition, and co-opetition: Interorganizational dynamics between private child welfare agencies and child serving sectors

Human service agencies are encouraged to collaborate with other public and private agencies in providing services to children and families. However, they also often compete with these same partners for funding, qualified staff, and clientele. Although little is known about complex interagency dynamics of competition and collaboration in the child-serving sector, evidence suggests that competition can undermine collaboration unless managed strategically. This study explores the interrelationship between competition and collaboration, sometimes referred to as “co-opetition.” Using a national dataset of private child and family serving agencies, we examine their relationships with other child serving sectors (N=4460 pair-wise relationships), and explore how variations in patterns of collaboration and competition are associated with several organizational, environmental and relational factors. Results suggest that most relationships between private child welfare agencies and other child serving agencies are characterized by both competition and collaboration (i.e. “co-opetition”), and is most frequently reported with other local private child welfare agencies. Logistic regression analyses indicate that co-opetition is likely to occur when private child welfare agencies have a good perceived relationship or a sub-contract with their partner. Findings have implications for how agency leaders manage partner relationships, and how public child welfare administrators structure contracts