Automatic classification of communication logs into implementation stages via text analysis

Abstract Background To improve the quality, quantity, and speed of implementation, careful monitoring of the implementation process is required. However, some health organizations have such limited capacity to collect, organize, and synthesize information relevant to its decision to implement an evidence-based program, the preparation steps necessary for successful program adoption, the fidelity of program delivery, and the sustainment of this program over time. When a large health system implements an evidence-based program across multiple sites, a trained intermediary or broker may provide such monitoring and feedback, but this task is labor intensive and not easily scaled up for large numbers of sites. We present a novel approach to producing an automated system of monitoring implementation stage entrances and exits based on a computational analysis of communication log notes generated by implementation brokers. Potentially discriminating keywords are identified using the definitions of the stages and experts’ coding of a portion of the log notes. A machine learning algorithm produces a decision rule to classify remaining, unclassified log notes. Results We applied this procedure to log notes in the implementation trial of multidimensional treatment foster care in the California 40-county implementation trial (CAL-40) project, using the stages of implementation completion (SIC) measure. We found that a semi-supervised non-negative matrix factorization method accurately identified most stage transitions. Another computational model was built for determining the start and the end of each stage. Conclusions This automated system demonstrated feasibility in this proof of concept challenge. We provide suggestions on how such a system can be used to improve the speed, quality, quantity, and sustainment of implementation. The innovative methods presented here are not intended to replace the expertise and judgement of an expert rater already in place. Rather, these can be used when human monitoring and feedback is too expensive to use or maintain. These methods rely on digitized text that already exists or can be collected with minimal to no intrusiveness and can signal when additional attention or remediation is required during implementation. Thus, resources can be allocated according to need rather than universally applied, or worse, not applied at all due to their cost

Supporting play exploration and early developmental intervention versus usual care to enhance development outcomes during the transition from the neonatal intensive care unit to home: a pilot randomized controlled trial

Background While therapy services may start in the Neonatal Intensive Care Unit (NICU) there is often a gap in therapy after discharge. Supporting Play Exploration and Early Development Intervention (SPEEDI) supports parents, helping them build capacity to provide developmentally supportive opportunities starting in the NICU and continuing at home. The purpose of this single blinded randomized pilot clinical trial was to evaluate the initial efficacy of SPEEDI to improve early reaching and exploratory problem solving behaviors. Methods Fourteen infants born very preterm or with neonatal brain injury were randomly assigned to SPEEDI or Usual Care. The SPEEDI group participated in 5 collaborative parent, therapist, and infant interventions sessions in the NICU (Phase 1) and 5 at home (Phase 2). Parents provided daily opportunities designed to support the infants emerging motor control and exploratory behaviors. Primary outcome measures were assessed at the end of the intervention, 1 and 3 months after the intervention ended. Reaching was assessed with the infant supported in an infant chair using four 30 s trials. The Early Problem Solving Indicator was used to evaluate the frequency of behaviors during standardized play based assessment. Effect sizes are including for secondary outcomes including the Test of Infant Motor Performance and Bayley Scales of Infant and Toddler Development. Results No group differences were found in the duration of toy contact. There was a significant group effect on (F1,8 = 4.04, p = 0.08) early exploratory problem-solving behaviors with infants in the SPEEDI group demonstrating greater exploration with effect sizes of 1.3, 0.6, and 0.9 at the end of the intervention, 1 and 3 months post-intervention. Conclusions While further research is needed, this initial efficacy study showed promising results for the ability of SPEEDI to impact early problem solving behaviors at the end of intervention and at least 3 months after the intervention is over. While reaching did not show group differences, a ceiling effect may have contributed to this finding. This single blinded pilot RCT was registered prior to subject enrollment on 5/27/14 at ClinicalTrials.Gov with number NCT02153736

Influence network linkages across implementation strategy conditions in a randomized controlled trial of two strategies for scaling up evidence-based practices in public youth-serving systems.

BackgroundGiven the importance of influence networks in the implementation of evidence-based practices and interventions, it is unclear whether such networks continue to operate as sources of information and advice when they are segmented and disrupted by randomization to different implementation strategy conditions. The present study examines the linkages across implementation strategy conditions of social influence networks of leaders of youth-serving systems in 12 California counties participating in a randomized controlled trial of community development teams (CDTs) to scale up use of an evidence-based practice.MethodsSemi-structured interviews were conducted with 38 directors, assistant directors, and program managers of county probation, mental health, and child welfare departments. A web-based survey collected additional quantitative data on information and advice networks of study participants. A mixed-methods approach to data analysis was used to create a sociometric data set (n = 176) to examine linkages between treatment and standard conditions.ResultsOf those network members who were affiliated with a county (n = 137), only 6 (4.4%) were directly connected to a member of the opposite implementation strategy condition; 19 (13.9%) were connected by two steps or fewer to a member of the opposite implementation strategy condition; 64 (46.7%) were connected by three or fewer steps to a member of the opposite implementation strategy condition. Most of the indirect steps between individuals who were in different implementation strategy conditions were connections involving a third non-county organizational entity that had an important role in the trial in keeping the implementation strategy conditions separate. When these entities were excluded, the CDT network exhibited fewer components and significantly higher betweenness centralization than did the standard condition network.ConclusionAlthough the integrity of the RCT in this instance was not compromised by study participant influence networks, RCT designs should consider how influence networks may extend beyond boundaries established by the randomization process in implementation studies.Trial registrationNCT00880126

Increasing the Delivery of Preventive Health Services in Public Education

The delivery of prevention services to children and adolescents through traditional healthcare settings is challenging for a variety of reasons. Parent- and community-focused services are typically not reimbursable in traditional medical settings, and personal healthcare services are often designed for acute and chronic medical treatment rather than prevention. To provide preventive services in a setting that reaches the widest population, those interested in public health and prevention often turn to school settings. This paper proposes that an equitable, efficient manner in which to promote health across the life course is to integrate efforts from public health, primary care, and public education through the delivery of preventive healthcare services, in particular, in the education system. Such an integration of systems will require a concerted effort on the part of various stakeholders, as well as a shared vision to promote child health via community and institutional stakeholder partnerships. This paper includes (1) examination of some key system features necessary for delivery of preventive services that improve child outcomes; (2) a review of the features of some common models of school health services for their relevance to prevention services; and (3) policy and implementation strategy recommendations to further the delivery of preventive services in schools. These recommendations include the development of common metrics for health outcomes reporting, facilitated data sharing of these metrics, shared organization incentives for integration, and improved reimbursement and funding opportunities

Combinatorial Markov chains on linear extensions

We consider generalizations of Schuetzenberger's promotion operator on the set L of linear extensions of a finite poset of size n. This gives rise to a strongly connected graph on L. By assigning weights to the edges of the graph in two different ways, we study two Markov chains, both of which are irreducible. The stationary state of one gives rise to the uniform distribution, whereas the weights of the stationary state of the other has a nice product formula. This generalizes results by Hendricks on the Tsetlin library, which corresponds to the case when the poset is the anti-chain and hence L=S_n is the full symmetric group. We also provide explicit eigenvalues of the transition matrix in general when the poset is a rooted forest. This is shown by proving that the associated monoid is R-trivial and then using Steinberg's extension of Brown's theory for Markov chains on left regular bands to R-trivial monoids.Comment: 35 pages, more examples of promotion, rephrased the main theorems in terms of discrete time Markov chain

‘Tackling’ rugby safety through a collective approach

Commitment to seeking an evidence-informed approachWhen it comes to player welfare, Rugby Union governing bodies have committed to seeking and funding an evidence-informed approach. This involves using research to make informed decisions about policy, laws and injury prevention programmes. Over the last decade, a growing body of research has informed player safety, for example, modifications to scrum laws to reduce catastrophic head and neck injuries.1 However, major gaps remain, including tackle research focusing on the women’s game.2A socioecological perspectiveIt is well understood that player welfare, specifically injury prevention, is a complex issue. To effectively address these complexities and make a long-term impact requires a dynamic socioecological approach.3 ,4 An athlete operates within a socioecological structure (individual, interpersonal, organisational, community) that is influenced by a web of inter-related factors and actors, both of which change over time and/or when a factor/actor is modified (figure 1). Typically, injury prevention research will identify player level factors that influence injury risk (risk factors), and aim to modify these factors through behaviour change interventions. However, the socioecological view emphasises understanding contextual factors influencing implementation of such modifications. For example, if the behaviour intervention is a training programme, how much time is available to implement the training programme? Or, is the training programme appropriate for all sexes

How to harness and improve on video analysis for youth rugby player safety: A narrative review

Video analysis is a useful tool for injury surveillance in rugby union. There are few video analysis studies in the professional female game, with most studies published in the male elite/professional settings. Moreover, there is a sparsity of literature in youth rugby settings. The following narrative review outlines the strengths and limitations of the current video analysis literature for injury surveillance in youth rugby union, highlights the importance of video analysis for youth rugby player safety and welfare, and discusses recommendations for using video analysis to inform player safety in youth rugby