Dissemination of DOiT

Mechelen, W. van [Promotor]Brug, J. [Promotor]Singh, A.S. [Copromotor]Chin A Paw, J.M.M. [Copromotor

The intervention process in the European Fans in Training (EuroFIT) trial: a mixed method protocol for evaluation

Background - EuroFIT is a gender-sensitised, health and lifestyle program targeting physical activity, sedentary time and dietary behaviours in men. The delivery of the program in football clubs, led by the clubs’ community coaches, is designed to both attract and engage men in lifestyle change through an interest in football or loyalty to the club they support. The EuroFIT program will be evaluated in a multicentre pragmatic randomised controlled trial (RCT), for which ~1000 overweight men, aged 30–65 years, will be recruited in 15 top professional football clubs in the Netherlands, Norway, Portugal and the UK. The process evaluation is designed to investigate how implementation within the RCT is achieved in the various football clubs and countries and the processes through which EuroFIT affects outcomes. Methods - This mixed methods evaluation is guided by the Medical Research Council (MRC) guidance for conducting process evaluations of complex interventions. Data will be collected in the intervention arm of the EuroFIT trial through: participant questionnaires (n = 500); attendance sheets and coach logs (n = 360); observations of sessions (n = 30); coach questionnaires (n = 30); usage logs from a novel device for self-monitoring physical activity and non-sedentary behaviour (SitFIT); an app-based game to promote social support for physical activity outside program sessions (MatchFIT); interviews with coaches (n = 15); football club representatives (n = 15); and focus groups with participants (n = 30). Written standard operating procedures are used to ensure quality and consistency in data collection and analysis across the participating countries. Data will be analysed thematically within datasets and overall synthesis of findings will address the processes through which the program is implemented in various countries and clubs and through which it affects outcomes, with careful attention to the context of the football club. Discussion - The process evaluation will provide a comprehensive account of what was necessary to implement the EuroFIT program in professional football clubs within a trial setting and how outcomes were affected by the program. This will allow us to re-appraise the program’s conceptual base, optimise the program for post-trial implementation and roll out, and offer suggestions for the development and implementation of future initiatives to promote health and wellbeing through professional sports clubs. Trial Registration - ISRCTN81935608. Registered on 16 June 2015

Action 3:30R: Process evaluation of a cluster randomised feasibility study of a revised teaching assistant-led extracurricular physical activity intervention for 8 to 10 year olds

Background: Numerous interventions to increase children's physical activity levels are published, yet, few studies report indicators of external validity. Process evaluations are critical for assessing intervention implementation, sustainability and effectiveness. A mixed-methods process evaluation, using the RE-AIM framework, was conducted to evaluate the internal and external validity of Action 3:30R, a revised teaching assistant-led after-school intervention which aimed to increase physical activity in children aged 8-10 years and was underpinned by Self-determination Theory (SDT). Methods: Data were collected and reported in line with the five components of RE-AIM (Reach, Effectiveness, Adoption, Implementation and Maintenance). Quantitative measures included logbooks, registers and self-reported teaching-efficacy, autonomy support, child enjoyment and perceived exertion questionnaires. Questionnaire data were collected at three points throughout the 15-week intervention. Observations by trained researchers were also conducted to assess fidelity to the intervention manual and its underpinning theory. Post-intervention focus groups with pupils and interviews with teaching assistants (TAs), school staff and external stakeholders explored the implementation and potential sustainability of Action 3:30R from stakeholders' perspectives. Results: Action 3:30R appealed to a broad range of pupils, including girls and less-active pupils. The Action 3:30R TA training was implemented as intended and was perceived as valuable professional development. Releasing staff for training was a barrier in two of the six intervention schools, which were unable to deliver the intervention as a result. Pupils enjoyed the intervention, and the Action 3:30R core principles underpinned by SDT were implemented with high fidelity, as was the intervention itself. Scheduling conflicts with other clubs and lack of parental support were perceived as the main barriers to recruitment and attendance. Lack of space and season were cited as the main barriers affecting the quality of delivery. The study shows evidence of maintenance, as one intervention school decided to continue Action 3:30R beyond the study. Funding and continued TA training were suggested as factors which may affect the maintenance of Action 3:30R. Conclusions: Action 3:30R is an enjoyable, autonomy-supportive after-school programme, which engages a range of pupils and offers TAs valuable training. RE-AIM provided helpful structure and is recommended for intervention evaluations. Trial registration: ISRCTN34001941. Prospectively registered 01/12/2016

Process evaluation results of a cluster randomised controlled childhood obesity prevention trial: the WAVES study

Background: Increasing prevalence of childhood obesity and its related consequences emphasises the importance of developing and evaluating interventions aimed at prevention. The importance of process evaluation in health intervention research is increasingly recognised, assessing implementation and participant response, and how these may relate to intervention success or failure. A comprehensive process evaluation was designed and undertaken for the West Midlands ActiVe lifestyle and healthy Eating in School children (WAVES) study that tested the effectiveness of an obesity prevention programme for children aged 6-7 years, delivered in 24 UK schools. The four intervention components were: additional daily school-time physical activity (PA); cooking workshops for children and parents; Villa Vitality (VV), a 6-week healthy lifestyle promotion programme run by a local football club; and signposting to local PA opportunities. Methods: Data relating to six dimensions (Fidelity, Reach, Recruitment, Quality, Participant Responsiveness, Context) were collected via questionnaires, logbooks, direct observations, focus groups and interviews. Multiple data collection methods allowed for data triangulation and validation of methods, comparing research observations with teacher records. The 6-stage WAVES study model ((i) Data collection, (ii) Collation, (iii) Tabulation, (iv) Score allocation and discussion, (v) Consultation, (vi) Final score allocation) was developed to guide the collection, assimilation and analysis of process evaluation data. Two researchers independently allocated school scores on a 5-point Likert scale for each process evaluation dimension. Researchers then discussed school score allocations and reached a consensus. Schools were ranked by total score, and grouped to reflect low, medium or high intervention implementation. Results: The intervention was predominantly well-implemented and well-received by teachers, parents and children. The PA component was identified as the most challenging, VV the least. Median implementation score across schools was 56/75 (IQR, 51.0 - 60.8). Agreement between teacher logbooks and researcher observations was generally high, the main discrepancies occurred in session duration reporting where in some cases teachers’ estimations tended to be higher than researchers’. Conclusions: The WAVES study model provides a rigorous and replicable approach to undertaking and analysing a multi-component process evaluation. Challenges to implementing school-based obesity prevention interventions have been identified which can be used to inform future trials

Validity and reliability of subjective methods to assess sedentary behaviour in adults: a systematic review and meta-analysis.

BACKGROUND: Subjective measures of sedentary behaviour (SB) (i.e. questionnaires and diaries/logs) are widely implemented, and can be useful for capturing type and context of SBs. However, little is known about comparative validity and reliability. The aim of this systematic review and meta-analysis was to: 1) identify subjective methods to assess overall, domain- and behaviour-specific SB, and 2) examine the validity and reliability of these methods. METHODS: The databases MEDLINE, EMBASE and SPORTDiscus were searched up to March 2020. Inclusion criteria were: 1) assessment of SB, 2) evaluation of subjective measurement tools, 3) being performed in healthy adults, 4) manuscript written in English, and 5) paper was peer-reviewed. Data of validity and/or reliability measurements was extracted from included studies and a meta-analysis using random effects was performed to assess the pooled correlation coefficients of the validity. RESULTS: The systematic search resulted in 2423 hits. After excluding duplicates and screening on title and abstract, 82 studies were included with 75 self-reported measurement tools. There was wide variability in the measurement properties and quality of the studies. The criterion validity varied between poor-to-excellent (correlation coefficient [R] range - 0.01- 0.90) with logs/diaries (R = 0.63 [95%CI 0.48-0.78]) showing higher criterion validity compared to questionnaires (R = 0.35 [95%CI 0.32-0.39]). Furthermore, correlation coefficients of single- and multiple-item questionnaires were comparable (1-item R = 0.34; 2-to-9-items R = 0.35; ≥10-items R = 0.37). The reliability of SB measures was moderate-to-good, with the quality of these studies being mostly fair-to-good. CONCLUSION: Logs and diaries are recommended to validly and reliably assess self-reported SB. However, due to time and resources constraints, 1-item questionnaires may be preferred to subjectively assess SB in large-scale observations when showing similar validity and reliability compared to longer questionnaires. REGISTRATION NUMBER: CRD42018105994

Validity and responsiveness of four measures of occupational sitting and standing

BACKGROUND: Evidence on the detrimental health effects of prolonged sedentary behavior is accumulating. Interventions need to have a specific focus on sedentary behavior in order to generate clinically meaningful decreases in sedentary time. When evaluating such intervention, the question whether a participant improved or deteriorated their behavior is fundamental and instruments that are able to detect those changes are essential. Therefore, the aim of this study was to determine the criterion validity against activPAL and responsiveness to change of two activity monitors (ActiGraph and activPAL) and two questionnaires for the assessment of occupational sitting and standing time. METHODS: 42 participants took part in the Stand@Work intervention trial. Six (T0) and two (T1) weeks before they received a sit-stand workstation and three weeks thereafter (T2), participants wore an ActiGraph and an activPAL activity monitor, and completed the Occupational Sitting and Physical Activity Questionnaire (OSPAQ) and the Workforce Sitting Questionnaire (WSQ). The activPAL was used as the criterion validity measure. RESULTS: The ActiGraph showed strong validity for occupational sedentary time at T0 and T1 (Spearman rho = 0.77 and 0.69), but its validity dropped substantially after introduction of the sit-stand workstation (rho = 0.19). Correlations between occupational light-intensity activity assessed by the ActiGraph and occupational standing time assessed by the activPAL varied between 0.25–0.63. The occupational sitting validity correlation of the OSPAQ and WSQ varied from 0.35-0.48 and 0.25-0.30, respectively, and between 0.16–0.68 for the OSPAQ for occupational standing time. The intervention-induced changes in occupational sitting and standing time were well detected by the activPAL, OSPAQ and WSQ (sitting only), but not by the ActiGraph, which had the lowest responsiveness to change. CONCLUSIONS: This study suggests that studies aimed at determining differences in occupational sitting and standing time should use activPAL-type inclinometers as a preferred type of objective measure. Simple questionnaires showed sufficient validity and are usable in addition to an objective measure or alone when objective monitoring is not possible. The hip-worn ActiGraph was unable to distinguish between occupational sitting and standing time, when using uniaxial data and traditional cut-points for sedentary time and light-intensity activity. TRIAL REGISTRATION: The study was registered with the Australian New Zealand Clinical Trials Registry (No. ACTRN 12612000072819)