Reliability and Test Differences for the Impact: Implications for Concussion Testing Programs

This study was conducted to determine the long-term relatability of ImPACT scores among young athletes. Youth sport participants (n=294) who completed ImPACT tests one year apart were included in the study. Ages ranged from nine to 14 with a mean of 11.42 (SD = .96). The majority (n = 215) were males. Test-retest reliabilities for verbal memory, visual memory, response time, and impulse control were statistically significant but weak, ranging between .33 and .49. The index score had poor test-retest reliabilities (r = .26). Visual-motor test-retest reliability was also significant but moderate (r=.68). Scores for the verbal memory subtest and the index score did not change over time. However, there was significant improvement for the visual memory (t(293) = 2.24, p \u3c .03, d = .13), visualmotor (t(293) = 9.23, p \u3c .001, d = .54), response time (t(293) = 3.78, p \u3c .001, d = .22), and impulse (t(293) = 3.27, p \u3c .001, d = .19) subtests. These results indicate that the long-term test-retest reliability of the ImPACT is inadequate and that several subtests change over time. Therefore, it is recommended that baseline ImPACT scores are obtained on an annual basis

Tapering practices of strongman athletes: Test-retest reliability study

BACKGROUND: Little is currently known about the tapering practices of strongman athletes. We have developed an Internet-based comprehensive self-report questionnaire examining the training and tapering practices of strongman athletes. OBJECTIVE: The objective of this study was to document the test-retest reliability of questions associated with the Internet-based comprehensive self-report questionnaire on the tapering practices of strongman athletes. The information will provide insight on the reliability and usefulness of the online questionnaire for use with strongman athletes. METHODS: Invitations to complete an Internet questionnaire were sent via Facebook Messenger to identified strongman athletes. The survey consisted of four main areas of inquiry, including demographics and background information, training practices, tapering, and tapering practices. Of the 454 athletes that completed the survey over the 8-week period, 130 athletes responded on Facebook Messenger indicating that they intended to complete, or had completed, the survey. These participants were asked if they could complete the online questionnaire a second time for a test-retest reliability analysis. Sixty-four athletes (mean age 33.3 years, standard deviation [SD] 7.7; mean height 178.2 cm, SD 11.0; mean body mass 103.7 kg, SD 24.8) accepted this invitation and completed the survey for the second time after a minimum 7-day period from the date of their first completion. Agreement between athlete responses was measured using intraclass correlation coefficients (ICCs) and kappa statistics. Confidence intervals (at 95%) were reported for all measures and significance was set at P<.05. RESULTS: Test-retest reliability for demographic and training practices items were significant (P<.001) and showed excellent (ICC range=.84 to .98) and fair to almost perfect agreement (κ range=.37-.85). Moderate to excellent agreements (ICC range=.56-.84; P<.01) were observed for all tapering practice measures except for the number of days athletes started their usual taper before a strongman competition (ICC=.30). When the number of days were categorized with additional analyses, moderate reliability was observed (κ=.43; <.001). Fair to substantial agreement was observed for the majority of tapering practices measures (κrange=.38-.73; P<.001) except for how training frequency (κ=.26) and the percentage and type of resistance training performed, which changed in the taper (κ=.20). Good to excellent agreement (ICC=.62-.93; P<.05) was observed for items relating to strongman events and traditional exercises performed during the taper. Only the time at which the Farmer's Walk was last performed before competition showed poor reliability (ICC=.27). CONCLUSIONS: We have developed a low cost, self-reported, online retrospective questionnaire, which provided stable and reliable answers for most of the demographic, training, and tapering practice questions. The results of this study support the inferences drawn from the Tapering Practices of Strongman Athletes Stud

Reliability and Precision of the Nana Protocol to Assess Body Composition Using Dual Energy X-ray Absorptiometry

The Nana positioning protocol is widely used to position participants to minimize technical error when undertaking body composition scanning and analysis with a Dual energy X-Ray absorptiometry (DXA) machine. Once biological and technical errors are accounted for, the only variation in test–retest results is from statistical fluctuation or machine error. Therefore, the aim of this study is to assess the test–retest reliability of the Nana positioning protocol and establish the smallest real difference percentage (SRD%). A gender-balanced group of 30 participants (15 males, 15 females) underwent two scans in succession using the Nana positioning protocol, with repositioning between scans. Percentage change in mean with typical error, Intraclass Correlation Coefficients (ICC), and standard error measurement percentage (SEM%) were used to identify the test–retest reliability and error rate of these protocols. Additionally, SRD% was calculated to assess the point at which clinically important changes occurred in a participant. The reliabilities of the whole body and regional scans were excellent. Percentage change in mean ranged between 0.00% and 0.23%. High reproducibility of the Nana positioning protocol was evident through an ICC ranging between 0.966–1.000. Additionally, typical error, SEM%, and SRD% were all low. Interestingly, fat mass was associated with the largest fluctuations observed to be associated with any of the parameters assessed. When all sources of biological and technical errors have been accounted for, the Nana positioning protocol has excellent test–retest reliability and produces low SEM% and SRD%

Reliability and validity of two widely-used worry questionnaires: self-report and self-peer convergence

The reliability and validity of the Penn State Worry Questionnaire (PSWQ) and the Worry Domains Questionnaire (WDQ) were examined with self-ratings from a non-clinical sample of 148 students in a test-retest design across four weeks. Ratings from three well-acquainted peers were also obtained. With internal consistencies and test-retest correlations of at least 0.85, the present study confirmed the high reliability of the questionnaires. Moreover, both measures demonstrated substantial convergent validity: Average agreement among peers was 0.42 (PSWQ) and 0.47 (WDQ) and aggregated self-peer agreement was 0.55 (PSWQ) and 0.49 (WDQ). Self-peer agreement was not biased by social desirability. These findings challenge views that worry is an unreliable and unobservable phenomenon

The test-retest reliability of different ankle joint center location techniques

Accurate and reliable joint identification is imperative for the collection of meaningful kinetic and kinematic data. Of the lower kinetic chain both the hip and knee joints have received a considerable amount of attention in 3D modelling. However, the reliability of methods to define the ankle joint center have received very little attention. This study investigated the reliability of the two marker method (TMM) and the functional ankle method (FAM) on estimating the ankle joint center. Furthermore, the effects of the two-marker method reliability for defining the ankle joint center when the ankle was covered with a brace or protector was investigated. 3D kinematic data was collected from ten participants (8 female and 2 male) whilst walking. The ankle joint center was defined twice using each test condition; TMM (WITHOUT), FAM (FUNCTIONAL), TMM when the ankle was covered with a brace (BRACE), and TMM when the ankle was covered with a protector (PROTECTOR). Intraclass correlations (ICC) were utilised to compare test and retest waveforms and paired samples t-tests were used to compare angular parameters. Significant differences were found in the test-retest angular parameters in the transverse and sagittal planes for the WITHOUT, BRACE, and FUNCTIONAL conditions. The strongest test-retest ICC’s were observed in the WITHOUT and PROTECTOR conditions. The findings of the current investigation indicate that there are fewer errors using the TMM when the ankle is uncovered or when covered with soft foam that is easy to palpate through

Development and initial validation of a sensory threshold examination protocol (STEP) for phenotyping canine pain syndromes

Objective To study feasibility and test-retest repeatability of a sensory threshold examination protocol (STEP) and report quantitative sensory threshold distributions in healthy dogs. Study design Prospective, observational, cohort study. Animals Twenty-five healthy client-owned dogs. Methods Tactile sensitivity (TST) (von Frey filaments), mechanical thresholds (MT with 2, 4 and 8 mm probes), heat thresholds (HT) and responsiveness to cold stimulus (CT at 0 °C) were quantitatively assessed for five body areas (BA: tibias, humeri, neck, thoracolumbar region and abdomen) in a randomized order on three different occasions. Linear Mixed Model and Generalised Linear Mixed models were used to evaluate the effects of body weight category, age, sex, BA, occasion, feasibility score and investigator experience. Test-retest repeatability was evaluated with the Intra-class Correlation Coefficient (ICC). Results The STEP lasted 90 minutes without side effects. The BA affected most tests (p = 0.001). Higher thresholds and longer cold latencies were scored in the neck (p = 0.024) compared to other BAs. Weight category affected all thresholds (p = 0.037). Small dogs had lower MT (~1.4 N mean difference) and HT (1.1 0C mean difference) than other dogs (p = 0.029). Young dogs had higher HT than adults (2.2 0C mean difference) (p = 0.035). Gender also affected TST, MT and HT (p < 0.05) (females versus males: TST OR= 0.5, MT= 1.3 N mean difference, HT= 2.2 0C mean difference). Repeatability was substantial to moderate for all tests, but poor for TST. There was no difference in thresholds between occasions, except for CT. Test-retest repeatability was slightly better with the 2 mm MT probe compared to other diameters and improved with operator experience. Conclusions and clinical relevance The STEP was feasible, well tolerated and showed substantial test-retest repeatability in healthy dogs. Further validation is needed in dogs suffering pain

Assessment of physical activity in older Belgian adults : validity and reliability of an adapted interview version of the long International Physical Activity Questionnaire (IPAQ-L)

Background: Adequate monitoring of older adults’ physical activity (PA) is essential to develop effective health promotion programs. The present study examined criterion validity and test-retest reliability of the long International Physical Activity Questionnaire (IPAQ-L), adapted for Belgian, community-dwelling older adults (65y and older). Methods: Participants (n = 434) completed the last seven days version of IPAQ-L, modified for the Belgian population of community-dwelling older adults. This elderly-adapted version of IPAQ-L combined vigorous and moderate activities, and questions on gait speed and recreational cycling were added. Furthermore, participants wore an ActiGraph GT3X(+) accelerometer for at least five days. Criterion validity was determined by comparing self-reported weekly minutes of moderate-to-vigorous physical activity (MVPA) and weekly minutes of total PA with accelerometer data, defined by two different cut points (Freedson vs. Copeland). To examine test-retest reliability, a subsample of 29 participants completed IPAQ-L for a second time within a ten day interval. Results: IPAQ-L showed moderate criterion validity for measuring weekly minutes of MVPA and total PA (Spearman’s ρ range 0.33–0.40). However, plots on agreement between self-reported and accelerometer PA showed a systematic over-reporting of IPAQ-L for MVPA. In contrast, plots indicated that IPAQ-L under-estimated levels of total PA, however, this under-estimation of total PA was substantially lower than the observed over-reporting of MVPA. Test-retest reliability was moderate-to-good for work-related PA, domestic PA, MVPA and total PA (ICC range 0.52–0.81), but poorer for transportation and recreational PA (ICC 0.44 and 0.43, respectively). Conclusions: Criterion validity results suggest that IPAQ-L is more valid to measure older adults’ weeklyminutes of total PA than weekly MVPA minutes. Moreover, results might imply that content validity of IPAQ-L can be improved if specific light-intensity PA items are incorporated into IPAQ-L. Test-retest reliability of IPAQ-L was moderate to good, except for weekly minutes of transportation and recreational PA, probably due to week-to-week variability of these behaviors

Reliability and validity of a domain-specific last 7-d sedentary time questionnaire

Purpose: The objective of this study is to examine test-retest reliability, criterion validity, and absolute agreement of a self-report, last 7-d sedentary behavior questionnaire (SIT-Q-7d), which assesses total daily sedentary time as an aggregate of sitting/lying down in five domains (meals, transportation, occupation, nonoccupational screen time, and other sedentary time). Dutch (DQ) and English (EQ) versions of the questionnaire were examined. Methods: Fifty-one Flemish adults (ages 39.4 +/- 11.1 yr) wore a thigh accelerometer (activPAL3 (TM)) and simultaneously kept a domain log for 7 d. The DQ was subsequently completed twice (median test-retest interval: 3.3 wk). Thigh-acceleration sedentary time was log annotated to create comparable domain-specific and total sedentary time variables. Four hundred two English adults (ages 49.6 +/- 7.3 yr) wore a combined accelerometer and HR monitor (Actiheart (R)) for 6 d to objectively measure total sedentary time. The EQ was subsequently completed twice (median test-retest interval: 3.4 wk). In both samples, the questionnaire reference frame overlapped with the criterion measure administration period. All participants had five or more valid days of criterion data, including one or more weekend day. Results: Test-retest reliability (intraclass correlation coefficient (95% CI)) was fair to good for total sedentary time (DQ: 0.68 (0.50-0.81); EQ: 0.53 (0.44-0.62)) and poor to excellent for domain-specific sedentary time (DQ: from 0.36 (0.10-0.57) (meals) to 0.66 (0.46-0.79) (occupation); EQ: from 0.45 (0.35-0.54) (other sedentary time) to 0.76 (0.71-0.81) (meals)). For criterion validity (Spearman rho), significant correlations were found for total sedentary time (DQ: 0.52; EQ: 0.22; all P <0.001). Compared with domain-specific criterion variables (DQ), modest-to-strong correlations were found for domain-specific sedentary time (from 0.21 (meals) to 0.76 (P < 0.001) (screen time)). The questionnaire generally overestimated sedentary time compared with criterion measures. Conclusion: The SIT-Q-7d appears to be a useful tool for ranking individuals in large-scale observational studies examining total and domain-specific sitting

Perceived characteristics of the environment associated with active travel: development and testing of a new scale

Background Environmental characteristics may be associated with patterns of physical activity. However, the development of instruments to measure perceived characteristics of the local environment is still at a comparatively early stage, and published instruments are not necessarily suitable for application in all settings. We therefore developed and established the test-retest reliability of a new scale for use in a study of the correlates of active travel and overall physical activity in deprived urban neighbourhoods in Glasgow, Scotland. Methods We developed and piloted a 14-item scale based on seven constructs identified from the literature (aesthetics, green space, access to amenities, convenience of routes, traffic, road safety and personal safety). We administered the scale to all participants in a random postal survey (n = 1322) and readministered the scale to a subset of original respondents (n = 125) six months later. We used principal components analysis and Varimax rotation to identify three principal components (factors) and derived summary scores for subscales based on these factors. We examined the internal consistency of these subscales using Cronbach's alpha and examined the test-retest reliability of the individual items, the subscale summary scores and an overall summary neighbourhood score using a combination of correlation coefficients and Cohen's kappa with and without weighting. Results Public transport and proximity to shops were the items most likely to be rated positively, whereas traffic volume, traffic noise and road safety for cyclists were most likely to be rated negatively. Three principal components – 'safe and pleasant surroundings', 'low traffic' and 'convenience for walking' – together explained 45% of the total variance. The test-retest reliability of individual items was comparable with that of items in other published scales (intraclass correlation coefficients (ICCs) 0.34–0.70; weighted Cohen's kappa 0.24–0.59). The overall summary neighbourhood score had acceptable internal consistency (Cronbach's alpha 0.72) and test-retest reliability (ICC 0.73). Conclusion This new scale contributes to the development of a growing set of tools for investigating the role of perceived environmental characteristics in explaining or mediating patterns of active travel and physical activity