Reliability assessment of ultrasound muscle echogenicity in patients with rheumatic diseases: Results of a multicenter international web-based study

ObjectivesTo investigate the inter/intra-reliability of ultrasound (US) muscle echogenicity in patients with rheumatic diseases.MethodsForty-two rheumatologists and 2 radiologists from 13 countries were asked to assess US muscle echogenicity of quadriceps muscle in 80 static images and 20 clips from 64 patients with different rheumatic diseases and 8 healthy subjects. Two visual scales were evaluated, a visual semi-quantitative scale (0–3) and a continuous quantitative measurement (“VAS echogenicity,” 0–100). The same assessment was repeated to calculate intra-observer reliability. US muscle echogenicity was also calculated by an independent research assistant using a software for the analysis of scientific images (ImageJ). Inter and intra reliabilities were assessed by means of prevalence-adjusted bias-adjusted Kappa (PABAK), intraclass correlation coefficient (ICC) and correlations through Kendall’s Tau and Pearson’s Rho coefficients.ResultsThe semi-quantitative scale showed a moderate inter-reliability [PABAK = 0.58 (0.57–0.59)] and a substantial intra-reliability [PABAK = 0.71 (0.68–0.73)]. The lowest inter and intra-reliability results were obtained for the intermediate grades (i.e., grade 1 and 2) of the semi-quantitative scale. “VAS echogenicity” showed a high reliability both in the inter-observer [ICC = 0.80 (0.75–0.85)] and intra-observer [ICC = 0.88 (0.88–0.89)] evaluations. A substantial association was found between the participants assessment of the semi-quantitative scale and “VAS echogenicity” [ICC = 0.52 (0.50–0.54)]. The correlation between these two visual scales and ImageJ analysis was high (tau = 0.76 and rho = 0.89, respectively).ConclusionThe results of this large, multicenter study highlighted the overall good inter and intra-reliability of the US assessment of muscle echogenicity in patients with different rheumatic diseases

Reliability assessment of the definition of ultrasound enthesitis in SpA: results of a large, multicentre, international web-based study

Objectives: To investigate the reliability of the OMERACT ultrasound (US) Task Force definition of US enthesitis in spondyloarthritis (SpA). Methods: In this web exercise, based on the evaluation of 101 images and 39 clips of the main entheses of the lower limbs, the elementary components included in the OMERACT definition of US enthesitis in SpA [hypoechoic areas, entheseal thickening, power Doppler signal (PD) at the enthesis, enthesophytes/calcifications, bone erosions] were assessed by 47 rheumatologists from 37 rheumatology centres in 15 countries.Inter and intra-observer reliability of the US components of enthesitis was calculated using Light's kappa, Cohen's kappa, Prevalence and Bias Adjusted Kappa (PABAK) and their 95% confidence intervals. Results: Bone erosions and PD showed the highest overall inter-reliability [Light's kappa: 0.77 (0.76-0.78), 0.72 (0.71-0.73), respectively; PABAK: 0.86 (0.86-0.87), 0.73 (0.73-0.74), respectively], followed by enthesophytes/calcifications [Light's kappa: 0.65 (0.64-0.65), PABAK: 0.67 (0.67-0.68)]. This was moderate for entheseal thickening [Light's kappa: 0.41 (0.41-0.42), PABAK: 0.41 (0.40-0.42)], and fair for hypoechoic areas [Light's kappa: 0.37 (0.36-0.38); PABAK: 0.37 (0.37-0.38)]. A similar trend was observed in the intra-reliability exercise, although this was characterized by an overall higher degree of reliability for all US elementary components compared with the inter-observer evaluation. Conclusions: The results of this multicentre, international, web-based study show a good reliability of the OMERACT US definition of bone erosions, PD, and enthesophytes/calcifications. The low reliability of entheseal thickening and hypoechoic areas raises questions about the opportunity to revise the definition of these two major components for the US diagnosis of enthesitis