Measuring what matters in healthcare: A practical guide to psychometric principles and instrument development

The provision of quality healthcare relies on scales and measures with robust evidence of their psychometric properties. Using measurement instruments with poor reliability, validity, or feasibility, or those that are not appropriate for the target diagnostic group or construct/dimension under consideration, may be unfavorable for patients, unproductive, and hinder empirical advancement. Resources from the COnsensus-based Standards for the selection of health status Measurement INstruments (COSMIN) group can assist in identifying and developing psychometrically sound measures. The COSMIN initiative is the only international, research-based practice taxonomy and methodological guidelines for measurement in healthcare. This manuscript aims to provide an accessible introduction to theories, principles and practices of psychometrics, instrument properties, and scale development, with applied examples from the COSMIN recommendations. It describes why measurement in healthcare is critical to good practice, explains the concepts of the latent variable and hypothetical construct and their importance in healthcare assessments, explores issues of flawed measurement and briefly explains key theories relevant to psychometrics. The paper also outlines a ten-step process to develop and validate a new measurement instrument, with examples drawn from a recently developed visuoperceptual measure for analysis of disordered swallowing to demonstrate key concepts and provides a guide for understanding properties of and terminology related to measurement instruments. This manuscript serves as a resource for healthcare clinicians, educators, and researchers who seek to develop and validate new measurement instruments or improve the properties of existing ones. It highlights the importance of using psychometrically sound measurement instruments to ensure high-quality healthcare assessments

A Visuoperceptual Measure for Videofluoroscopic Swallow Studies (VMV): A Pilot Study of Validity and Reliability in Adults with Dysphagia

The visuoperceptual measure for videofluoroscopic swallow studies (VMV) is a new measure for analysing the recordings from videofluoroscopic swallow studies (VFSS). This study evaluated the reliability and validity of the pilot version of the VMV using classical test theory (CTT) analysis, informed by the consensus-based standards for the selection of health measurement instruments (COSMIN) guidelines. Forty participants, diagnosed with oropharyngeal dysphagia by fibreoptic endoscopic evaluation of swallowing, were recruited. The VFSS and administration of bolus textures and volumes were conducted according to a standardised protocol. Recordings of the VFSS were rated by three blinded raters: a speech-language pathologist, a radiologist and a phoniatrician. Inter- and intra-rater reliability was assessed with a weighted kappa and resulted in 0.889 and 0.944 overall, respectively. Structural validity was determined using exploratory factor analyses, which found four and five factor solutions. Internal consistency was evaluated with Cronbach’s alpha coefficients, which found all but one factor scoring within an acceptable range (>0.70 and 0.95). Hypothesis testing for construct validity found the expected correlations between the severity of dysphagia and the VMV’s performance, and found no impact of gender on measure performance. These results suggest that the VMV has potential as a reliable and valid measure for VFSS. Further validation with a larger sample is required, and validation using an item response theory paradigm approach is recommended

CT colonography: size reduction of submerged colorectal polyps due to electronic cleansing and CT-window settings.

OBJECTIVES: To assess whether electronic cleansing (EC) of tagged residue and different computed tomography (CT) windows influence the size of colorectal polyps in CT colonography (CTC). METHODS: A database of 894 colonoscopy-validated CTC datasets of a low-prevalence cohort was retrospectively reviewed to identify patients with polyps ≥6 mm that were entirely submerged in tagged residue. Ten radiologists independently measured the largest diameter of each polyp, two-dimensionally, before and after EC in colon, bone, and soft-tissue-windows, in randomised order. Differences in size and polyp count before and after EC were calculated for size categories ≥6 mm and ≥10 mm. Statistical testing involved 95% confidence interval, intraclass correlation and mixed-model ANOVA. RESULTS: Thirty-seven patients with 48 polyps were included. Mean polyp size before EC was 9.8 mm in colon, 9.9 mm in bone and 8.2 mm in soft-tissue windows. After EC, the mean polyp size decreased significantly to 9.4 mm in colon, 9.1 mm in bone and 7.1 mm in soft-tissue windows. Compared to unsubtracted colon windows, EC, performed in colon, bone and soft-tissue windows, led to a shift of 6 (12,5%), 10 (20.8%) and 25 (52.1%) polyps ≥6 mm into the next smaller size category, thus affecting patient risk stratification. CONCLUSIONS: EC and narrow CT windows significantly reduce the size of polyps submerged in tagged residue. Polyp measurements should be performed in unsubtracted colon windows. KEY POINTS: • EC significantly reduces the size of polyps submerged in tagged residue. • Abdominal CT-window settings significantly underestimate 2D sizes of submerged polyps. • Size reduction in EC is significantly greater in narrow than wide windows. • Underestimation of polyp size due to EC may lead to inadequate treatment. • Polyp measurements should be performed in unsubtracted images using a colon window

Measuring what matters in healthcare: a practical guide to psychometric principles and instrument development

The provision of quality healthcare relies on scales and measures with robust evidence of their psychometric properties. Using measurement instruments with poor reliability, validity, or feasibility, or those that are not appropriate for the target diagnostic group or construct/dimension under consideration, may be unfavorable for patients, unproductive, and hinder empirical advancement. Resources from the COnsensus-based Standards for the selection of health status Measurement INstruments (COSMIN) group can assist in identifying and developing psychometrically sound measures. The COSMIN initiative is the only international, research-based practice taxonomy and methodological guidelines for measurement in healthcare. This manuscript aims to provide an accessible introduction to theories, principles and practices of psychometrics, instrument properties, and scale development, with applied examples from the COSMIN recommendations. It describes why measurement in healthcare is critical to good practice, explains the concepts of the latent variable and hypothetical construct and their importance in healthcare assessments, explores issues of flawed measurement and briefly explains key theories relevant to psychometrics. The paper also outlines a ten-step process to develop and validate a new measurement instrument, with examples drawn from a recently developed visuoperceptual measure for analysis of disordered swallowing to demonstrate key concepts and provides a guide for understanding properties of and terminology related to measurement instruments. This manuscript serves as a resource for healthcare clinicians, educators, and researchers who seek to develop and validate new measurement instruments or improve the properties of existing ones. It highlights the importance of using psychometrically sound measurement instruments to ensure high-quality healthcare assessments

Zufallsbefunde von Leber, Gallensystem, Pankreas und Milz bei asymptomatischen Patienten : Bewertung und Managementempfehlung

Klinisches Problem Die vermehrte Verwendung hoch entwickelter bildgebender Verfahren wie Multidetektorcomputertomographie und Magnetresonanztomographie hat zu einer beträchtlichen Zunahme asymptomatischer und unerwarteter Befunde geführt. Radiologische Standardverfahren Besonders betroffen sind abdominelle CT-Untersuchungen mit einer Vielzahl inzidenteller Befunde. Dieses wertvolle Diagnoseverfahren birgt auch die Gefahr aufwendiger und auch kostenintensiver Folgeuntersuchungen mit z. T. invasiven Verfahren. Bewertung Vor diesem Hintergrund stellt sich für den Radiologen immer häufiger die schwierige Aufgabe, diese Läsionen korrekt einzuschätzen, über die Notwendigkeit einer weiteren Abklärung zu entscheiden und den Patienten umfassend über die klinische Relevanz zu informieren. Empfehlung für die Praxis Das Ziel dieses Artikels ist es, die am häufigsten vorkommenden abdominellen Zufallsbefunde zu beschreiben sowie Hilfestellung bei ihrer Interpretation und Differenzialdiagnose mit Empfehlungen für das weitere Management zu geben.Clinical issue The increased use of highly developed imaging procedures, such as multidetector-row computed tomography and magnetic resonance imaging has led to a substantial increase of asymptomatic and unexpected findings. Standard radiological methods Abdominal CT investigations are particularly affected with a large number of incidental findings. This valuable diagnostic procedure also entails the risk of complex and cost-intensive subsequent investigations with partly invasive procedures. Achievements For this reason radiologists are more often confronted with the difficult task of correctly assessing these lesions, to decide on the need for additional investigations and to inform the patient in detail about the clinical relevance. Practical recommendations The aims of this article are to describe the most common abdominal incidentalomas, to assist with the interpretation and differential diagnosis and to give recommendations for further management.(VLID)353372

Der Radiologe / Zufallsbefunde von Niere, Nebenniere, Adnexen, Gastrointestinaltrakt, Mesenterium und Lymphknoten : Bewertung und Managementempfehlung

Klinisches Problem Neben den parenchymatösen Oberbauchorganen hat der zunehmende Einsatz von Schnittbildverfahren zu einer vermehrten Anzahl von Zufallsbefunden der Nieren, Nebennieren, Adnexe, des Gastrointestinaltrakts, Mesenteriums und der intraabdominellen Lymphknoten geführt. Radiologische Standardverfahren Abdominelle CT-Untersuchungen zeigen häufig unerwartete Befunde ohne korrelierende Symptomatik. Die steigende klinische Relevanz ist einerseits auf die Zunahme inzidenteller Pathologien und andererseits auf ein wachsendes Bewusstsein ethischer und sozioökonomischer Faktoren zurückzuführen. Bewertung Bei der radiologischen Interpretation sind neben morphologischen Kriterien sowohl die Einbeziehung der individuellen Risikofaktoren des Patienten als auch der klinische Gesamtkontext von großer Bedeutung. Empfehlung für die Praxis Das Ziel dieses Artikels ist eine Beschreibung und Bewertung der in der Computertomographie detektierten genannten Zufallsbefunde sowie weiterer Managementempfehlungen.Clinical issue Besides the upper abdominal parenchymal organs, the increasing application of cross-sectional imaging has also led to a rising number of incidental findings in the kidneys, adrenal glands, adnexa uteri, the gastrointestinal tract, mesentery and abdominal lymph nodes. Standard radiological methods Abdominal computed tomography investigations often show unexpected findings without any correlating symptoms. The growing clinical relevance is due to the large number of incidental findings as well as an increasing awareness of ethical and socioeconomic factors. Achievements When interpreting radiological findings not only morphological criteria but also individual risk factors of the patient and the clinical context are of great importance. Practical recommendations The aims of this article are the description and evaluation of frequent incidental findings detected by computed tomography and to provide information about management recommendations.(VLID)353373

Visceral fat area measured with computed tomography does not predict postoperative course in Crohn´s disease patients.

The role of visceral fat measured by computer tomography is yet not well defined in patients with Crohn's disease. Therefore, the present study was designed to assess the impact of visceral fat area on postoperative short-term outcome and surgical characteristics. We analyzed 95 patients, who underwent intestinal resection for symptomatic Crohn's disease at an academic tertiary referral center between 2003 and 2008. Visceral fat area was measured on preoperative computed tomography scans. Postoperative morbidity was graded according to the Clavien-Dindo classification. Visceral fat area was correlated with baseline characteristics, disease phenotype and 30-day morbidity. Body mass index and age were significantly associated with a higher visceral fat area (p = 0.001). Overall 19 (20.0%) postoperative complications were observed, of whom 7 (7.4%) patients required surgical re-intervention. No significant difference was found with regard to visceral fat area between patients with an uneventful and eventful postoperative course (no complications: median visceral fat area 52.0 cm2 SD 59.7, complications: 41.3 cm2 SD 42.8; p = 0.465). In contrast to current literature, we cannot support the role of visceral fat area for predicting postoperative course in Crohn's disease. In addition, no correlation of the visceral fat area and disease behavior was detected

Taking the history in patients with swallowing disorders : an international multidisciplinary survey

Purpose: Clinical assessment of swallowing disorders (dysphagia) requires accurate and comprehensive medical history-taking to further tailor the diagnostic work-up, but functional health care questionnaires show a large variability and various limitations. The aim of this study was to assess the way in which international swallowing experts from various disciplines asses swallowing problems in order to improve the radiologist´s ability to take a thorough medical history in this specific patient group. Methods: A two-step Delphi method was used to collect swallowing experts’ ways of taking the medical history in patients with swallowing disorders. The questions obtained in a first interview round were pooled and structured by dividing them into general and specific questions, including several subcategories, and these were scored by the experts in a second step based on to their clinical relevance. Results: Eighteen experts provided 25 different questions categorized as general questions and 34 dimension-specific questions (eight attributed to ‘suspicion of aspiration,’ 13 to ‘dysphagia,’ six to ‘globus sensation,’ four to ‘non-cardiac chest pain,’ and three to ‘effect of life.’) In the second interview round, the experts´ average predictive values attributed to those questions showed the varying importance of the presented items. Seven general and 13 specific questions (six of them attributed to ‘effect on life’ and seven ‘others’) were also added. Conclusions: This collection of questions reflects the fact that a multidisciplinary approach when obtaining the medical history in patients with swallowing disorders may contribute to an improved technique for performing a symptom-oriented medical history-taking for radiologists of all training levels

Comparison of videofluoroscopy and impedance planimetry for the evaluation of oesophageal stenosis: a retrospective study.

OBJECTIVES To compare videofluoroscopy that included a tablet test with impedance planimetry (EndoFLIP(®)) for the evaluation of oesophageal stenosis in patients with dysphagia. METHODS In 56 patients, videofluoroscopic examinations following the transit of a 14-mm tablet were retrospectively reviewed and correlated with impedance planimetry findings, a catheter-based method using impedance planimetry to display the oesophageal diameter estimates. Additional findings assessed were the occurrence of symptoms during tablet passage and evaluation of oesophageal motility. RESULTS Impaction of the tablet occurred in 31/56 patients; nine showed a moderate delay (2-15 s), three a short delay (<2 s) and 13 no delay of tablet passage. Both methods showed a significant correlation between tablet impaction and oesophageal diameter <15.1 mm, as measured by impedance planimetry (p = 0.035). The feeling of the tablet getting stuck was reported by seven patients, six showing impaction of the tablet (four with an EndoFLIP-diameter < 13 mm, two with a diameter of 13-19 mm) and one showing delayed passage (EndoFLIP diameter of 17 mm). CONCLUSIONS Videofluoroscopy and impedance planimetry correlate significantly regarding tablet impaction and residual oesophageal lumen. A standardized 14-mm tablet is helpful in demonstrating oesophageal strictures in dysphagic patients. Triggering of subjective symptoms provides valuable information during a videofluoroscopic study. KEY POINTS • A 14-mm tablet can demonstrate oesophagogastric junction narrowing in patients with dysphagia. • Type of passage of a tablet enables estimation of oesophageal luminal diameter. • Videofluoroscopy and impedance planimetry correlate significantly regarding tablet impaction and residual oesophageal lumen