Quality of reporting of diagnostic accuracy studies

PURPOSE: To evaluate quality of reporting in diagnostic accuracy articles published in 2000 in journals with impact factor of at least 4 by using items of Standards for Reporting of Diagnostic Accuracy (STARD) statement published later in 2003. MATERIALS AND METHODS: English-language articles on primary diagnostic accuracy studies in 2000 were identified with validated search strategy in MEDLINE. Articles published in journals with impact factor of 4 or higher that regularly publish articles on diagnostic accuracy were selected. Two independent reviewers evaluated quality of reporting by using STARD statement, which consists of 25 items and encourages use of a flow diagram. Total STARD score for each article was calculated by summing number of reported items. Subgroup analyses were performed for study design (case-control or cohort study) by using Student t tests for continuous outcomes and chi(2) tests for dichotomous outcomes. RESULTS: Included were 124 articles published in 2000 in 12 journals: 33 case-control and 91 cohort studies. Only 41% of articles (51 of 124) reported on more than 50% of STARD items, while no articles reported on more than 80%. A flow chart was presented in two articles. Assessment of reporting on individual items of STARD statement revealed wide variation, with some items described in 11% of articles and others in 92%. Mean STARD score (0-25 points available) was 11.9 (range, 3.5-19.5). Mean difference in STARD score between cohort studies and case-control studies was 1.53 (95% confidence interval: 0.24, 2.82). CONCLUSION: Quality of reporting in diagnostic accuracy articles published in 2000 is less than optimal, even in journals with high impact factor. Authors, editors, and reviewers should pay more attention to reporting by checking STARD statement items and including a flow diagram to represent study design and patient flow. Supplemental material: radiology.rsnajnls.org/cgi/content/full/2352040507/DC1 (c) RSNA, 200

Minimally important change determined by a visual method integrating an anchor-based and a distribution-based approach

Background: Minimally important changes (MIC) in scores help interpret results from health status instruments. Various distribution-based and anchor-based approaches have been proposed to assess MIC. Objectives: To describe and apply a visual method, called the anchor-based MIC distribution method, which integrates both approaches. Method: Using an anchor, patients are categorized as persons with an important improvement, an important deterioration, or without important change. For these three groups the distribution of the change scores on the health status instrument are depicted in a graph. We present two cut-off points for an MIC: the ROC cut-off point and the 95% limit cut-off point. Results: We illustrate our anchor-based MIC distribution method determining the MIC for the Pain Intensity Numerical Rating Scale in patients with low back pain, using two conceivable definitions of minimal important change on the anchor. The graph shows the distribution of the scores of the health status instrument for the relevant categories on the anchor, and also the consequences of choosing the ROC cut-off point or the 95% limit cut-off point. Discussion: The anchor-based MIC distribution method provides a general framework, applicable to all kind of anchors. This method forces researchers to choose and justify their choice of an appropriate anchor and to define minimal importance on that anchor. The MIC is not an invariable characteristic of a measurement instrument, but may depend, among other things, on the perspective from which minimal importance is considered and the baseline values on the measurement instrument under study. A balance needs to be struck between the practicality of a single MIC value and the validity of a range of MIC values. © 2006 Springer Science+Business Media B.V

Rating the methodological quality in systematic reviews of studies on measurement properties: a scoring system for the COSMIN checklist

Background: The COSMIN checklist is a standardized tool for assessing the methodological quality of studies on measurement properties. It contains 9 boxes, each dealing with one measurement property, with 5-18 items per box about design aspects and statistical methods. Our aim was to develop a scoring system for the COSMIN checklist to calculate quality scores per measurement property when using the checklist in systematic reviews of measurement properties. Methods: The scoring system was developed based on discussions among experts and testing of the scoring system on 46 articles from a systematic review. Four response options were defined for each COSMIN item (excellent, good, fair, and poor). A quality score per measurement property is obtained by taking the lowest rating of any item in a box ("worst score counts"). Results: Specific criteria for excellent, good, fair, and poor quality for each COSMIN item are described. In defining the criteria, the "worst score counts" algorithm was taken into consideration. This means that only fatal flaws were defined as poor quality. The scores of the 46 articles show how the scoring system can be used to provide an overview of the methodological quality of studies included in a systematic review of measurement properties. Conclusions: Based on experience in testing this scoring system on 46 articles, the COSMIN checklist with the proposed scoring system seems to be a useful tool for assessing the methodological quality of studies included in systematic reviews of measurement properties. © The Author(s) 2011

Dutch translation and cross-cultural validation of the Adult Social Care Outcomes Toolkit (ASCOT)

Background: The Adult Social Care Outcomes Toolkit was developed to measure outcomes of social care in England. In this study, we translated the four level self-completion version (SCT-4) of the ASCOT for use in the Netherlands and performed a cross-cultural validation. Methods: The ASCOT SCT-4 was translated into Dutch following international guidelines, including two forward and back translations. The resulting version was pilot tested among frail older adults using think-aloud interviews. Furthermore, using a subsample of the Dutch ACT-study, we investigated test-retest reliability and construct validity and compared response distributions with data from a comparable English study. Results: The pilot tests showed that translated items were in general understood as intended, that most items were reliable, and that the response distributions of the Dutch translation and associations with other measures were comparable to the original English version. Based on the results of the pilot tests, some small modifications and a revision of the Dignity items were proposed for the final translation, which were approved by the ASCOT development team. The complete original English version and the final Dutch translation can be obtained after registration on the ASCOT website (http://www.pssru.ac.uk/ascot). Conclusions: This study provides preliminary evidence that the Dutch translation of the ASCOT is valid, reliable and comparable to the original English version. We recommend further research to confirm the validity of the modified Dutch ASCOT translation

Minimal clinically important change of the Neck Disability Index and the Numerical Rating Scale for patients with neck pain

STUDY DESIGN: Prospective, single-cohort study. OBJECTIVE: To assess the minimal clinically important change (MCIC) on the Neck Disability Index (NDI) and the Numerical Rating Scale (NRS) for pain in patients with neck pain. SUMMARY OF BACKGROUND DATA: Both measurement instruments are frequently used in research and clinical practice, but which changes are clinically relevant is still unknown. METHODS: The MCIC was estimated with 2 different methods, both integrating an anchor-based and distribution-based approach: the minimal detectable change (MDC) and the optimal cutoff point of the ROC curve. The study population consisted of 183 patients with nonspecific neck pain. RESULTS: The results show an MDC of 10.5 points for the NDI (scale range, 0-50) and 4.3 points for the NRS (scale range, 0-10), and optimal cutoff points of the ROC curve of 3.5 for the NDI and 2.5 for the NRS. CONCLUSION: The estimated MCIC should be used as an indication for relevant changes in clinical practice. Using the optimal cutoff point of the ROC curve, false positives and false negatives are equally weighted; and if there are no objections doing so, the optimal cutoff point of the ROC curve may be a good choic

The burden of neck pain: its meaning for persons with neck pain and healthcare providers, explored by concept mapping

PURPOSE: To empirically define the concept of burden of neck pain. The lack of a clear understanding of this construct from the perspective of persons with neck pain and care providers hampers adequate measurement of this burden. An additional aim was to compare the conceptual model obtained with the frequently used Neck Disability Index (NDI). METHODS: Concept mapping, combining qualitative (nominal group technique and group consensus) and quantitative research methods (cluster analysis and multidimensional scaling), was applied to groups of persons with neck pain (n = 3) and professionals treating persons with neck pain (n = 2). Group members generated statements, which were organized into concept maps. Group members achieved consensus about the number and description of domains and the researchers then generated an overall mind map covering the full breadth of the burden of neck pain. RESULTS: Concept mapping revealed 12 domains of burden of neck pain: impaired mobility neck, neck pain, fatigue/concentration, physical complaints, psychological aspects/consequences, activities of daily living, social participation, financial consequences, difficult to treat/difficult to diagnose, difference of opinion with care providers, incomprehension by social environment, and how person with neck pain deal with complaints. All ten items of the NDI could be linked to the mind map, but the NDI measures only part of the burden of neck pain. CONCLUSION: This study revealed the relevant domains for the burden of neck pain from the viewpoints of persons with neck pain and their care providers. These results can guide the identification of existing measurements instruments for each domain or the development of new ones to measure the burden of neck pain

Conventional and novel peripheral blood iron markers compared against bone marrow in Malawian children.

AIM Iron deficiency is an important child health problem. Its diagnosis in areas of high infection exposure remains complicated as inflammation may interfere with the accuracy of peripheral iron markers. With this study, we aimed to validate the conventional iron markers and two novel iron markers, hepcidin and Red blood cell Size Factor (RSf), against the reference standard of iron status, bone marrow iron, in children living in an infectious setting. METHODS We compared ferritin, soluble transferrin receptor, Soluble Transferrin Log-Ferritin Index (sTfR-F), mean cellular volume, mean cellular haemoglobin concentration, hepcidin and RSf, against bone marrow iron in 87 healthy Malawian children (6-66 months) scheduled for elective surgery. RESULTS Of all children, 44.8% had depleted bone marrow iron stores. Using optimised cut-offs, ferritin (1.85) best predicted depleted iron stores with a sensitivity/specificity of 73.7%/77.1% and 72.5%/75.0%, respectively. Hepcidin (<1.4 nmol/L) was a moderate sensitive marker (73.0%) although specificity was 54.2%; RSf poorly predicted depleted iron stores. CONCLUSIONS We provide the first bone marrow-validated data on peripheral iron markers in African children, and showed ferritin and sTfR-F best predicted iron status. Using appropriately defined cut-offs, these indicators can be applied in surveillance and research. As their accuracy is limited for clinical purposes, more reliable iron biomarkers are still required in African children

What does quality of life mean to older adults? A thematic synthesis.

BackgroundConsideration of older adults' quality of life (QoL) is becoming increasingly important in the evaluation, quality improvement and allocation of health and social care services. While numerous definitions and theories of QoL have been proposed, an overall synthesis of the perspective of older adults themselves is lacking.MethodsQualitative studies were identified in PubMed, Ebsco/Psycinfo and Ebsco/CINAHL, through a search on 28 November 2018. Articles needed to meet all of the following criteria: (i) focus on perceptions of QoL, (ii) older adults living at home as main participants, (iii) use of qualitative methodology, (iv) conducted in a Western country and (v) published in English (vi) not focused on specific patient groups. A thematic synthesis was conducted of the selected studies, using the complete 'findings/results' sections from the papers.ResultsWe included 48 qualitative studies representing the views of more than 3,400 older adults living at home in 11 Western countries. The QoL aspects identified in the synthesis were categorized into nine QoL domains: autonomy, role and activity, health perception, relationships, attitude and adaptation, emotional comfort, spirituality, home and neighbourhood, and financial security. The results showed that although different domains can be distinguished, these are also strongly connected.ConclusionQoL can be expressed in a number of domains and related subthemes that are important for older adults living at home. The findings further support that the concept of QoL should be seen as a dynamic web of intertwined domains