Meta-analysis of diagnostic accuracy studies in mental health

Objectives To explain methods for data synthesis of evidence from diagnostic test accuracy (DTA) studies, and to illustrate different types of analyses that may be performed in a DTA systematic review. Methods We described properties of meta-analytic methods for quantitative synthesis of evidence. We used a DTA review comparing the accuracy of three screening questionnaires for bipolar disorder to illustrate application of the methods for each type of analysis. Results The discriminatory ability of a test is commonly expressed in terms of sensitivity (proportion of those with the condition who test positive) and specificity (proportion of those without the condition who test negative). There is a trade-off between sensitivity and specificity, as an increasing threshold for defining test positivity will decrease sensitivity and increase specificity. Methods recommended for meta-analysis of DTA studies --such as the bivariate or hierarchical summary receiver operating characteristic (HSROC) model --jointly summarise sensitivity and specificity while taking into account this threshold effect, as well as allowing for between study differences in test performance beyond what would be expected by chance. The bivariate model focuses on estimation of a summary sensitivity and specificity at a common threshold while the HSROC model focuses on the estimation of a summary curve from studies that have used different thresholds. Conclusions Meta-analyses of diagnostic accuracy studies can provide answers to important clinical questions. We hope this article will provide clinicians with sufficient understanding of the terminology and methods to aid interpretation of systematic reviews and facilitate better patient care

Pedometry and 'peer support' in older Chinese adults: a 12-month cluster randomised controlled trial

Session - Exercise/RehabilitationResearch Dissemination ReportsThere is a need to increase physical activity to attenuate age-related morbidity. This 12-month factorial design cluster trial randomized 399 volunteers from 24 centres to buddy peer support, pedometry, or control group. Data were anaysed using last-observation carried-forward and intention-to-treat methods. Compared to the controls, participants in the pedometry group increased their levels of physical activity energy expenditure significantly, as did those in the buddy group. As recorded by the International Physical Activity Questionnaire [IPAQ], the respective increases amounted to 1820 (95% confidence interval [CI], 1360-2290) and 1260 (95% CI, 780-17 460) metabolic equivalent of task (MET).min.wk-1. The buddy group also had significantly improved aerobic fitness after adjustment for body weight (12%; 95% CI, 4-21%), but this did not attain significance in the pedometry group (7%; 95% CI, -1 to 15%). Our results suggest that recourse to pedometers and the buddy peer support system is simple means of increasing physical activity in older subjects.published_or_final_versio

Use of Non-Steroidal Anti-Inflammatory Drugs That Elevate Cardiovascular Risk: An Examination of Sales and Essential Medicines Lists in Low-, Middle-, and High-Income Countries

PMCID: PMC3570554This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited

Point-of-care tests detecting HIV nucleic acids for diagnosis of HIV-1 or HIV-2 infection in infants and children aged 18 months or less

BACKGROUND: The standard method of diagnosing HIV in infants and children less than 18 months is with a nucleic acid amplification test reverse transcriptase polymerase chain reaction test (NAT RT-PCR) detecting viral ribonucleic acid (RNA). Laboratory testing using the RT-PCR platform for HIV infection is limited by poor access, logistical support, and delays in relaying test results and initiating therapy in low-resource settings. The use of rapid diagnostic tests at or near the point-of-care (POC) can increase access to early diagnosis of HIV infection in infants and children less than 18 months of age and timely initiation of antiretroviral therapy (ART). OBJECTIVES: To summarize the diagnostic accuracy of point-of-care nucleic acid-based testing (POC NAT) to detect HIV-1/HIV-2 infection in infants and children aged 18 months or less exposed to HIV infection. SEARCH METHODS: We searched the Cochrane Central Register of Controlled Trials (CENTRAL) (until 2 February 2021), MEDLINE and Embase (until 1 February 2021), and LILACS and Web of Science (until 2 February 2021) with no language or publication status restriction. We also searched conference websites and clinical trial registries, tracked reference lists of included studies and relevant systematic reviews, and consulted experts for potentially eligible studies. SELECTION CRITERIA: We defined POC tests as rapid diagnostic tests conducted at or near the patient site. We included any primary study that compared the results of a POC NAT to a reference standard of laboratory NAT RT-PCR or total nucleic acid testing to detect the presence or absence of HIV infection denoted by HIV viral nucleic acids in infants and children aged 18 months or less who were exposed to HIV-1/HIV-2 infection. We included cross-sectional, prospective, and retrospective study designs and those that provided sufficient data to create the 2 × 2 table to calculate sensitivity and specificity. We excluded diagnostic case control studies with healthy controls. DATA COLLECTION AND ANALYSIS: We extracted information on study characteristics using a pretested standardized data extraction form. We used the QUADAS-2 (Quality Assessment of Diagnostic Accuracy Studies) tool to assess the risk of bias and applicability concerns of the included studies. Two review authors independently selected and assessed the included studies, resolving any disagreements by consensus. The unit of analysis was the participant. We first conducted preliminary exploratory analyses by plotting estimates of sensitivity and specificity from each study on forest plots and in receiver operating characteristic (ROC) space. For the overall meta-analyses, we pooled estimates of sensitivity and specificity using the bivariate meta-analysis model at a common threshold (presence or absence of infection). MAIN RESULTS: We identified a total of 12 studies (15 evaluations, 15,120 participants). All studies were conducted in sub-Saharan Africa. The ages of included infants and children in the evaluations were as follows: at birth (n = 6), ≤ 12 months (n = 3), ≤ 18 months (n = 5), and ≤ 24 months (n = 1). Ten evaluations were field evaluations of the POC NAT test at the point of care, and five were laboratory evaluations of the POC NAT tests.The POC NAT tests evaluated included Alere q HIV-1/2 Detect qualitative test (recently renamed m-PIMA q HIV-1/2 Detect qualitative test) (n = 6), Xpert HIV-1 qualitative test (n = 6), and SAMBA HIV-1 qualitative test (n = 3). POC NAT pooled sensitivity and specificity (95% confidence interval (CI)) against laboratory reference standard tests were 98.6% (96.1 to 99.5) (15 evaluations, 1728 participants) and 99.9% (99.7 to 99.9) (15 evaluations, 13,392 participants) in infants and children ≤ 18 months. Risk of bias in the included studies was mostly low or unclear due to poor reporting. Five evaluations had some concerns for applicability for the index test, as they were POC tests evaluated in a laboratory setting, but there was no difference detected between settings in sensitivity (-1.3% (95% CI -4.1 to 1.5)); and specificity results were similar. AUTHORS' CONCLUSIONS: For the diagnosis of HIV-1/HIV-2 infection, we found the sensitivity and specificity of POC NAT tests to be high in infants and children aged 18 months or less who were exposed to HIV infection

How are "teaching the teachers" courses in evidence based medicine evaluated? A systematic review

Background Teaching of evidence-based medicine (EBM) has become widespread in medical education. Teaching the teachers (TTT) courses address the increased teaching demand and the need to improve effectiveness of EBM teaching. We conducted a systematic review of assessment tools for EBM TTT courses. To summarise and appraise existing assessment methods for teaching the teachers courses in EBM by a systematic review. Methods We searched PubMed, BioMed, EmBase, Cochrane and Eric databases without language restrictions and included articles that assessed its participants. Study selection and data extraction were conducted independently by two reviewers. Results Of 1230 potentially relevant studies, five papers met the selection criteria. There were no specific assessment tools for evaluating effectiveness of EBM TTT courses. Some of the material available might be useful in initiating the development of such an assessment tool. Conclusion There is a need for the development of educationally sound assessment tools for teaching the teachers courses in EBM, without which it would be impossible to ascertain if such courses have the desired effect

Dual HLA B*42 and B*81-reactive T cell receptors recognize more diverse HIV-1 Gag escape variants

Closely related HLA alleles presenting similar HIV-1 epitopes can be associated with variable clinical outcome. Here the authors report their findings on CD8+ T cell responses to the HIV-1 Gag-p24 TL9 immunodominant epitope in the context of closely related protective and less protective HLA alleles, and their differential effect on viral contro

Oral rehydration versus intravenous therapy for treating dehydration due to gastroenteritis in children: a meta-analysis of randomised controlled trials

BACKGROUND: Despite treatment recommendations from various organizations, oral rehydration therapy (ORT) continues to be underused, particularly by physicians in high-income countries. We conducted a systematic review of randomised controlled trials (RCTs) to compare ORT and intravenous therapy (IVT) for the treatment of dehydration secondary to acute gastroenteritis in children. METHODS: RCTs were identified through MEDLINE, EMBASE, CENTRAL, authors and references of included trials, pharmaceutical companies, and relevant organizations. Screening and inclusion were performed independently by two reviewers in order to identify randomised or quasi-randomised controlled trials comparing ORT and IVT in children with acute diarrhea and dehydration. Two reviewers independently assessed study quality using the Jadad scale and allocation concealment. Data were extracted by one reviewer and checked by a second. The primary outcome measure was failure of rehydration. We analyzed data using standard meta-analytic techniques. RESULTS: The quality of the 14 included trials ranged from 0 to 3 (Jadad score); allocation concealment was unclear in all but one study. Using a random effects model, there was no significant difference in treatment failures (risk difference [RD] 3%; 95% confidence intervals [CI]: 0, 6). The Mantel-Haenzsel fixed effects model gave a significant difference between treatment groups (RD 4%; 95% CI: 2, 5) favoring IVT. Based on the four studies that reported deaths, there were six in the IVT groups and two in ORT. There were no significant differences in total fluid intake at six and 24 hours, weight gain, duration of diarrhea, or hypo/hypernatremia. Length of stay was significantly shorter for the ORT group (weighted mean difference [WMD] -1.2 days; 95% CI: -2.4,-0.02). Phlebitis occurred significantly more often with IVT (number needed to treat [NNT] 33; 95% CI: 25,100); paralytic ileus occurred more often with ORT (NNT 33; 95% CI: 20,100). These results may not be generalizable to children with persistent vomiting. CONCLUSION: There were no clinically important differences between ORT and IVT in terms of efficacy and safety. For every 25 children (95% CI: 20, 50) treated with ORT, one would fail and require IVT. The results support existing practice guidelines recommending ORT as the first course of treatment in appropriate children with dehydration secondary to gastroenteritis

Accuracy of five algorithms to diagnose gambiense human African trypanosomiasis.

Algorithms to diagnose gambiense human African trypanosomiasis (HAT, sleeping sickness) are often complex due to the unsatisfactory sensitivity and/or specificity of available tests, and typically include a screening (serological), confirmation (parasitological) and staging component. There is insufficient evidence on the relative accuracy of these algorithms. This paper presents estimates of the accuracy of five algorithms used by past Médecins Sans Frontières programmes in the Republic of Congo, Southern Sudan and Uganda

Radiographers supporting radiologists in the interpretation of screening mammography: a viable strategy to meet the shortage in the number of radiologists.

BackgroundAn alternative approach to the traditional model of radiologists interpreting screening mammography is necessary due to the shortage of radiologists to interpret screening mammograms in many countries.MethodsWe evaluated the performance of 15 Mexican radiographers, also known as radiologic technologists, in the interpretation of screening mammography after a 6 months training period in a screening setting. Fifteen radiographers received 6 months standardized training with radiologists in the interpretation of screening mammography using the Breast Imaging Reporting and Data System (BI-RADS) system. A challenging test set of 110 cases developed by the Breast Cancer Surveillance Consortium was used to evaluate their performance. We estimated sensitivity, specificity, false positive rates, likelihood ratio of a positive test (LR+) and the area under the subject-specific Receiver Operating Characteristic (ROC) curve (AUC) for diagnostic accuracy. A mathematical model simulating the consequences in costs and performance of two hypothetical scenarios compared to the status quo in which a radiologist reads all screening mammograms was also performed.ResultsRadiographer's sensitivity was comparable to the sensitivity scores achieved by U.S. radiologists who took the test but their false-positive rate was higher. Median sensitivity was 73.3 % (Interquartile range, IQR: 46.7-86.7 %) and the median false positive rate was 49.5 % (IQR: 34.7-57.9 %). The median LR+ was 1.4 (IQR: 1.3-1.7 %) and the median AUC was 0.6 (IQR: 0.6-0.7). A scenario in which a radiographer reads all mammograms first, and a radiologist reads only those that were difficult for the radiographer, was more cost-effective than a scenario in which either the radiographer or radiologist reads all mammograms.ConclusionsGiven the comparable sensitivity achieved by Mexican radiographers and U.S. radiologists on a test set, screening mammography interpretation by radiographers appears to be a possible adjunct to radiologists in countries with shortages of radiologists. Further studies are required to assess the effectiveness of different training programs in order to obtain acceptable screening accuracy, as well as the best approaches for the use of non-physician readers to interpret screening mammography