Estimating sensitivity and specificity of diagnostic tests using latent class models that account for conditional dependence between tests: a simulation study

BACKGROUND: Latent class models are increasingly used to estimate the sensitivity and specificity of diagnostic tests in the absence of a gold standard, and are commonly fitted using Bayesian methods. These models allow us to account for 'conditional dependence' between two or more diagnostic tests, meaning that the results from tests are correlated even after conditioning on the person's true disease status. The challenge is that it is not always clear to researchers whether conditional dependence exists between tests and whether it exists in all or just some latent classes. Despite the increasingly widespread use of latent class models to estimate diagnostic test accuracy, the impact of the conditional dependence structure chosen on the estimates of sensitivity and specificity remains poorly investigated. METHODS: A simulation study and a reanalysis of a published case study are used to highlight the impact of the conditional dependence structure chosen on estimates of sensitivity and specificity. We describe and implement three latent class random-effect models with differing conditional dependence structures, as well as a conditional independence model and a model that assumes perfect test accuracy. We assess the bias and coverage of each model in estimating sensitivity and specificity across different data generating mechanisms. RESULTS: The findings highlight that assuming conditional independence between tests within a latent class, where conditional dependence exists, results in biased estimates of sensitivity and specificity and poor coverage. The simulations also reiterate the substantial bias in estimates of sensitivity and specificity when incorrectly assuming a reference test is perfect. The motivating example of tests for Melioidosis highlights these biases in practice with important differences found in estimated test accuracy under different model choices. CONCLUSIONS: We have illustrated that misspecification of the conditional dependence structure leads to biased estimates of sensitivity and specificity when there is a correlation between tests. Due to the minimal loss in precision seen by using a more general model, we recommend accounting for conditional dependence even if researchers are unsure of its presence or it is only expected at minimal levels

Biotic factors limit the invasion of the plague pathogen ( <i>Yersinia pestis</i> ) in novel geographical settings

Aim: The distribution of Yersinia pestis, the pathogen that causes plague in humans, is reliant upon transmission between host species; however, the degree to which host species distributions dictate the distribution of Y. pestis, compared with limitations imposed by the environmental niche of Y. pestis per se, is debated. We test whether the present-day environmental niche of Y. pestis differs between its native range and an invaded range and whether biotic factors (host distributions) can explain observed discrepancies. Location: North America and Central Asia. Major taxa studied: Yersinia pestis. Methods: We use environmental niche models to determine whether the current climatic niche of Y. pestis differs between its native range in Asia and its invaded range in North America. We then test whether the inclusion of information on the distribution of host species improves the ability of models to capture the North American niche. We use geographical null models to guard against spurious correlations arising from spatially autocorrelated occurrence points. Results: The current climatic niche of Y. pestis differs between its native and invaded regions. The Asian niche overpredicted the distribution of Y. pestis across North America. Including biotic factors along with the native climatic niche increased niche overlap between the native and invaded models, and models containing only biotic factors performed better than the native climatic niche alone. Geographical null models confirmed that the increased niche overlap through inclusion of biotic factors did not, with a couple of exceptions, arise solely from spatially autocorrelated occurrences. Main conclusions: The current climatic niche in Central Asia differs from the current climatic niche in North America. Inclusion of biotic factors improved the fit of models to the Y. pestis distribution data in its invaded region better than climate variables alone. This highlights the importance of host species when investigating zoonotic disease introductions and suggests that climatic variables alone are insufficient to predict disease distribution in novel environments

Diagnostic performance of the IMMY cryptococcal antigen lateral flow assay on serum and cerebrospinal fluid for diagnosis of cryptococcosis in HIV-negative patients: a systematic review.

BACKGROUND: The incidence of cryptococcosis amongst HIV-negative persons is increasing. Whilst the excellent performance of the CrAg testing in people living with HIV is well described, the diagnostic performance of the CrAg LFA has not been systematically evaluated in HIV-negative cohorts on serum or cerebrospinal fluid. METHODS: We performed a systematic review to characterise the diagnostic performance of IMMY CrAg® LFA in HIV-negative populations on serum and cerebrospinal fluid. A systematic electronic search was performed using Medline, Embase, Global Health, CENTRAL, WoS Science Citation Index, SCOPUS, Africa-Wide Information, LILACS and WHO Global Health Library. Studies were screened and data extracted from eligible studies by two independent reviewers. A fixed effect meta-analysis was used to estimate the diagnostic sensitivity and specificity. RESULTS: Of 447 records assessed for eligibility, nine studies met our inclusion criteria, including 528 participants overall. Amongst eight studies that evaluated the diagnostic performance of the IMMY CrAg® LFA on serum, the pooled median sensitivity was 96% (95% Credible Interval (CrI) 68-100%) with a pooled specificity estimate of 96% (95%CrI 84-100%). Amongst six studies which evaluated the diagnostic performance of IMMY CrAg® LFA on CSF, the pooled median sensitivity was 99% (95%CrI 95-100%) with a pooled specificity median of 99% (95%CrI 95-100%). CONCLUSIONS: This review demonstrates a high pooled sensitivity and specificity for the IMMY CrAg® LFA in HIV-negative populations, in keeping with findings in HIV-positive individuals. The review was limited by the small number of studies. Further studies using IMMY CrAg® LFA in HIV-negative populations would help to better determine the diagnostic value of this test

Mapping malaria by sharing spatial information between incidence and prevalence data sets

As malaria incidence decreases and more countries move towards elimination, maps of malaria risk in low-prevalence areas are increasingly needed. For low-burden areas, disaggregation regression models have been developed to estimate risk at high spatial resolution from routine surveillance reports aggregated by administrative unit polygons. However, in areas with both routine surveillance data and prevalence surveys, models that make use of the spatial information from prevalence point-surveys might make more accurate predictions. Using case studies in Indonesia, Senegal and Madagascar, we compare the out-of-sample mean absolute error for two methods for incorporating point-level, spatial information into disaggregation regression models. The first simply fits a binomial-likelihood, logit-link, Gaussian random field to prevalence point-surveys to create a new covariate. The second is a multi-likelihood model that is fitted jointly to prevalence point-surveys and polygon incidence data. We find that in most cases there is no difference in mean absolute error between models. In only one case, did the new models perform the best. More generally, our results demonstrate that combining these types of data has the potential to reduce absolute error in estimates of malaria incidence but that simpler baseline models should always be fitted as a benchmark

Spatiotemporal mapping of malaria prevalence in Madagascar using routine surveillance and health survey data.

Malaria transmission in Madagascar is highly heterogeneous, exhibiting spatial, seasonal and long-term trends. Previous efforts to map malaria risk in Madagascar used prevalence data from Malaria Indicator Surveys. These cross-sectional surveys, conducted during the high transmission season most recently in 2013 and 2016, provide nationally representative prevalence data but cover relatively short time frames. Conversely, monthly case data are collected at health facilities but suffer from biases, including incomplete reporting and low rates of treatment seeking. We combined survey and case data to make monthly maps of prevalence between 2013 and 2016. Health facility catchment populations were estimated to produce incidence rates from the case data. Smoothed incidence surfaces, environmental and socioeconomic covariates, and survey data informed a Bayesian prevalence model, in which a flexible incidence-to-prevalence relationship was learned. Modelled spatial trends were consistent over time, with highest prevalence in the coastal regions and low prevalence in the highlands and desert south. Prevalence was lowest in 2014 and peaked in 2015 and seasonality was widely observed, including in some lower transmission regions. These trends highlight the utility of monthly prevalence estimates over the four year period. By combining survey and case data using this two-step modelling approach, we were able to take advantage of the relative strengths of each metric while accounting for potential bias in the case data. Similar modelling approaches combining large datasets of different malaria metrics may be applicable across sub-Saharan Africa

Global estimation of anti-malarial drug effectiveness for the treatment of uncomplicated Plasmodium falciparum malaria 1991-2019.

BACKGROUND: Anti-malarial drugs play a critical role in reducing malaria morbidity and mortality, but their role is mediated by their effectiveness. Effectiveness is defined as the probability that an anti-malarial drug will successfully treat an individual infected with malaria parasites under routine health care delivery system. Anti-malarial drug effectiveness (AmE) is influenced by drug resistance, drug quality, health system quality, and patient adherence to drug use; its influence on malaria burden varies through space and time. METHODS: This study uses data from 232 efficacy trials comprised of 86,776 infected individuals to estimate the artemisinin-based and non-artemisinin-based AmE for treating falciparum malaria between 1991 and 2019. Bayesian spatiotemporal models were fitted and used to predict effectiveness at the pixel-level (5 km × 5 km). The median and interquartile ranges (IQR) of AmE are presented for all malaria-endemic countries. RESULTS: The global effectiveness of artemisinin-based drugs was 67.4% (IQR: 33.3-75.8), 70.1% (43.6-76.0) and 71.8% (46.9-76.4) for the 1991-2000, 2006-2010, and 2016-2019 periods, respectively. Countries in central Africa, a few in South America, and in the Asian region faced the challenge of lower effectiveness of artemisinin-based anti-malarials. However, improvements were seen after 2016, leaving only a few hotspots in Southeast Asia where resistance to artemisinin and partner drugs is currently problematic and in the central Africa where socio-demographic challenges limit effectiveness. The use of artemisinin-based combination therapy (ACT) with a competent partner drug and having multiple ACT as first-line treatment choice sustained high levels of effectiveness. High levels of access to healthcare, human resource capacity, education, and proximity to cities were associated with increased effectiveness. Effectiveness of non-artemisinin-based drugs was much lower than that of artemisinin-based with no improvement over time: 52.3% (17.9-74.9) for 1991-2000 and 55.5% (27.1-73.4) for 2011-2015. Overall, AmE for artemisinin-based and non-artemisinin-based drugs were, respectively, 29.6 and 36% below clinical efficacy as measured in anti-malarial drug trials. CONCLUSIONS: This study provides evidence that health system performance, drug quality and patient adherence influence the effectiveness of anti-malarials used in treating uncomplicated falciparum malaria. These results provide guidance to countries' treatment practises and are critical inputs for malaria prevalence and incidence models used to estimate national level malaria burden

Mapping the global endemicity and clinical burden of Plasmodium vivax, 2000–17: a spatial and temporal modelling study.

BACKGROUND: Plasmodium vivax exacts a significant toll on health worldwide, yet few efforts to date have quantified the extent and temporal trends of its global distribution. Given the challenges associated with the proper diagnosis and treatment of P vivax, national malaria programmes-particularly those pursuing malaria elimination strategies-require up to date assessments of P vivax endemicity and disease impact. This study presents the first global maps of P vivax clinical burden from 2000 to 2017. METHODS: In this spatial and temporal modelling study, we adjusted routine malariometric surveillance data for known biases and used socioeconomic indicators to generate time series of the clinical burden of P vivax. These data informed Bayesian geospatial models, which produced fine-scale predictions of P vivax clinical incidence and infection prevalence over time. Within sub-Saharan Africa, where routine surveillance for P vivax is not standard practice, we combined predicted surfaces of Plasmodium falciparum with country-specific ratios of P vivax to P falciparum. These results were combined with surveillance-based outputs outside of Africa to generate global maps. FINDINGS: We present the first high-resolution maps of P vivax burden. These results are combined with those for P falciparum (published separately) to form the malaria estimates for the Global Burden of Disease 2017 study. The burden of P vivax malaria decreased by 41·6%, from 24·5 million cases (95% uncertainty interval 22·5-27·0) in 2000 to 14·3 million cases (13·7-15·0) in 2017. The Americas had a reduction of 56·8% (47·6-67·0) in total cases since 2000, while South-East Asia recorded declines of 50·5% (50·3-50·6) and the Western Pacific regions recorded declines of 51·3% (48·0-55·4). Europe achieved zero P vivax cases during the study period. Nonetheless, rates of decline have stalled in the past five years for many countries, with particular increases noted in regions affected by political and economic instability. INTERPRETATION: Our study highlights important spatial and temporal patterns in the clinical burden and prevalence of P vivax. Amid substantial progress worldwide, plateauing gains and areas of increased burden signal the potential for challenges that are greater than expected on the road to malaria elimination. These results support global monitoring systems and can inform the optimisation of diagnosis and treatment where P vivax has most impact. FUNDING: Bill & Melinda Gates Foundation and the Wellcome Trust

Global age-sex-specific fertility, mortality, healthy life expectancy (HALE), and population estimates in 204 countries and territories, 1950-2019 : a comprehensive demographic analysis for the Global Burden of Disease Study 2019

Background: Accurate and up-to-date assessment of demographic metrics is crucial for understanding a wide range of social, economic, and public health issues that affect populations worldwide. The Global Burden of Diseases, Injuries, and Risk Factors Study (GBD) 2019 produced updated and comprehensive demographic assessments of the key indicators of fertility, mortality, migration, and population for 204 countries and territories and selected subnational locations from 1950 to 2019. Methods: 8078 country-years of vital registration and sample registration data, 938 surveys, 349 censuses, and 238 other sources were identified and used to estimate age-specific fertility. Spatiotemporal Gaussian process regression (ST-GPR) was used to generate age-specific fertility rates for 5-year age groups between ages 15 and 49 years. With extensions to age groups 10–14 and 50–54 years, the total fertility rate (TFR) was then aggregated using the estimated age-specific fertility between ages 10 and 54 years. 7417 sources were used for under-5 mortality estimation and 7355 for adult mortality. ST-GPR was used to synthesise data sources after correction for known biases. Adult mortality was measured as the probability of death between ages 15 and 60 years based on vital registration, sample registration, and sibling histories, and was also estimated using ST-GPR. HIV-free life tables were then estimated using estimates of under-5 and adult mortality rates using a relational model life table system created for GBD, which closely tracks observed age-specific mortality rates from complete vital registration when available. Independent estimates of HIV-specific mortality generated by an epidemiological analysis of HIV prevalence surveys and antenatal clinic serosurveillance and other sources were incorporated into the estimates in countries with large epidemics. Annual and single-year age estimates of net migration and population for each country and territory were generated using a Bayesian hierarchical cohort component model that analysed estimated age-specific fertility and mortality rates along with 1250 censuses and 747 population registry years. We classified location-years into seven categories on the basis of the natural rate of increase in population (calculated by subtracting the crude death rate from the crude birth rate) and the net migration rate. We computed healthy life expectancy (HALE) using years lived with disability (YLDs) per capita, life tables, and standard demographic methods. Uncertainty was propagated throughout the demographic estimation process, including fertility, mortality, and population, with 1000 draw-level estimates produced for each metric. Findings: The global TFR decreased from 2·72 (95% uncertainty interval [UI] 2·66–2·79) in 2000 to 2·31 (2·17–2·46) in 2019. Global annual livebirths increased from 134·5 million (131·5–137·8) in 2000 to a peak of 139·6 million (133·0–146·9) in 2016. Global livebirths then declined to 135·3 million (127·2–144·1) in 2019. Of the 204 countries and territories included in this study, in 2019, 102 had a TFR lower than 2·1, which is considered a good approximation of replacement-level fertility. All countries in sub-Saharan Africa had TFRs above replacement level in 2019 and accounted for 27·1% (95% UI 26·4–27·8) of global livebirths. Global life expectancy at birth increased from 67·2 years (95% UI 66·8–67·6) in 2000 to 73·5 years (72·8–74·3) in 2019. The total number of deaths increased from 50·7 million (49·5–51·9) in 2000 to 56·5 million (53·7–59·2) in 2019. Under-5 deaths declined from 9·6 million (9·1–10·3) in 2000 to 5·0 million (4·3–6·0) in 2019. Global population increased by 25·7%, from 6·2 billion (6·0–6·3) in 2000 to 7·7 billion (7·5–8·0) in 2019. In 2019, 34 countries had negative natural rates of increase; in 17 of these, the population declined because immigration was not sufficient to counteract the negative rate of decline. Globally, HALE increased from 58·6 years (56·1–60·8) in 2000 to 63·5 years (60·8–66·1) in 2019. HALE increased in 202 of 204 countries and territories between 2000 and 2019

Global burden of 369 diseases and injuries in 204 countries and territories, 1990–2019: a systematic analysis for the Global Burden of Disease Study 2019

Background: In an era of shifting global agendas and expanded emphasis on non-communicable diseases and injuries along with communicable diseases, sound evidence on trends by cause at the national level is essential. The Global Burden of Diseases, Injuries, and Risk Factors Study (GBD) provides a systematic scientific assessment of published, publicly available, and contributed data on incidence, prevalence, and mortality for a mutually exclusive and collectively exhaustive list of diseases and injuries. Methods: GBD estimates incidence, prevalence, mortality, years of life lost (YLLs), years lived with disability (YLDs), and disability-adjusted life-years (DALYs) due to 369 diseases and injuries, for two sexes, and for 204 countries and territories. Input data were extracted from censuses, household surveys, civil registration and vital statistics, disease registries, health service use, air pollution monitors, satellite imaging, disease notifications, and other sources. Cause-specific death rates and cause fractions were calculated using the Cause of Death Ensemble model and spatiotemporal Gaussian process regression. Cause-specific deaths were adjusted to match the total all-cause deaths calculated as part of the GBD population, fertility, and mortality estimates. Deaths were multiplied by standard life expectancy at each age to calculate YLLs. A Bayesian meta-regression modelling tool, DisMod-MR 2.1, was used to ensure consistency between incidence, prevalence, remission, excess mortality, and cause-specific mortality for most causes. Prevalence estimates were multiplied by disability weights for mutually exclusive sequelae of diseases and injuries to calculate YLDs. We considered results in the context of the Socio-demographic Index (SDI), a composite indicator of income per capita, years of schooling, and fertility rate in females younger than 25 years. Uncertainty intervals (UIs) were generated for every metric using the 25th and 975th ordered 1000 draw values of the posterior distribution. Findings: Global health has steadily improved over the past 30 years as measured by age-standardised DALY rates. After taking into account population growth and ageing, the absolute number of DALYs has remained stable. Since 2010, the pace of decline in global age-standardised DALY rates has accelerated in age groups younger than 50 years compared with the 1990–2010 time period, with the greatest annualised rate of decline occurring in the 0–9-year age group. Six infectious diseases were among the top ten causes of DALYs in children younger than 10 years in 2019: lower respiratory infections (ranked second), diarrhoeal diseases (third), malaria (fifth), meningitis (sixth), whooping cough (ninth), and sexually transmitted infections (which, in this age group, is fully accounted for by congenital syphilis; ranked tenth). In adolescents aged 10–24 years, three injury causes were among the top causes of DALYs: road injuries (ranked first), self-harm (third), and interpersonal violence (fifth). Five of the causes that were in the top ten for ages 10–24 years were also in the top ten in the 25–49-year age group: road injuries (ranked first), HIV/AIDS (second), low back pain (fourth), headache disorders (fifth), and depressive disorders (sixth). In 2019, ischaemic heart disease and stroke were the top-ranked causes of DALYs in both the 50–74-year and 75-years-and-older age groups. Since 1990, there has been a marked shift towards a greater proportion of burden due to YLDs from non-communicable diseases and injuries. In 2019, there were 11 countries where non-communicable disease and injury YLDs constituted more than half of all disease burden. Decreases in age-standardised DALY rates have accelerated over the past decade in countries at the lower end of the SDI range, while improvements have started to stagnate or even reverse in countries with higher SDI. Interpretation: As disability becomes an increasingly large component of disease burden and a larger component of health expenditure, greater research and developm nt investment is needed to identify new, more effective intervention strategies. With a rapidly ageing global population, the demands on health services to deal with disabling outcomes, which increase with age, will require policy makers to anticipate these changes. The mix of universal and more geographically specific influences on health reinforces the need for regular reporting on population health in detail and by underlying cause to help decision makers to identify success stories of disease control to emulate, as well as opportunities to improve. Funding: Bill & Melinda Gates Foundation. © 2020 The Author(s). Published by Elsevier Ltd. This is an Open Access article under the CC BY 4.0 licens

shk313/Evaluating-sensitivity-and-specificity-from-LCM-a-simulation-study

Codes used in the study to generate the simulated data sets and run each model