Patient-level performance evaluation of a smartphone-based malaria diagnostic application

Background Microscopic examination is commonly used for malaria diagnosis in the field. However, the lack of well-trained microscopists in malaria-endemic areas impacted the most by the disease is a severe problem. Besides, the examination process is time-consuming and prone to human error. Automated diagnostic systems based on machine learning offer great potential to overcome these problems. This study aims to evaluate Malaria Screener, a smartphone-based application for malaria diagnosis. Methods A total of 190 patients were recruited at two sites in rural areas near Khartoum, Sudan. The Malaria Screener mobile application was deployed to screen Giemsa-stained blood smears. Both expert microscopy and nested PCR were performed to use as reference standards. First, Malaria Screener was evaluated using the two reference standards. Then, during post-study experiments, the evaluation was repeated for a newly developed algorithm, PlasmodiumVF-Net. Results Malaria Screener reached 74.1% (95% CI 63.5–83.0) accuracy in detecting Plasmodium falciparum malaria using expert microscopy as the reference after a threshold calibration. It reached 71.8% (95% CI 61.0–81.0) accuracy when compared with PCR. The achieved accuracies meet the WHO Level 3 requirement for parasite detection. The processing time for each smear varies from 5 to 15 min, depending on the concentration of white blood cells (WBCs). In the post-study experiment, Malaria Screener reached 91.8% (95% CI 83.8–96.6) accuracy when patient-level results were calculated with a different method. This accuracy meets the WHO Level 1 requirement for parasite detection. In addition, PlasmodiumVF-Net, a newly developed algorithm, reached 83.1% (95% CI 77.0–88.1) accuracy when compared with expert microscopy and 81.0% (95% CI 74.6–86.3) accuracy when compared with PCR, reaching the WHO Level 2 requirement for detecting both Plasmodium falciparum and Plasmodium vivax malaria, without using the testing sites data for training or calibration. Results reported for both Malaria Screener and PlasmodiumVF-Net used thick smears for diagnosis. In this paper, both systems were not assessed in species identification and parasite counting, which are still under development. Conclusion Malaria Screener showed the potential to be deployed in resource-limited areas to facilitate routine malaria screening. It is the first smartphone-based system for malaria diagnosis evaluated on the patient-level in a natural field environment. Thus, the results in the field reported here can serve as a reference for future studies

Clinical accuracy of instrument-based SARS-CoV-2 antigen diagnostic tests:a systematic review and meta-analysis

Background: During the COVID-19 pandemic, antigen diagnostic tests were frequently used for screening, triage, and diagnosis. Novel instrument-based antigen tests (iAg tests) hold the promise of outperforming their instrument-free, visually-read counterparts. Here, we provide a systematic review and meta-analysis of the SARS-CoV-2 iAg tests’ clinical accuracy. Methods: We systematically searched MEDLINE (via PubMed), Web of Science, medRxiv, and bioRxiv for articles published before November 7th, 2022, evaluating the accuracy of iAg tests for SARS-CoV-2 detection. We performed a random effects meta-analysis to estimate sensitivity and specificity and used the QUADAS-2 tool to assess study quality and risk of bias. Sub-group analysis was conducted based on Ct value range, IFU-conformity, age, symptom presence and duration, and the variant of concern. Results: We screened the titles and abstracts of 20,431 articles and included 114 publications that fulfilled the inclusion criteria. Additionally, we incorporated three articles sourced from the FIND website, totaling 117 studies encompassing 95,181 individuals, which evaluated the clinical accuracy of 24 commercial COVID-19 iAg tests. The studies varied in risk of bias but showed high applicability. Of 24 iAg tests from 99 studies assessed in the meta-analysis, the pooled sensitivity and specificity compared to molecular testing of a paired NP swab sample were 76.7% (95% CI 73.5 to 79.7) and 98.4% (95% CI 98.0 to 98.7), respectively. Higher sensitivity was noted in individuals with high viral load (99.6% [95% CI 96.8 to 100] at Ct-level ≤ 20) and within the first week of symptom onset (84.6% [95% CI 78.2 to 89.3]), but did not differ between tests conducted as per manufacturer’s instructions and those conducted differently, or between point-of-care and lab-based testing. Conclusion: Overall, iAg tests have a high pooled specificity but a moderate pooled sensitivity, according to our analysis. The pooled sensitivity increases with lower Ct-values (a proxy for viral load), or within the first week of symptom onset, enabling reliable identification of most COVID-19 cases and highlighting the importance of context in test selection. The study underscores the need for careful evaluation considering performance variations and operational features of iAg tests.</p

Clinical accuracy of instrument-based SARS-CoV-2 antigen diagnostic tests:a systematic review and meta-analysis

Background: During the COVID-19 pandemic, antigen diagnostic tests were frequently used for screening, triage, and diagnosis. Novel instrument-based antigen tests (iAg tests) hold the promise of outperforming their instrument-free, visually-read counterparts. Here, we provide a systematic review and meta-analysis of the SARS-CoV-2 iAg tests’ clinical accuracy. Methods: We systematically searched MEDLINE (via PubMed), Web of Science, medRxiv, and bioRxiv for articles published before November 7th, 2022, evaluating the accuracy of iAg tests for SARS-CoV-2 detection. We performed a random effects meta-analysis to estimate sensitivity and specificity and used the QUADAS-2 tool to assess study quality and risk of bias. Sub-group analysis was conducted based on Ct value range, IFU-conformity, age, symptom presence and duration, and the variant of concern. Results: We screened the titles and abstracts of 20,431 articles and included 114 publications that fulfilled the inclusion criteria. Additionally, we incorporated three articles sourced from the FIND website, totaling 117 studies encompassing 95,181 individuals, which evaluated the clinical accuracy of 24 commercial COVID-19 iAg tests. The studies varied in risk of bias but showed high applicability. Of 24 iAg tests from 99 studies assessed in the meta-analysis, the pooled sensitivity and specificity compared to molecular testing of a paired NP swab sample were 76.7% (95% CI 73.5 to 79.7) and 98.4% (95% CI 98.0 to 98.7), respectively. Higher sensitivity was noted in individuals with high viral load (99.6% [95% CI 96.8 to 100] at Ct-level ≤ 20) and within the first week of symptom onset (84.6% [95% CI 78.2 to 89.3]), but did not differ between tests conducted as per manufacturer’s instructions and those conducted differently, or between point-of-care and lab-based testing. Conclusion: Overall, iAg tests have a high pooled specificity but a moderate pooled sensitivity, according to our analysis. The pooled sensitivity increases with lower Ct-values (a proxy for viral load), or within the first week of symptom onset, enabling reliable identification of most COVID-19 cases and highlighting the importance of context in test selection. The study underscores the need for careful evaluation considering performance variations and operational features of iAg tests.</p

Diagnostic accuracy and limit of detection of ten malaria parasite lactate dehydrogenase-based rapid tests for Plasmodium knowlesi and P. falciparum.

Background: Plasmodium knowlesi causes zoonotic malaria across Southeast Asia. First-line diagnostic microscopy cannot reliably differentiate P. knowlesi from other human malaria species. Rapid diagnostic tests (RDTs) designed for P. falciparum and P. vivax are used routinely in P. knowlesi co-endemic areas despite potential cross-reactivity for species-specific antibody targets. Methods: Ten RDTs were evaluated: nine to detect clinical P. knowlesi infections from Malaysia, and nine assessing limit of detection (LoD) for P. knowlesi (PkA1-H.1) and P. falciparum (Pf3D7) cultures. Targets included Plasmodium-genus parasite lactate dehydrogenase (pan-pLDH) and P. vivax (Pv)-pLDH. Results: Samples were collected prior to antimalarial treatment from 127 patients with microscopy-positive PCR-confirmed P. knowlesi mono-infections. Median parasitaemia was 788/µL (IQR 247-5,565/µL). Pan-pLDH sensitivities ranged from 50.6% (95% CI 39.6-61.5) (SD BIOLINE) to 87.0% (95% CI 75.1-94.6) (First Response® and CareStart™ PAN) compared to reference PCR. Pv-pLDH RDTs detected P. knowlesi with up to 92.0% (95% CI 84.3-96.7%) sensitivity (Biocredit™). For parasite counts ≥200/µL, pan-pLDH (Standard Q) and Pv-pLDH RDTs exceeded 95% sensitivity. Specificity of RDTs against 26 PCR-confirmed negative controls was 100%. Sensitivity of six highest performing RDTs were not significantly different when comparing samples taken before and after (median 3 hours) antimalarial treatment. Parasite ring stages were present in 30% of pre-treatment samples, with ring stage proportions (mean 1.9%) demonstrating inverse correlation with test positivity of Biocredit™ and two CareStart™ RDTs.For cultured P. knowlesi, CareStart™ PAN demonstrated the lowest LoD at 25 parasites/µL; LoDs of other pan-pLDH ranged from 98 to >2000 parasites/µL. Pv-pLDH LoD for P. knowlesi was 49 parasites/µL. No false-positive results were observed in either P. falciparum-pLDH or histidine-rich-protein-2 channels. Conclusion: Selected RDTs demonstrate sufficient performance for detection of major human malaria species including P. knowlesi in co-endemic areas where microscopy is not available, particularly for higher parasite counts, although cannot reliably differentiate among non-falciparum malaria

Regulation of Rps6 phosphorylation by TOR complexes in Saccharomyces cerevisiae

The Target Of Rapamycin (TOR) pathway is a central regulator of cell growth in response to various environmental and cell intrinsic cues. In this work, we investigated the role of TOR pathway in the regulation of the fate of an mRNA in Saccharomyces cerevisiae. The first part of the thesis work was dedicated to the investigation of how Ccr4, the major deadenylase in budding yeast, is regulated by TOR complex 1, while the second part focused on the regulation of translation by TOR complexes 1 and 2 with a specific interest on the regulation of the phosphorylation of a ribosomal protein, Rps6 in a TOR-dependent manner

A tuberculosis biomarker database: the key to novel TB diagnostics

New diagnostic innovations for tuberculosis (TB), including point-of-care solutions, are critical to reach the goals of the End TB Strategy. However, despite decades of research, numerous reports on new biomarker candidates, and significant investment, no well-performing, simple and rapid TB diagnostic test is yet available on the market, and the search for accurate, non-DNA biomarkers remains a priority. To help overcome this ‘biomarker pipeline problem’, FIND and partners are working on the development of a well-curated and user-friendly TB biomarker database. The web-based database will enable the dynamic tracking of evidence surrounding biomarker candidates in relation to target product profiles (TPPs) for needed TB diagnostics. It will be able to accommodate raw datasets and facilitate the verification of promising biomarker candidates and the identification of novel biomarker combinations. As such, the database will simplify data and knowledge sharing, empower collaboration, help in the coordination of efforts and allocation of resources, streamline the verification and validation of biomarker candidates, and ultimately lead to an accelerated translation into clinically useful tools