Two-stage automated diagnosis framework for urogenital schistosomiasis in microscopy images from low-resource settings

Purpose Automated diagnosis of urogenital schistosomiasis using digital microscopy images of urine slides is an essential step toward the elimination of schistosomiasis as a disease of public health concern in Sub-Saharan African countries. We create a robust image dataset of urine samples obtained from field settings and develop a two-stage diagnosis framework for urogenital schistosomiasis. Approach Urine samples obtained from field settings were captured using the Schistoscope device, and S. haematobium eggs present in the images were manually annotated by experts to create the SH dataset. Next, we develop a two-stage diagnosis framework, which consists of semantic segmentation of S. haematobium eggs using the DeepLabv3-MobileNetV3 deep convolutional neural network and a refined segmentation step using ellipse fitting approach to approximate the eggs with an automatically determined number of ellipses. We defined two linear inequality constraints as a function of the overlap coefficient and area of a fitted ellipses. False positive diagnosis resulting from over-segmentation was further minimized using these constraints. We evaluated the performance of our framework on 7605 images from 65 independent urine samples collected from field settings in Nigeria, by deploying our algorithm on an Edge AI system consisting of Raspberry Pi + Coral USB accelerator. Result The SH dataset contains 12,051 images from 103 independent urine samples and the developed urogenital schistosomiasis diagnosis framework achieved clinical sensitivity, specificity, and precision of 93.8%, 93.9%, and 93.8%, respectively, using results from an experienced microscopist as reference. Conclusion Our detection framework is a promising tool for the diagnosis of urogenital schistosomiasis as our results meet the World Health Organization target product profile requirements for monitoring and evaluation of schistosomiasis control programs

Performance evaluation of the Schistoscope 5.0 for (semi-)automated digital detection and quantification of schistosoma haematobium eggs in Urine: A field-based study in Nigeria

Conventional microscopy is the standard procedure for the diagnosis of schistosomiasis, despite its limited sensitivity, reliance on skilled personnel, and the fact that it is error prone. Here, we report the performance of the innovative (semi-)automated Schistoscope 5.0 for optical digital detection and quantification of Schistosoma haematobium eggs in urine, using conventional microscopy as the reference standard. At baseline, 487 participants in a rural setting in Nigeria were assessed, of which 166 (34.1%) tested S. haematobium positive by conventional microscopy. Captured images from the Schistoscope 5.0 were analyzed manually (semiautomation) and by an artificial intelligence (AI) algorithm (full automation). Semi- and fully automated digital microscopy showed comparable sensitivities of 80.1% (95% confidence interval [CI]: 73.2–86.0) and 87.3% (95% CI: 81.3–92.0), but a significant difference in specificity of 95.3% (95% CI: 92.4–97.4) and 48.9% (95% CI: 43.3–55.0), respectively. Overall, estimated egg counts of semi- and fully automated digital microscopy correlated significantly with the egg counts of conventional microscopy (r = 0.90 and r = 0.80, respectively, P < 0.001), although the fully automated procedure generally underestimated the higher egg counts. In 38 egg positive cases, an additional urine sample was examined 10 days after praziquantel treatment, showing a similar cure rate and egg reduction rate when comparing conventional microscopy with semiautomated digital microscopy. In this first extensive field evaluation, we found the semiautomated Schistoscope 5.0 to be a promising tool for the detection and monitoring of S. haematobium infection, although further improvement of the AI algorithm for full automation is required

Validation of artificial intelligence-based digital microscopy for automated detection of Schistosoma haematobium eggs in urine in Gabon

Introduction Schistosomiasis is a significant public health concern, especially in Sub-Saharan Africa. Conventional microscopy is the standard diagnostic method in resource-limited settings, but with limitations, such as the need for expert microscopists. An automated digital microscope with artificial intelligence (Schistoscope), offers a potential solution. This field study aimed to validate the diagnostic performance of the Schistoscope for detecting and quantifying Schistosoma haematobium eggs in urine compared to conventional microscopy and to a composite reference standard (CRS) consisting of real-time PCR and the up-converting particle (UCP) lateral flow (LF) test for the detection of schistosome circulating anodic antigen (CAA). Methods Based on a non-inferiority concept, the Schistoscope was evaluated in two parts: study A, consisting of 339 freshly collected urine samples and study B, consisting of 798 fresh urine samples that were also banked as slides for analysis with the Schistoscope. In both studies, the Schistoscope, conventional microscopy, real-time PCR and UCP-LF CAA were performed and samples with all the diagnostic test results were included in the analysis. All diagnostic procedures were performed in a laboratory located in a rural area of Gabon, endemic for S. haematobium. Results In study A and B, the Schistoscope demonstrated a sensitivity of 83.1% and 96.3% compared to conventional microscopy, and 62.9% and 78.0% compared to the CRS. The sensitivity of conventional microscopy in study A and B compared to the CRS was 61.9% and 75.2%, respectively, comparable to the Schistoscope. The specificity of the Schistoscope in study A (78.8%) was significantly lower than that of conventional microscopy (96.4%) based on the CRS but comparable in study B (90.9% and 98.0%, respectively). Conclusion Overall, the performance of the Schistoscope was non-inferior to conventional microscopy with a comparable sensitivity, although the specificity varied. The Schistoscope shows promising diagnostic accuracy, particularly for samples with moderate to higher infection intensities as well as for banked sample slides, highlighting the potential for retrospective analysis in resource-limited settings

A usability study of an innovative optical device for the diagnosis of schistosomiasis in Nigeria

Schistosomiasis is a neglected tropical disease thatis predominantly diagnosed by conventional microscopy in Sub-Saharan Africa. However, effective diagnosis by conventional microscopy is limited by multiple technical and logistic barriers.Alternative diagnostic techniques are needed. The Schistoscope is a digital optical device that has been designed to support microscopists for the detection of schistosomiasis in endemic resource-limited settings. Aim: A user-centered design approachwas used to assess the usability and user-acceptance of the Schistoscope compared to conventional microscopy in the Federal Capital Territory, Abuja, Nigeria. In this study, usability and acceptance are defined as being easy-to-use, efficient, and suitable in the daily workflow by end-users. Methods: Using a qualitative conventional context analysis approach, a mixedmethods questionnaire was used to elucidate themes related to the usability and user-acceptance of the device. Participants included trained microscopists and university students (n=17). Results: Participants answered both ranked and open questions. Overall the device’s use was considered to be easy and acceptablein the routine workflow of a microscopist. The auto-scan feature was considered to have added value. Critical feedback regarding aesthetics of the device, particularly related to size, was noted by the participants. Conclusion: The usability approach used in this study elucidated valuable insights of end-users. The Schistoscope was very well perceived by both medical students and trained microscopists. Critical feedback will be used to further improve the next iterative design of the device

A review on innovative optical devices for the diagnosis of human soil-transmitted helminthiasis and schistosomiasis: From research and development to commercialisation: from research and development to commercialization

Diagnosis of soil-transmitted helminth (STH) and schistosome infections relies largely on conventional microscopy which has limited sensitivity, requires highly trained personnel and is error-prone. Rapid advances in miniaturization of optical systems, sensors and processors have enhanced research and development of digital and automated microscopes suitable for the detection of these diseases in resource-limited settings. While some studies have reported proof-of-principle results, others have evaluated the performance of working prototypes in field settings. The extensive commercialization of these innovative devices has, however, not yet been achieved. This review provides an overview of recent publications (2010-2022) on innovative field applicable optical devices which can be used for the diagnosis of STH and schistosome infections. Using an adapted technology readiness level (TRL) scale taking into account the WHO target product profile (TPP) for these diseases, the developmental stages of the devices were ranked to determine the readiness for practical applications in field settings. From the reviewed 18 articles, 19 innovative optical devices were identified and ranked. Almost all of the devices (85%) were ranked with a TRL score below 8 indicating that, most of the devices are not ready for commercialization and field use. The potential limitations of these innovative devices were discussed. We believe that the outcome of this review can guide the end-to-end development of automated digital microscopes aligned with the WHO TPP for the diagnosis of STH and schistosome infections in resource-limited settings.</p

A review on innovative optical devices for the diagnosis of human soil-transmitted helminthiasis and schistosomiasis: From research and development to commercialisation: from research and development to commercialization

Diagnosis of soil-transmitted helminth (STH) and schistosome infections relies largely on conventional microscopy which has limited sensitivity, requires highly trained personnel and is error-prone. Rapid advances in miniaturization of optical systems, sensors and processors have enhanced research and development of digital and automated microscopes suitable for the detection of these diseases in resource-limited settings. While some studies have reported proof-of-principle results, others have evaluated the performance of working prototypes in field settings. The extensive commercialization of these innovative devices has, however, not yet been achieved. This review provides an overview of recent publications (2010-2022) on innovative field applicable optical devices which can be used for the diagnosis of STH and schistosome infections. Using an adapted technology readiness level (TRL) scale taking into account the WHO target product profile (TPP) for these diseases, the developmental stages of the devices were ranked to determine the readiness for practical applications in field settings. From the reviewed 18 articles, 19 innovative optical devices were identified and ranked. Almost all of the devices (85%) were ranked with a TRL score below 8 indicating that, most of the devices are not ready for commercialization and field use. The potential limitations of these innovative devices were discussed. We believe that the outcome of this review can guide the end-to-end development of automated digital microscopes aligned with the WHO TPP for the diagnosis of STH and schistosome infections in resource-limited settings.Design for SustainabilityTeam Michel Verhaege

Performance Evaluation of the Schistoscope 5.0 for (Semi-)automated Digital Detection and Quantification of Schistosoma haematobium Eggs in Urine: A Field-based Study in Nigeria

Conventional microscopy is the standard procedure for the diagnosis of schistosomiasis, despite its limited sensitivity, reliance on skilled personnel, and the fact that it is error prone. Here, we report the performance of the innovative (semi-)automated Schistoscope 5.0 for optical digital detection and quantification of Schistosoma haematobium eggs in urine, using conventional microscopy as the reference standard. At baseline, 487 participants in a rural setting in Nigeria were assessed, of which 166 (34.1%) tested S. haematobium positive by conventional microscopy. Captured images from the Schistoscope 5.0 were analyzed manually (semiautomation) and by an artificial intelligence (AI) algorithm (full automation). Semi- and fully automated digital microscopy showed comparable sensitivities of 80.1% (95% confidence interval [CI]: 73.2-86.0) and 87.3% (95%CI: 81.3-92.0), but a significant difference in specificity of 95.3% (95% CI: 92.4-97.4) and 48.9% (95% CI: 43.3-55.0), respectively. Overall, estimated egg counts of semi- and fully automated digital microscopy correlated significantly with the egg counts of conventional microscopy (r50.90 and r50.80, respectively, P &lt; 0.001), although the fully automated procedure generally underestimated the higher egg counts. In 38 egg positive cases, an additional urine sample was examined 10 days after praziquantel treatment, showing a similar cure rate and egg reduction rate when comparing conventional microscopy with semiautomated digital microscopy. In this first extensive field evaluation, we found the semiautomated Schistoscope 5.0 to be a promising tool for the detection and monitoring of S. haematobium infection, although further improvement of the AI algorithm for full automation is required.Team Michel VerhaegenDesign for Sustainabilit

Schistoscope: An Automated Microscope with Artificial Intelligence for Detection of Schistosoma haematobium Eggs in Resource-Limited Settings

For many parasitic diseases, the microscopic examination of clinical samples such as urine and stool still serves as the diagnostic reference standard, primarily because microscopes are accessible and cost-effective. However, conventional microscopy is laborious, requires highly skilled personnel, and is highly subjective. Requirements for skilled operators, coupled with the cost and maintenance needs of the microscopes, which is hardly done in endemic countries, presents grossly limited access to the diagnosis of parasitic diseases in resource-limited settings. The urgent requirement for the management of tropical diseases such as schistosomiasis, which is now focused on elimination, has underscored the critical need for the creation of access to easy-to-use diagnosis for case detection, community mapping, and surveillance. In this paper, we present a low-cost automated digital microscope—the Schistoscope—which is capable of automatic focusing and scanning regions of interest in prepared microscope slides, and automatic detection of Schistosoma haematobium eggs in captured images. The device was developed using widely accessible distributed manufacturing methods and off-the-shelf components to enable local manufacturability and ease of maintenance. For proof of principle, we created a Schistosoma haematobium egg dataset of over 5000 images captured from spiked and clinical urine samples from field settings and demonstrated the automatic detection of Schistosoma haematobium eggs using a trained deep neural network model. The experiments and results presented in this paper collectively illustrate the robustness, stability, and optical performance of the device, making it suitable for use in the monitoring and evaluation of schistosomiasis control programs in endemic settings.Team Michel VerhaegenDesign for SustainabilityTeam Gleb Vdovin

Fig 3 -

Correlation between S. haematobium egg counts measured by the Schistoscope and S. haematobium egg counts measured by conventional microscopy (a, d, e), Ct-values determined by real-time PCR (b, f) and urine CAA concentration measured by UCP-LF CAA (c, g) in study A and B.</p

S1 Raw Dataset -

Overall raw dataset containing data for Schistoscope validation on fresh urine samples (study A), Banked slides (study B) and quality control of banked slides. (XLSX)</p