Advances and challenges in automated malaria diagnosis using digital microscopy imaging with artificial intelligence tools: A review

Malaria is an infectious disease caused by parasites of the genus Plasmodium spp. It is transmitted to humans by the bite of an infected female Anopheles mosquito. It is the most common disease in resource-poor settings, with 241 illion malaria cases reported in 2020 according to the World Health Organization. Optical microscopy examination of blood smears is the gold standard technique for malaria diagnosis; however, it is a time-consuming method and a well-trained microscopist is needed to perform the microbiological diagnosis. New techniques based on digital imaging analysis by deep learning and artificial intelligence methods are a challenging alternative tool for the diagnosis of infectious diseases. In particular, systems based on Convolutional Neural Networks for image detection of the malaria parasites emulate the microscopy visualization of an expert. Microscope automation provides a fast and low-cost diagnosis, requiring less supervision. Smartphones are a suitable option for microscopic diagnosis, allowing image capture and software identification of parasites. In addition, image analysis techniques could be a fast and optimal solution for the diagnosis of malaria, tuberculosis, or Neglected Tropical Diseases in endemic areas with low resources. The implementation of automated diagnosis by using smartphone applications and new digital imaging technologies in low-income areas is a challenge to achieve. Moreover, automating the movement of the microscope slide and image autofocusing of the samples by hardware implementation would systemize the procedure. These new diagnostic tools would join the global effort to fight against pandemic malaria and other infectious and poverty-related diseases.The project is funded by the Microbiology Department of Vall d’Hebron Universitary Hospital, the Cooperation Centre of the Universitat Politècnica de Catalunya (CCD-UPC) and the Probitas FoundationPostprint (published version

Advances and challenges in automated malaria diagnosis using digital microscopy imaging with artificial intelligence tools : A review

Malaria is an infectious disease caused by parasites of the genus Plasmodium spp. It is transmitted to humans by the bite of an infected female Anopheles mosquito. It is the most common disease in resource-poor settings, with 241 million malaria cases reported in 2020 according to the World Health Organization. Optical microscopy examination of blood smears is the gold standard technique for malaria diagnosis; however, it is a time-consuming method and a well-trained microscopist is needed to perform the microbiological diagnosis. New techniques based on digital imaging analysis by deep learning and artificial intelligence methods are a challenging alternative tool for the diagnosis of infectious diseases. In particular, systems based on Convolutional Neural Networks for image detection of the malaria parasites emulate the microscopy visualization of an expert. Microscope automation provides a fast and low-cost diagnosis, requiring less supervision. Smartphones are a suitable option for microscopic diagnosis, allowing image capture and software identification of parasites. In addition, image analysis techniques could be a fast and optimal solution for the diagnosis of malaria, tuberculosis, or Neglected Tropical Diseases in endemic areas with low resources. The implementation of automated diagnosis by using smartphone applications and new digital imaging technologies in low-income areas is a challenge to achieve. Moreover, automating the movement of the microscope slide and image autofocusing of the samples by hardware implementation would systemize the procedure. These new diagnostic tools would join the global effort to fight against pandemic malaria and other infectious and poverty-related diseases

Advances and challenges in automated malaria diagnosis using digital microscopy imaging with artificial intelligence tools: A review

Deep learning; Malaria diagnosis; Microscopic examinationAprenentatge profund; Diagnòstic de malària; Examen microscòpicAprendizaje profundo; Diagnóstico de malaria; Examen microscópicoMalaria is an infectious disease caused by parasites of the genus Plasmodium spp. It is transmitted to humans by the bite of an infected female Anopheles mosquito. It is the most common disease in resource-poor settings, with 241 million malaria cases reported in 2020 according to the World Health Organization. Optical microscopy examination of blood smears is the gold standard technique for malaria diagnosis; however, it is a time-consuming method and a well-trained microscopist is needed to perform the microbiological diagnosis. New techniques based on digital imaging analysis by deep learning and artificial intelligence methods are a challenging alternative tool for the diagnosis of infectious diseases. In particular, systems based on Convolutional Neural Networks for image detection of the malaria parasites emulate the microscopy visualization of an expert. Microscope automation provides a fast and low-cost diagnosis, requiring less supervision. Smartphones are a suitable option for microscopic diagnosis, allowing image capture and software identification of parasites. In addition, image analysis techniques could be a fast and optimal solution for the diagnosis of malaria, tuberculosis, or Neglected Tropical Diseases in endemic areas with low resources. The implementation of automated diagnosis by using smartphone applications and new digital imaging technologies in low-income areas is a challenge to achieve. Moreover, automating the movement of the microscope slide and image autofocusing of the samples by hardware implementation would systemize the procedure. These new diagnostic tools would join the global effort to fight against pandemic malaria and other infectious and poverty-related diseases.The project is funded by the Microbiology Department of Vall d’Hebron Universitary Hospital, the Cooperation Centre of the Universitat Politècnica de Catalunya (CCD-UPC) and the Probitas Foundation

Vδ2+ T cell response to malaria correlates with protection from infection but is attenuated with repeated exposure.

Vδ2+ γδ T cells are semi-innate T cells that expand markedly following P. falciparum (Pf) infection in naïve adults, but are lost and become dysfunctional among children repeatedly exposed to malaria. The role of these cells in mediating clinical immunity (i.e. protection against symptoms) to malaria remains unclear. We measured Vδ2+ T cell absolute counts at acute and convalescent malaria timepoints (n = 43), and Vδ2+ counts, cellular phenotype, and cytokine production following in vitro stimulation at asymptomatic visits (n = 377), among children aged 6 months to 10 years living in Uganda. Increasing age was associated with diminished in vivo expansion following malaria, and lower Vδ2 absolute counts overall, among children living in a high transmission setting. Microscopic parasitemia and expression of the immunoregulatory markers Tim-3 and CD57 were associated with diminished Vδ2+ T cell pro-inflammatory cytokine production. Higher Vδ2 pro-inflammatory cytokine production was associated with protection from subsequent Pf infection, but also with an increased odds of symptoms once infected. Vδ2+ T cells may play a role in preventing malaria infection in children living in endemic settings; progressive loss and dysfunction of these cells may represent a disease tolerance mechanism that contributes to the development of clinical immunity to malaria

iMAGING: a novel automated system for malaria diagnosis by using artificial intelligence tools and a universal low-cost robotized microscope

Artificial intelligence; Malaria diagnosis; Robotized microscopeInteligencia artificial; Diagnóstico de malaria; Microscopio robotizadoIntel·ligència artificial; Diagnòstic de malària; Microscopi robotitzatIntroduction: Malaria is one of the most prevalent infectious diseases in sub-Saharan Africa, with 247 million cases reported worldwide in 2021 according to the World Health Organization. Optical microscopy remains the gold standard technique for malaria diagnosis, however, it requires expertise, is time-consuming and difficult to reproduce. Therefore, new diagnostic techniques based on digital image analysis using artificial intelligence tools can improve diagnosis and help automate it. Methods: In this study, a dataset of 2571 labeled thick blood smear images were created. YOLOv5x, Faster R-CNN, SSD, and RetinaNet object detection neural networks were trained on the same dataset to evaluate their performance in Plasmodium parasite detection. Attention modules were applied and compared with YOLOv5x results. To automate the entire diagnostic process, a prototype of 3D-printed pieces was designed for the robotization of conventional optical microscopy, capable of auto-focusing the sample and tracking the entire slide. Results: Comparative analysis yielded a performance for YOLOv5x on a test set of 92.10% precision, 93.50% recall, 92.79% F-score, and 94.40% mAP0.5 for leukocyte, early and mature Plasmodium trophozoites overall detection. F-score values of each category were 99.0% for leukocytes, 88.6% for early trophozoites and 87.3% for mature trophozoites detection. Attention modules performance show non-significant statistical differences when compared to YOLOv5x original trained model. The predictive models were integrated into a smartphone-computer application for the purpose of image-based diagnostics in the laboratory. The system can perform a fully automated diagnosis by the auto-focus and X-Y movements of the robotized microscope, the CNN models trained for digital image analysis, and the smartphone device. The new prototype would determine whether a Giemsa-stained thick blood smear sample is positive/negative for Plasmodium infection and its parasite levels. The whole system was integrated into the iMAGING smartphone application. Conclusion: The coalescence of the fully-automated system via auto-focus and slide movements and the autonomous detection of Plasmodium parasites in digital images with a smartphone software and AI algorithms confers the prototype the optimal features to join the global effort against malaria, neglected tropical diseases and other infectious diseases.The project is funded by the Microbiology Department of Vall d’Hebron University Hospital, the Cooperation Centre of the Universitat Politècnica de Catalunya (CCD-UPC), and the Probitas Foundation

The malaria system microApp: A new, mobile device-based tool for malaria diagnosis

Background: Malaria is a public health problem that affects remote areas worldwide. Climate change has contributed to the problem by allowing for the survival of Anopheles in previously uninhabited areas. As such, several groups have made developing news systems for the automated diagnosis of malaria a priority. Objective: The objective of this study was to develop a new, automated, mobile device-based diagnostic system for malaria. The system uses Giemsa-stained peripheral blood samples combined with light microscopy to identify the Plasmodium falciparum species in the ring stage of development. Methods: The system uses image processing and artificial intelligence techniques as well as a known face detection algorithm to identify Plasmodium parasites. The algorithm is based on integral image and haar-like features concepts, and makes use of weak classifiers with adaptive boosting learning. The search scope of the learning algorithm is reduced in the preprocessing step by removing the background around blood cells. Results: As a proof of concept experiment, the tool was used on 555 malaria-positive and 777 malaria-negative previously-made slides. The accuracy of the system was, on average, 91%, meaning that for every 100 parasite-infected samples, 91 were identified correctly. Conclusions: Accessibility barriers of low-resource countries can be addressed with low-cost diagnostic tools. Our system, developed for mobile devices (mobile phones and tablets), addresses this by enabling access to health centers in remote communities, and importantly, not depending on extensive malaria expertise or expensive diagnostic detection equipment.Peer ReviewedPostprint (published version

Automated Low-Cost Malaria Detection System in Thin Blood Slide Images Using Mobile Phones

Malaria, a deadly disease which according to the World Health Organisation (WHO) is responsible for the fatal illness in 200 million people around the world in 2010, is diagnosed using peripheral blood examination. The work undertaken in this research programme aims to develop an automated malaria parasite-detection system, using microscopic-image processing, that can be incorporated onto mobile phones. In this research study, the main objective is to achieve the performance equal to or better than the manual microscopy, which is the gold standard in malaria diagnosis, in order to produce a reliable automated diagnostic platform without expert intervention, for the effective treatment and eradication of the deadly disease. The work contributed to the field of mathematical morphology by proposing a novel method called the Annular Ring Ratio transform for blood component identification. It has also proposed an automated White Blood Cell and Red Blood Cell differentiation algorithm, which when combined with ARR transform method, has wide applications not only for malaria diagnosis but also for many blood related analysis involving microscopic examination. The research has undertaken investigations on infected cell identification which aids in the calculation of parasitemia, the measure of infection. In addition, an automated diagnostic tool to detect the sexual stage (gametocytes) of the species P.falciparum for post-treatment malaria diagnosis was developed. Furthermore, a parallel investigation was carried out on automated malaria diagnosis on fluorescent thin blood films and a WBC and infected cell differentiation algorithm was proposed. Finally, a mobile phone application based on the morphological image processing algorithms proposed in this thesis was developed. A complete malaria diagnostic unit using the mobile phones attached to a portable microscope was set up which has enormous potential not only for malaria diagnosis but also for the blood parasitological field where advancement in medical diagnostics using cellular smart phone technology is widely acknowledged

Automated detection and staging of malaria parasites from cytological smears using convolutional neural networks

Microscopic examination of blood smears remains the gold standard for laboratory inspection and diagnosis of malaria. Smear inspection is, however, time-consuming and dependent on trained microscopists with results varying in accuracy. We sought to develop an automated image analysis method to improve accuracy and standardization of smear inspection that retains capacity for expert confirmation and image archiving. Here, we present a machine learning method that achieves red blood cell (RBC) detection, differentiation between infected/uninfected cells, and parasite life stage categorization from unprocessed, heterogeneous smear images. Based on a pretrained Faster Region-Based Convolutional Neural Networks (R-CNN) model for RBC detection, our model performs accurately, with an average precision of 0.99 at an intersection-over-union threshold of 0.5. Application of a residual neural network-50 model to infected cells also performs accurately, with an area under the receiver operating characteristic curve of 0.98. Finally, combining our method with a regression model successfully recapitulates intraerythrocytic developmental cycle with accurate lifecycle stage categorization. Combined with a mobile-friendly web-based interface, called PlasmoCount, our method permits rapid navigation through and review of results for quality assurance. By standardizing assessment of Giemsa smears, our method markedly improves inspection reproducibility and presents a realistic route to both routine lab and future field-based automated malaria diagnosis

Detection of Plasmodium falciparum male and female gametocytes and determination of parasite sex ratio in human endemic populations by novel, cheap and robust RTqPCR assays

The presence of Plasmodium falciparum gametocytes in peripheral blood is essential for human to mosquito parasite transmission. The detection of submicroscopic infections with gametocytes and the estimation of the gametocyte sex ratio are crucial to assess the human host potential ability to infect mosquitoes and transmit malaria parasites

Review of Microscopic Image Processing techniques towards Malaria Infected Erythrocyte Detection from Thin Blood Smears

In order to diagnose malaria, the test that has traditionally been conducted is the gold standard test. The process mainly entails the preparation of a blood smear on glass slide, staining the blood and examining the blood through the use of a microscope so as to observe parasite genus plasmodium. Although these are several other kinds of diagnostic test solutions that are available and which can be adopted, there are numerous shortcomings which are always observed when microscopic analysis is carried out. Presently, the treatments are hugely conducted based on symptoms and upon the occurrence of false negatives, it might be fatal and may result into the creation of different kinds of implications. There have been a number of deaths which have been associated with malaria and as a result, there is the dire need to ensure that there is early detection of malarial infection among the people. This manuscript mainly provides a review of the current contributions regarding computer aided strategies, as well as microscopic image processing strategies for the detection of malaria. They are discussed based on the contemporary literature