Advances and challenges in automated malaria diagnosis using digital microscopy imaging with artificial intelligence tools: A review

Malaria is an infectious disease caused by parasites of the genus Plasmodium spp. It is transmitted to humans by the bite of an infected female Anopheles mosquito. It is the most common disease in resource-poor settings, with 241 illion malaria cases reported in 2020 according to the World Health Organization. Optical microscopy examination of blood smears is the gold standard technique for malaria diagnosis; however, it is a time-consuming method and a well-trained microscopist is needed to perform the microbiological diagnosis. New techniques based on digital imaging analysis by deep learning and artificial intelligence methods are a challenging alternative tool for the diagnosis of infectious diseases. In particular, systems based on Convolutional Neural Networks for image detection of the malaria parasites emulate the microscopy visualization of an expert. Microscope automation provides a fast and low-cost diagnosis, requiring less supervision. Smartphones are a suitable option for microscopic diagnosis, allowing image capture and software identification of parasites. In addition, image analysis techniques could be a fast and optimal solution for the diagnosis of malaria, tuberculosis, or Neglected Tropical Diseases in endemic areas with low resources. The implementation of automated diagnosis by using smartphone applications and new digital imaging technologies in low-income areas is a challenge to achieve. Moreover, automating the movement of the microscope slide and image autofocusing of the samples by hardware implementation would systemize the procedure. These new diagnostic tools would join the global effort to fight against pandemic malaria and other infectious and poverty-related diseases.The project is funded by the Microbiology Department of Vall d’Hebron Universitary Hospital, the Cooperation Centre of the Universitat Politècnica de Catalunya (CCD-UPC) and the Probitas FoundationPostprint (published version

Advances and challenges in automated malaria diagnosis using digital microscopy imaging with artificial intelligence tools : A review

Malaria is an infectious disease caused by parasites of the genus Plasmodium spp. It is transmitted to humans by the bite of an infected female Anopheles mosquito. It is the most common disease in resource-poor settings, with 241 million malaria cases reported in 2020 according to the World Health Organization. Optical microscopy examination of blood smears is the gold standard technique for malaria diagnosis; however, it is a time-consuming method and a well-trained microscopist is needed to perform the microbiological diagnosis. New techniques based on digital imaging analysis by deep learning and artificial intelligence methods are a challenging alternative tool for the diagnosis of infectious diseases. In particular, systems based on Convolutional Neural Networks for image detection of the malaria parasites emulate the microscopy visualization of an expert. Microscope automation provides a fast and low-cost diagnosis, requiring less supervision. Smartphones are a suitable option for microscopic diagnosis, allowing image capture and software identification of parasites. In addition, image analysis techniques could be a fast and optimal solution for the diagnosis of malaria, tuberculosis, or Neglected Tropical Diseases in endemic areas with low resources. The implementation of automated diagnosis by using smartphone applications and new digital imaging technologies in low-income areas is a challenge to achieve. Moreover, automating the movement of the microscope slide and image autofocusing of the samples by hardware implementation would systemize the procedure. These new diagnostic tools would join the global effort to fight against pandemic malaria and other infectious and poverty-related diseases

Advances and challenges in automated malaria diagnosis using digital microscopy imaging with artificial intelligence tools: A review

Deep learning; Malaria diagnosis; Microscopic examinationAprenentatge profund; Diagnòstic de malària; Examen microscòpicAprendizaje profundo; Diagnóstico de malaria; Examen microscópicoMalaria is an infectious disease caused by parasites of the genus Plasmodium spp. It is transmitted to humans by the bite of an infected female Anopheles mosquito. It is the most common disease in resource-poor settings, with 241 million malaria cases reported in 2020 according to the World Health Organization. Optical microscopy examination of blood smears is the gold standard technique for malaria diagnosis; however, it is a time-consuming method and a well-trained microscopist is needed to perform the microbiological diagnosis. New techniques based on digital imaging analysis by deep learning and artificial intelligence methods are a challenging alternative tool for the diagnosis of infectious diseases. In particular, systems based on Convolutional Neural Networks for image detection of the malaria parasites emulate the microscopy visualization of an expert. Microscope automation provides a fast and low-cost diagnosis, requiring less supervision. Smartphones are a suitable option for microscopic diagnosis, allowing image capture and software identification of parasites. In addition, image analysis techniques could be a fast and optimal solution for the diagnosis of malaria, tuberculosis, or Neglected Tropical Diseases in endemic areas with low resources. The implementation of automated diagnosis by using smartphone applications and new digital imaging technologies in low-income areas is a challenge to achieve. Moreover, automating the movement of the microscope slide and image autofocusing of the samples by hardware implementation would systemize the procedure. These new diagnostic tools would join the global effort to fight against pandemic malaria and other infectious and poverty-related diseases.The project is funded by the Microbiology Department of Vall d’Hebron Universitary Hospital, the Cooperation Centre of the Universitat Politècnica de Catalunya (CCD-UPC) and the Probitas Foundation

iMAGING: a novel automated system for malaria diagnosis by using artificial intelligence tools and a universal low-cost robotized microscope

Artificial intelligence; Malaria diagnosis; Robotized microscopeInteligencia artificial; Diagnóstico de malaria; Microscopio robotizadoIntel·ligència artificial; Diagnòstic de malària; Microscopi robotitzatIntroduction: Malaria is one of the most prevalent infectious diseases in sub-Saharan Africa, with 247 million cases reported worldwide in 2021 according to the World Health Organization. Optical microscopy remains the gold standard technique for malaria diagnosis, however, it requires expertise, is time-consuming and difficult to reproduce. Therefore, new diagnostic techniques based on digital image analysis using artificial intelligence tools can improve diagnosis and help automate it. Methods: In this study, a dataset of 2571 labeled thick blood smear images were created. YOLOv5x, Faster R-CNN, SSD, and RetinaNet object detection neural networks were trained on the same dataset to evaluate their performance in Plasmodium parasite detection. Attention modules were applied and compared with YOLOv5x results. To automate the entire diagnostic process, a prototype of 3D-printed pieces was designed for the robotization of conventional optical microscopy, capable of auto-focusing the sample and tracking the entire slide. Results: Comparative analysis yielded a performance for YOLOv5x on a test set of 92.10% precision, 93.50% recall, 92.79% F-score, and 94.40% mAP0.5 for leukocyte, early and mature Plasmodium trophozoites overall detection. F-score values of each category were 99.0% for leukocytes, 88.6% for early trophozoites and 87.3% for mature trophozoites detection. Attention modules performance show non-significant statistical differences when compared to YOLOv5x original trained model. The predictive models were integrated into a smartphone-computer application for the purpose of image-based diagnostics in the laboratory. The system can perform a fully automated diagnosis by the auto-focus and X-Y movements of the robotized microscope, the CNN models trained for digital image analysis, and the smartphone device. The new prototype would determine whether a Giemsa-stained thick blood smear sample is positive/negative for Plasmodium infection and its parasite levels. The whole system was integrated into the iMAGING smartphone application. Conclusion: The coalescence of the fully-automated system via auto-focus and slide movements and the autonomous detection of Plasmodium parasites in digital images with a smartphone software and AI algorithms confers the prototype the optimal features to join the global effort against malaria, neglected tropical diseases and other infectious diseases.The project is funded by the Microbiology Department of Vall d’Hebron University Hospital, the Cooperation Centre of the Universitat Politècnica de Catalunya (CCD-UPC), and the Probitas Foundation

Fully-automated patient-level malaria assessment on field-prepared thin blood film microscopy images, including Supplementary Information

Malaria is a life-threatening disease affecting millions. Microscopy-based assessment of thin blood films is a standard method to (i) determine malaria species and (ii) quantitate high-parasitemia infections. Full automation of malaria microscopy by machine learning (ML) is a challenging task because field-prepared slides vary widely in quality and presentation, and artifacts often heavily outnumber relatively rare parasites. In this work, we describe a complete, fully-automated framework for thin film malaria analysis that applies ML methods, including convolutional neural nets (CNNs), trained on a large and diverse dataset of field-prepared thin blood films. Quantitation and species identification results are close to sufficiently accurate for the concrete needs of drug resistance monitoring and clinical use-cases on field-prepared samples. We focus our methods and our performance metrics on the field use-case requirements. We discuss key issues and important metrics for the application of ML methods to malaria microscopy.Comment: 16 pages, 13 figure

Reducing data dimension boosts neural network-based stage-specific malaria detection

Although malaria has been known for more than 4 thousand years(1), it still imposes a global burden with approx. 240 million annual cases(2). Improvement in diagnostic techniques is a prerequisite for its global elimination. Despite its main limitations, being time-consuming and subjective, light microscopy on Giemsa-stained blood smears is still the gold-standard diagnostic method used worldwide. Autonomous computer assisted recognition of malaria infected red blood cells (RBCs) using neural networks (NNs) has the potential to overcome these deficiencies, if a fast, high-accuracy detection can be achieved using low computational power and limited sets of microscopy images for training the NN. Here, we report on a novel NN-based scheme that is capable of the high-speed classification of RBCs into four categories—healthy ones and three classes of infected ones according to the parasite age—with an accuracy as high as 98%. Importantly, we observe that a smart reduction of data dimension, using characteristic one-dimensional cross-sections of the RBC images, not only speeds up the classification but also significantly improves its performance with respect to the usual two-dimensional NN schemes. Via comparative studies on RBC images recorded by two additional techniques, fluorescence and atomic force microscopy, we demonstrate that our method is universally applicable for different types of microscopy images. This robustness against imaging platform-specific features is crucial for diagnostic applications. Our approach for the reduction of data dimension could be straightforwardly generalised for the classification of different parasites, cells and other types of objects

A Systematic Review on Automatic Detection of Plasmodium Parasite

Plasmodium parasite is the main cause of malaria which has taken many lives. Some research works have been conducted to detect the Plasmodium parasite automatically. This research aims to identify the development of current research in the area of Plasmodium parasite detection. The research uses a systematic literature review (SLR) approach comprising three stages, namely planning, conducting, and reporting. The search process is based on the keywords which were determined in advance. The selection process involves the inclusion and exclusion criteria. The search yields 45 literatures from five different digital libraries. The identification process finds out that 28 methods are applied and mainly categorizes as machine learning algorithms with performance achievements between 60% and 95%. Overall, the research of Plasmodium parasite detection today has focused on the development with artificial intelligence specifically related to machine and deep learning. These approaches are believed as the most effective approach to detect Plasmodium parasites

Deep learning networks with adaptive attention mechanisms for malaria detection in thick smear blood samples

This project aims to develop an end-to end deep network to detect malaria parasites from thick smear blood sample images with object detectors. This project uses different objects detectors such as Faster-RCNN, SSD, RetinaNet and YOLO. The model with the best results is YOLO, so adaptive attention mechanisms are implemented in this model, such as Squeeze-and-Excitation (SE) and Convolution Block Attention Module (CBAM).Este proyecto tiene como objetivo desarrollar una red profunda de extremo a extremo para detectar parásitos de la malaria a partir de imágenes de muestras de sangre de frotis gruesos con detectores de objetos. Este proyecto utiliza diferentes detectores de objetos como Faster-RCNN, SSD, RetinaNet y YOLO. El modelo con mejores resultados es YOLO, por lo que en este modelo se implementan mecanismos de atención adaptativa, como Squeeze-and-Excitation (SE) y Convolution Block Attention Module (CBAM).Aquest projecte pretén desenvolupar una xarxa profunda d'extrem a extrem per detectar paràsits de la malària a partir d'imatges de mostres de sang de frotis gruixut amb detectors d'objectes. Aquest projecte utilitza diferents detectors d'objectes com Faster-RCNN, SSD, RetinaNet i YOLO. El model amb millors resultats és YOLO, per la qual cosa s'implementen mecanismes d'atenció adaptativa en aquest model, com el Squeeze-and-Excitation (SE) i el Convolution Block Attention Module (CBAM)