28 research outputs found
Content aware multi-focus image fusion for high-magnification blood film microscopy
Automated digital high-magnification optical microscopy is key to accelerating biology research and improving pathology clinical pathways. High magnification objectives with large numerical apertures are usually preferred to resolve the fine structural details of biological samples, but they have a very limited depth-of-field. Depending on the thickness of the sample, analysis of specimens typically requires the acquisition of multiple images at different focal planes for each field-of-view, followed by the fusion of these planes into an extended depth-of-field image. This translates into low scanning speeds, increased storage space, and processing time not suitable for high-throughput clinical use. We introduce a novel content-aware multi-focus image fusion approach based on deep learning which extends the depth-of-field of high magnification objectives effectively. We demonstrate the method with three examples, showing that highly accurate, detailed, extended depth of field images can be obtained at a lower axial sampling rate, using 2-fold fewer focal planes than normally required
Hardware and software integration and testing for the automation of bright-field microscopy for tuberculosis detection
Automated microscopy for the detection of tuberculosis (TB) in sputum smears would reduce the load on technicians, especially in countries with a high TB burden. This dissertation reports on the development and testing of an automated system built around a conventional microscope for the detection of TB in Ziehl-Neelsen (ZN) stained sputum smears. Microscope auto-focusing, image analysis and stage movement were integrated. Images were captured at 40x magnification
Maskless imaging of dense samples using pixel super-resolution based multi-height lensfree on-chip microscopy.
Lensfree in-line holographic microscopy offers sub-micron resolution over a large field-of-view (e.g., ~24 mm2) with a cost-effective and compact design suitable for field use. However, it is limited to relatively low-density samples. To mitigate this limitation, we demonstrate an on-chip imaging approach based on pixel super-resolution and phase recovery, which iterates among multiple lensfree intensity measurements, each having a slightly different sample-to-sensor distance. By digitally aligning and registering these lensfree intensity measurements, phase and amplitude images of dense and connected specimens can be iteratively reconstructed over a large field-of-view of ~24 mm2 without the use of any spatial masks. We demonstrate the success of this multi-height in-line holographic approach by imaging dense Papanicolaou smears (i.e., Pap smears) and blood samples
GedankenNet: Self-supervised learning of hologram reconstruction using physics consistency
The past decade has witnessed transformative applications of deep learning in
various computational imaging, sensing and microscopy tasks. Due to the
supervised learning schemes employed, most of these methods depend on
large-scale, diverse, and labeled training data. The acquisition and
preparation of such training image datasets are often laborious and costly,
also leading to biased estimation and limited generalization to new types of
samples. Here, we report a self-supervised learning model, termed GedankenNet,
that eliminates the need for labeled or experimental training data, and
demonstrate its effectiveness and superior generalization on hologram
reconstruction tasks. Without prior knowledge about the sample types to be
imaged, the self-supervised learning model was trained using a
physics-consistency loss and artificial random images that are synthetically
generated without any experiments or resemblance to real-world samples. After
its self-supervised training, GedankenNet successfully generalized to
experimental holograms of various unseen biological samples, reconstructing the
phase and amplitude images of different types of objects using experimentally
acquired test holograms. Without access to experimental data or the knowledge
of real samples of interest or their spatial features, GedankenNet's
self-supervised learning achieved complex-valued image reconstructions that are
consistent with the Maxwell's equations, meaning that its output inference and
object solutions accurately represent the wave propagation in free-space. This
self-supervised learning of image reconstruction tasks opens up new
opportunities for various inverse problems in holography, microscopy and
computational imaging fields.Comment: 30 pages, 6 Figure
Advances and challenges in automated malaria diagnosis using digital microscopy imaging with artificial intelligence tools: A review
Malaria is an infectious disease caused by parasites of the genus Plasmodium spp. It is transmitted to humans by the bite of an infected female Anopheles mosquito. It is the most common disease in resource-poor settings, with 241 illion malaria cases reported in 2020 according to the World Health Organization. Optical microscopy examination of blood smears is the gold standard technique for malaria diagnosis; however, it is a time-consuming method and a well-trained microscopist is needed to perform the microbiological diagnosis. New techniques based on digital imaging analysis by deep learning and artificial intelligence methods are a challenging alternative tool for the diagnosis of infectious diseases. In particular, systems based on Convolutional Neural Networks for image detection of the malaria parasites emulate the microscopy visualization of an expert. Microscope automation provides a fast and low-cost diagnosis, requiring less supervision. Smartphones are a suitable option for microscopic diagnosis, allowing image capture and software identification of parasites. In addition, image analysis techniques could be a fast and optimal solution for the diagnosis of malaria, tuberculosis, or Neglected Tropical Diseases in endemic areas with low resources. The implementation of automated diagnosis by using smartphone applications and new digital imaging technologies in low-income areas is a challenge to achieve. Moreover, automating the movement of the microscope slide and image autofocusing of the samples by hardware implementation would systemize the procedure. These new diagnostic tools would join the global effort to fight against pandemic malaria and other infectious and poverty-related diseases.The project is funded by the Microbiology Department of Vall
d’Hebron Universitary Hospital, the Cooperation Centre of the
Universitat Politècnica de Catalunya (CCD-UPC) and the
Probitas FoundationPostprint (published version
Advances and challenges in automated malaria diagnosis using digital microscopy imaging with artificial intelligence tools : A review
Malaria is an infectious disease caused by parasites of the genus Plasmodium spp. It is transmitted to humans by the bite of an infected female Anopheles mosquito. It is the most common disease in resource-poor settings, with 241 million malaria cases reported in 2020 according to the World Health Organization. Optical microscopy examination of blood smears is the gold standard technique for malaria diagnosis; however, it is a time-consuming method and a well-trained microscopist is needed to perform the microbiological diagnosis. New techniques based on digital imaging analysis by deep learning and artificial intelligence methods are a challenging alternative tool for the diagnosis of infectious diseases. In particular, systems based on Convolutional Neural Networks for image detection of the malaria parasites emulate the microscopy visualization of an expert. Microscope automation provides a fast and low-cost diagnosis, requiring less supervision. Smartphones are a suitable option for microscopic diagnosis, allowing image capture and software identification of parasites. In addition, image analysis techniques could be a fast and optimal solution for the diagnosis of malaria, tuberculosis, or Neglected Tropical Diseases in endemic areas with low resources. The implementation of automated diagnosis by using smartphone applications and new digital imaging technologies in low-income areas is a challenge to achieve. Moreover, automating the movement of the microscope slide and image autofocusing of the samples by hardware implementation would systemize the procedure. These new diagnostic tools would join the global effort to fight against pandemic malaria and other infectious and poverty-related diseases
Advances and challenges in automated malaria diagnosis using digital microscopy imaging with artificial intelligence tools: A review
Deep learning; Malaria diagnosis; Microscopic examinationAprenentatge profund; Diagnòstic de malà ria; Examen microscòpicAprendizaje profundo; Diagnóstico de malaria; Examen microscópicoMalaria is an infectious disease caused by parasites of the genus Plasmodium spp. It is transmitted to humans by the bite of an infected female Anopheles mosquito. It is the most common disease in resource-poor settings, with 241 million malaria cases reported in 2020 according to the World Health Organization. Optical microscopy examination of blood smears is the gold standard technique for malaria diagnosis; however, it is a time-consuming method and a well-trained microscopist is needed to perform the microbiological diagnosis. New techniques based on digital imaging analysis by deep learning and artificial intelligence methods are a challenging alternative tool for the diagnosis of infectious diseases. In particular, systems based on Convolutional Neural Networks for image detection of the malaria parasites emulate the microscopy visualization of an expert. Microscope automation provides a fast and low-cost diagnosis, requiring less supervision. Smartphones are a suitable option for microscopic diagnosis, allowing image capture and software identification of parasites. In addition, image analysis techniques could be a fast and optimal solution for the diagnosis of malaria, tuberculosis, or Neglected Tropical Diseases in endemic areas with low resources. The implementation of automated diagnosis by using smartphone applications and new digital imaging technologies in low-income areas is a challenge to achieve. Moreover, automating the movement of the microscope slide and image autofocusing of the samples by hardware implementation would systemize the procedure. These new diagnostic tools would join the global effort to fight against pandemic malaria and other infectious and poverty-related diseases.The project is funded by the Microbiology Department of Vall d’Hebron Universitary Hospital, the Cooperation Centre of the Universitat Politècnica de Catalunya (CCD-UPC) and the Probitas Foundation