Laryngoscopic Image Stitching for View Enhancement and Documentation - First Experiences

One known problem within laryngoscopy is the spatially limited view onto the hypopharynx and the larynx through the endoscope. To examine the complete larynx and hypopharynx, the laryngoscope can be rotated about its main axis, and hence the physician obtains a complete view. If such examinations are captured using endoscopic video, the examination can be reviewed in detail at a later time. Nevertheless, in order to document the examination with a single representative image, a panorama image can be computed for archiving and enhanced documentation. Twenty patients with various clinical findings were examined with a 70 rigid laryngoscope, and the video sequences were digitally stored. The image sequence for each patient was then post-processed using an image stitching tool based on SIFT features, the RANSAC approach and blending. As a result, endoscopic panorama images of the larynx and pharynx were obtained for each video sequence. The proposed approach of image stitching for laryngoscopic video sequences offers a new tool for enhanced visual examination and documentation of morphologic characteristics of the larynx and the hypopharynx

Real-time video mosaicing with a high-resolution microendoscope

Microendoscopes allow clinicians to view subcellular features in vivo and in real-time, but their field-of-view is inherently limited by the small size of the probe's distal end. Video mosaicing has emerged as an effective technique to increase the acquired image size. Current implementations are performed post-procedure, which removes the benefits of live imaging. In this manuscript we present an algorithm for real-time video mosaicing using a low-cost high-resolution microendoscope. We present algorithm execution times and show image results obtained from in vivo tissue

Toward the vision based supervision of microfactories through images mosaicing.

International audienceThe microfactory paradigm means the miniaturisation of manufacturing systems according to the miniaturisation of products. Some benefits are the saving of material, energy and place. A vision based solution to the problem of supervision of microfactories is proposed. It consists in synthetising a high resolution global view of the work field and real time inlay of local image in this background. The result can be used for micromanipulation monitoring, assistance to the operator, alarms and others useful informations displaying

Synthesizing a virtual imager with a large field of view and a high resolution for micromanipulation.

International audiencePhoton microscope connected with a camera is the usual imager required in micromanipulation applications. That microimager gives high resolution views, but the corresponding field of view are very narrow and do not allow the vision of the entire workfield. The classical solution consists in using multiple views imaging system: a high resolution imager for local view and a low resolution imager for global view. We are developing an alternative solution based on image mosaicing that requires only one microimager. The views from that real microimager are associated in order to achieve a virtual microimager which combines a large field of view with a high resolution

Towards Optimal Image Stitching for Virtual Microscopy

In this paper we present an image stitching method based on dynamic programming and describe its application to automated slide acquisition for Virtual Microscopy (VM). Given a large number of fields of view (FOVs) acquired from a single microscope slide, we composite these images into a single large 'virtual slide' image. The location of each FOV is determined using a new algorithm based on dynamic programming. We compare the performance of the proposed algorithm to an existing greedy algorithm. In a visual trial it is shown that the new algorithm provides a significant improvement in perceived image quality at image boundaries compared to the existing algorithm

Direct comparison between confocal and multiphoton microscopy for rapid histopathological evaluation of unfixed human breast tissue

Rapid histopathological examination of surgical specimen margins using fluorescence microscopy during breast conservation therapy has the potential to reduce the rate of positive margins on postoperative histopathology and the need for repeat surgeries. To assess the suitability of imaging modalities, we perform a direct comparison between confocal fluorescence microscopy and multiphoton microscopy for imaging unfixed tissue and compare to paraffin-embedded histology. An imaging protocol including dual channel detection of two contrast agents to implement virtual hematoxylin and eosin images is introduced that provides high quality imaging under both one and two photon excitation. Corresponding images of unfixed human breast tissue show that both confocal and multiphoton microscopy can reproduce the appearance of conventional histology without the need for physical sectioning. We further compare normal breast tissue and invasive cancer specimens imaged at multiple magnifications, and assess the effects of photobleaching for both modalities using the staining protocol. The results demonstrate that confocal fluorescence microscopy is a promising and cost-effective alternative to multiphoton microscopy for rapid histopathological evaluation of ex vivo breast tissue.National Institutes of Health (U.S.) (Grant R01-CA178636-02)National Institutes of Health (U.S.) (Grant R01-CA075289-18)National Institutes of Health (U.S.) (Grant F32-CA183400-03)United States. Air Force. Office of Scientific Research (Grant FA9550-12-1-0551)United States. Air Force. Office of Scientific Research (Grant FA9550-15-1-0473

Virtual Microscopy with Extended Depth of Field

In this paper, we describe a virtual microscope system, based on JPEG 2000, which utilizes extended depth of field (EDF) imaging. Through a series of observer trials we show that EDF imaging improves both the local image quality of individual fields of view (FOV) and the accuracy with which the FOVs can be mosaiced (stitched) together. In addition, we estimate the required bit rate to adequately render a set of histology and cytology specimens at a quality suitable for on-line learning and collaboration. We show that, using JPEG 2000, we can efficiently represent high-quality, high-resolution colour images of microscopic specimens with less than 1 bit per pixel