A review of parallel computing for large-scale remote sensing image mosaicking

Interest in image mosaicking has been spurred by a wide variety of research and management needs. However, for large-scale applications, remote sensing image mosaicking usually requires significant computational capabilities. Several studies have attempted to apply parallel computing to improve image mosaicking algorithms and to speed up calculation process. The state of the art of this field has not yet been summarized, which is, however, essential for a better understanding and for further research of image mosaicking parallelism on a large scale. This paper provides a perspective on the current state of image mosaicking parallelization for large scale applications. We firstly introduce the motivation of image mosaicking parallel for large scale application, and analyze the difficulty and problem of parallel image mosaicking at large scale such as scheduling with huge number of dependent tasks, programming with multiple-step procedure, dealing with frequent I/O operation. Then we summarize the existing studies of parallel computing in image mosaicking for large scale applications with respect to problem decomposition and parallel strategy, parallel architecture, task schedule strategy and implementation of image mosaicking parallelization. Finally, the key problems and future potential research directions for image mosaicking are addressed

Revisiting the theory of interferometric wide-field synthesis

After several generations of interferometers in radioastronomy, wide-field imaging at high angular resolution is today a major goal for trying to match optical wide-field performances. All the radio-interferometric, wide-field imaging methods currently belong to the mosaicking family. Based on a 30 years old, original idea from Ekers & Rots, we aim at proposing an alternate formalism. Starting from their ideal case, we successively evaluate the impact of the standard ingredients of interferometric imaging. A comparison with standard nonlinear mosaicking shows that both processing schemes are not mathematically equivalent, though they both recover the sky brightness. In particular, the weighting scheme is very different in both methods. Moreover, the proposed scheme naturally processes the short spacings from both single-dish antennas and heterogeneous arrays. Finally, the sky gridding of the measured visibilities, required by the proposed scheme, may potentially save large amounts of hard-disk space and cpu processing power over mosaicking when handling data sets acquired with the on-the-fly observing mode. We propose to call this promising family of imaging methods wide-field synthesis because it explicitly synthesizes visibilities at a much finer spatial frequency resolution than the one set by the diameter of the interferometer antennas.Comment: 22 pages, 6 PostScript figures. Accepted for publication in Astronomy & Astrophysics. Uses aa LaTeX macros

Smart environment monitoring through micro unmanned aerial vehicles

In recent years, the improvements of small-scale Unmanned Aerial Vehicles (UAVs) in terms of flight time, automatic control, and remote transmission are promoting the development of a wide range of practical applications. In aerial video surveillance, the monitoring of broad areas still has many challenges due to the achievement of different tasks in real-time, including mosaicking, change detection, and object detection. In this thesis work, a small-scale UAV based vision system to maintain regular surveillance over target areas is proposed. The system works in two modes. The first mode allows to monitor an area of interest by performing several flights. During the first flight, it creates an incremental geo-referenced mosaic of an area of interest and classifies all the known elements (e.g., persons) found on the ground by an improved Faster R-CNN architecture previously trained. In subsequent reconnaissance flights, the system searches for any changes (e.g., disappearance of persons) that may occur in the mosaic by a histogram equalization and RGB-Local Binary Pattern (RGB-LBP) based algorithm. If present, the mosaic is updated. The second mode, allows to perform a real-time classification by using, again, our improved Faster R-CNN model, useful for time-critical operations. Thanks to different design features, the system works in real-time and performs mosaicking and change detection tasks at low-altitude, thus allowing the classification even of small objects. The proposed system was tested by using the whole set of challenging video sequences contained in the UAV Mosaicking and Change Detection (UMCD) dataset and other public datasets. The evaluation of the system by well-known performance metrics has shown remarkable results in terms of mosaic creation and updating, as well as in terms of change detection and object detection

Clustering Acoustic Backscatter in the Angular Response Space

Backscatter mosaicking is a necessary step in the analysis and interpretation of sidescan and multibeam sonar records. However, due to limitations intrinsic to the mosaicking technique, backscatter mosaics are restricted in their capacity to unambiguously discriminate seafloor properties. A more adequate technique to characterize the seafloor is the analysis of backscatter angular responses, since those responses are intrinsic properties of the seafloor. This technique sometimes lacks spatial resolution, however, as the analysis is limited to the swath width of the sonar. In this paper, we propose an approach to combine mosaicking and angular response analysis techniques in an attempt to take advantage of both the spatial resolution of the mosaic, and the angular resolution derived from the angular response analysis. In order to test these ideas, we used acoustic backscatter acquired by a Reson 8101 (240kHz) multibeam sonar during normal survey operations conducted on the NOAA Ship FAIRWEATHER around Cape Decision, Alaska in spring 2005. First, we defined parameters that uniquely described the angular responses, and treated those parameters as a feature vector in a multidimensional space. The parameters were then clustered with a simple unsupervised clustering algorithm. The result of the clustering analysis defined areas on the seafloor which had similar angular responses, which we called themes. We then used these themes to develop more robust indicators of angular response from their coverage areas, which were finally used as Angle Varying Gain correction tables to assemble an enhanced mosaic

Retrieval and Registration of Long-Range Overlapping Frames for Scalable Mosaicking of In Vivo Fetoscopy

Purpose: The standard clinical treatment of Twin-to-Twin Transfusion Syndrome consists in the photo-coagulation of undesired anastomoses located on the placenta which are responsible to a blood transfer between the two twins. While being the standard of care procedure, fetoscopy suffers from a limited field-of-view of the placenta resulting in missed anastomoses. To facilitate the task of the clinician, building a global map of the placenta providing a larger overview of the vascular network is highly desired. Methods: To overcome the challenging visual conditions inherent to in vivo sequences (low contrast, obstructions or presence of artifacts, among others), we propose the following contributions: (i) robust pairwise registration is achieved by aligning the orientation of the image gradients, and (ii) difficulties regarding long-range consistency (e.g. due to the presence of outliers) is tackled via a bag-of-word strategy, which identifies overlapping frames of the sequence to be registered regardless of their respective location in time. Results: In addition to visual difficulties, in vivo sequences are characterised by the intrinsic absence of gold standard. We present mosaics motivating qualitatively our methodological choices and demonstrating their promising aspect. We also demonstrate semi-quantitatively, via visual inspection of registration results, the efficacy of our registration approach in comparison to two standard baselines. Conclusion: This paper proposes the first approach for the construction of mosaics of placenta in in vivo fetoscopy sequences. Robustness to visual challenges during registration and long-range temporal consistency are proposed, offering first positive results on in vivo data for which standard mosaicking techniques are not applicable.Comment: Accepted for publication in International Journal of Computer Assisted Radiology and Surgery (IJCARS

MusA: Using Indoor Positioning and Navigation to Enhance Cultural Experiences in a museum

In recent years there has been a growing interest into the use of multimedia mobile guides in museum environments. Mobile devices have the capabilities to detect the user context and to provide pieces of information suitable to help visitors discovering and following the logical and emotional connections that develop during the visit. In this scenario, location based services (LBS) currently represent an asset, and the choice of the technology to determine users' position, combined with the definition of methods that can effectively convey information, become key issues in the design process. In this work, we present MusA (Museum Assistant), a general framework for the development of multimedia interactive guides for mobile devices. Its main feature is a vision-based indoor positioning system that allows the provision of several LBS, from way-finding to the contextualized communication of cultural contents, aimed at providing a meaningful exploration of exhibits according to visitors' personal interest and curiosity. Starting from the thorough description of the system architecture, the article presents the implementation of two mobile guides, developed to respectively address adults and children, and discusses the evaluation of the user experience and the visitors' appreciation of these application

Laryngoscopic Image Stitching for View Enhancement and Documentation - First Experiences

One known problem within laryngoscopy is the spatially limited view onto the hypopharynx and the larynx through the endoscope. To examine the complete larynx and hypopharynx, the laryngoscope can be rotated about its main axis, and hence the physician obtains a complete view. If such examinations are captured using endoscopic video, the examination can be reviewed in detail at a later time. Nevertheless, in order to document the examination with a single representative image, a panorama image can be computed for archiving and enhanced documentation. Twenty patients with various clinical findings were examined with a 70 rigid laryngoscope, and the video sequences were digitally stored. The image sequence for each patient was then post-processed using an image stitching tool based on SIFT features, the RANSAC approach and blending. As a result, endoscopic panorama images of the larynx and pharynx were obtained for each video sequence. The proposed approach of image stitching for laryngoscopic video sequences offers a new tool for enhanced visual examination and documentation of morphologic characteristics of the larynx and the hypopharynx

LANDSAT Digital Data Base Preparation for the Pennsylvania Defoliation Application Pilot Test

A LANDSAT digital mosaic data base for the State of Pennsylvania was prepared for use in the development of an automated system to annually estimate the extent and severity of Gypsy Moth defoliation of hardward forests. The techniques for detecting the defoliation and development of a geographic information system (GIS) to assess damage is being developed jointly by NASA/Goddard Space Flight Center and Pennsylvania State University using the JPL prepared mosaic base. The JPL processing involved the use of ground control points from the Master Data Processor for planimetric control, resampling of the LANDSAT data to 57 x 57 meter pixels, realignment to north, and reprojection to the Universal Transverse Mercator (UTM) projection in UTM zones 17 and 18. The completed mosaic for each UTM zone was subdivided into 1 degree of latitude by 2 degrees of longitude quadrangles for easy data handling. Consideration is given to the issues of mapping standards, sensor and spacecraft platform characteristics, and their implication to geographic information systems operation. Methods for obtaining measures of accuracy for LANDSAT mosaics are reviewed