Research Issues in Image Registration for Remote Sensing

Image registration is an important element in data processing for remote sensing with many applications and a wide range of solutions. Despite considerable investigation the field has not settled on a definitive solution for most applications and a number of questions remain open. This article looks at selected research issues by surveying the experience of operational satellite teams, application-specific requirements for Earth science, and our experiments in the evaluation of image registration algorithms with emphasis on the comparison of algorithms for subpixel accuracy. We conclude that remote sensing applications put particular demands on image registration algorithms to take into account domain-specific knowledge of geometric transformations and image content

Accuracy comparison of Pléiades satellite ortho-images using GPS device based GCPs against TerraSAR-X-based GCPs

Conducting single frame orthorectification on satellite images to create an ortho-image requires four basic components, namely an image, a geometric sensor model, elevation data (for example a digital elevation model (DEM)) and ground control points (GCPs). For this study, orthorectification entailed the use of a single scene Pléiades primary panchromatic image, applying the Pléiades rigorous geometric model, utilising a high-quality 2 m DEM and using GCPs that were acquired from two different collection methods. The application of these different GCPs to the execution of orthorectification encompassed the aim of this paper, which was to investigate and compare the positional accuracies of ortho-images under two scenarios. Firstly, GCPs were manually collected through fieldwork utilising a Trimble GeoExplorer 6000 series handheld GPS device and secondly, by utilising TerraSAR-X based GCPs that were acquired from Airbus Defence and Space. The objective of this study was to determine the geolocation accuracy of a high-resolution satellite ortho-image when different types of ground control are used. This required the execution of two orthorectification tests where only the type of GCPs differed. The results of these tests were interesting since it highlighted the difference in positional accuracy when utilising various sources of ground control to perform orthorectification on satellite imagery. The comparison results showed that utilising the manual GCPs produced a better positional accurate ortho-image as opposed to using the TerraSAR-X based GCPs. Nonetheless, the TerraSAR-X based GCPs still produced a sub 2 m accurate ortho-image, which is more than sufficient for the production of most geospatial products.Keywords: orthorectification, digital elevation model (DEM), ground control point (GCP), high-resolution satellite imagery, TerraSAR-X based GCPs, WorldDEM™, Airbus Defence and Spac

Semi-Automatic Methodology for Fire Break Maintenance Operations Detection with Sentinel-2 Imagery and Artificial Neural Network

PTDC/CCI-COM/30344/2017 PCIF/SSI/0102/2017 UID/EEA/00066/2019 UIDB/00239/2020The difficult job of fighting fires and the nearly impossible task to stop a wildfire without great casualties requires an imperative implementation of proactive strategies. These strategies must decrease the number of fires, the burnt area and create better conditions for the firefighting. In this line of action, the Portuguese Institute of Nature and Forest Conservation defined a fire break network (FBN), which helps controlling wildfires. However, these fire breaks are efficient only if they are correctly maintained, which should be ensured by the local authorities and requires verification from the national authorities. This is a fastidious task since they have a large network of thousands of hectares to monitor over a full year. With the increasing quality and frequency of the Earth Observation Satellite imagery with Sentinel-2 and the definition of the FBN, a semi-automatic remote sensing methodology is proposed in this article for the detection of maintenance operations in a fire break. The proposed methodology is based on a time-series analysis, an object-based classification and a change detection process. The change detection is ensured by an artificial neural network, with reflectance bands and spectral indices as features. Additionally, an analysis of several bands and spectral indices is presented to show the behaviour of the data during a full year and in the presence of a maintenance operation. The proposed methodology achieved a relative error lower than 4% and a recall higher than 75% on the detection of maintenance operations.publishersversionpublishe

The application of time-series MODIS NDVI profiles for the acquisition of crop information across Afghanistan

We investigated and developed a prototype crop information system integrating 250 m Moderate Resolution Imaging Spectroradiometer (MODIS) normalized difference vegetation index (NDVI) data with other available remotely sensed imagery, field data, and knowledge as part of a wider project monitoring opium and cereal crops. NDVI profiles exhibited large geographical variations in timing, height, shape, and number of peaks, with characteristics determined by underlying crop mixes, growth cycles, and agricultural practices. MODIS pixels were typically bigger than the field sizes, but profiles were indicators of crop phenology as the growth stages of the main first-cycle crops (opium poppy and cereals) were in phase. Profiles were used to investigate crop rotations, areas of newly exploited agriculture, localized variation in land management, and environmental factors such as water availability and disease. Near-real-time tracking of the current years’ profile provided forecasts of crop growth stages, early warning of drought, and mapping of affected areas. Derived data products and bulletins provided timely crop information to the UK Government and other international stakeholders to assist the development of counter-narcotic policy, plan activity, and measure progress. Results show the potential for transferring these techniques to other agricultural systems

Upgrade of foss date plug-in: Implementation of a new radargrammetric DSM generation capability

Synthetic Aperture Radar (SAR) satellite systems may give important contribution in terms of Digital Surface Models (DSMs) generation considering their complete independence from logistic constraints on the ground and weather conditions. In recent years, the new availability of very high resolution SAR data (up to 20 cm Ground Sample Distance) gave a new impulse to radargrammetry and allowed new applications and developments. Besides, to date, among the software aimed to radargrammetric applications only few show as free and open source. It is in this context that it has been decided to widen DATE (Digital Automatic Terrain Extractor) plug-in capabilities and additionally include the possibility to use SAR imagery for DSM stereo reconstruction (i.e. radargrammetry), besides to the optical workflow already developed. DATE is a Free and Open Source Software (FOSS) developed at the Geodesy and Geomatics Division, University of Rome "La Sapienza", and conceived as an OSSIM (Open Source Software Image Map) plug-in. It has been developed starting from May 2014 in the framework of 2014 Google Summer of Code, having as early purpose a fully automatic DSMs generation from high resolution optical satellite imagery acquired by the most common sensors. Here, the results achieved through this new capability applied to two stacks (one ascending and one descending) of three TerraSAR-X images each, acquired over Trento (Northern Italy) testfield, are presented. Global accuracies achieved are around 6 metres. These first results are promising and further analysis are expected for a more complete assessment of DATE application to SAR imagery

Computer Vision for Multimedia Geolocation in Human Trafficking Investigation: A Systematic Literature Review

The task of multimedia geolocation is becoming an increasingly essential component of the digital forensics toolkit to effectively combat human trafficking, child sexual exploitation, and other illegal acts. Typically, metadata-based geolocation information is stripped when multimedia content is shared via instant messaging and social media. The intricacy of geolocating, geotagging, or finding geographical clues in this content is often overly burdensome for investigators. Recent research has shown that contemporary advancements in artificial intelligence, specifically computer vision and deep learning, show significant promise towards expediting the multimedia geolocation task. This systematic literature review thoroughly examines the state-of-the-art leveraging computer vision techniques for multimedia geolocation and assesses their potential to expedite human trafficking investigation. This includes a comprehensive overview of the application of computer vision-based approaches to multimedia geolocation, identifies their applicability in combating human trafficking, and highlights the potential implications of enhanced multimedia geolocation for prosecuting human trafficking. 123 articles inform this systematic literature review. The findings suggest numerous potential paths for future impactful research on the subject

REMOTE SENSING DATA ANALYSIS FOR ENVIRONMENTAL AND HUMANITARIAN PURPOSES. The automation of information extraction from free satellite data.

This work is aimed at investigating technical possibilities to provide information on environmental parameters that can be used for risk management. The World food Program (WFP) is the United Nations Agency which is involved in risk management for fighting hunger in least-developed and low-income countries, where victims of natural and manmade disasters, refugees, displaced people and the hungry poor suffer from severe food shortages. Risk management includes three different phases (pre-disaster, response and post disaster) to be managed through different activities and actions. Pre disaster activities are meant to develop and deliver risk assessment, establish prevention actions and prepare the operative structures for managing an eventual emergency or disaster. In response and post disaster phase actions planned in the pre-disaster phase are executed focusing on saving lives and secondly, on social economic recovery. In order to optimally manage its operations in the response and post disaster phases, WFP needs to know, in order to estimate the impact an event will have on future food security as soon as possible, the areas affected by the natural disaster, the number of affected people, and the effects that the event can cause to vegetation. For this, providing easy-to-consult thematic maps about the affected areas and population, with adequate spatial resolution, time frequency and regular updating can result determining. Satellite remote sensed data have increasingly been used in the last decades in order to provide updated information about land surface with an acceptable time frequency. Furthermore, satellite images can be managed by automatic procedures in order to extract synthetic information about the ground condition in a very short time and can be easily shared in the web. The work of thesis, focused on the analysis and processing of satellite data, was carried out in cooperation with the association ITHACA (Information Technology for Humanitarian Assistance, Cooperation and Action), a center of research which works in cooperation with the WFP in order to provide IT products and tools for the management of food emergencies caused by natural disasters. These products should be able to facilitate the forecasting of the effects of catastrophic events, the estimation of the extension and location of the areas hit by the event, of the affected population and thereby the planning of interventions on the area that could be affected by food insecurity. The requested features of the instruments are: • Regular updating • Spatial resolution suitable for a synoptic analysis • Low cost • Easy consultation Ithaca is developing different activities to provide georeferenced thematic data to WFP users, such a spatial data infrastructure for storing, querying and manipulating large amounts of global geographic information, and for sharing it between a large and differentiated community; a system of early warning for floods, a drought monitoring tool, procedures for rapid mapping in the response phase in a case of natural disaster, web GIS tools to distribute and share georeferenced information, that can be consulted only by means of a web browser. The work of thesis is aimed at providing applications for the automatic production of base georeferenced thematic data, by using free global satellite data, which have characteristics suitable for analysis at a regional scale. In particular the main themes of the applications are water bodies and vegetation phenology. The first application aims at providing procedures for the automatic extraction of water bodies and will lead to the creation and update of an historical archive, which can be analyzed in order to catch the seasonality of water bodies and delineate scenarios of historical flooded areas. The automatic extraction of phenological parameters from satellite data will allow to integrate the existing drought monitoring system with information on vegetation seasonality and to provide further information for the evaluation of food insecurity in the post disaster phase. In the thesis are described the activities carried on for the development of procedures for the automatic processing of free satellite data in order to produce customized layers according to the exigencies in format and distribution of the final users. The main activities, which focused on the development of an automated procedure for the extraction of flooded areas, include the research of an algorithm for the classification of water bodies from satellite data, an important theme in the field of management of the emergencies due to flood events. Two main technologies are generally used: active sensors (radar) and passive sensors (optical data). Advantages for active sensors include the ability to obtain measurements anytime, regardless of the time of day or season, while passive sensors can only be used in the daytime cloud free conditions. Even if with radar technologies is possible to get information on the ground in all weather conditions, it is not possible to use radar data to obtain a continuous archive of flooded areas, because of the lack of a predetermined frequency in the acquisition of the images. For this reason the choice of the dataset went in favor of MODIS (Moderate Resolution Imaging Spectroradiometer), optical data with a daily frequency, a spatial resolution of 250 meters and an historical archive of 10 years. The presence of cloud coverage prevents from the acquisition of the earth surface, and the shadows due to clouds can be wrongly classified as water bodies because of the spectral response very similar to the one of water. After an analysis of the state of the art of the algorithms of automated classification of water bodies in images derived from optical sensors, the author developed an algorithm that allows to classify the data of reflectivity and to temporally composite them in order to obtain flooded areas scenarios for each event. This procedure was tested in the Bangladesh areas, providing encouraging classification accuracies. For the vegetation theme, the main activities performed, here described, include the review of the existing methodologies for phenological studies and the automation of the data flow between inputs and outputs with the use of different global free satellite datasets. In literature, many studies demonstrated the utility of the NDVI (Normalized Difference Vegetation Index) indices for the monitoring of vegetation dynamics, in the study of cultivations, and for the survey of the vegetation water stress. The author developed a procedure for creating layers of phenological parameters which integrates the TIMESAT software, produced by Lars Eklundh and Per Jönsson, for processing NDVI indices derived from different satellite sensors: MODIS (Moderate Resolution Imaging Spectroradiometer), AVHRR (Advanced Very High Resolution Radiometer) AND SPOT (Système Pour l'Observation de la Terre) VEGETATION. The automated procedure starts from data downloading, calls in a batch mode the software and provides customized layers of phenological parameters such as the starting of the season or length of the season and many others

GEOMETRIC PROCESSING OF VERY HIGH-RESOLUTION SATELLITE IMAGERY: QUALITY ASSESSMENT FOR 3D MAPPING NEEDS

In recent decades, the geospatial domain has benefitted from technological advances in sensors, methodologies, and processing tools to expand capabilities in mapping applications. Airborne techniques (LiDAR and aerial photogrammetry) generally provide most of the data used for this purpose. However, despite the relevant accuracy of these technologies and the high spatial resolution of airborne data, updates are not sufficiently regular due to significant flight costs and logistics. New possibilities to fill this information gap have emerged with the advent of Very High Resolution (VHR) optical satellite images in the early 2000s. In addition to the high temporal resolution of the cost-effective datasets and their sub-meter geometric resolutions, the synoptic coverage is an unprecedented opportunity for mapping remote areas, multi-temporal analyses, updating datasets and disaster management. For all these reasons, VHR satellite imagery is clearly a relevant study for National Mapping and Cadastral Agencies (NMCAs). This work, supported by EuroSDR, summarises a series of experimental analyses carried out over diverse landscapes to explore the potential of VHR imagery for large-scale mapping

Mitigation of atmospheric perturbations and solid Earth movements in a TerraSAR-X time-series

The TerraSAR-X (TSX) synthetic aperture radar (SAR) marks the recent emergence of a new generation of spaceborne radar sensors that can for the first time lay claim to localization accuracies in the sub-meter range. The TSX platform's extremely high orbital stability and the sensor's hardware timing accuracy combine to enable direct measurements of atmospheric refraction and solid Earth movements. By modeling these effects for individual TSX acquisitions, absolute pixel geolocation accuracy on the order of several centimeters can be achieved without need for even a single tiepoint. A 16-month time series of images was obtained over a fixed test site, making it possible to validate both an atmospheric refraction and a solid Earth tide model, while at the same time establishing the instrument's long-term stability. These related goals were achieved by placing trihedral corner reflectors (CRs) at the test site and estimating their phase centers with centimeter-level accuracy using differential GPS (DGPS). Oriented in pairs toward a given satellite track, the CRs could be seen as bright "points” in the images, providing a geometric reference set. SAR images from the high-resolution spotlight (HS) mode were obtained in alternating ascending and descending orbit configurations. The highest-resolution products were selected for their small sample dimensions, as positions can be more precisely determined. Based on the delivered product annotations, the CR image positions were predicted, and these predictions were compared with their measured image positions both before and after compensation for atmospheric refraction and systematic solid Earth deviations. It was possible to show that when the atmospheric distortion and Earth tides are taken into account, the TSX HS products have geolocation accuracies far exceeding the specified requirements. Furthermore, this accuracy was maintained for the duration of the 16-month test period. It could be demonstrated that with a correctly calibrated sensor, and after accounting for atmospheric and tidal effects, tiepoint-free geolocation is possible with TSX with an absolute product accuracy of about 5c