The Impact of Sensor Characteristics and Data Availability on Remote Sensing Based Change Detection

Land cover and land use change are among the major drivers of global change. In a time of mounting challenges for sustainable living on our planet any research benefits from interdisciplinary collaborations to gain an improved understanding of the human-environment system and to develop suitable and improve existing measures of natural resource management. This includes comprehensive understanding of land cover and land use changes, which is fundamental to mitigate global change. Remote sensing technology is essential for the analyses of the land surface (and hence related changes) because it offers cost-effective ways of collecting data simultaneously over large areas. With increasing variety of sensors and better data availability, the application of remote sensing as a means to assist in modeling, to support monitoring, and to detect changes at various spatial and temporal scales becomes more and more feasible. The relationship between the nature of the changes on the land surface, the sensor properties, and the conditions at the time of acquisition influences the potential and quality of land cover and land use change detection. Despite the wealth of existing change detection research, there is a need for new methodologies in order to efficiently explore the huge amount of data acquired by remote sensing systems with different sensor characteristics. The research of this thesis provides solutions to two main challenges of remote sensing based change detection. First, geometric effects and distortions occur when using data taken under different sun-target-sensor geometries. These effects mainly occur if sun position and/or viewing angles differ between images. This challenge was met by developing a theoretical framework of bi-temporal change detection scenarios. The concept includes the quantification of distortions that can occur in unfavorable situations. The invention and application of a new method – the Robust Change Vector Analysis (RCVA) – reduced the detection of false changes due to these distortions. The quality and robustness of the RCVA were demonstrated in an example of bi-temporal cross-sensor change detection in an urban environment in Cologne, Germany. Comparison with a state-of-the-art method showed better performance of RCVA and robustness against thresholding. Second, this thesis provides new insights into how to optimize the use of dense time series for forest cover change detection. A collection of spectral indices was reviewed for their suitability to display forest structure, development, and condition at a study site on Vancouver Island, British Columbia, Canada. The spatio-temporal variability of the indices was analyzed to identify those indices, which are considered most suitable for forest monitoring based on dense time series. Amongst the indices, the Disturbance Index (DI) was found to be sensitive to the state of the forest (i.e., forest structure). The Normalized Difference Moisture Index (NDMI) was found to be spatio-temporally stable and to be the most sensitive index for changes in forest condition. Both indices were successfully applied to detect abrupt forest cover changes. Further, this thesis demonstrated that relative radiometric normalization can obscure actual seasonal variation and long-term trends of spectral signals and is therefore not recommended to be incorporated in the time series pre-processing of remotely-sensed data. The main outcome of this part of the presented research is a new method for detecting discontinuities in time series of spectral indices. The method takes advantage of all available information in terms of cloud-free pixels and hence increases the number of observations compared to most existing methods. Also, the first derivative of the time series was identified (together with the discontinuity measure) as a suitable variable to display and quantify the dynamic of dense Landsat time series that cannot be observed with less dense time series. Given that these discontinuities are predominantly related to abrupt changes, the presented method was successfully applied to clearcut harvest detection. The presented method detected major events of forest change at unprecedented temporal resolution and with high accuracy (93% overall accuracy). This thesis contributes to improved understanding of bi-temporal change detection, addressing image artifacts that result from flexible acquisition features of modern satellites (e.g., off-nadir capabilities). The demonstrated ability to efficiently analyze cross-sensor data and data taken under unfavorable conditions is increasingly important for the detection of many rapid changes, e.g., to assist in emergency response. This thesis further contributes to the optimized use of remotely sensed time series for improving the understanding, accuracy, and reliability of forest cover change detection. Additionally, the thesis demonstrates the usability of and also the necessity for continuity in medium spatial resolution satellite imagery, such as the Landsat data, for forest management. Constellations of recently launched (e.g., Landsat 8 OLI) and upcoming sensors (e.g., Sentinel-2) will deliver new opportunities to apply and extend the presented methodologies.Der Einfluss von Sensorcharakteristik und Datenverfügbarkeit auf die fernerkundungsbasierte Veränderungsdetektion Landbedeckungs- und Landnutzungswandel gehören zu den Haupttriebkräften des Globalen Wandels. In einer Zeit, in der ein nachhaltiges Leben auf unserem Planeten zu einer wachsenden Herausforderung wird, profitiert die Wissenschaft von interdisziplinärer Zusammenarbeit, um ein besseres Verständnis der Mensch-Umwelt-Beziehungen zu erlangen und um verbesserte Maßnahmen des Ressourcenmanagements zu entwickeln. Dazu gehört auch ein erweitertes Verständnis von Landbedeckungs- und Landnutzungswandel, das elementar ist, um dem Globalen Wandel zu begegnen. Die Fernerkundungstechnologie ist grundlegend für die Analyse der Landoberfläche und damit verknüpften Veränderungen, weil sie in der Lage ist, große Flächen gleichzeitig zu erfassen. Mit zunehmender Sensorenvielfalt und besserer Datenverfügbarkeit gewinnt Fernerkundung bei der Modellierung, beim Monitoring sowie als Mittel zur Erkennung von Veränderungen in verschiedenen räumlichen und zeitlichen Skalen zunehmend an Bedeutung. Das Wirkungsgeflecht zwischen der Art von Veränderungen der Landoberfläche, Sensoreigenschaften und Aufnahmebedingungen beeinflusst das Potenzial und die Qualität fernerkundungsbasierter Landbedeckungs- und Landnutzungsveränderungs-detektion. Trotz der Fülle an bestehenden Forschungsleistungen zur Veränderungsdetektion besteht ein dringender Bedarf an neuen Methoden, die geeignet sind, das große Aufkommen von Daten unterschiedlicher Sensoren effizient zu nutzen. Die in dieser Abschlussarbeit durchgeführte Forschung befasst sich mit zwei aktuellen Problemfeldern der fernerkundungsbasierten Veränderungsdetektion. Das erste sind die geometrischen Effekte und Verzerrungen, die auftreten, wenn Daten genutzt werden, die unter verschiedenen Sonne-Zielobjekt-Sensor-Geometrien aufgenommen wurden. Diese Effekte treten vor allem dann auf, wenn unterschiedliche Sonnenstände und/oder unterschiedliche Einfallswinkel der Satelliten genutzt werden. Der Herausforderung wurde begegnet, indem ein theoretisches Konzept von Szenarien dargelegt wurde, die bei der bi-temporalen Veränderungsdetektion auftreten können. Das Konzept beinhaltet die Quantifizierung der Verzerrungen, die in ungünstigen Fällen auftreten können. Um die Falscherkennung von Veränderungen in Folge der resultierenden Verzerrungen zu reduzieren, wurde eine neue Methode entwickelt – die Robust Change Vector Analysis (RCVA). Die Qualität der Methode wird an einem Beispiel der Veränderungsdetektion im urbanen Raum (Köln, Deutschland) aufgezeigt. Ein Vergleich mit einer anderen gängigen Methode zeigt bessere Ergebnisse für die neue RCVA und untermauert deren Robustheit gegenüber der Schwellenwertbestimmung. Die zweite Herausforderung, mit der sich die vorliegende Arbeit befasst, betrifft die optimierte Nutzung von dichten Zeitreihen zur Veränderungsdetektion von Wäldern. Eine Auswahl spektraler Indizes wurde hinsichtlich ihrer Tauglichkeit zur Erfassung von Waldstruktur, Waldentwicklung und Waldzustand in einem Untersuchungsgebiet auf Vancouver Island, British Columbia, Kanada, bewertet. Um die Einsatzmöglichkeiten der Indizes für dichte Zeitreihen bewerten zu können, wurde ihre raum-zeitliche Variabilität untersucht. Der Disturbance Index (DI) ist ein Index, der sensitiv für das Stadium eines Waldes ist (d. h. seine Struktur). DerNormalized Difference Moisture Index (NDMI) ist raum-zeitlich stabil und zudem am sensitivsten für Veränderungen des Waldzustands. Beide Indizes wurden erfolgreich zur Erkennung von abrupten Veränderungen getestet. In der vorliegenden Arbeit wird aufgezeigt, dass die relative radiometrische Normierung saisonale Variabilität und Langzeittrends von Zeitreihen spektraler Signale verzerrt. Die relative radiometrische Normierung wird daher nicht zur Vorprozessierung von Fernerkundungszeitreihen empfohlen. Das wichtigste Ergebnis dieser Studie ist eine neue Methode zur Erkennung von Diskontinuitäten in Zeitreihen spektraler Indizes. Die Methode nutzt alle wolkenfreien, ungestörten Beobachtungen (d. h. unabhängig von der Gesamtbewölkung in einem Bild) in einer Zeitreihe und erhöht dadurch die Anzahl an Beobachtungen im Vergleich zu anderen Methoden. Die erste Ableitung und die Messgröße zur Erfassung der Diskontinuitäten sind gut geeignet, um die Dynamik dichter Zeitreihen zu beschreiben und zu quantifizieren. Dies ist mit weniger dichten Zeitreihen nicht möglich. Da diese Diskontinuitäten im Untersuchungsgebiet üblicherweise abrupter Natur sind, ist die Methode gut geeignet, um Kahlschläge zu erfassen. Die hier dargelegte neue Methode detektiert Waldbedeckungsveränderungen mit einzigartiger zeitlicher Auflösung und hoher Genauigkeit (93% Gesamtgenauigkeit). Die vorliegende Arbeit trägt zu einem verbesserten Verständnis bi-temporaler Veränderungsdetektion bei, indem Bildartefakte berücksichtigt werden, die infolge der Flexibilität moderner Sensoren entstehen können. Die dargestellte Möglichkeit, Daten zu analysieren, die von unterschiedlichen Sensoren stammen und die unter ungünstigen Bedingungen aufgenommen wurden, wird zukünftig bei der Erfassung von schnellen Veränderungen an Bedeutung gewinnen, z. B. bei Katastropheneinsätzen. Ein weiterer Beitrag der vorliegenden Arbeit liegt in der optimierten Anwendung von Fernerkundungszeitreihen zur Verbesserung von Verständnis, Genauigkeit und Verlässlichkeit der Waldveränderungsdetektion. Des Weiteren zeigt die Arbeit den Nutzen und die Notwendigkeit der Fortführung von Satellitendaten mit mittlerer Auflösung (z. B. Landsat) für das Waldmanagement. Konstellationen kürzlich gestarteter (z. B. Landsat 8 OLI) und zukünftiger Sensoren (z. B. Sentinel-2) werden neue Möglichkeiten zur Anwendung und Optimierung der hier vorgestellten Methoden bieten

Using Lidar to geometrically-constrain signature spaces for physics-based target detection

A fundamental task when performing target detection on spectral imagery is ensuring that a target signature is in the same metric domain as the measured spectral data set. Remotely sensed data are typically collected in digital counts and calibrated to radiance. That is, calibrated data have units of spectral radiance, while target signatures in the visible regime are commonly characterized in units of re°ectance. A necessary precursor to running a target detection algorithm is converting the measured scene data and target signature to the same domain. Atmospheric inversion or compensation is a well-known method for transforming mea- sured scene radiance values into the re°ectance domain. While this method may be math- ematically trivial, it is computationally attractive and is most e®ective when illumination conditions are constant across a scene. However, when illumination conditions are not con- stant for a given scene, signi¯cant error may be introduced when applying the same linear inversion globally. In contrast to the inversion methodology, physics-based forward modeling approaches aim to predict the possible ways that a target might appear in a scene using atmospheric and radiometric models. To fully encompass possible target variability due to changing illumination levels, a target vector space is created. In addition to accounting for varying illumination, physics-based model approaches have a distinct advantage in that they can also incorporate target variability due to a variety of other sources, to include adjacency target orientation, and mixed pixels. Increasing the variability of the target vector space may be beneficial in a global sense in that it may allow for the detection of difficult targets, such as shadowed or partially concealed targets. However, it should also be noted that expansion of the target space may introduce unnecessary confusion for a given pixel. Furthermore, traditional physics-based approaches make certain assumptions which may be prudent only when passive, spectral data for a scene are available. Common examples include the assumption of a °at ground plane and pure target pixels. Many of these assumptions may be attributed to the lack of three-dimensional (3D) spatial information for the scene. In the event that 3D spatial information were available, certain assumptions could be levied, allowing accurate geometric information to be fed to the physics-based model on a pixel- by-pixel basis. Doing so may e®ectively constrain the physics-based model, resulting in a pixel-specific target space with optimized variability and minimized confusion. This body of work explores using spatial information from a topographic Light Detection and Ranging (Lidar) system as a means to enhance the delity of physics-based models for spectral target detection. The incorporation of subpixel spatial information, relative to a hyperspectral image (HSI) pixel, provides valuable insight about plausible geometric con¯gurations of a target, background, and illumination sources within a scene. Methods for estimating local geometry on a per-pixel basis are introduced; this spatial information is then fed into a physics-based model to the forward prediction of a target in radiance space. The target detection performance based on this spatially-enhanced, spectral target space is assessed relative to current state-of-the-art spectral algorithms

Mapping Exoplanets

The varied surfaces and atmospheres of planets make them interesting places to live, explore, and study from afar. Unfortunately, the great distance to exoplanets makes it impossible to resolve their disk with current or near-term technology. It is still possible, however, to deduce spatial inhomogeneities in exoplanets provided that different regions are visible at different times---this can be due to rotation, orbital motion, and occultations by a star, planet, or moon. Astronomers have so far constructed maps of thermal emission and albedo for short period giant planets. These maps constrain atmospheric dynamics and cloud patterns in exotic atmospheres. In the future, exo-cartography could yield surface maps of terrestrial planets, hinting at the geophysical and geochemical processes that shape them.Comment: Updated chapter for Handbook of Exoplanets, eds. Deeg & Belmonte. 17 pages, including 6 figures and 4 pages of reference

Signature extension preprocessing for LANDSAT MSS data

There are no author-identified significant results in this report

Static scene illumination estimation from video with applications

We present a system that automatically recovers scene geometry and illumination from a video, providing a basis for various applications. Previous image based illumination estimation methods require either user interaction or external information in the form of a database. We adopt structure-from-motion and multi-view stereo for initial scene reconstruction, and then estimate an environment map represented by spherical harmonics (as these perform better than other bases). We also demonstrate several video editing applications that exploit the recovered geometry and illumination, including object insertion (e.g., for augmented reality), shadow detection, and video relighting

Multispectral photography for earth resources

A guide for producing accurate multispectral results for earth resource applications is presented along with theoretical and analytical concepts of color and multispectral photography. Topics discussed include: capabilities and limitations of color and color infrared films; image color measurements; methods of relating ground phenomena to film density and color measurement; sensitometry; considerations in the selection of multispectral cameras and components; and mission planning

Three-dimensional camouflage:exploiting photons to conceal form

Many animals have a gradation of body color, termed “countershading,” where the areas that are typically exposed to more light are darker. One hypothesis is that this patterning enhances visual camouflage by making the retinal image of the animal match that of the background, a fundamentally two-dimensional theory. More controversially, countershading may also obliterate cues to three-dimensional (3D) shape delivered by shading. Despite relying on distinct cognitive mechanisms, these two potential functions hitherto have been amalgamated in the literature. It has previously not been possible to validate either hypothesis empirically, because there has been no general theory of optimal countershading that allows quantitative predictions to be made about the many environmental parameters involved. Here we unpack the logical distinction between using countershading for background matching and using it to obliterate 3D shape. We use computational modeling to determine the optimal coloration for the camouflage of 3D shape. Our model of 3D concealment is derived from the physics of light and informed by perceptual psychology: we simulate a 3D world that incorporates naturalistic lighting environments. The model allows us to predict countershading coloration for terrestrial environments, for any body shape and a wide range of ecologically relevant parameters. The approach can be generalized to any light distribution, including those underwater

The 27-28 October 1986 FIRE IFO cirrus case study: Cirrus parameter relationships derived from satellite and lidar data

Cirrus cloud radiative and physical characteristics are determined using a combination of ground-based, aircraft, and satellite measurements taken as part of the First ISCCP Regional Experiment (FIRE) Cirrus Intensive Field Observations (IFO) during October and November 1986. Lidar backscatter data are used to define cloud base, center, and top heights and the corresponding temperatures. Coincident GOES 4 km visible (0.65 microns) and 8 km infrared window (11.5 microns) radiances are analyzed to determine cloud emittances and reflectances. Infrared optical depth is computed from the emittance results. Visible optical depth is derived from reflectance using a theoretical ice crystal scattering model and an empirical bidirectional reflectance mode. No clouds with visible optical depths greater than 5 or infrared optical depths less than 0.1 were used in the analysis. Average cloud thickness ranged from 0.5 km to 8 km for the 71 scenes. An average visible scattering efficiency of 2.1 was found for this data set. The results reveal a significant dependence of scattering efficiency on cloud temperature