Efficient multitemporal change detection techniques for hyperspectral images on GPU

Hyperspectral images contain hundreds of reflectance values for each pixel. Detecting regions of change in multiple hyperspectral images of the same scene taken at different times is of widespread interest for a large number of applications. For remote sensing, in particular, a very common application is land-cover analysis. The high dimensionality of the hyperspectral images makes the development of computationally efficient processing schemes critical. This thesis focuses on the development of change detection approaches at object level, based on supervised direct multidate classification, for hyperspectral datasets. The proposed approaches improve the accuracy of current state of the art algorithms and their projection onto Graphics Processing Units (GPUs) allows their execution in real-time scenarios

HoEnTOA: Holoentropy and Taylor Assisted Optimization based Novel Image Quality Enhancement Algorithm for Multi-Focus Image Fusion

875-886In machine vision as well as image processing applications, multi-focus image fusion strategy carries a prominent exposure. Normally, image fusion is a method of merging of information extracted out of two or more than two source images fused to produce a solitary image, which is much more instructive as well as much suitable for computer processing and visual perception. In this research paper authors have devised a novel image quality enhancement algorithm by fusing multi-focus images, in short, termed as HoEnTOA. Initially, contourlet transform is incorporated to both of the input images for generation of four respective sub-bands of each of input image. After converting into sub-bands further holoentropy along with proposed HoEnTOA is introduced to fuse multi-focus images. Here, the developed HoEnTOA is integration of Taylor series with ASSCA. After fusion, the inverse contourlet transform is incorporated for obtaining last fused image. Thus, the proposed HoEnTOA effectively performs the image fusion and has demonstrated better performance utilizing the five metrics i.e. Root Mean Square Error with a minimum value of 3.687, highest universal quality index value of 0.984, maximum Peak Signal to Noise Ratio of 42.08dB, maximal structural similarity index measurement of 0.943, as well as maximum mutual information of 1.651

HoEnTOA: Holoentropy and Taylor Assisted Optimization based Novel Image Quality Enhancement Algorithm for Multi-Focus Image Fusion

In machine vision as well as image processing applications, multi-focus image fusion strategy carries a prominent exposure. Normally, image fusion is a method of merging of information extracted out of two or more than two source images fused to produce a solitary image, which is much more instructive as well as much suitable for computer processing and visual perception. In this research paper authors have devised a novel image quality enhancement algorithm by fusing multi-focus images, in short, termed as HoEnTOA. Initially, contourlet transform is incorporated to both of the input images for generation of four respective sub-bands of each of input image. After converting into sub-bands further holoentropy along with proposed HoEnTOA is introduced to fuse multi-focus images. Here, the developed HoEnTOA is integration of Taylor series with ASSCA. After fusion, the inverse contourlet transform is incorporated for obtaining last fused image. Thus, the proposed HoEnTOA effectively performs the image fusion and has demonstrated better performance utilizing the five metrics i.e. Root Mean Square Error with a minimum value of 3.687, highest universal quality index value of 0.984, maximum Peak Signal to Noise Ratio of 42.08dB, maximal structural similarity index measurement of 0.943, as well as maximum mutual information of 1.651

Master of Science

thesisThe focus of this thesis has been developing and validating new methods of streamlining expensive function calls. These new methods of streamlining are applied to the problem of modeling electrodynamic response in in nite two-dimensional nanoparticle (NP) arrays. Using these methods, an exact analytical solution for electromagnetic interaction with two-dimensional spherical periodic in nite arrays has been developed. The new solution o ers fundamental insight into the singularities responsible for dramatic sensitivity in- creases seen in sensory applications. The new analytical solution also provides increased computational time with 60x improvement demonstrated in this work. In addition, a new electroless deposition method followed by thermal annealing was developed by Ahn et al. for spherical Au array fabrication. To complement the model and fabrication technique, additional improvements in NP array sample analysis have been adapted and developed. Algorithms for NP particle density, size, and shape analysis are described using Atomic Force Microscope (AFM) and Scanning Electron Microscope (SEM) with a comparison between the two microscopy methods. Using fabrication and analysis, the methods of streamlining expensive function calls can be tested and improved

Big Data Analytics for Earth Sciences: the EarthServer approach

Big Data Analytics is an emerging field since massive storage and computing capabilities have been made available by advanced e-infrastructures. Earth and Environmental sciences are likely to benefit from Big Data Analytics techniques supporting the processing of the large number of Earth Observation datasets currently acquired and generated through observations and simulations. However, Earth Science data and applications present specificities in terms of relevance of the geospatial information, wide heterogeneity of data models and formats, and complexity of processing. Therefore, Big Earth Data Analytics requires specifically tailored techniques and tools. The EarthServer Big Earth Data Analytics engine offers a solution for coverage-type datasets, built around a high performance array database technology, and the adoption and enhancement of standards for service interaction (OGC WCS and WCPS). The EarthServer solution, led by the collection of requirements from scientific communities and international initiatives, provides a holistic approach that ranges from query languages and scalability up to mobile access and visualization. The result is demonstrated and validated through the development of lighthouse applications in the Marine, Geology, Atmospheric, Planetary and Cryospheric science domains

Study of segmentation and identification techniques applied to environments with natural illumination and moving objects

La presente tesis está enmarcada en el área de visión por computador y en ella se realizan aportaciones encaminados a resolver el problema de segmentar automáticamente objetos en imágenes de escenas adquiridas en entornos donde se está realizando actividad, es decir, aparece movimiento de los elementos que la componen, y con iluminación variable o no controlada. Para llevar a cabo los desarrollos y poder evaluar prestaciones se ha abordado la resolución de dos problemas distintos desde el punto de vista de requerimientos y condiciones de entorno. En primer lugar se aborda el problema de segmentar e identificar, los códigos de los contenedores de camiones con imágenes tomadas en la entrada de un puerto comercial que se encuentra ubicada a la intemperie. En este caso se trata de proponer técnicas de segmentación que permitan extraer objetos concretos, en nuestro caso caracteres en contenedores, procesando imágenes individuales. No sólo supone un reto el trabajar con iluminación natural, sino además el trabajar con elementos deteriorados, con contrastes muy diferentes, etc. Dentro de este contexto, en la tesis se evalúan técnicas presentes en la literatura como LAT, Watershed, algoritmo de Otsu, variación local o umbralizado para segmentar imágenes en niveles de gris. A partir de este estudio, se propone una solución que combina varias de las técnicas anteriores, en un intento de abordar con éxito la extracción de caracteres de contenedores en todas las situaciones ambientales de movimiento e iluminación. El conocimiento a priori del tipo de objetos a segmentar nos permitió diseñar filtros con capacidad discriminante entre el ruido y los caracteres. El sistema propuesto tiene el valor añadido de que no necesita el ajuste de parámetros, por parte del usuario, para adaptarse a las variaciones de iluminación ambientales y consigue un nivel alto en la segmentación e identificación de caracteres.Rosell Ortega, JA. (2011). Study of segmentation and identification techniques applied to environments with natural illumination and moving objects [Tesis doctoral no publicada]. Universitat Politècnica de València. https://doi.org/10.4995/Thesis/10251/10863Palanci

Semi-Automated DIRSIG scene modeling from 3D lidar and passive imagery

The Digital Imaging and Remote Sensing Image Generation (DIRSIG) model is an established, first-principles based scene simulation tool that produces synthetic multispectral and hyperspectral images from the visible to long wave infrared (0.4 to 20 microns). Over the last few years, significant enhancements such as spectral polarimetric and active Light Detection and Ranging (lidar) models have also been incorporated into the software, providing an extremely powerful tool for multi-sensor algorithm testing and sensor evaluation. However, the extensive time required to create large-scale scenes has limited DIRSIG’s ability to generate scenes ”on demand.” To date, scene generation has been a laborious, time-intensive process, as the terrain model, CAD objects and background maps have to be created and attributed manually. To shorten the time required for this process, this research developed an approach to reduce the man-in-the-loop requirements for several aspects of synthetic scene construction. Through a fusion of 3D lidar data with passive imagery, we were able to semi-automate several of the required tasks in the DIRSIG scene creation process. Additionally, many of the remaining tasks realized a shortened implementation time through this application of multi-modal imagery. Lidar data is exploited to identify ground and object features as well as to define initial tree location and building parameter estimates. These estimates are then refined by analyzing high-resolution frame array imagery using the concepts of projective geometry in lieu of the more common Euclidean approach found in most traditional photogrammetric references. Spectral imagery is also used to assign material characteristics to the modeled geometric objects. This is achieved through a modified atmospheric compensation applied to raw hyperspectral imagery. These techniques have been successfully applied to imagery collected over the RIT campus and the greater Rochester area. The data used include multiple-return point information provided by an Optech lidar linescanning sensor, multispectral frame array imagery from the Wildfire Airborne Sensor Program (WASP) and WASP-lite sensors, and hyperspectral data from the Modular Imaging Spectrometer Instrument (MISI) and the COMPact Airborne Spectral Sensor (COMPASS). Information from these image sources was fused and processed using the semi-automated approach to provide the DIRSIG input files used to define a synthetic scene. When compared to the standard manual process for creating these files, we achieved approximately a tenfold increase in speed, as well as a significant increase in geometric accuracy

Uso de sensores remotos en el seguimiento de la vegetación de dehesa y su influencia en el balance hidrológico a escala de cuenca

The Mediterranean region is characterized by hot summers with long dry periods, a situation that may be exacerbated by the progressive global warming. In these water-limited environments where productivity of the ecosystems depends mainly on water availability, the reduction of freshwater resources can have severe consequences. An increase in aridity may lead to low productivity, land degradation and unwanted changes in land use. To reduce the vulnerability of Mediterranean landscapes it is important to improve our knowledge of the hydrological processes conditioning the water exchanges, with evapotranspiration (ET) being a key indicator of the state of ecosystems and playing a crucial role in the basin's water and energy balances. The goal of this dissertation is to improve our understanding of the evapotranspiration dynamics over Mediterranean heterogeneous and complex vegetation covers, with a focus on the dehesa ecosystem. The final aim is to contribute to the conservation of the water resources in these regions in the medium to long term, supporting the decision-making processes with quantitative, distributed, and high-quality information. To reach this goal, in this research the evaluation of remote sensing-based soil water balance (SWB) and surface energy balance (SEB) models was proposed to monitor the water consumption and water stress of typical Mediterranean vegetation at different spatial and temporal scales. In particular, the VI-ETo methodology (SWB) and the ALEXI/DisALEXI approach (SEB) have been adapted and applied. ET modeling using the VI-ETo scheme has been improved through the assessment of the vegetation layers' effective parameters. A data fusion algorithm was applied to the ET maps produced by the SEB model over the dehesa ecosystem, and we analyzed the opportunities that this high-resolution ET product in time and space can provide for water and vegetation resource management. The results have demonstrated the feasibility of both approaches (SWB and SEB models) to accurately monitor ET dynamics over the dehesa landscape, adequately reproducing the annual bimodal behavior and the response of the vegetation in periods of water deficit. The error obtained using the SWB approach (the VI-ETo method) was RMSE = 0.47 mm day-1 over the whole dehesa system (grass + trees) and over an open grassland. The monitoring of water stress for both systems with different canopy structure, using as a proxy the ET/ETo ratio, and the stress coefficient (Ks), was successful. Improvements on the specific spectral properties of oak trees and layer-specific parameters were included into the modeling. We also analyzed the influence of the spectral properties of oak trees and another typical Mediterranean tree canopy, the olive orchard, in the VI-ETo model. We found that the use of appropriate values of the parameter SAVImax (0.51 for oak trees and 0.57 for olive trees) had notable implications in the computation of ET and water stress, in contrast to using a generic value for Mediterranean crops (SAVImax= 0.75). The accuracy of this water balance-based approach was also evaluated over two heterogeneous Mediterranean basins, with a mosaic of holm oaks and grasslands, shrubs, coniferous plantations, and irrigated horticultural crops. The annual discharge flows of both watersheds, which were determined from the modeled ET data and using a simple surface water balance, were very similar to those obtained with the HBV hydrological model, and to the values measured at the outlet of one of the basins, corroborating the usefulness of the VI-ETo methodology on these vegetation types. On the other hand, the resulting ET series (30 m, daily) derived with the SEB approach (ALEXI/DisALEXI method) and the STARFM fusion algorithm provided an RMSE value of 0.67 mm day-1, which was considered an acceptable error for management purposes. This error was slightly lower compared to using simpler interpolation methods, probably due to the high temporal frequency and better spatial representation of the flux tower footprint of the fused time series. The analysis of ET patterns over small heterogeneous vegetated patches that form the dehesa structure revealed the importance of having fine resolution information at field scale to distinguish the water consumed by the different vegetation components, which influences the provision of many ecosystem services. For example, it was key for identifying phenology dates of grasslands, or understanding the hydrological functioning of riverside dense evergreen vegetation with high ET rates during the whole year, in contrast with the herbaceous areas. Accurately modeling these different behaviors of dehesa microclimates is useful to support farmers‘ management and provide recommendations tailored for each structural component and requirements.La región mediterránea se caracteriza por veranos calurosos con largos períodos sin precipitaciones, situación que puede agravarse con el progresivo calentamiento global. En estos ambientes donde la productividad de los ecosistemas depende principalmente de la disponibilidad de agua, la reducción de los recursos hídricos puede tener graves consecuencias. Un aumento de la aridez puede conducir a una baja productividad, degradación de la tierra y cambios no deseados en el uso del suelo. Para reducir la vulnerabilidad de las zonas mediterráneas es importante profundizar en el estudio de los procesos hidrológicos que condicionan los intercambios de agua, siendo la evapotranspiración (ET) un indicador clave del estado de los ecosistemas y jugando un papel crucial en los balances hídricos y energéticos de la cuenca. El objetivo de esta tesis es mejorar nuestro conocimiento sobre la dinámica de la evapotranspiración en cubiertas mediterráneas heterogéneas y complejas, con el foco en el ecosistema de dehesa. El objetivo final es contribuir a la conservación de los recursos hídricos de estas regiones en el medio-largo plazo, apoyando en los procesos de toma de decisiones con información cuantitativa, distribuida y de calidad. Para alcanzar este objetivo, en esta investigación se propuso evaluar modelos de balance de agua en el suelo (SWB) y balance de energía en superficie (SEB) basados en el uso de sensores remotos, para el seguimiento del consumo de agua y el estrés hídrico de la vegetación mediterránea a diferentes escalas espaciales y temporales. En particular, se ha adaptado y aplicado la metodología VI-ETo (SWB) y el enfoque ALEXI/DisALEXI (SEB). Se ha mejorado el modelado de ET utilizando el esquema VI-ETo mediante la evaluación de los parámetros efectivos de las capas de vegetación. Se aplicó un algoritmo de fusión de datos remotos a los mapas de ET generados por el modelo SEB sobre el ecosistema de dehesa, y estudiamos las oportunidades que este producto de ET con alta resolución espacial y temporal puede aportar en la gestión de los recursos hídricos y de los ecosistemas. Los resultados han demostrado la viabilidad de ambos enfoques (modelos SWB y SEB) para monitorear con precisión la dinámica de la ET sobre el ecosistema de dehesa, reproduciendo adecuadamente el comportamiento bimodal anual y la respuesta de la vegetación en períodos de déficit hídrico. El error obtenido usando el enfoque SWB (el método VI-ETo) fue RMSE = 0.47 mm día-1, tanto para el sistema dehesa (pasto + árboles) como para una zona de pastizal. El seguimiento del estrés hídrico para ambos sistemas con diferente estructura de vegetación, utilizando la relación ET/ETo y el coeficiente de estrés (Ks), fue satisfactorio. Se incluyeron en el modelado mejoras sobre las propiedades espectrales específicas de las encinas y los parámetros específicos de los diferentes estratos de vegetación. También analizamos la influencia de las propiedades espectrales de las encinas y otra cubierta mediterránea, el olivar, en el modelo VI-ETo. Encontramos que el uso de valores apropiados del parámetro SAVImax (0,51 para robles y 0,57 para olivos) tuvo un efecto significativo en la determinación del consumo de agua y estrés hídrico, en comparación con usar un valor genérico para cultivos mediterráneos (SAVImax = 0,75). La precisión de este enfoque basado en el balance hídrico también se evaluó en dos cuencas mediterráneas heterogéneas, con un mosaico de encinas y pastizales, arbustos, plantaciones de coníferas y cultivos hortícolas de regadío. Los caudales de descarga anual de ambas cuencas, determinados a partir de los datos de ET modelados y utilizando un balance hídrico superficial muy simple, fueron muy similares a los obtenidos con el modelo hidrológico HBV, y a los valores medidos en la salida de una de las cuencas, corroborando la utilidad de la metodología VI-ETo sobre estas formaciones vegetales. Por otra parte, la serie final de ET (30 m, diaria) derivada del enfoque SEB (método ALEXI/DisALEXI) y del algoritmo de fusión STARFM proporcionó un valor de RMSE de 0,67 mm día-1, considerado un error aceptable para fines de manejo. Este error fue ligeramente inferior a los obtenidos usando métodos de interpolación más simples, debido probablemente a la alta frecuencia temporal y una mejor representación espacial del footprint de la torre de medida de flujos en la serie temporal fusionada. El análisis de los patrones de la ET sobre pequeñas manchas de vegetación heterogéneas, que forman la estructura de la dehesa, reveló la importancia de tener información con alta resolución a escala de campo para distinguir el agua consumida por los diferentes componentes de la vegetación, que tienen influencia en el aprovisionamiento de muchos servicios ecosistémicos. Por ejemplo, fue clave para identificar ciertas fechas fenológicas de los pastizales, o entender el funcionamiento hidrológico de la vegetación densa de hoja perenne en zonas de ribera con altas tasas de ET durante todo el año, en comparación con zonas de especies herbáceas. Modelar con precisión estos comportamientos diferentes de los microclimas de la dehesa es útil para apoyar la gestión de los agricultores y ofrecer recomendaciones adaptadas a cada componente y necesidades estructurales