UAV-Enabled Surface and Subsurface Characterization for Post-Earthquake Geotechnical Reconnaissance

Major earthquakes continue to cause significant damage to infrastructure systems and the loss of life (e.g. 2016 Kaikoura, New Zealand; 2016 Muisne, Ecuador; 2015 Gorkha, Nepal). Following an earthquake, costly human-led reconnaissance studies are conducted to document structural or geotechnical damage and to collect perishable field data. Such efforts are faced with many daunting challenges including safety, resource limitations, and inaccessibility of sites. Unmanned Aerial Vehicles (UAV) represent a transformative tool for mitigating the effects of these challenges and generating spatially distributed and overall higher quality data compared to current manual approaches. UAVs enable multi-sensor data collection and offer a computational decision-making platform that could significantly influence post-earthquake reconnaissance approaches. As demonstrated in this research, UAVs can be used to document earthquake-affected geosystems by creating 3D geometric models of target sites, generate 2D and 3D imagery outputs to perform geomechanical assessments of exposed rock masses, and characterize subsurface field conditions using techniques such as in situ seismic surface wave testing. UAV-camera systems were used to collect images of geotechnical sites to model their 3D geometry using Structure-from-Motion (SfM). Key examples of lessons learned from applying UAV-based SfM to reconnaissance of earthquake-affected sites are presented. The results of 3D modeling and the input imagery were used to assess the mechanical properties of landslides and rock masses. An automatic and semi-automatic 2D fracture detection method was developed and integrated with a 3D, SfM, imaging framework. A UAV was then integrated with seismic surface wave testing to estimate the shear wave velocity of the subsurface materials, which is a critical input parameter in seismic response of geosystems. The UAV was outfitted with a payload release system to autonomously deliver an impulsive seismic source to the ground surface for multichannel analysis of surface waves (MASW) tests. The UAV was found to offer a mobile but higher-energy source than conventional seismic surface wave techniques and is the foundational component for developing the framework for fully-autonomous in situ shear wave velocity profiling.PHDCivil EngineeringUniversity of Michigan, Horace H. Rackham School of Graduate Studieshttps://deepblue.lib.umich.edu/bitstream/2027.42/145793/1/wwgreen_1.pd

A Vegetation Analysis on Horn Island, Mississippi, ca. 1940 Using Characteristic Dimensions Derived from Historical Aerial Photography

Horn Island is part of the MS/AL barrier island chain in the northern Gulf of Mexico located approximately 18kn off the coast of Mississippi. This island’s habitats have undergone many transitions over the last several decades. The goal of this study was to quantify habitat change over a seventy year period using historical black and white photography from 1940. Using present NAIP imagery from the USDA, habitat structure was estimated by using geo-statistics, and second order statistics, from a co-occurrence matrix, to characterize texture for habitat classification. Percent land cover was then calculated to determine overall land cover change over a seventy year period. The geostatistic of the horizontal spectral variation (CV) of image textures was used to estimate habitat structure using a multi scale approach if any characteristics of habitat texture could be delineated from CV histograms. The classification met with a result of an 80% habitat map of Horn Island ca. 1940, at 21x21 window size proving, that CV can be used successfully to classify text of historical black and white imagery. It was, also proven that CV can be used to characterize relative patch size for slash pine woodland habitat types, but not for habitats with smaller horizontal variations (i.e., marsh, and dune herbland)

Identifying the Failure to Recognize, Acknowledge, and Correct the Epidemic of Vitamin D Deficiency/Infantile Rickets (VDD/IR) and Its Role in False Accusations of Abuse in Infants

Non

Adaptive remote visualization system with optimized network performance for large scale scientific data

This dissertation discusses algorithmic and implementation aspects of an automatically configurable remote visualization system, which optimally decomposes and adaptively maps the visualization pipeline to a wide-area network. The first node typically serves as a data server that generates or stores raw data sets and a remote client resides on the last node equipped with a display device ranging from a personal desktop to a powerwall. Intermediate nodes can be located anywhere on the network and often include workstations, clusters, or custom rendering engines. We employ a regression model-based network daemon to estimate the effective bandwidth and minimal delay of a transport path using active traffic measurement. Data processing time is predicted for various visualization algorithms using block partition and statistical technique. Based on the link measurements, node characteristics, and module properties, we strategically organize visualization pipeline modules such as filtering, geometry generation, rendering, and display into groups, and dynamically assign them to appropriate network nodes to achieve minimal total delay for post-processing or maximal frame rate for streaming applications. We propose polynomial-time algorithms using the dynamic programming method to compute the optimal solutions for the problems of pipeline decomposition and network mapping under different constraints. A parallel based remote visualization system, which comprises a logical group of autonomous nodes that cooperate to enable sharing, selection, and aggregation of various types of resources distributed over a network, is implemented and deployed at geographically distributed nodes for experimental testing. Our system is capable of handling a complete spectrum of remote visualization tasks expertly including post processing, computational steering and wireless sensor network monitoring. Visualization functionalities such as isosurface, ray casting, streamline, linear integral convolution (LIC) are supported in our system. The proposed decomposition and mapping scheme is generic and can be applied to other network-oriented computation applications whose computing components form a linear arrangement

Advancements in mesoscale ensemble prediction strategies: Application to Mediterranean high-impact weather

[cat] La predictibilitat d'esdeveniments d'alt impacte a la regi o Mediterr ania ha millorat substancialment al llarg de les darreres d ecades. No obstant aix o, una representaci o precisa d'aspectes dels sistemes convectius rellevants per la societat, tals com el moment en qu e es produeixen, i la seva localitzaci o i intensitat encara suposen un repte. Aquestes febleses de la predicci o a escala convectiva provenen d'imprecisions a l'estimaci o de l'estat atmosf eric inicial, la formulaci o de processos f sics rellevants i la natura ca otica dels sistema associada a la seva no linealitat. En el marc probabil stic imposat per les incerteses intr nseques implicades en la predicci o num erica del temps, l'entitat matem atica que quanti ca la incertesa en l'estat atmosf eric es la funci o densitat de probabilitat. Malgrat aix o, el c alcul de la seva evoluci o temporal es inviable per situacions realistes amb els recursos computacionals disponibles actualment. La modesta aproximaci o habitual per estimar aquesta evoluci o es l' us d'un discret i petit nombre de mostres de l'estat del sistema, que es coneix com a predicci o per conjunts (ensemble forecasting). L'objectiu general d'aquesta Tesi es entendre millor els l mits de la predictibilitat i contribuir a una millora de la predicci o de temps sever a la regi o Mediterr ania. En primer lloc, s'avalua l'evoluci o temporal de les funcions densitat de probabilitat per sistemes de baixa complexitat amb un cert grau de realisme adoptant el formalisme de Liouville. En segon lloc, es dissenya una estrat egia de mostreig per crear pertorbacions a les condicions inicials per abastos de predicci o curts (24-36 h). La t ecnica es basa en el m etode de breeding, que utilitza la din amica completa no lineal per identi car modes de creixement r apid. La modi caci o proposada est a dirigida a ajustar l'escala de les pertorbacions per tal de cobrir l'ample rang d'escales rellevants per la predicci o de curt abast. En tercer lloc, s'investiga el potencial de varis m etodes per tenir en compte la incertesa en el model per a un episodi recent de precipitacions intenses i inundacions que va oc orrer al llarg de la costa Mediterr ania espanyola (12-13 setembre de 2019). S'avaluen m ultiples estrat egies estoc astiques en front l'aproximaci o ordin aria de multif sica en termes de diversitat i habilitat de l'ensemble. Les t ecniques considerades inclouen pertorbacions estoc astiques a les tend encies f siques i pertorbacions a par ametres in uents de l'esquema de microf sica. Finalment, aquestes estrat egies de generaci o d'ensembles s'utilitzen com a for cament meteorol ogic per a un model hidrol ogic per tal d'investigar la predictibilitat 21 22 CONTENTS hidrometeorol ogica de l'episodi del 12-13 setembre de 2019. Les t ecniques desenvolupades, juntament amb l'assimilaci o de dades mitjan cant Ensemble Kalman Filter es comparen amb altres estrat egies populars, tals com el downscaling d'un model global i l'aproximaci o de multif sica. Els resultats d'aquesta Tesi s on rellevants des d'una perspectiva te orica, ja que la soluci o de l'equaci o de Liouville revela estructures complexes per la funci o densitat de probabilitat que podrien comprometre les hip otesis de compacitat i suavitat assumides per la majoria d'eines d'interpretaci o i post proc es d'ensembles. Per altra banda, les estrat egies de generaci o d'ensembles desenvolupades mostren potencial per millorar la predicci o d'esdeveniments d'alt impacte, que es demostra per una major diversitat i habilitat dels ensembles comparades amb les estrat egies de refer encia. Aquests resultats prometedors posen les bases per un sistema avan cat d'alertes a la regi o Mediterr ania per encarar els esdeveniments de temps sever.[spa] La predictibilidad de eventos de alto impacto en la regi on Mediterr anea ha mejorado sustancialmente a lo largo de las ultimas d ecadas. No obstante, una representaci on precisa de aspectos relevantes de los sistemas convectivos relevantes para la sociedad, como el momento en el que se producen, su localizaci on e intensidad a un suponen un reto. Estas debilidades de la predicci on a escala convectiva provienen de imprecisiones en la estimaci on del estado atmosf erico inicial, la formulaci on de los procesos f sicos relevantes y la naturaleza ca otica del sistema asociada a su no linealidad. En el marco probabilista impuesto por las incertidumbres intr nsecas implicadas en la predicci on num erica del tiempo, la entidad matem atica que cuanti ca la incertidumbre en el estado atmosf erico inicial es la funci on densidad de probabilidad. Sin embargo, el c alculo de su evoluci on temporal es inviable para situaciones realistas con los recursos computacionales disponibles actualmente. La modesta aproximaci on habitual para estimar esta evoluci on en el uso de un discreto y peque~no n umero de muestras del estado del sistema, lo que se conoce como predicci on por conjuntos (ensemble forecasting). El objetivo general de esta Tesis es entender mejor los l mites de la predictibilidad y contribuir a una mejora de la predicci on del tiempo severo en la regi on Mediterr anea. En primer lugar, se eval ua la evoluci on temporal de las funciones densidad de probabilidad para sistemas de baja complejidad con un cierto grado de realismo adoptando el formalismo te orico de Liouville. En segundo lugar, se dise~na una estrategia de muestreo para crear perturbaciones en les condiciones iniciales para alcances de predicci on cortos (24-36 h). La t ecnica se basa en el m etodo de breeding, que utiliza la din amica completa no lineal para identi car modos de crecimiento r apido. La modi caci on propuesta est a dirigida a ajustar la escala de las perturbaciones para cubrir el amplio rango de escalas relevantes para la predicci on de corto alcance. En tercer lugar, se investiga el potencial de varios m etodos para tener en cuenta la incertidumbre en el modelo para un episodio reciente de precipitaciones intensas e inundaciones que ocurri o a lo largo de la costa Mediterr anea espa~nola (12-13 de septiembre de 2019). Se eval uan m ultiples estrategias estoc asticas frente a la aproximaci on ordinaria de multif sica en t erminos de diversidad y habilidad del ensemble. Las t ecnicas consideradas incluyen perturbaciones estoc asticas en las tendencias f sicas y perturbaciones en par ametros in uyentes del esquema de microf sica. Finalmente, estas estrategias de generaci on de ensembles se usan como forzamiento meteorol ogico para un modelo hidrol ogico con el n de investigar la predictibilidad hidrometeorol ogica del episodio del 12-13 de septiembre de 2019. Las t ecnicas desarrolladas, junto a la asimilaci on de datos mediante Ensemble Kalman Filter se comparan con otras estrategias populares, como el dowscaling de un modelo global y la aproximaci on de multif sica. Los resultados de esta Tesis son relevantes desde una perspectiva te orica, ya que la soluci on de la ecuaci on de Liouville revela estructuras complejas para la funci on densidad de probabilidad que podr an comprometer las hip otesis de compacidad y suavidad asumidas por la mayor a de herramientas de interpretaci on y pos proceso de ensembles. Por otro lado, las estrategias de generaci on de ensembles desarrolladas muestran potencial para mejorar la predicci on de eventos de alto impacto, que se demuestra por una mayor diversidad y habilidad de los ensembles comparadas con las estrategias de referencia. Estos resultados prometedores sientan las bases para un sistema avanzado de alertas en la regi on Mediterr anea para afrontar los eventos de tiempo severo.[eng] The predictability of meteorological high-impact events in the Mediterranean region has substantially improved over the last decades. Nevertheless, a precise representation of socially relevant aspects of convective systems, such as their timing, location, and intensity is still challenging. These weaknesses of convective-scale forecasting stem from inaccuracies in the estimation of the atmospheric initial state, formulation of relevant physical processes, and the chaotic nature of the system associated with its nonlinearity. In the probabilistic framework imposed by the intrinsic uncertainties involved in numerical weather prediction, the mathematical entity that quanti es the uncertainty in the atmospheric state is the probability density function. However, the computation of its time evolution is unfeasible for realistic situations with the current available computational resources. The usual modest approach to estimate this evolution is the use of a discrete and small number of samples of the state of the system, which is known as ensemble forecasting. The general aim of this Thesis is to better understand the predictability limits and contribute towards the improvement of severe weather forecasting in the Mediterranean region. Firstly, the time evolution of probability density functions for low complexity systems with a certain degree of realism is evaluated by adopting the Liouville formalism. Secondly, a sampling strategy to create initial condition perturbations for the short-range (24-36 h) is designed. The technique is based on the breeding method, which uses the full nonlinear dynamics to identify fast-growing modes. The proposed modi cation is aimed at tailoring the scale of the perturbations in order to cover the wide range of scales relevant for short-range forecasting. Thirdly, the potential of several methods to account for model uncertainty is investigated for a recent heavy precipitation and ash ood episode occurred along the Spanish Mediterranean coast (12-13 September 2019). Multiple stochastic strategies are evaluated against the ordinary multiphysics approach in terms of ensemble diversity and skill. The considered techniques include stochastically perturbed physics tendencies and perturbations to in uential parameters within the microphysics scheme. Finally, these ensemble generation strategies are used as the meteorological forcing for a hydrological model in order to investigate the hydrometeorological predictability of the 12-13 September 2019 episode. The developed techniques, along with data assimilation by means of Ensemble Kalman Filter are compared to other popular strategies, such as the downscaling from a global model and the multiphysics approach. The results of this Thesis are relevant from a theoretical perspective, as the solution of the Liouville equation reveals complex structures for the probability density function that could compromise the hypothesis of compactness and smoothness assumed by most current ensemble interpretation and postprocessing tools. Conversely, the ensemble generation strategies developed show potential to improve the forecasting of high-impact events, proven by higher ensemble diversity and skill compared to the benchmark strategies. These encouraging results lay the foundations for an advanced warning system in the Mediterranean region to deal with severe weather events

Recent Advances in Signal Processing

The signal processing task is a very critical issue in the majority of new technological inventions and challenges in a variety of applications in both science and engineering fields. Classical signal processing techniques have largely worked with mathematical models that are linear, local, stationary, and Gaussian. They have always favored closed-form tractability over real-world accuracy. These constraints were imposed by the lack of powerful computing tools. During the last few decades, signal processing theories, developments, and applications have matured rapidly and now include tools from many areas of mathematics, computer science, physics, and engineering. This book is targeted primarily toward both students and researchers who want to be exposed to a wide variety of signal processing techniques and algorithms. It includes 27 chapters that can be categorized into five different areas depending on the application at hand. These five categories are ordered to address image processing, speech processing, communication systems, time-series analysis, and educational packages respectively. The book has the advantage of providing a collection of applications that are completely independent and self-contained; thus, the interested reader can choose any chapter and skip to another without losing continuity

Human machine collaboration for foreground segmentation in images and videos

Foreground segmentation is defined as the problem of generating pixel level foreground masks for all the objects in a given image or video. Accurate foreground segmentations in images and videos have several potential applications such as improving search, training richer object detectors, image synthesis and re-targeting, scene and activity understanding, video summarization, and post-production video editing. One effective way to solve this problem is human-machine collaboration. The main idea is to let humans guide the segmentation process through some partial supervision. As humans, we are extremely good at perception and can easily identify the foreground regions. Computers, on the other hand, lack this capability, but are extremely good at continuously processing large volumes of data at the lowest level of detail with great efficiency. Bringing these complementary strengths together can lead to systems which are accurate and cost-effective at the same time. However, in any such human-machine collaboration system, cost effectiveness and higher accuracy are competing goals. While more involvement from humans can certainly lead to higher accuracy, it also leads to increased cost both in terms of time and money. On the other hand, relying more on machines is cost-effective, but algorithms are still nowhere near human-level performance. Balancing this cost versus accuracy trade-off holds the key behind success for such a hybrid system. In this thesis, I develop foreground segmentation algorithms which effectively and efficiently make use of human guidance for accurately segmenting foreground objects in images and videos. The algorithms developed in this thesis actively reason about the best modalities or interactions through which a user can provide guidance to the system for generating accurate segmentations. At the same time, these algorithms are also capable of prioritizing human guidance on instances where it is most needed. Finally, when structural similarity exists within data (e.g., adjacent frames in a video or similar images in a collection), the algorithms developed in this thesis are capable of propagating information from instances which have received human guidance to the ones which did not. Together, these characteristics result in a substantial savings in human annotation cost while generating high quality foreground segmentations in images and videos. In this thesis, I consider three categories of segmentation problems all of which can greatly benefit from human-machine collaboration. First, I consider the problem of interactive image segmentation. In traditional interactive methods a human annotator provides a coarse spatial annotation (e.g., bounding box or freehand outlines) around the object of interest to obtain a segmentation. The mode of manual annotation used affects both its accuracy and ease-of-use. Whereas existing methods assume a fixed form of input no matter the image, in this thesis I propose a data-driven algorithm which learns whether an interactive segmentation method will succeed if initialized with a given annotation mode. This allows us to predict the modality that will be sufficiently strong to yield a high quality segmentation for a given image and results in large savings in annotation costs. I also propose a novel interactive segmentation algorithm called Click Carving which can accurately segment objects in images and videos using a very simple form of human interaction---point clicks. It outperforms several state-of-the-art methods and requires only a fraction of human effort in comparison. Second, I consider the problem of segmenting images in a weakly supervised image collection. Here, we are given a collection of images all belonging to the same object category and the goal is to jointly segment the common object from all the images. For this, I develop a stagewise active approach to segmentation propagation: in each stage, the images that appear most valuable for human annotation are actively determined and labeled by human annotators, then the foreground estimates are revised in all unlabeled images accordingly. In order to identify images that, once annotated, will propagate well to other examples, I introduce an active selection procedure that operates on the joint segmentation graph over all images. It prioritizes human intervention for those images that are uncertain and influential in the graph, while also mutually diverse. Building on this, I also introduce the problem of measuring compatibility between image pairs for joint segmentation. I show that restricting the joint segmentation to only compatible image pairs results in an improved joint segmentation performance. Finally, I propose a semi-supervised approach for segmentation propagation in video. Given human supervision in some frames of a video, this information can be propagated through time. The main challenge is that the foreground object may move quickly in the scene at the same time its appearance and shape evolves over time. To address this, I propose a higher order supervoxel label consistency potential which leverages bottom-up supervoxels to enforce long-range temporal consistency during propagation. I also introduce the notion of a generic pixel-level objectness in images and videos by training a deep neural network which uses appearance and motion to automatically assign a score to each pixel capturing its likelihood to be an "object" or "background". I show that the human guidance in the semi-supervised propagation algorithm can be further augmented with the generic pixel-objectness scores to obtain an even more accurate foreground segmentation in videos. Throughout, I provide extensive evaluation on challenging datasets and also compare with many state-of-the-art methods and other baselines validating the strengths of proposed algorithms. The outcomes across several different experiments show that the proposed human-machine collaboration algorithms achieve accurate segmentation of foreground objects in images and videos while saving a large amount of human annotation effort.Computer Science