Contributions to improve the technologies supporting unmanned aircraft operations

Mención Internacional en el título de doctorUnmanned Aerial Vehicles (UAVs), in their smaller versions known as drones, are becoming increasingly important in today's societies. The systems that make them up present a multitude of challenges, of which error can be considered the common denominator. The perception of the environment is measured by sensors that have errors, the models that interpret the information and/or define behaviors are approximations of the world and therefore also have errors. Explaining error allows extending the limits of deterministic models to address real-world problems. The performance of the technologies embedded in drones depends on our ability to understand, model, and control the error of the systems that integrate them, as well as new technologies that may emerge. Flight controllers integrate various subsystems that are generally dependent on other systems. One example is the guidance systems. These systems provide the engine's propulsion controller with the necessary information to accomplish a desired mission. For this purpose, the flight controller is made up of a control law for the guidance system that reacts to the information perceived by the perception and navigation systems. The error of any of the subsystems propagates through the ecosystem of the controller, so the study of each of them is essential. On the other hand, among the strategies for error control are state-space estimators, where the Kalman filter has been a great ally of engineers since its appearance in the 1960s. Kalman filters are at the heart of information fusion systems, minimizing the error covariance of the system and allowing the measured states to be filtered and estimated in the absence of observations. State Space Models (SSM) are developed based on a set of hypotheses for modeling the world. Among the assumptions are that the models of the world must be linear, Markovian, and that the error of their models must be Gaussian. In general, systems are not linear, so linearization are performed on models that are already approximations of the world. In other cases, the noise to be controlled is not Gaussian, but it is approximated to that distribution in order to be able to deal with it. On the other hand, many systems are not Markovian, i.e., their states do not depend only on the previous state, but there are other dependencies that state space models cannot handle. This thesis deals a collection of studies in which error is formulated and reduced. First, the error in a computer vision-based precision landing system is studied, then estimation and filtering problems from the deep learning approach are addressed. Finally, classification concepts with deep learning over trajectories are studied. The first case of the collection xviiistudies the consequences of error propagation in a machine vision-based precision landing system. This paper proposes a set of strategies to reduce the impact on the guidance system, and ultimately reduce the error. The next two studies approach the estimation and filtering problem from the deep learning approach, where error is a function to be minimized by learning. The last case of the collection deals with a trajectory classification problem with real data. This work completes the two main fields in deep learning, regression and classification, where the error is considered as a probability function of class membership.Los vehículos aéreos no tripulados (UAV) en sus versiones de pequeño tamaño conocidos como drones, van tomando protagonismo en las sociedades actuales. Los sistemas que los componen presentan multitud de retos entre los cuales el error se puede considerar como el denominador común. La percepción del entorno se mide mediante sensores que tienen error, los modelos que interpretan la información y/o definen comportamientos son aproximaciones del mundo y por consiguiente también presentan error. Explicar el error permite extender los límites de los modelos deterministas para abordar problemas del mundo real. El rendimiento de las tecnologías embarcadas en los drones, dependen de nuestra capacidad de comprender, modelar y controlar el error de los sistemas que los integran, así como de las nuevas tecnologías que puedan surgir. Los controladores de vuelo integran diferentes subsistemas los cuales generalmente son dependientes de otros sistemas. Un caso de esta situación son los sistemas de guiado. Estos sistemas son los encargados de proporcionar al controlador de los motores información necesaria para cumplir con una misión deseada. Para ello se componen de una ley de control de guiado que reacciona a la información percibida por los sistemas de percepción y navegación. El error de cualquiera de estos sistemas se propaga por el ecosistema del controlador siendo vital su estudio. Por otro lado, entre las estrategias para abordar el control del error se encuentran los estimadores en espacios de estados, donde el filtro de Kalman desde su aparición en los años 60, ha sido y continúa siendo un gran aliado para los ingenieros. Los filtros de Kalman son el corazón de los sistemas de fusión de información, los cuales minimizan la covarianza del error del sistema, permitiendo filtrar los estados medidos y estimarlos cuando no se tienen observaciones. Los modelos de espacios de estados se desarrollan en base a un conjunto de hipótesis para modelar el mundo. Entre las hipótesis se encuentra que los modelos del mundo han de ser lineales, markovianos y que el error de sus modelos ha de ser gaussiano. Generalmente los sistemas no son lineales por lo que se realizan linealizaciones sobre modelos que a su vez ya son aproximaciones del mundo. En otros casos el ruido que se desea controlar no es gaussiano, pero se aproxima a esta distribución para poder abordarlo. Por otro lado, multitud de sistemas no son markovianos, es decir, sus estados no solo dependen del estado anterior, sino que existen otras dependencias que los modelos de espacio de estados no son capaces de abordar. Esta tesis aborda un compendio de estudios sobre los que se formula y reduce el error. En primer lugar, se estudia el error en un sistema de aterrizaje de precisión basado en visión por computador. Después se plantean problemas de estimación y filtrado desde la aproximación del aprendizaje profundo. Por último, se estudian los conceptos de clasificación con aprendizaje profundo sobre trayectorias. El primer caso del compendio estudia las consecuencias de la propagación del error de un sistema de aterrizaje de precisión basado en visión artificial. En este trabajo se propone un conjunto de estrategias para reducir el impacto sobre el sistema de guiado, y en última instancia reducir el error. Los siguientes dos estudios abordan el problema de estimación y filtrado desde la perspectiva del aprendizaje profundo, donde el error es una función que minimizar mediante aprendizaje. El último caso del compendio aborda un problema de clasificación de trayectorias con datos reales. Con este trabajo se completan los dos campos principales en aprendizaje profundo, regresión y clasificación, donde se plantea el error como una función de probabilidad de pertenencia a una clase.I would like to thank the Ministry of Science and Innovation for granting me the funding with reference PRE2018-086793, associated to the project TEC2017-88048-C2-2-R, which provide me the opportunity to carry out all my PhD. activities, including completing an international research internship.Programa de Doctorado en Ciencia y Tecnología Informática por la Universidad Carlos III de MadridPresidente: Antonio Berlanga de Jesús.- Secretario: Daniel Arias Medina.- Vocal: Alejandro Martínez Cav

Remote sensing for the Spanish forests in the 21st century: a review of advances, needs, and opportunities

[EN] Forest ecosystems provide a host of services and societal benefits, including carbon storage, habitat for fauna, recreation, and provision of wood or non-wood products. In a context of complex demands on forest resources, identifying priorities for biodiversity and carbon budgets require accurate tools with sufficient temporal frequency. Moreover, understanding long term forest dynamics is necessary for sustainable planning and management. Remote sensing (RS) is a powerful means for analysis, synthesis, and report, providing insights and contributing to inform decisions upon forest ecosystems. In this communication we review current applications of RS techniques in Spanish forests, examining possible trends, needs, and opportunities offered by RS in a forestry context. Currently, wall-to-wall optical and LiDAR data are extensively used for a wide range of applications-many times in combination-whilst radar or hyperspectral data are rarely used in the analysis of Spanish forests. Unmanned Aerial Vehicles (UAVs) carrying visible and infrared sensors are gaining ground in acquisition of data locally and at small scale, particularly for health assessments. Forest fire identification and characterization are prevalent applications at the landscape scale, whereas structural assessments are the most widespread analyses carried out at limited extents. Unparalleled opportunities are offered by the availability of diverse RS data like those provided by the European Copernicus programme and recent satellite LiDAR launches, processing capacity, and synergies with other ancillary sources to produce information of our forests. Overall, we live in times of unprecedented opportunities for monitoring forest ecosystems with a growing support from RS technologies.Part of this work was funded by the Spanish Ministry of Science, innovation and University through the project AGL2016-76769-C2-1-R "Influence of natural disturbance regimes and management on forests dynamics. structure and carbon balance (FORESTCHANGE)".Gómez, C.; Alejandro, P.; Hermosilla, T.; Montes, F.; Pascual, C.; Ruiz Fernández, LÁ.; Álvarez-Taboada, F.... (2019). Remote sensing for the Spanish forests in the 21st century: a review of advances, needs, and opportunities. Forest Systems. 28(1):1-33. https://doi.org/10.5424/fs/2019281-14221S133281Ungar S, Pearlman J, Mendenhall J, Reuter D, 2003. Overview of the Earth Observing-1 (EO-1) mission. IEEE T Geosci Remote 41: 1149−1159.Valbuena R, Mauro F, Arjonilla FJ, Manzanera JA, 2011. Comparing Airborne Laser Scanning-Imagery Fusion Methods Based on Geometric Accuracy in Forested Areas. Remote Sens Environ 115(8): 1942-1956.Valbuena R, Mauro F, Rodríguez-Solano R, Manzanera JA, 2012. Partial Least Squares for Discriminating Variance Components in GNSS Accuracy Obtained Under Scots Pine Canopies. Forest Sci 58(2): 139-153.Valbuena R, De Blas A, Martín Fernández S, Maltamo M, Nabuurs GJ, Manzanera JA, 2013a. Within-Species Benefits of Back-projecting Laser Scanner and Multispectral Sensors in Monospecific P. sylvestris Forests. Eur J Remote Sens 46: 401-416.Valbuena R, Maltamo M, Martín-Fernández S, Packalen P, Pascual C, Nabuurs G-J, 2013b. Patterns of covariance between airborne laser scanning metrics and Lorenz curve descriptors of tree size inequality. Can J Remote Sens 39(1): 18-31.Valbuena R, Packalen P, García-Abril A, Mehtätalo L, Maltamo M, 2013c. Characterizing Forest Structural Types and Shelterwood Dynamics from Lorenz-based Indicators Predicted by Airborne Laser Scanning. Can J For Res 43: 1063-1074.Valbuena R, Maltamo M, Packalen P, 2016a. Classification of Multi-Layered Forest Development Classes from Low-Density National Airborne LiDAR Datasets. Forestry 89: 392-341.Valbuena R, Maltamo M, Packalen P, 2016b. Classification of Forest Development Stages from National Low-Density LiDAR Datasets: a Comparison of Machine Learning Methods. Revista de Teledetección 45: 15-25.Valbuena R, Hernando A, Manzanera JA, Martínez-Falero E, García-Abril A, Mola-Yudego B, 2017a. Most Similar Neighbour Imputation of Forest Attributes Using Metrics Derived from Combined Airborne LIDAR and Multispectral Sensors. Int J Digit Earth 11 (12): 1205-1218.Valbuena R, Hernando A, Manzanera JA, Görgens EB, Almeida DRA, Mauro F, García-Abril A, Coomes DA, 2017b. Enhancing of accuracy assessment for forest above-ground biomass estimates obtained from remote sensing via hypothesis testing and overfitting evaluation. Eco Mod 622: 15-26.Valbuena-Rabadán M, Santamaría-Pe-a J, Sanz-Adán F, 2016. Estimation of diameter and height of individual trees for Pinus sylvestris L. based on the individualising of crowns using airborne LiDAR and the National Forest Inventory data. For Sys 25(1): e046Varo-Martínez MA, Navarro-Cerrillo RM, Hernández-Clemente R, Duque-Lazo J, 2017. Semi-automated stand delineation in Mediterranean Pinus sylvestris plantations through segmentation of LiDAR data: The influence of pulse density. Int J Appl Earth Obs 56: 54-64.Vázquez de la Cueva A, 2008. Structural attributes of three forest types in central Spain and Landsat ETM+ information evaluated with redundancy analysis. Int J Remote Sens 29: 5657-5676.Verdú F, Salas J, 2010. Cartografía de áreas quemadas mediante análisis visual de imágenes de satélite en la Espa-a peninsular para el periodo 1991–2005. Geofocus 10: 54–81.Viana-Soto A, Aguado I, Martínez S, 2017. Assessment of post-fire vegetation recovery using fire severity and geographical data in the Mediterranean region (Spain). Environments 4: 90.Vicente-Serrano SG, Pérez-Cabello F, Lasanta T, 2011. Pinus halepensis regeneration after a wildfire in a semiarid environment: assessment using multitemporal Landsat images. Int J Wildland Fire 20Ñ 195-208.Viedma O, Quesada J, Torres I, De Santis A, Moreno JM, 2015. Fire severity in a large fire in a Pinus pinaster forest is highly predictable from burning conditions, stand structure, and topography. Ecosystems 18: 237-250.Yebra M, Chuvieco E, 2009. Generation of a species-specific look-up table for fuel moisture content assessment. IEEE J Selected topics in applied earth observation and RS 2 (1): 21-26.White JC, Wulder MA, Varhola A, Vastaranta M, Coops NC, Cook BD, Pitt D, Woods M, 2013. A best practices guide for generating forest inventory attributes from airborne laser scanning data using an area-based approach. Natural Resources Canada, Canadian Forest Service, Canadian Wood Fibre Centre, Victoria, BC. Information Report FI-X-010, 39 pp.White JC, Wulder MA, Hobart GW, Luther JE, Hermosilla T, Griffiths P, Coops NC, Hall RJ, Hostert P, Dyk A, Guindon L, 2014. Pixel-based image compositing for large-area dense time series applications and science. Can J Remote Sens 40 (3): 192-212.White JC, Coops NC, Wulder MA, Vastaranta M, Hilker T, Tompalski P, 2016. Remote sensing technologies for enhancing forest inventories: a review. Can J Remote Sens 42: 619-641.White JC, Wulder MA, Hermosilla T, Coops NC, Hobart GW, 2017. A nationwide characterization of 25 years of forest disturbance and recovery for Canada using Landsat time series. Remote Sens Environ 194: 303-321.Wulder MA, 1998. Optical remote-sensing techniques for the assessment of forest inventory and biophysical parameters. Progr Phys Geog 22 (4): 449-476.Wulder MA, Dymond CC, 2004. Remote sensing in survey of Mountain Pine impacts: review and recommendations. MPBI Report. Canadian Forest Service. Natural Resources Canada, Victoria, BC, Canada. 89 pp.Wulder MA, Masek JG, Cohen WB, Loveland TR, Woodcock CE, 2012. Opening the archive: how free data has enabled the science and monitoring promise of Landsat. Remote Sens Environ 122: 2-10.Wulder MA, Hilker T, White JC, Coops NC, Masek JG, Pflugmacher D, Crevier Y, 2015. Virtual constellations for global terrestrial monitoring. Remote Sens Environ 170: 62-76.Wulder MA, White JC, Loveland TR, Woodcock CE, Belward AS, Cohen WB, Fosnight EA, Shaw J, Masek JG, Roy DP, 2016. The global Landsat archive: Status, consolidation, and direction. Remote Sens Environ 185: 271-283.Xie Q, Zhu J, Wang Ch, Fu H, López-Sánchez JM, Ballester-Berman JD, 2017. A modified dual-baseline PolInSAR method for forest height estimation. Remote Sens-Basel 9 (8): 819.Xie Y, Sha Z, Yu M, 2008. Remote sensing imagery in vegetation mapping: a review. J Plant Ecol 1 (1): 9-23.Zald HSJ, Wulder MA, White JC, Hilker T, Hermosilla T, Hobart GW, Coops NC, 2016. Integrating Landsat pixel composites and change metrics with LiDAR plots to predictively map forest structure and aboveground biomass in Saskatchewan, Canada. Remote Sens Environ 176: 188-201.Zarco-Tejada PJ, Diaz-Varela R, Angileri V, Loudjani P, 2014. Tree height quantification using very high resolution imagery acquired from an unmanned aerial vehicle (UAV) and automatic 3D photo-reconstruction methods. Eur J Agron 55: 89-99.Zarco-Tejada PJ, Hornero A, Hernández-Clemente R, Beck PSA, 2018. Understanding the temporal dimension of the red-edge spectral region for forest decline detection using high-resolution hyperspectral and Sentinel-2A imagery. ISPRS J Photogramm 137: 134-148

Surface and Sub-Surface Analyses for Bridge Inspection

The development of bridge inspection solutions has been discussed in the recent past. In this dissertation, significant development and improvement on the state-of-the-art in the field of bridge inspection using multiple sensors (e.g. ground penetrating radar (GPR) and visual sensor) has been proposed. In the first part of this research (discussed in chapter 3), the focus is towards developing effective and novel methods for rebar detection and localization for sub-surface bridge inspection of steel rebars. The data has been collected using Ground Penetrating Radar (GPR) sensor on real bridge decks. In this regard, a number of different approaches have been successively developed that continue to improve the state-of-the-art in this particular research area. The second part (discussed in chapter 4) of this research deals with the development of an automated system for steel bridge defect detection system using a Multi-Directional Bicycle Robot. The training data has been acquired from actual bridges in Vietnam and validation is performed on data collected using Bicycle Robot from actual bridge located in Highway-80, Lovelock, Nevada, USA. A number of different proposed methods have been discussed in chapter 4. The final chapter of the dissertation will conclude the findings from the different parts and discuss ways of improving on the existing works in the near future