Exploitation of X-band weather radar data in the Andes high mountains and its application in hydrology: a machine learning approach

Rainfall in the tropical Andes high mountains is paramount for understanding complex hydrological and ecological phenomena that take place in this distinctive area of the world. Here, rainfall drives imminent hazards such as severe floods, rainfall-induced landslides, different types of erosion, among others. Nonetheless, sparse and uneven distributed rain gauge networks as well as low- resolution satellite imagery are not sufficient to capture its high variability and complex dynamics in the irregular topography of high mountains at appropriate temporal and spatial scales. This results in both, a lack of knowledge about rainfall patterns, as well as a poor understanding of rainfall microphysics, which to date are largely underexplored in the tropical Andes. Therefore, this investigation focuses on the deployment and exploitation of single-polarization (SP) X-band weather radars in the Andean high mountain regions of southern Ecuador, applicable to quantitative precipitation estimation (QPE) and discharge forecasting. This work leverages radar rainfall data by exploring a machine learning (ML) approach. The main aims of the thesis were: (i) The deployment of a first X-band weather radar network in tropical high mountains, (ii) the physically-based QPE of X-band radar retrievals, (iii) the optimization of radar QPE by using a ML-based model and (iv) a discharge forecasting application using a ML-based model and SP X-band radar data. As a starting point, deployment of the first weather radar network in tropical high mountains was carried out. A complete framework for data transmission was set for communication among the network. The highest radar in the network (4450 m a.s.l.) was selected in this study for exploiting the potential of SP X-band radar data in the Andes. First and foremost, physically-based QPE was performed through the derivation of Z-R relationships. For this, data from three disdrometers at different geographic locations and elevation were used. Several rainfall events were selected in order to perform a classification of rainfall types based on the mean volume diameter (Dm [mm]). Derived Z-R relations confirmed the high variability in their parameters due to different rainfall types in the study area. Afterwards, the optimization of radar QPE was pursued by using a ML approach as an alternative to the common physically-based QPE method by means of the Z-R relation. For this, radar QPE was tackled by using two different approaches. The first one was conducted by implementing a step-wise approach where reflectivity correction is performed in a step-by-step basis (i.e., clutter removal, attenuation correction). Finally a locally derived Z-R relationship was applied for obtaining radar QPE. Rain gauge-bias adjustment was neglected because the availability of rain gauge data at near-real time is limited and infrequent in the study area. The second one was conducted by an implementation of a radar QPE model that used the Random Forest (RF) algorithm and reflectivity derived features as inputs for the model. Finally, the performances of both models were compared against rain gauge data. The results showed that the ML-based model outperformed the step-wise approach, making it possible to obtain radar QPE without the need of rain gauge data after the model was implemented. It also allowed to extend the useful range of the radar image (i.e., up to 50 km). Radar QPE can be generally used as input for discharge forecasting models if available. However, one could expect from ML-based models as RF, the ability to map radar data to the target variable (discharge) without any intermediate step (e.g., transformation from reflectivity to rainfall rate). Thus, a comparison for discharge forecasting was performed between RF models that used different input data type. Input data for the relevant models were obtained either from native reflectivity records (i.e., reflectivity corrected from unrealistic measurements) or derived radar-rainfall data (i.e., radar QPE). Results showed that both models performed alike. This proved the suitability of using native radar data (reflectivity) for discharge forecasting in mountain regions. This could be extrapolated in the advantages of deploying radar networks and use their information directly to fed early-warning systems regardless of the availability of rain gauges at ground. In summary, this investigation (i) participated on the deployment of the first weather radar network in tropical high mountains, (ii) significantly contributed to a deeper understanding of rainfall microphysics and its variability in the high tropical Andes by using disdrometer data and (iii) exploited, for the very first time, the native X-band radar reflectivity as a suitable input for ML-based models for both, optimized radar QPE and discharge forecasting. The latter highlighted the benefits and potentials of using a ML approach in radar hydrology. The research generally accounted for ground monitoring limitations commonly found in mountain regions and provided a promising alternative with leveraging the cost-effective X-band technology in the steep terrain of the Andean Cordillera

Rethinking the Tradeoff in Integrated Sensing and Communication: Recognition Accuracy versus Communication Rate

Integrated sensing and communication (ISAC) is a promising technology to improve the band-utilization efficiency via spectrum sharing or hardware sharing between radar and communication systems. Since a common radio resource budget is shared by both functionalities, there exists a tradeoff between the sensing and communication performance. However, this tradeoff curve is currently unknown in ISAC systems with human motion recognition tasks based on deep learning. To fill this gap, this paper formulates and solves a multi-objective optimization problem which simultaneously maximizes the recognition accuracy and the communication data rate. The key ingredient of this new formulation is a nonlinear recognition accuracy model with respect to the wireless resources, where the model is derived from power function regression of the system performance of the deep spectrogram network. To avoid cost-expensive data collection procedures, a primitive-based autoregressive hybrid (PBAH) channel model is developed, which facilitates efficient training and testing dataset generation for human motion recognition in a virtual environment. Extensive results demonstrate that the proposed wireless recognition accuracy and PBAH channel models match the actual experimental data very well. Moreover, it is found that the accuracy-rate region consists of a communication saturation zone, a sensing saturation zone, and a communication-sensing adversarial zone, of which the third zone achieves the desirable balanced performance for ISAC systems.Comment: arXiv admin note: text overlap with arXiv:2104.1037

Détection de bateaux dans les images de radar à ouverture synthétique

Le but principal de cette thèse est de développer des algorithmes efficaces et de concevoir un système pour la détection de bateaux dans les images Radar à Ouverture Synthetique (ROS.) Dans notre cas, la détection de bateaux implique en premier lieu la détection de cibles de points dans les images ROS. Ensuite, la détection d'un bateau proprement dit dépend des propriétés physiques du bateau lui-même, tel que sa taille, sa forme, sa structure, son orientation relative a la direction de regard du radar et les conditions générales de l'état de la mer. Notre stratégie est de détecter toutes les cibles de bateaux possibles dans les images de ROS, et ensuite de chercher autour de chaque candidat des évidences telle que les sillons. Les objectifs de notre recherche sont (1) d'améliorer 1'estimation des paramètres dans Ie modèle de distribution-K et de déterminer les conditions dans lesquelles un modèle alternatif (Ie Gamma, par exemple) devrait être utilise plutôt; (2) d'explorer Ie modèle PNN (Probabilistic Neural Network) comme une alternative aux modèles paramétriques actuellement utilises; (3) de concevoir un modèle de regroupement flou (FC : Fuzzy Clustering) capable de détecter les petites et grandes cibles de bateaux dans les images a un seul canal ou les images a multi-canaux; (4) de combiner la détection de sillons avec la détection de cibles de bateaux; (5) de concevoir un modèle de détection qui peut être utilisé aussi pour la détection des cibles de bateaux en zones costières.Abstract: The main purpose of this thesis is to develop efficient algorithms and design a system for ship detection from Synthetic Aperture Radar (SAR) imagery. Ship detection usually involves through detection of point targets on a radar clutter background.The detection of a ship depends on the physical properties of the ship itself, such as size, shape, and structure; its orientation relative to the radar look-direction; and the general condition of the sea state. Our strategy is to detect all possible ship targets in SAR images, and then search around each candidate for the wake as further evidence.The objectives of our research are (1) to improve estimation of the parameters in the K-distribution model and to determine the conditions in which an alternative model (Gamma, for example) should be used instead; (2) to explore a PNN (Probabilistic Neural Networks) model as an alternative to the commonly used parameteric models; (3) to design a FC (Fuzzy Clustering) model capable of detecting both small and large ship targets from single-channel images or multi-channel images; (4) to combine wake detection with ship target detection; (5) to design a detection model that can also be used to detect ship targets in coastal areas. We have developed algorithms for each of these objectives and integrated them into a system comprising six models.The system has been tested on a number of SAR images (SEASAT, ERS and RADARSAT-1, for example) and its performance has been assessed

Kalman Filter Bibliography: Agriculture, Biology, and Medicine

27 pages, 1 article*Kalman Filter Bibliography: Agriculture, Biology, and Medicine* (Federer, Walter T.; Murty, B. R.) 27 page

Roadmap on signal processing for next generation measurement systems

Signal processing is a fundamental component of almost any sensor-enabled system, with a wide range of applications across different scientific disciplines. Time series data, images, and video sequences comprise representative forms of signals that can be enhanced and analysed for information extraction and quantification. The recent advances in artificial intelligence and machine learning are shifting the research attention towards intelligent, data-driven, signal processing. This roadmap presents a critical overview of the state-of-the-art methods and applications aiming to highlight future challenges and research opportunities towards next generation measurement systems. It covers a broad spectrum of topics ranging from basic to industrial research, organized in concise thematic sections that reflect the trends and the impacts of current and future developments per research field. Furthermore, it offers guidance to researchers and funding agencies in identifying new prospects.AerodynamicsMicrowave Sensing, Signals & System