Text Summarization for Compressed Inverted Indexes and Snippets

Text summarization is a technique to generate a concise summary ofa larger text. In search engines, Text summarization can be used forgenerating compressed descriptions of web pages. For indexing, these canbe used rather than whole pages when building inverted indexes. For queryresults, summaries can be used for snippet generation. In this project, weresearch on several techniques of text summarization. We evaluate thesetechniques for quality of the generated summary and time required togenerate it. We implement the technique chosen from the evaluation inYioop, an open source, PHP-based search engine

Optoelectronic Multifractal Wavelet Analysis for Fast and Accurate Detection of Rainfall in Weather Radar Images

In this thesis we propose an automated process for the removal of non-precipitation echoes present in weather radar signals and accurate detection of rainfall. The process employs multifractal analysis using directional Gabor wavelets for accurate detection of the rain events. An optoelectronic joint transform correlator is proposed to provide ultra fast processing and wavelet analysis. Computer simulations of the proposed system show that the proposed algorithm is successful in the detecting rainfall accurately in radar images. The accuracy of the algorithms proposed are compared to accurate results that were generated under expert supervision. Results of the proposed system are also compared to results of QC algorithm for the ground validation software (GVS) used by TRMM ground validity Project and a previous QC algorithm. Several statistical measures computed for different reflectivity ranges show that the proposed algorithm gives accuracy as high as 98.95%, which exceed the 97.46% maximum accuracy for the GVS results. Also, the minimum error rate obtained by the proposed algorithm for different dB ranges decreases to 1.09% whereas the GVS results show a minimum error rate of 1.80%. The rain rate accumulation confirms the success of the proposed algorithm in the accurate removal of nonprecipitation echoes and a higher precision in rain accumulation estimates

Optoelectronic Multifractal Wavelet Analysis for Fast and Accurate Detection of Rainfall in Weather Radar Images

In this thesis we propose an automated process for the removal of non-precipitation echoes present in weather radar signals and accurate detection of rainfall. The process employs multifractal analysis using directional Gabor wavelets for accurate detection of the rain events. An optoelectronic joint transform correlator is proposed to provide ultra fast processing and wavelet analysis. Computer simulations of the proposed system show that the proposed algorithm is successful in the detecting rainfall accurately in radar images. The accuracy of the algorithms proposed are compared to accurate results that were generated under expert supervision. Results of the proposed system are also compared to results of QC algorithm for the ground validation software (GVS) used by TRMM ground validity Project and a previous QC algorithm. Several statistical measures computed for different reflectivity ranges show that the proposed algorithm gives accuracy as high as 98.95%, which exceed the 97.46% maximum accuracy for the GVS results. Also, the minimum error rate obtained by the proposed algorithm for different dB ranges decreases to 1.09% whereas the GVS results show a minimum error rate of 1.80%. The rain rate accumulation confirms the success of the proposed algorithm in the accurate removal of nonprecipitation echoes and a higher precision in rain accumulation estimates

A General Framework for Uncertainty Quantification via Neural SDE-RNN

Uncertainty quantification is a critical yet unsolved challenge for deep learning, especially for the time series imputation with irregularly sampled measurements. To tackle this problem, we propose a novel framework based on the principles of recurrent neural networks and neural stochastic differential equations for reconciling irregularly sampled measurements. We impute measurements at any arbitrary timescale and quantify the uncertainty in the imputations in a principled manner. Specifically, we derive analytical expressions for quantifying and propagating the epistemic and aleatoric uncertainty across time instants. Our experiments on the IEEE 37 bus test distribution system reveal that our framework can outperform state-of-the-art uncertainty quantification approaches for time-series data imputations.Comment: 7 pages, 3 figure

Situational awareness in low-observable distribution grid - exploiting sparsity and multi-timescale data

Doctor of PhilosophyDepartment of Electrical and Computer EngineeringBalasubramaniam NatarajanThe power distribution grid is typically unobservable due to a lack of real-time measurements. While deploying more sensors can alleviate this issue, it also presents new challenges related to data aggregation and the underlying communication infrastructure. Limited real-time measurements hinders the distribution system state estimation (DSSE). DSSE involves estimation of the system states (i.e., voltage magnitude and voltage angle) based on available measurements and system model information. To cope with the unobservability issue, sparsity-based DSSE approaches allow us to recover system state information from a small number of measurements, provided the states of the distribution system exhibit sparsity. However, these approaches perform poorly in the presence of outliers in measurements and errors in system model information. In this dissertation, we first develop robust formulations of sparsity-based DSSE to deal with uncertainties in the system model and measurement data in a low-observable distribution grid. We also combine the advantages of two sparsity-based DSSE approaches to estimate grid states with high fidelity in low observability regions. In practical distribution systems, information from field sensors and meters are unevenly sampled at different time scales and could be lost during the transmission process. It is critical to effectively aggregate these information sources for DSSE as well as other tasks related to situational awareness. To address this challenge, the second part of this dissertation proposes a Bayesian framework for multi-timescale data aggregation and matrix completion-based state estimation. Specifically, the multi-scale time-series data aggregated from heterogeneous sources are reconciled using a multitask Gaussian process. The resulting consistent time-series alongwith the confidence bound on the imputations are fed into a Bayesian matrix completion method augmented with linearized power-flow constraints for accurate state estimation low-observable distribution system. We also develop a computationally efficient recursive Gaussian process approach that is capable of handling batch-wise or real-time measurements while leveraging the network connectivity information of the grid. To further enhance the scalability and accuracy, we develop neural network-based approaches (latent neural ordinary differential equation approach and stochastic neural differential equation with recurrent neural network approach) to aggregate irregular time-series data in the distribution grid. The stochastic neural differential equation and recurrent neural network also allows us to quantify the uncertainty in a holistic manner. Simulation results on the different IEEE unbalanced test systems illustrate the high fidelity of the Bayesian and neural network-based methods in aggregating multi-timescale measurements. Lastly, we develop phase, and outage awareness approaches for power distribution grid. In this regard, we first design a graph signal processing approach that identifies the phase labels in the presence of limited measurements and incorrect phase labeling. The second approach proposes a novel outage detector for identifying all outages in a reconfigurable distribution network. Simulation results on standard IEEE test systems reveal the potential of these methods to improve situational awareness

Latent Neural ODE for Integrating Multi-timescale measurements in Smart Distribution Grids

Under a smart grid paradigm, there has been an increase in sensor installations to enhance situational awareness. The measurements from these sensors can be leveraged for real-time monitoring, control, and protection. However, these measurements are typically irregularly sampled. These measurements may also be intermittent due to communication bandwidth limitations. To tackle this problem, this paper proposes a novel latent neural ordinary differential equations (LODE) approach to aggregate the unevenly sampled multivariate time-series measurements. The proposed approach is flexible in performing both imputations and predictions while being computationally efficient. Simulation results on IEEE 37 bus test systems illustrate the efficiency of the proposed approach

Identifying and Forecasting Potential Biophysical Risk Areas within a Tropical Mangrove Ecosystem Using Multi-Sensor Data

Mangroves are one of the most productive ecosystems known for provisioning of various ecosystem goods and services. They help in sequestering large amounts of carbon, protecting coastline against erosion, and reducing impacts of natural disasters such as hurricanes. Bhitarkanika Wildlife Sanctuary in Odisha harbors the second largest mangrove ecosystem in India. This study used Terra, Landsat and Sentinel-1 satellite data for spatio-temporal monitoring of mangrove forest within Bhitarkanika Wildlife Sanctuary between 2000 and 2016. Three biophysical parameters were used to assess mangrove ecosystem health: leaf chlorophyll (CHL), Leaf Area Index (LAI), and Gross Primary Productivity (GPP). A long-term analysis of meteorological data such as precipitation and temperature was performed to determine an association between these parameters and mangrove biophysical characteristics. The correlation between meteorological parameters and mangrove biophysical characteristics enabled forecasting of mangrove health and productivity for year 2050 by incorporating IPCC projected climate data. A historical analysis of land cover maps was also performed using Landsat 5 and 8 data to determine changes in mangrove area estimates in years 1995, 2004 and 2017. There was a decrease in dense mangrove extent with an increase in open mangroves and agricultural area. Despite conservation efforts, the current extent of dense mangrove is projected to decrease up to 10% by the year 2050. All three biophysical characteristics including GPP, LAI and CHL, are projected to experience a net decrease of 7.7%, 20.83% and 25.96% respectively by 2050 compared to the mean annual value in 2016. This study will help the Forest Department, Government of Odisha in managing and taking appropriate decisions for conserving and sustaining the remaining mangrove forest under the changing climate and developmental activities

Cap analysis of gene expression reveals alternative promoter usage in a rat model of hypertension

The role of alternative promoter usage in tissue-specific gene expression has been well established, however, its role in complex diseases is poorly understood. We performed cap analysis of gene expression (CAGE) sequencing from the left ventricle (LV) of a rat model of hypertension, the spontaneously hypertensive rat (SHR), and a normotensive strain, Brown Norway (BN) to understand the role of alternative promoter usage in complex disease. We identified 26,560 CAGE-defined transcription start sites (TSS) in the rat LV, including 1,970 novel cardiac TSSs. We identified 28 genes with alternative promoter usage between SHR and BN, which could lead to protein isoforms differing at the amino terminus between two strains and 475 promoter switching events altering the length of the 5’ UTR. We found that the shift in Insr promoter usage was significantly associated with insulin levels and blood pressure within a panel of HXB/BXH recombinant inbred rat strains, suggesting that hyperinsulinemia due to insulin resistance might lead to hypertension in SHR. Our study provides a preliminary evidence of alternative promoter usage in complex diseases