Improving the resilience of post-disaster water distribution systems using a dynamic optimization framework

The file attached to this record is the author's final peer reviewed version. The Publisher's final version can be found by following the DOI link.Improving the resilience of water distribution systems (WDSs) to handle natural disasters (e.g., earthquakes) is a critical step towards sustainable urban water management. This requires the water utility to be able to respond quickly to such disaster events and in an organized manner, to prioritize the use of available resources to restore service rapidly whilst minimizing the negative impacts. Many methods have been developed to evaluate the WDS resilience, but few efforts are made so far to improve resilience of a post-disaster WDS through identifying optimal sequencing of recovery actions. To address this gap, a new dynamic optimization framework is proposed here where the resilience of a post-disaster WDS is evaluated using six different metrics. A tailored Genetic Algorithm is developed to solve the complex optimization problem driven by these metrics. The proposed framework is demonstrated using a real-world WDS with 6,064 pipes. Results obtained show that the proposed framework successfully identifies near-optimal sequencing of recovery actions for this complex WDS. The gained insights, conditional on the specific attributes of the case study, include: (i) the near-optimal sequencing of recovery strategy heavily depends on the damage properties of the WDS, (ii) replacements of damaged elements tend to be scheduled at the intermediate-late stages of the recovery process due to their long operation time, and (iii) interventions to damaged pipe elements near critical facilities (e.g., hospitals) should not be necessarily the first priority to recover due to complex hydraulic interactions within the WDS

Safety Guaranteed Manipulation Based on Reinforcement Learning Planner and Model Predictive Control Actor

Deep reinforcement learning (RL) has been endowed with high expectations in tackling challenging manipulation tasks in an autonomous and self-directed fashion. Despite the significant strides made in the development of reinforcement learning, the practical deployment of this paradigm is hindered by at least two barriers, namely, the engineering of a reward function and ensuring the safety guaranty of learning-based controllers. In this paper, we address these challenging limitations by proposing a framework that merges a reinforcement learning \lstinline[columns=fixed]{planner} that is trained using sparse rewards with a model predictive controller (MPC) \lstinline[columns=fixed]{actor}, thereby offering a safe policy. On the one hand, the RL \lstinline[columns=fixed]{planner} learns from sparse rewards by selecting intermediate goals that are easy to achieve in the short term and promising to lead to target goals in the long term. On the other hand, the MPC \lstinline[columns=fixed]{actor} takes the suggested intermediate goals from the RL \lstinline[columns=fixed]{planner} as the input and predicts how the robot's action will enable it to reach that goal while avoiding any obstacles over a short period of time. We evaluated our method on four challenging manipulation tasks with dynamic obstacles and the results demonstrate that, by leveraging the complementary strengths of these two components, the agent can solve manipulation tasks in complex, dynamic environments safely with a $100\%$ success rate. Videos are available at \url{https://videoviewsite.wixsite.com/mpc-hgg}

Learning from Symmetry: Meta-Reinforcement Learning with Symmetric Data and Language Instructions

Meta-reinforcement learning (meta-RL) is a promising approach that enables the agent to learn new tasks quickly. However, most meta-RL algorithms show poor generalization in multiple-task scenarios due to the insufficient task information provided only by rewards. Language-conditioned meta-RL improves the generalization by matching language instructions and the agent's behaviors. Learning from symmetry is an important form of human learning, therefore, combining symmetry and language instructions into meta-RL can help improve the algorithm's generalization and learning efficiency. We thus propose a dual-MDP meta-reinforcement learning method that enables learning new tasks efficiently with symmetric data and language instructions. We evaluate our method in multiple challenging manipulation tasks, and experimental results show our method can greatly improve the generalization and efficiency of meta-reinforcement learning

A Semi-supervised Sensing Rate Learning based CMAB Scheme to Combat COVID-19 by Trustful Data Collection in the Crowd

Mobile CrowdSensing (MCS), through employing considerable workers to sense and collect data in a participatory manner, has been recognized as a promising paradigm for building many large-scale applications in a cost-effective way, such as combating COVID-19. The recruitment of trustworthy and high-quality workers is an important research issue for MCS. Previous studies assume that the qualities of workers are known in advance, or the platform knows the qualities of workers once it receives their collected data. In reality, to reduce their costs and thus maximize revenue, many strategic workers do not perform their sensing tasks honestly and report fake data to the platform. So, it is very hard for the platform to evaluate the authenticity of the received data. In this paper, an incentive mechanism named Semi-supervision based Combinatorial Multi-Armed Bandit reverse Auction (SCMABA) is proposed to solve the recruitment problem of multiple unknown and strategic workers in MCS. First, we model the worker recruitment as a multi-armed bandit reverse auction problem, and design an UCB-based algorithm to separate the exploration and exploitation, considering the Sensing Rates (SRs) of recruited workers as the gain of the bandit. Next, a Semi-supervised Sensing Rate Learning (SSRL) approach is proposed to quickly and accurately obtain the workers' SRs, which consists of two phases, supervision and self-supervision. Last, SCMABA is designed organically combining the SRs acquisition mechanism with multi-armed bandit reverse auction, where supervised SR learning is used in the exploration, and the self-supervised one is used in the exploitation. We prove that our SCMABA achieves truthfulness and individual rationality. Additionally, we exhibit outstanding performances of the SCMABA mechanism through in-depth simulations of real-world data traces.Comment: 18 pages, 14 figure

MR Molecular Imaging of Aortic Angiogenesis

ObjectivesThe objectives of this study were to use magnetic resonance (MR) molecular imaging to 1) characterize the aortic neovascular development in a rat model of atherosclerosis and 2) monitor the effects of an appetite suppressant on vascular angiogenesis progression.BackgroundThe James C. Russell:LA corpulent rat strain (JCR:LA-cp) is a model of metabolic syndrome characterized by obesity, insulin resistance, hyperlipidemia, and vasculopathy, although plaque neovascularity has not been reported in this strain. MR molecular imaging with ανβ3-targeted nanoparticles can serially map angiogenesis in the aortic wall and monitor the progression of atherosclerosis.MethodsSix-week old JCR:LA-cp (+/?; lean, n = 5) and JCR:LA-cp (cp/cp; obese, n = 5) rats received standard chow, and 6 obese rats were fed the appetite suppressant benfluorex over 16 weeks. Body weight and food consumption were recorded at baseline and weeks 4, 8, 12, and 16. MR molecular imaging with ανβ3-targeted paramagnetic nanoparticles was performed at weeks 0, 8, and 16. Fasted plasma triglyceride, cholesterol, and glucose were measured immediately before MR scans. Plasma insulin and leptin levels were assayed at weeks 8 and 16.ResultsBenfluorex reduced food consumption (p < 0.05) to the same rate as lean animals, but had no effect on serum cholesterol or triglyceride levels. MR (3-T) aortic signal enhancement with ανβ3-targeted nanoparticles was initially equivalent between groups, but increased (p < 0.05) in the untreated obese animals over 16 weeks. No signal change (p > 0.05) was observed in the benfluorex-treated or lean rat groups. MR differences paralleled adventitial microvessel counts, which increased (p < 0.05) among the obese rats and were equivalently low in the lean and benfluorex-treated animals (p > 0.05). Body weight, insulin, and leptin were decreased (p < 0.05) from the untreated obese animals by benfluorex, but not to the lean control levels (p < 0.05).ConclusionsNeovascular expansion is a prominent feature of the JCR:LA-cp model. MR imaging with ανβ3-targeted nanoparticles provided a noninvasive assessment of angiogenesis in untreated obese rats, which was suppressed by benfluorex

Searching for the nano-Hertz stochastic gravitational wave background with the Chinese Pulsar Timing Array Data Release I

Observing and timing a group of millisecond pulsars (MSPs) with high rotational stability enables the direct detection of gravitational waves (GWs). The GW signals can be identified from the spatial correlations encoded in the times-of-arrival of widely spaced pulsar-pairs. The Chinese Pulsar Timing Array (CPTA) is a collaboration aiming at the direct GW detection with observations carried out using Chinese radio telescopes. This short article serves as a `table of contents' for a forthcoming series of papers related to the CPTA Data Release 1 (CPTA DR1) which uses observations from the Five-hundred-meter Aperture Spherical radio Telescope (FAST). Here, after summarizing the time span and accuracy of CPTA DR1, we report the key results of our statistical inference finding a correlated signal with amplitude \log A_{\rm c}= -14.4 \,^{+1.0}_{-2.8} for spectral index in the range of $\alpha\in [-1.8, 1.5]$ assuming a GW background (GWB) induced quadrupolar correlation. The search for the Hellings-Downs (HD) correlation curve is also presented, where some evidence for the HD correlation has been found that a 4.6-$\sigma$ statistical significance is achieved using the discrete frequency method around the frequency of 14 nHz. We expect that the future International Pulsar Timing Array data analysis and the next CPTA data release will be more sensitive to the nHz GWB, which could verify the current results.Comment: 18 pages, 6 figures, submitted to "Research in astronomy and astrophysics" 22nd March 202

GaAs-Based Superluminescent Light-Emitting Diodes with 290-nm Emission Bandwidth by Using Hybrid Quantum Well/Quantum Dot Structures

A high-performance superluminescent light-emitting diode (SLD) based upon a hybrid quantum well (QW)/quantum dot (QD) active element is reported and is assessed with regard to the resolution obtainable in an optical coherence tomography system. We report on the appearance of strong emission from higher order optical transition from the QW in a hybrid QW/QD structure. This additional emission broadening method contributes significantly to obtaining a 3-dB linewidth of 290 nm centered at 1200 nm, with 2.4 mW at room temperature

Comparative analysis of the transcriptome across distant species

The transcriptome is the readout of the genome. Identifying common features in it across distant species can reveal fundamental principles. To this end, the ENCODE and modENCODE consortia have generated large amounts of matched RNA-sequencing data for human, worm and fly. Uniform processing and comprehensive annotation of these data allow comparison across metazoan phyla, extending beyond earlier within-phylum transcriptome comparisons and revealing ancient, conserved features. Specifically, we discover co-expression modules shared across animals, many of which are enriched in developmental genes. Moreover, we use expression patterns to align the stages in worm and fly development and find a novel pairing between worm embryo and fly pupae, in addition to the embryo-to-embryo and larvae-to-larvae pairings. Furthermore, we find that the extent of non-canonical, non-coding transcription is similar in each organism, per base pair. Finally, we find in all three organisms that the gene-expression levels, both coding and non-coding, can be quantitatively predicted from chromatin features at the promoter using a 'universal model' based on a single set of organism-independent parameters

An Efficient, Platform-Independent Map Rendering Framework for Mobile Augmented Reality

With the extensive application of big spatial data and the emergence of spatial computing, augmented reality (AR) map rendering has attracted significant attention. A common issue in existing solutions is that AR-GIS systems rely on different platform-specific graphics libraries on different operating systems, and rendering implementations can vary across various platforms. This causes performance degradation and rendering styles that are not consistent across environments. However, high-performance rendering consistency across devices is critical in AR-GIS, especially for edge collaborative computing. In this paper, we present a high-performance, platform-independent AR-GIS rendering engine; the augmented reality universal graphics library (AUGL) engine. A unified cross-platform interface is proposed to preserve AR-GIS rendering style consistency across platforms. High-performance AR-GIS map symbol drawing models are defined and implemented based on a unified algorithm interface. We also develop a pre-caching strategy, optimized spatial-index querying, and a GPU-accelerated vector drawing algorithm that minimizes IO latency throughout the rendering process. Comparisons to existing AR-GIS visualization engines indicate that the performance of the AUGL engine is two times higher than that of the AR-GIS rendering engine on the Android, iOS, and Vuforia platforms. The drawing efficiency for vector polygons is improved significantly. The rendering performance is more than three times better than the average performances of existing Android and iOS systems

An Accurate and Efficient Quaternion-Based Visualization Approach to 2D/3D Vector Data for the Mobile Augmented Reality Map

Increasingly complex vector map applications and growing multi-source spatial data pose a serious challenge to the accuracy and efficiency of vector map visualization. It is true especially for real-time and dynamic scene visualization in mobile augmented reality, with the dramatic development of spatial data sensing and the emergence of AR-GIS. Such issues can be decomposed into three issues: accurate pose representation, fast and precise topological relationships computation and high-performance acceleration methods. To solve these issues, a novel quaternion-based real-time vector map visualization approach is proposed in this paper. It focuses on precise position and orientation representation, accurate and efficient spatial relationships calculation and acceleration parallel rendering in mobile AR. First, a quaternion-based pose processing method for multi-source spatial data is developed. Then, the complex processing of spatial relationships is mapped into simple and efficient quaternion-based operations. With these mapping methods, spatial relationship operations with large computational volumes can be converted into efficient quaternion calculations, and then the results are returned to respond to the interaction. Finally, an asynchronous rendering acceleration mechanism is also presented in this paper. Experiments demonstrated that the method proposed in this paper can significantly improve vector visualization of the AR map. The new approach, when compared to conventional visualization methods, provides more stable and accurate rendering results, especially when the AR map has strenuous movements and high frequency variations. The smoothness of the user interaction experience is also significantly improved