Model-free Reinforcement Learning for H2/H∞{H_{2}/H_{\infty}} Control of Stochastic Discrete-time Systems

This paper proposes a reinforcement learning (RL) algorithm for infinite horizon $\rm {H_{2}/H_{\infty}}$ problem in a class of stochastic discrete-time systems, rather than using a set of coupled generalized algebraic Riccati equations (GAREs). The algorithm is able to learn the optimal control policy for the system even when its parameters are unknown. Additionally, the paper explores the effect of detection noise as well as the convergence of the algorithm, and shows that the control policy is admissible after a finite number of iterations. The algorithm is also able to handle multi-objective control problems within stochastic fields. Finally, the algorithm is applied to the F-16 aircraft autopilot with multiplicative noise

Review of rational (total) nonlinear dynamic system modelling, identification, and control

© 2013 Taylor & Francis. This paper is a summary of the research development in the rational (total) nonlinear dynamic modelling over the last two decades. Total nonlinear dynamic systems are defined as those where the model parameters and input (controller outputs) are subject to nonlinear to the output. Previously, this class of models has been known as rational models, which is a model that can be considered to belong to the nonlinear autoregressive moving average with exogenous input (NARMAX) model subset and is an extension of the well-known polynomial NARMAX model. The justification for using the rational model is that it provides a very concise and parsimonious representation for highly complex nonlinear dynamic systems and has excellent interpolatory and extrapolatory properties. However, model identification and controller design are much more challenging compared to the polynomial models. This has been a new and fascinating research trend in the area of mathematical modelling, control, and applications, but still within a limited research community. This paper brings several representative algorithms together, developed by the authors and their colleagues, to form an easily referenced archive for promotion of the awareness, tutorial, applications, and even further research expansion

Predictive values of clinical data,molecular biomarkers, and echocardiographic measurements in preterm infants with bronchopulmonary dysplasia

ObjectiveWe aimed to use molecular biomarkers and clinical data and echocardiograms that were collected during admission to predict bronchopulmonary dysplasia (BPD) in preterm infants with gestational age ≤32 weeks.MethodsEighty-two patients (40 with BPD, BPD group and 42 healthy as controls, non-BPD group) admitted to the Department of Neonatology of the Children's Hospital of Soochow University between October 1, 2018, and February 29, 2020, were enrolled in this study at the tertiary hospital. Basic clinical data on the perinatal period, echocardiographic measurements, and molecular biomarkers (N-terminal-pro-B-brain natriuretic peptide, NT-proBNP) were collected. We used multiple logistic regression analysis to establish an early predictive model for detecting BPD development in preterm infants of gestational age ≤32 weeks. We also used a receiver operating characteristic curve to assess the sensitivity and specificity of the model.ResultsNo significant differences were found between the BPD and non-BPD groups in terms of sex, birth weight, gestational age, incidence of asphyxia, maternal age, gravidity, parity, mode of delivery, premature rupture of membranes >18 h, use of prenatal hormones, placental abruption, gestational diabetes mellitus, amniotic fluid contamination, prenatal infections, and maternal diseases. The use of caffeine, albumin, gamma globulin; ventilation; days of FiO2 ≥ 40%; oxygen inhalation time; red blood cell suspension infusion volume (ml/kg); and proportion of infants who received total enteral nutrition (120 kcal/kg.d) ≥24 d after birth were higher in the BPD group than in the non-BPD group. The levels of hemoglobin, hematocrit, and albumin in the BPD group were significantly lower than those in the non-BPD group. The total calorie intake was significantly lower in the BPD group on the 3rd, 7th, and 14th day after birth than in the non-BPD group (P < 0.05). The incidence rates of patent ductus arteriosus (PDA), pulmonary hypertension, and tricuspid regurgitation were significantly higher in the BPD group than in the non-BPD group (P < 0.05). The serum level of NT-proBNP 24 h after birth was significantly higher in the BPD group than in the non-BPD group (P < 0.05). Serum NT-proBNP levels were significantly higher in infants with severe BPD than in those with mild or moderate BPD (P < 0.05).ConclusionAs there were various risk factors for BPD, a combining clinical data, molecular biomarkers, and echocardiogram measurements can be valuable in predicting the BPD. The tricuspid regurgitation flow rate (m/s), NT-proBNP (pg/ml), ventilator-associated pneumonia, days of FiO2 ≥ 40% (d), red blood cell suspension infusion volume (ml/kg), and proportion of infants who received total enteral nutrition (120 kcal/kg.d) ≥24 d after birth were the most practical factors considered for designing an appropriate model for predicting the risk of BPD

VoiceShop: A Unified Speech-to-Speech Framework for Identity-Preserving Zero-Shot Voice Editing

We present VoiceShop, a novel speech-to-speech framework that can modify multiple attributes of speech, such as age, gender, accent, and speech style, in a single forward pass while preserving the input speaker's timbre. Previous works have been constrained to specialized models that can only edit these attributes individually and suffer from the following pitfalls: the magnitude of the conversion effect is weak, there is no zero-shot capability for out-of-distribution speakers, or the synthesized outputs exhibit undesirable timbre leakage. Our work proposes solutions for each of these issues in a simple modular framework based on a conditional diffusion backbone model with optional normalizing flow-based and sequence-to-sequence speaker attribute-editing modules, whose components can be combined or removed during inference to meet a wide array of tasks without additional model finetuning. Audio samples are available at \url{https://voiceshopai.github.io}

Real-time PCR of the mammalian hydroxymethylbilane synthase (HMBS) gene for analysis of flea (Ctenocephalides felis) feeding patterns on dogs

<p>Abstract</p> <p>Background</p> <p>Precise data on quantitative kinetics of blood feeding of fleas, particularly immediately after contact with the host, are essential for understanding dynamics of flea-borne disease transmission and for evaluating flea control strategies. Standard methods used are inadequate for studies that simulate early events after real-life flea access to the host.</p> <p>Methods</p> <p>Here, we developed a novel quantitative polymerase chain reaction targeting mammalian DNA within fleas to quantify blood consumption with high sensitivity and specificity. We used primers and fluorescent probes that amplify the hydroxymethylbilane synthase (HMBS) gene, an evolutionary divergent gene that is unlikely to be detected in insects by mammalian-specific primers and probes. To validate this assay, fleas were placed on dogs, allowed to distribute in the hair, and removed at specific time points with single-use combs. Fleas were then immediately homogenized by vigorous shaking with ceramic beads in guanidinium-based DNA preservation buffer for DNA extraction.</p> <p>Results</p> <p>The specificity of this assay was ascertained by amplification of canine, feline and equine blood with differential product melting temperatures (<it>T</it>_m), and lack of amplification of bovine and porcine blood and of adult fleas reared from larvae fed with bovine blood. Sensitivity of the assay was established by limiting dilution and detection of single copies of HMBS DNA equivalent to 0.043 nL blood. Application of the assay indicated that after 15 minutes on a dog, male and female fleas had ingested low, but similar amounts of approximately 1.1. nL blood. Saturation uptake of 118 and 100 nL blood per flea was found at 30 and 60 min on the dog, respectively.</p> <p>Conclusions</p> <p>The HMBS PCR method developed here offers the advantages of both exquisite sensitivity and specificity that make it superior to other approaches for quantification of blood ingested by fleas. The capability to detect minute quantities of blood in single fleas, particularly immediately after colonization of the host, will provide a superior tool for studying flea-host interactions, flea-borne disease transmission, and flea control strategies.</p