Hamiltonian-Driven Adaptive Dynamic Programming with Efficient Experience Replay

This article presents a novel efficient experience-replay-based adaptive dynamic programming (ADP) for the optimal control problem of a class of nonlinear dynamical systems within the Hamiltonian-driven framework. The quasi-Hamiltonian is presented for the policy evaluation problem with an admissible policy. With the quasi-Hamiltonian, a novel composite critic learning mechanism is developed to combine the instantaneous data with the historical data. In addition, the pseudo-Hamiltonian is defined to deal with the performance optimization problem. Based on the pseudo-Hamiltonian, the conventional Hamilton–Jacobi–Bellman (HJB) equation can be represented in a filtered form, which can be implemented online. Theoretical analysis is investigated in terms of the convergence of the adaptive critic design and the stability of the closed-loop systems, where parameter convergence can be achieved under a weakened excitation condition. Simulation studies are investigated to verify the efficacy of the presented design scheme

Data-Driven Integral Reinforcement Learning for Continuous-Time Non-Zero-Sum Games

This paper develops an integral value iteration (VI) method to efficiently find online the Nash equilibrium solution of two-player non-zero-sum (NZS) differential games for linear systems with partially unknown dynamics. To guarantee the closed-loop stability about the Nash equilibrium, the explicit upper bound for the discounted factor is given. To show the efficacy of the presented online model-free solution, the integral VI method is compared with the model-based off-line policy iteration method. Moreover, the theoretical analysis of the integral VI algorithm in terms of three aspects, i.e., positive definiteness properties of the updated cost functions, the stability of the closed-loop systems, and the conditions that guarantee the monotone convergence, is provided in detail. Finally, the simulation results demonstrate the efficacy of the presented algorithms

High accuracy theoretical investigations of CaF, SrF, and BaF and implications for laser-cooling

The NL-eEDM collaboration is building an experimental setup to search for the permanent electric dipole moment of the electron in a slow beam of cold barium fluoride molecules [Eur. Phys. J. D, 72, 197 (2018)]. Knowledge of molecular properties of BaF is thus needed to plan the measurements and in particular to determine an optimal laser-cooling scheme. Accurate and reliable theoretical predictions of these properties require incorporation of both high-order correlation and relativistic effects in the calculations. In this work theoretical investigations of the ground and the lowest excited states of BaF and its lighter homologues, CaF and SrF, are carried out in the framework of the relativistic Fock-space coupled cluster (FSCC) and multireference configuration interaction (MRCI) methods. Using the calculated molecular properties, we determine the Franck-Condon factors (FCFs) for the $A^2\Pi_{1/2} \rightarrow X^2\Sigma^{+}_{1/2}$ transition, which was successfully used for cooling CaF and SrF and is now considered for BaF. For all three species, the FCFs are found to be highly diagonal. Calculations are also performed for the $B^2\Sigma^{+}_{1/2} \rightarrow X^2\Sigma^{+}_{1/2}$ transition recently exploited for laser-cooling of CaF; it is shown that this transition is not suitable for laser-cooling of BaF, due to the non-diagonal nature of the FCFs in this system. Special attention is given to the properties of the $A'^2\Delta$ state, which in the case of BaF causes a leak channel, in contrast to CaF and SrF species where this state is energetically above the excited states used in laser-cooling. We also present the dipole moments of the ground and the excited states of the three molecules and the transition dipole moments (TDMs) between the different states.Comment: Minor changes; The following article has been submitted to the Journal of Chemical Physics. After it is published, it will be found at https://publishing.aip.org/resources/librarians/products/journals

Systematic study and uncertainty evaluation of P, T-odd molecular enhancement factors in BaF

A measurement of the magnitude of the electric dipole moment of the electron (eEDM) larger than that predicted by the Standard Model (SM) of particle physics is expected to have a huge impact on the search for physics beyond the SM. Polar diatomic molecules containing heavy elements experience enhanced sensitivity to parity (P) and time-reversal (T)-violating phenomena, such as the eEDM and the scalar-pseudoscalar (S-PS) interaction between the nucleons and the electrons, and are thus promising candidates for measurements. The NL-eEDM collaboration is preparing an experiment to measure the eEDM and S-PS interaction in a slow beam of cold BaF molecules [P. Aggarwal et al., Eur. Phys. J. D 72, 197 (2018)]. Accurate knowledge of the electronic structure parameters, Wd and Ws, connecting the eEDM and the S-PS interaction to the measurable energy shifts is crucial for the interpretation of these measurements. In this work, we use the finite field relativistic coupled cluster approach to calculate the Wd and Ws parameters in the ground state of the BaF molecule. Special attention was paid to providing a reliable theoretical uncertainty estimate based on investigations of the basis set, electron correlation, relativistic effects, and geometry. Our recommended values of the two parameters, including conservative uncertainty estimates, are 3.13 ±0.12×1024Hzecm for Wd and 8.29 ± 0.12 kHz for W

Benzoate Catabolite Repression of the Phenol Degradation in Acinetobacter calcoaceticus PHEA-2

Acinetobacter calcoaceticus PHEA-2 exhibited a delayed utilization of phenol in the presence of benzoate. Benzoate supplementation completely inhibited phenol degradation in a benzoate 1,2-dioxygenase knockout mutant. The mphR encoding the transcriptional activator and mphN encoding the largest subunit of multi-component phenol hydroxylase in the benA mutant were significantly downregulated (about 7- and 70-fold) on the basis of mRNA levels when benzoate was added to the medium. The co-transformant assay of E. coli JM109 with mphK::lacZ fusion and the plasmid pETR carrying mphR gene showed that MphR did not activate the mph promoter in the presence of benzoate. These results suggest that catabolite repression of phenol degradation by benzoate in A. calcoaceticus PHEA-2 is mediated by the inhibition of the activator protein MphR

A PATO-compliant zebrafish screening database (MODB): management of morpholino knockdown screen information

<p>Abstract</p> <p>Background</p> <p>The zebrafish is a powerful model vertebrate amenable to high throughput <it>in vivo </it>genetic analyses. Examples include reverse genetic screens using morpholino knockdown, expression-based screening using enhancer trapping and forward genetic screening using transposon insertional mutagenesis. We have created a database to facilitate web-based distribution of data from such genetic studies.</p> <p>Description</p> <p>The MOrpholino DataBase is a MySQL relational database with an online, PHP interface. Multiple quality control levels allow differential access to data in raw and finished formats. MODBv1 includes sequence information relating to almost 800 morpholinos and their targets and phenotypic data regarding the dose effect of each morpholino (mortality, toxicity and defects). To improve the searchability of this database, we have incorporated a fixed-vocabulary defect ontology that allows for the organization of morpholino affects based on anatomical structure affected and defect produced. This also allows comparison between species utilizing Phenotypic Attribute Trait Ontology (PATO) designated terminology. MODB is also cross-linked with ZFIN, allowing full searches between the two databases. MODB offers users the ability to retrieve morpholino data by sequence of morpholino or target, name of target, anatomical structure affected and defect produced.</p> <p>Conclusion</p> <p>MODB data can be used for functional genomic analysis of morpholino design to maximize efficacy and minimize toxicity. MODB also serves as a template for future sequence-based functional genetic screen databases, and it is currently being used as a model for the creation of a mutagenic insertional transposon database.</p

Methylation screening of the TGFBI promoter in human lung and prostate cancer by methylation-specific PCR

<p>Abstract</p> <p>Background</p> <p>Hypermethylation of the <it>TGFBI </it>promoter has been shown to correlate with decreased expression of this gene in human tumor cell lines. In this study, we optimized a methylation-specific polymerase chain reaction (MSP) method and investigated the methylation status of the <it>TGFBI </it>promoter in human lung and prostate cancer specimens.</p> <p>Methods</p> <p>Methylation-specific primers were designed based on the methylation profiles of the <it>TGFBI </it>promoter in human tumor cell lines, and MSP conditions were optimized for accurate and efficient amplification. Genomic DNA was isolated from lung tumors and prostatectomy tissues of prostate cancer patients, bisulfite-converted, and analyzed by MSP.</p> <p>Results</p> <p>Among 50 lung cancer samples, 44.0% (22/50) harbored methylated CpG sites in the <it>TGFBI </it>promoter. An analysis correlating gene methylation status with clinicopathological cancer features revealed that dense methylation of the <it>TGFBI </it>promoter was associated with a metastatic phenotype, with 42.9% (6/14) of metastatic lung cancer samples demonstrating dense methylation vs. only 5.6% (2/36) of primary lung cancer samples (<it>p </it>< 0.05). Similar to these lung cancer results, 82.0% (41/50) of prostate cancer samples harbored methylated CpG sites in the <it>TGFBI </it>promoter, and dense methylation of the promoter was present in 38.9% (7/18) of prostate cancer samples with the feature of locoregional invasiveness vs. only 19.4% (6/31) of prostate cancer samples without locoregional invasiveness (<it>p </it>< 0.05). Furthermore, promoter hypermethylation correlated with highly reduced expression of the <it>TGFBI </it>gene in human lung and prostate tumor cell lines.</p> <p>Conclusion</p> <p>We successfully optimized a MSP method for the precise and efficient screening of <it>TGFBI </it>promoter methylation status. Dense methylation of the <it>TGFBI </it>promoter correlated with the extent of <it>TGFBI </it>gene silencing in tumor cell lines and was related to invasiveness of prostate tumors and metastatic status of lung cancer tumors. Thus, <it>TGFBI </it>promoter methylation can be used as a potential prognostic marker for invasiveness and metastasis in prostate and lung cancer patients, respectively.</p

Production of Transgenic Pigs Mediated by Pseudotyped Lentivirus and Sperm

Sperm-mediated gene transfer can be a very efficient method to produce transgenic pigs, however, the results from different laboratories had not been widely repeated. Genomic integration of transgene by injection of pseudotyped lentivirus to the perivitelline space has been proved to be a reliable route to generate transgenic animals. To test whether transgene in the lentivirus can be delivered by sperm, we studied incubation of pseudotyped lentiviruses and sperm before insemination. After incubation with pig spermatozoa, 62±3 lentiviral particles were detected per 100 sperm cells using quantitative real-time RT-PCR. The association of lentivirus with sperm was further confirmed by electron microscopy. The sperm incubated with lentiviral particles were artificially inseminated into pigs. Of the 59 piglets born from inseminated 5 sows, 6 piglets (10.17%) carried the transgene based on the PCR identification. Foreign gene and EGFP was successfully detected in ear tissue biopsies from two PCR-positive pigs, revealed via in situ hybridization and immunohistochemistry. Offspring of one PCR-positive boar with normal sows showed PCR-positive. Two PCR-positive founders and offsprings of PCR-positive boar were further identified by Southern-blot analysis, out of which the two founders and two offsprings were positive in Southern blotting, strongly indicating integration of foreign gene into genome. The results indicate that incubation of sperm with pseudotyped lentiviruses can incorporated with sperm-mediated gene transfer to produce transgenic pigs with improved efficiency