AID-RL: Active information-directed reinforcement learning for autonomous source seeking and estimation

This paper proposes an active information-directed reinforcement learning (AID-RL) framework for autonomous source seeking and estimation problem. Source seeking requires the search agent to move towards the true source, and source estimation demands the agent to maintain and update its knowledge regarding the source properties such as release rate and source position. These two objectives give rise to the newly developed framework, namely, dual control for exploration and exploitation. In this paper, the greedy RL forms an exploitation search strategy that navigates the agent to the source position, while the information-directed search commands the agent to explore most informative positions to reduce belief uncertainty. Extensive results are presented using a high-fidelity dataset for autonomous search, which validates the effectiveness of the proposed AID-RL and highlights the importance of active exploration in improving sampling efficiency and search performance

Provenance and tectonic setting of the Neoproterozoic Yanbian Group, western Yangtze Block (SW China)

Tectonic evolution of the Yangtze Block of South China during Neoproterozoic time has been a major focus of debate and is important in the reconstruction of the Rodinian supercontinent. The Yanbian Group in the western margin of the Yangtze Block is a well-preserved Neoproterozoic volcanic-sedimentary sequence and provides a rare opportunity to examine the provenance and tectonic setting. It consists of a lower part composed of ∼1500 m thick basaltic lavas and an upper part of ∼3500 m thick flysch deposits. The flysch sequence contains typical deep marine turbidites consisting mainly of fine-grained volcaniclastic sandstones and mudstones, indicating a submarine fan depositional system. Detrital zircon dating yields ages ranging from ca. 865 Ma to 1000 Ma with two peaks at ca. 900 Ma and 920 Ma, respectively. The Yanbian Group is intruded by the ∼860 Ma Guandaoshan dioritic pluton, constraining its depositional age at ca. 870 Ma. The sandstones contain abundant feldspar and lithic fragments with minor amounts of quartz and have an average composition of Q 16F 35L 49, suggesting a proximal source and an undissected to transitional arc setting. The lithic fragments in the sandstones point to andesitic and felsic volcanic rock sources. The sandstones and mudstones have intermediate SiO 2/Al 2O 3 (typically 3-6), high Fe 2O 3 + MgO contents (5-12 wt%), and moderate to high K 2O/Na 2O ratios (generally 0.1-1 and 1-10 for sandstones and mudstones, respectively). In comparison with average upper continental crust, they show strong negative Nb-Ta anomalies, slight depletion of Zr-Hf, La and Th, but moderate enrichment of V, Cr, Ni, and Sc. These rocks show LREE enrichment (La/Yb N = 5.3-7.4) with flat HREE, and pronounced negative Eu anomalies (Eu/Eu * = 0.6-0.74) in chondrite-normalized REE patterns, similar to post-Archean shales. Geochemical data for these rocks suggest an arc setting and intermediate-felsic volcanic source, consistent with a back-arc basin scenario for the basaltic lavas in the lower Yanbian Group. Together with regional geological evidence, the turbidites of the Yanbian Group strongly support a model in which the western margin of the Yangtze Block was a major magmatic arc, active probably from ∼920 Ma to 740 Ma, a period of more than 180 million years. © 2008 Elsevier B.V. All rights reserved.postprin

Efficacy And Safety Of Hylan G-F 20 Injection In Treatment Of Knee Osteoarthritis In Chinese Patients: Results Of A Prospective, Multicentre, Longitudinal Study

published_or_final_versio

Prevalence of Femoroacetabular Impingement “at-risk” Radiographic Parameters in Young Asymptomatic Chinese and Caucasian Subjects

published_or_final_versio

Insufficient activity of MAPK pathway is a key monitor of Kidney-Yang Deficiency Syndrome.

OBJECTIVE: To explore the genetic characteristics and molecular regulator of Kidney-Yang Deficiency Syndrome (KDS). DESIGN: A typical KDS family was collected using a questionnaire of cold feeling and a 40-item scoring table of KDS based on Traditional Chinese Medicine (TCM), by single-blind method repeated annually over three years. Their transcriptomes were assayed by microarray and validated by RT-PCR and ELISA. Simultaneously, 10 healthy volunteers were recruited as controls and the same protocols were performed. RESULTS: This typical KDS family has 35 members, of whom 11 were evaluated as having severe KDS and 6 as having common KDS. Results of the cDNA microarray revealed that there were 420 genes/expressed sequence tags differentially expressed in KDS transcriptomes, indicating a global functional impairment in the mass-energy-information carrying network of KDS patients, involving energy metabolism, signal transduction, development, cell cycle, and immunity. Pathway analysis by gene set enrichment assay (GSEA) and other tools demonstrated that mitogenic activated protein kinase (MAPK) is among the most insufficiently activated pathways, while the oxidative phosphorylation and glycolysis/gluconeogenesis pathways, the two main pathways relevant to ATP synthesis, were among the most excessively activated pathways in KDS patients. Results of RT-PCR and ELISA confirmed the status of insufficient activity of the MAPK pathway. CONCLUSION: KDS patients undergo overall attenuated functions in the mass-energy-information carrying network. The marked low level of energy output in KDS may be primarily attributed to the insufficient activity of the MAPK pathway, which may be a key monitor for the abnormal energy metabolism and other impaired activities in KDS.published_or_final_versio

Nanostructured 3D Constructs Based on Chitosan and Chondroitin Sulphate Multilayers for Cartilage Tissue Engineering

Nanostructured three-dimensional constructs combining layer-by-layer technology (LbL) and template leaching were processed and evaluated as possible support structures for cartilage tissue engineering. Multilayered constructs were formed by depositing the polyelectrolytes chitosan (CHT) and chondroitin sulphate (CS) on either bidimensional glass surfaces or 3D packet of paraffin spheres. 2D CHT/CS multi-layered constructs proved to support the attachment and proliferation of bovine chondrocytes (BCH). The technology was transposed to 3D level and CHT/CS multi-layered hierarchical scaffolds were retrieved after paraffin leaching. The obtained nanostructured 3D constructs had a high porosity and water uptake capacity of about 300%. Dynamical mechanical analysis (DMA) showed the viscoelastic nature of the scaffolds. Cellular tests were performed with the culture of BCH and multipotent bone marrow derived stromal cells (hMSCs) up to 21 days in chondrogenic differentiation media. Together with scanning electronic microscopy analysis, viability tests and DNA quantification, our results clearly showed that cells attached, proliferated and were metabolically active over the entire scaffold. Cartilaginous extracellular matrix (ECM) formation was further assessed and results showed that GAG secretion occurred indicating the maintenance of the chondrogenic phenotype and the chondrogenic differentiation of hMSCs

Tumor Necrosis Factor-Alpha G308α Gene Polymorphism and Essential Hypertension: A Meta-Analysis Involving 2244 Participants

BACKGROUND: The tumor necrosis factor-alpha (TNFα) G308A gene polymorphism has been implicated in susceptibility to essential hypertension (EH), but study results are still controversial. OBJECTIVE AND METHODS: The present meta-analysis is performed to investigate the relationship between the TNFα G308A gene polymorphism and EH. Electronic databases were searched and seven separate studies on the association of the TNF α G308A gene polymorphism with EH were analyzed. The meta-analysis involved 1092 EH patients and 1152 controls. The pooled odds ratios (ORs) and their corresponding 95% confidence interval (CI) were calculated by a fixed or random effect model. RESULTS: A significant relationship between the TNFα G308A gene polymorphism and EH was found in an allelic genetic model (OR: 1.45, 95% CI: 1.17 to 1.80, P = 0.0008), a recessive genetic model (OR: 3.181, 95% CI: 1.204 to 8.408, P = 0.02), and a homozygote model (OR: 3.454, 95% CI: 1.286 to 9.278, P = 0.014). No significant association between them was detected in both a dominant genetic model (OR: 1.55, 95% CI: 0.99 to 2.42, P = 0.06) or a heterozygote genetic model (OR: 1.45, 95% CI: 0.90 to 2.33, P = 0.13). CONCLUSION: The TNFα G308A gene polymorphism is associated with EH susceptibility

The sudden change phenomenon of quantum discord

Even if the parameters determining a system's state are varied smoothly, the behavior of quantum correlations alike to quantum discord, and of its classical counterparts, can be very peculiar, with the appearance of non-analyticities in its rate of change. Here we review this sudden change phenomenon (SCP) discussing some important points related to it: Its uncovering, interpretations, and experimental verifications, its use in the context of the emergence of the pointer basis in a quantum measurement process, its appearance and universality under Markovian and non-Markovian dynamics, its theoretical and experimental investigation in some other physical scenarios, and the related phenomenon of double sudden change of trace distance discord. Several open questions are identified, and we envisage that in answering them we will gain significant further insight about the relation between the SCP and the symmetry-geometric aspects of the quantum state space.Comment: Lectures on General Quantum Correlations and their Applications, F. F. Fanchini, D. O. Soares Pinto, and G. Adesso (Eds.), Springer (2017), pp 309-33

Side-by-Side In(OH)3 and In2O3 Nanotubes: Synthesis and Optical Properties

A simple and mild wet-chemical approach was developed for the synthesis of one-dimensional (1D) In(OH)3 nanostructures. By calcining the 1D In(OH)3 nanocrystals in air at 250 °C, 1D In2O3 nanocrystals with the same morphology were obtained. TEM results show that both 1D In(OH)3 and 1D In2O3 are composed of uniform nanotube bundles. SAED and XRD patterns indicate that 1D In(OH)3 and 1D In2O3 nanostructures are single crystalline and possess the same bcc crystalline structure as the bulk In(OH)3 and In2O3, respectively. TGA/DTA analyses of the precursor In(OH)3 and the final product In2O3 confirm the existence of CTAB molecules, and its content is about 6%. The optical absorption band edge of 1D In2O3 exhibits an evident blueshift with respect to that of the commercial In2O3 powders, which is caused by the increasing energy gap resulted from decreasing the grain size. A relatively strong and broad purple-blue emission band centered at 440 nm was observed in the room temperature PL spectrum of 1D In2O3 nanotube bundles, which was mainly attributed to the existence of the oxygen vacancies