MFRL-BI: Design of a Model-free Reinforcement Learning Process Control Scheme by Using Bayesian Inference

Design of process control scheme is critical for quality assurance to reduce variations in manufacturing systems. Taking semiconductor manufacturing as an example, extensive literature focuses on control optimization based on certain process models (usually linear models), which are obtained by experiments before a manufacturing process starts. However, in real applications, pre-defined models may not be accurate, especially for a complex manufacturing system. To tackle model inaccuracy, we propose a model-free reinforcement learning (MFRL) approach to conduct experiments and optimize control simultaneously according to real-time data. Specifically, we design a novel MFRL control scheme by updating the distribution of disturbances using Bayesian inference to reduce their large variations during manufacturing processes. As a result, the proposed MFRL controller is demonstrated to perform well in a nonlinear chemical mechanical planarization (CMP) process when the process model is unknown. Theoretical properties are also guaranteed when disturbances are additive. The numerical studies also demonstrate the effectiveness and efficiency of our methodology.Comment: 31 pages, 7 figures, and 3 table

Interacting heavy fermions in a disordered optical lattice

We have theoretically studied the effect of disorder on ultracold alkaline-earth atoms governed by the Kondo lattice model in an optical lattice via simplified double-well model and hybridization mean-field theory. Disorder-induced narrowing and even complete closure of hybridization gap have been predicted and the compressibility of the system has also been investigated for metallic and Kondo insulator phases in the presence of the disordered potential. To make connection to the experimental situation, we have numerically solved the disordered Kondo lattice model with an external harmonic trap and shown both the melting of Kondo insulator plateau and an compressibility anomaly at low-density

Tensor-based process control and monitoring for semiconductor manufacturing with unstable disturbances

With the development and popularity of sensors installed in manufacturing systems, complex data are collected during manufacturing processes, which brings challenges for traditional process control methods. This paper proposes a novel process control and monitoring method for the complex structure of high-dimensional image-based overlay errors (modeled in tensor form), which are collected in semiconductor manufacturing processes. The proposed method aims to reduce overlay errors using limited control recipes. We first build a high-dimensional process model and propose different tensor-on-vector regression algorithms to estimate parameters in the model to alleviate the curse of dimensionality. Then, based on the estimate of tensor parameters, the exponentially weighted moving average (EWMA) controller for tensor data is designed whose stability is theoretically guaranteed. Considering the fact that low-dimensional control recipes cannot compensate for all high-dimensional disturbances on the image, control residuals are monitored to prevent significant drifts of uncontrollable high-dimensional disturbances. Through extensive simulations and real case studies, the performances of parameter estimation algorithms and the EWMA controller in tensor space are evaluated. Compared with existing image-based feedback controllers, the superiority of our method is verified especially when disturbances are not stable.Comment: 30 pages, 5 figure

Evidence based medicine research of tertiary prevention and management on type 2 diabetes mellitus

随着社会文明的进步、生活方式的西化以及人口结构的老龄化，糖尿病的发病率越来越高。因此糖尿病的防治工作至关重要，中国新近提出的慢病管理，关口前移，预防下沉，糖尿病的三级预防也得到日益关注。针对2型糖尿病患者的三级预防目标主要根据自然病程制定：一级预防是通过控制各种危险因素、中止2型糖尿病的发生、降低发病率；二级预防是通过改善胰岛素抵抗和阻止患者胰岛β细胞损害的进展，防止糖尿病各种并发症的发病；三级预防是保护患者残存的胰岛β细胞、加强血糖控制并且控制并发症，全面降低死亡率。本文将从循证医学的角度，总结2型糖尿病三级预防的临床研究证据，结合我们自己科室医护团队的经验心得，为糖尿病预防及管理的合理性及可行性提供理论基础,并对糖尿病的三级预防提出展望。With the progress of social civilization, the Westernization of lifestyle and the aging of population, the incidence of diabetes is increasing. Therefore, the prevention and treatment of diabetes is essential. China’s recently proposed management of chronic diseases, the gateway to move forward, prevention of subsidence, the tertiary prevention of diabetes has also attracted increasing attention. For patients with type 2 diabetes, the tertiary prevention objectives are made according to the natural course of development: primary prevention is to reduce the incidence of the control of risk factors, the incidence of type 2 diabetes, suspension. Second grade prevention is progress by improving insulin resistance and preventing the damage of patients with pancreatic beta cells, and the incidence of various complications of diabetes. Third prevention is the protection of patients remaining islet beta cells, strengthen blood glucose control and control complications, reduce overall mortality. This article summarizes the clinical research evidence of the tertiary prevention of type 2 diabetes from the perspective of evidence-based medicine, combined with the experience of our own medical team. It provides the theoretical basis for the rationality and feasibility of diabetes prevention and management, and puts forward the prospect of the tertiary prevention of diabetes

The Effect of Fertilizer on Seed Production of \u3cem\u3eMelilotoides ruthenica\u3c/em\u3e

M. ruthenica is very important legume forage, which has drought resistance, winter-hardness and high protein characteristics, and is thus adaptable wide environmental range, but low seed yield limited its widely extension and utilization. Fertilizer is the necessary nutrition for plant growth and production, Alfalfa production positively correlated with soil content of P and K (Attoe and Troug, 1950), and its seed yield can be increased 20.87%～31.37% by splashing B and Mo during the florescence (Haby and Keonaro, 1998). This study discussed the effect of fertilizer of N, P, K and microelements Mo, B, Cu, Zn on the seed production of M. ruthenic

catena-Poly[[silver(I)-μ-4,4′-bipyridine-κ2 N:N′] 4-[2-(4-carb­oxy­phen­yl)-1,1,1,3,3,3-hexa­fluoro­propan-2-yl]benzoate]

Assembly of the flexible dicarb­oxy­lic ligand 4-[2-(4-carboxyphenyl)-1,1,1,3,3,3-hexafluoropropan-2-yl]benzoate and 4,4′-bipyridine as co-ligand with AgI ions resulted in the formation of the polymeric title compound, {[Ag(C10H8N2)](C17H9F6O4)}n, in which the metal atoms are bridged by the 4,4′-bipyridine ligands, generating cationic chains extending along [010]. The dihedral angles between the benzene rings in the anion and the pyridine rings in the cation are 72.42 (9) and 9.36 (10)°, respectively. The mol­ecular conformation of the anion is stabilized by intra­molecular C—H⋯F hydrogen bonds. In the crystal, the anions inter­act with the cationic chains via C—H⋯O hydrogen bonds, forming layers parallel to (001), in which weak π–π stacking inter­actions [centroid–centroid distances = 3.975 (3)–4.047 (3) Å] involving the pyridine rings of adjacent 4,4′-bipyridine ligands are present. The planes are further assembled into a three-dimensional network by O—H⋯O hydrogen bonds

Ecological Balance of Oral Microbiota is Required to Maintain Oral Mesenchymal Stem Cell Homeostasis

Oral microbiome is essential for maintenance of oral cavity health. Imbalanced oral microbiome causes periodontal and other diseases. It is unknown whether oral microbiome affect oral stem cells function. In this study, we used a common clinical anti-biotic treatment approach to alter oral microbiome ecology and examine whether oral mesenchymal stem cells (MSCs) are affected. We found that altered oral microbiome resulted gingival MSCs deficiency, leading to a delayed wound healing in male mice. Mechanistically, oral microbiome release LPS that stimulates the expression of microRNA-21 (miR-21) and then impair the normal function of gingival MSCs and wound healing process through miR-21/Sp1/TERT pathway. This is the first study indicate that interplay between oral microbiome and MSCs homeostasis in male mice

BCL9 enhances the development of cervical carcinoma by deactivating CPEB3/EGFR axis

Purpose: To investigate the differential expression of BCL9 in cervical carcinoma samples, analyze its biological functions in regulating malignant phenotypes of cervical carcinoma cells, and to explore its potential molecular mechanism.Methods: Expression levels of BCL9 in 58 pairs of cervical carcinoma tissues and paracancerous tissues were determined using quantitative real time-polymerase chain reaction (qRT-PCR). Kaplan- Meier curves were used to analyze the prognostic potential of BCL9 in cervical carcinoma. After knockdown using BCL9 by lentivirus transfection, proliferative and migratory changes in Siha and HeLa cells were determined by CCK-8, colony formation and Transwell assays. Cytoplasmic polyadenylation element binding protein 3 (CPEB3), the potential downstream target of BCL9, was confirmed via dualluciferase reporter assay. Western blot analyses were conducted to determine the protein levels of CPEB3, EGFR, AKT and p21 in Siha and HeLa cells with BCL9 knockdown. The co-regulation of BCL9 and CPEB3 on phenotypes of cervical carcinoma cell was investigated.Results: BCL9 was upregulated in cervical carcinoma tissues. The high level of BCL9 was predicted by the tumor size, advanced stage and poor prognosis. The knockdown of BCL9 significantly weakened proliferative and migratory abilities of Siha and HeLa cells (p < 0.05). CPEB3 was the downstream target of BCL9, and was lowly expressed in cervical carcinoma tissues. The knockdown of BCL9 upregulated CPEB3, and downregulated EGFR, AKT and p21 (p < 0.05). The knockdown of CPEB3 also reversed the influence of silenced BCL9 in regulating its proliferative and migratory abilities in cervical carcinoma cells (p < 0.05).Conclusion: BCL9 drives the deterioration of cervical carcinoma by inhibiting the CPEB3/EGFR axis.Thus, BCL9 may be a novel molecular target for cervical carcinoma treatment

Chemical differences among collapsing low-mass protostellar cores

Organic features lead to two distinct types of Class 0/I low-mass protostars: hot corino sources, and warm carbon-chain chemistry (WCCC) sources. Some observations suggest that the chemical variations between WCCC sources and hot corino sources are associated with local environments, as well as the luminosity of protostars. We conducted gas-grain chemical simulation in collapsing protostellar cores, and found that the fiducial model predicts abundant carbon-chain molecules and COMs, and reproduces WCCC and hot corino chemistry in the hybrid source L483. By changing values of some physical parameters, including the visual extinction of ambient clouds ($A_{\rm V}^{\rm amb}$), the cosmic-ray ionization rate ($\zeta$), the maximum temperature during the warm-up phase ($T_{\rm max}$), and the contraction timescale of protostars ($t_{\rm cont}$), we found that UV photons and cosmic rays can boost WCCC features by accelerating the dissociation of CO and CH$_4$ molecules. On the other hand, UV photons can weaken the hot corino chemistry by photodissociation reactions, while the dependence of hot corino chemistry on cosmic rays is relatively complex. The $T_{\rm max}$ does not affect WCCC features, while it can influence hot corino chemistry by changing the effective duration of two-body surface reactions for most COMs. The long $t_{\rm cont}$ can boost WCCC and hot corino chemistry, by prolonging the effective duration of WCCC reactions in the gas phase and surface formation reactions for COMs, respectively. Subsequently, we ran a model with different physical parameters to reproduce scarce COMs in prototypical WCCC sources. The scarcity of COMs in prototypical WCCC sources can be explained by insufficient dust temperature in the inner envelopes to activate hot corino chemistry. Meanwhile, the High $\zeta$ and the long $t_{\rm cont}$ favors the explanation for scarce COMs in these sources.Comment: Accepted for publication in A&A, 18 pages, 10 figure