Reinforcement Learning Approach for Multi-Agent Flexible Scheduling Problems

Scheduling plays an important role in automated production. Its impact can be found in various fields such as the manufacturing industry, the service industry and the technology industry. A scheduling problem (NP-hard) is a task of finding a sequence of job assignments on a given set of machines with the goal of optimizing the objective defined. Methods such as Operation Research, Dispatching Rules, and Combinatorial Optimization have been applied to scheduling problems but no solution guarantees to find the optimal solution. The recent development of Reinforcement Learning has shown success in sequential decision-making problems. This research presents a Reinforcement Learning approach for scheduling problems. In particular, this study delivers an OpenAI gym environment with search-space reduction for Job Shop Scheduling Problems and provides a heuristic-guided Q-Learning solution with state-of-the-art performance for Multi-agent Flexible Job Shop Problems

Pressure measurement based on multi-waves fusion algorithm

Measuring the pressure of a pressure vessel accurately is one of fundamental requirements of the operation of many complex engineering systems. Ultrasonic technique has been proposed to be a good alteration of non-intrusive measurement. Based on the study of acoustoelastic effect and thin-shell theory, it has been identified that the travel-time changes of the critically refracted longitudinal wave (LCR wave) and other reflected longitudinal waves are all proportional to the inner pressure. Considering the information redundancy in these waves, we proposed an approach for pressure measurement by using the information fusion algorithm on multiple reflected longitudinal waves. In the paper, we discussed the fusion algorithm in details and proposed a pressure measurement model, which represents an accurate relationship between the pressure and the travel-time changes of multiple waves. Through the experiment, the analysis of data collected from experiment system showed that the pressure measurement based on the multi-wave model is notably more accurate than the one based on the single-wave model (the average relative error (ARE) can be less than 7.24% and the root-mean-square error (RMSE) can be lower than 0.3MPa)

Engineered external guide sequences are highly effective in inducing RNase P for inhibition of gene expression and replication of human cytomegalovirus

External guide sequences (EGSs), which are RNA molecules derived from natural tRNAs, bind to a target mRNA and render the mRNA susceptible to hydrolysis by RNase P, a tRNA processing enzyme. Using an in vitro selection procedure, we have previously generated EGS variants that efficiently direct human RNase P to cleave a target mRNA in vitro. In this study, a variant was used to target the overlapping region of the mRNAs encoding human cytomegalovirus (HCMV) essential transcription regulatory factors IE1 and IE2. The EGS variant was ∼25-fold more active in inducing human RNase P to cleave the mRNA in vitro than the EGS derived from a natural tRNA. Moreover, a reduction of 93% in IE1/IE2 gene expression and a reduction of 3000-fold in viral growth were observed in HCMV-infected cells that expressed the variant, while cells expressing the tRNA-derived EGS exhibited a reduction of 80% in IE1/IE2 expression and an inhibition of 150-fold in viral growth. Our results provide the first direct evidence that EGS variant is highly effective in blocking HCMV gene expression and growth and furthermore, demonstrate the feasibility of developing effective EGS RNA variants for anti-HCMV applications by using in vitro selection procedures

Di-μ-chlorido-bis­({9-[(2,6-diisopropyl­phen­yl)imino­meth­yl]anthracen-1-yl}palladium(II))

The centrosymmetric title compound, [Pd2Cl2(C27H26N)2], was obtained by a C—H bond-activation reaction of a Schiff base ligand with Li2PdCl4 in methanol, and was crystallized from dichloro­methane as orange crystals. The Pd atom displays a slightly distorted square-planar geometry, with the N- and C-atom donors in a cis arrangement

Self‐Assembly Mechanism of Spiky Magnetoplasmonic Supraparticles

Peer Reviewedhttp://deepblue.lib.umich.edu/bitstream/2027.42/106774/1/adfm201302405.pdfhttp://deepblue.lib.umich.edu/bitstream/2027.42/106774/2/adfm201302405-sup-0001-S1.pd

Effective inhibition of HCMV UL49 gene expression and viral replication by oligonucleotide external guide sequences and RNase P

Abstract Background Human cytomegalovirus (HCMV) is a ubiquitous herpesvirus that typically causes asymptomatic infections in healthy individuals but may lead to serious complications in newborns and immunodeficient individuals. The emergence of drug-resistant strains of HCMV has posed a need for the development of new drugs and treatment strategies. Antisense molecules are promising gene-targeting agents for specific regulation of gene expression. External guide sequences (EGSs) are oligonucleotides that consist of a sequence complementary to a target mRNA and recruit intracellular RNase P for specific degradation of the target RNA. The UL49-deletion BAC of HCMV was significantly defective in growth in human foreskin fibroblasts. Therefore, UL49 gene may serve as a potential target for novel drug development to combat HCMV infection. In this study, DNA-based EGS molecules were synthesized to target the UL49 mRNA of human cytomegalovirus (HCMV). Results By cleavage activity assessing in vitro, the EGS aimed to the cleavage site 324 nt downstream from the translational initiation codon of UL49 mRNA (i.e. EGS324) was confirmed be efficient to direct human RNase P to cleave the target mRNA sequence. When EGS324 was exogenously administered into HCMV-infected human foreskin fibroblasts (HFFs), a significant reduction of ~76% in the mRNA and ~80% in the protein expression of UL49 gene, comparing with the cells transfected with control EGSs. Furthermore, a reduction of about 330-fold in HCMV growth were observed in HCMV-infected HFFs treated with the EGS. Conclusions These results indicated that UL49 gene was essential for replication of HCMV. Moreover, our study provides evidence that exogenous administration of a DNA-based EGS can be used as a potential therapeutic approach for inhibiting gene expression and replication of a human virus.</p

Interparental conflict and infants’ behavior problems: The mediating role of maternal sensitivity

Although the negative effect of interparental conflict on child behavior problems has been well established, few studies have examined this association during infancy. This study examined the associations between mother-reported interparental conflict and young children’s behavior problems over the first 2 years of their lives in a sample of 212 mothers and infants. Two aspects of maternal sensitivity, sensitivity during distressing and nondistressing contexts, were examined as possible mediators between interparental conflict and infants’ behavior problems. Results indicated that interparental conflict was associated directly with infants’ externalizing problems over time but was associated indirectly with infants’ internalizing problems over time via compromised maternal sensitivity within distressing contexts but not through maternal sensitivity within nondistressing contexts. No significant child gender differences were found. Such findings add to a limited body of research suggesting that the early interparental relationship context is relevant for infant adjustment. The salient mediating role of maternal sensitivity within distressing contexts provides important theoretical and practical insights for future studies