Reinforcement learning versus model predictive control on greenhouse climate control

The greenhouse system plays a crucial role to ensure an adequate supply of fresh food for the growing global population. However, maintaining an optimal growing climate within a greenhouse requires resources and operational costs. To achieve economical and sustainable crop growth, efficient climate control in greenhouse production is paramount. Model Predictive Control (MPC) and Reinforcement Learning (RL) are the two approaches representing model-based and learning-based control, respectively. Each one has its own way to formulate control problems, define control objectives, and seek for optimal control actions that provide sustainable crop growth. Although certain forms of MPC and RL have been applied to greenhouse climate control, limited research has comprehensively analyzed the connections, differences, advantages, and disadvantages between these two approaches, both mathematically and in terms of performance. Therefore, this paper aims to address this gap by: (1) introducing a novel RL approach that utilizes Deep Deterministic Policy Gradient (DDPG) for large and continuous state–action space environments; (2) formulating the MPC and RL approaches for greenhouse climate control within a unified framework; (3) exploring the mathematical connections and differences between MPC and RL; (4) conducting a simulation study to analyze and compare the performance of MPC and RL; (5) presenting and interpreting the comparative results to provide valuable insights for the application of these control approaches in different scenarios. By undertaking these objectives, this paper seeks to contribute to the understanding and advancement of both MPC and RL methods in greenhouse climate control, fostering more informed decision-making regarding their selection and implementation based on specific requirements and constraints.This work has been partially funded by the Sector Plan for Science and Technology established by the Dutch Ministry of Education, Culture and Science. It has also been partially funded by the Spanish State Research Agency (AEI) and the European Regional Development Fund (ERFD) through the project SaCoAV (ref. PID2020-114244RB-I00).Peer ReviewedPostprint (published version

Transesterification Kinetics of Jatropha Methyl Ester and Trimethylol propane for Biolubricant Synthesis Using Paphiaundulata Shell Waste

Indium tin oxide (ITO) thin films of 150 nm thickness were deposited on quartz glass substrates by RF sputtering technique, followed by thermal annealing treatment. In this technique, the samples have been annealed at different temperature, 300ᴼC, 400ᴼC, 500ᴼC respectively in Argon gas flow. Structural and surface morphological properties were analyzed by X-ray diffraction (XRD) and Atomic Force Microscopy (AFM) after annealing. The XRD showed a polycrystalline structure of ITO film with maximum peak intensity at 2θ= 30.54, orientation without any change in the cubic structure. Continuous and homogeneous films obtained by the AFM after annealing treatment. The visible spectrum from the spectrophotometer showed high transparency between 81% and 95% in the. Increasing the annealing temperature yields evenly distributed pyramidal peaks shaped particles with low roughness. Resistance of ITO thin film was significantly improved from 8.75 kΩ to 1.96 kΩ after 10 minute from 300ᴼC to 500ᴼC annealing temperatures respectively under Argon gas flow. ITO films physical properties would be well improved by this method which is highly suitable for cost effective photonic devices

Mass Cytometry profiling of the peripheral blood immunome in patients with psoriasis and psoriatic arthritis uncovers potential biomarkers related to disease progression

Cutaneous psoriasis (PsC) is an auto-immune disorder affecting 60 million people globally, among 30% of whom progress to psoriatic arthritis (PsA), a disease with poorly understood etiology, making diagnosis and treatment difficult. Indeed, a complete systemic immune profile of PsA has yet to be performed. In the study herein, we collected peripheral blood samples from patients with PsC, PsA with or without systemic therapy, and healthy controls (HC), and utilized mass cytometry by time of flight (CyTOF) to acquire immune cell profiles of major leukocyte subsets. We found that patients with PsC and/or PsA exhibited increased frequencies of intermediate (CD14+CD16+) and nonclassical (CD14-CD16+) monocytes as well as regulatory T cells. Separation of our heterogenous patient population revealed distinct immune profiles according to ethnicity and sex in patient groups. Analysis of homing markers revealed upregulation of CCR4, CCR7, and CXCR3 on Classical Monocytes and/or Naïve CD8+ T cells in PsC and/or PsA patients. Moreover, analysis of functional markers revealed upregulation of CD38, CD28, and CD25 on Tregs and EM CD4+ T cells in PsC and/or PsA patients. Unbiased machine learning algorithms (CITRUS) revealed upregulation of Classical Monocytes in PsC and PsA compared to HC patients. Lastly, CITRUS revealed upregulated Intermediate Monocytes in PsA compared to PsC patients, and upregulated Classical Monocytes in treated PsA compared to untreated PsA patients. Therefore, we provide a comprehensive profile of immune cell population frequencies and phenotypes in patients with PsC and PsA, highlighting Monocytes and Tregs as potential biomarkers for early diagnosis of PsA

MiR-23a Regulates Skin Langerhans Cell Phagocytosis and Inflammation-Induced Langerhans Cell Repopulation

Langerhans cells (LCs) are skin-resident macrophage that act similarly to dendritic cells for controlling adaptive immunity and immune tolerance in the skin, and they are key players in the development of numerous skin diseases. While TGF-β and related downstream signaling pathways are known to control numerous aspects of LC biology, little is known about the epigenetic signals that coordinate cell signaling during LC ontogeny, maintenance, and function. Our previous studies in a total miRNA deletion mouse model showed that miRNAs are critically involved in embryonic LC development and postnatal LC homeostasis; however, the specific miRNA(s) that regulate LCs remain unknown. miR-23a is the first member of the miR-23a-27a-24-2 cluster, a direct downstream target of PU.1 and TGF-b, which regulate the determination of myeloid versus lymphoid fates. Therefore, we used a myeloid-specific miR-23a deletion mouse model to explore whether and how miR-23a affects LC ontogeny and function in the skin. We observed the indispensable role of miR-23a in LC antigen uptake and inflammation-induced LC epidermal repopulation; however, embryonic LC development and postnatal homeostasis were not affected by cells lacking miR23a. Our results suggest that miR-23a controls LC phagocytosis by targeting molecules that regulate efferocytosis and endocytosis, whereas miR-23a promotes homeostasis in bone marrow-derived LCs that repopulate the skin after inflammatory insult by targeting Fas and Bcl-2 family proapoptotic molecules. Collectively, the context-dependent regulatory role of miR-23a in LCs represents an extra-epigenetic layer that incorporates TGF-b- and PU.1-mediated regulation during steady-state and inflammation-induced repopulation

A cross-sectional survey on mother-to-child transmission of HIV among the migrant population in Dongguan, China

IntroductionThe migrant population, consisting of individuals who relocate from rural to urban areas, faces unique challenges that heighten their vulnerability to HIV infection. These challenges stem from a combination of sociodemographic factors and limited access to healthcare services. Understanding the dynamics of HIV transmission within this population is crucial for the development of effective prevention strategies.MethodsTo investigate the factors contributing to HIV vulnerability among migrants, we conducted a cross-sectional study at Dongguan People's Hospital from January 1, 2018, to December 31, 2021. Our study focused on pregnant women living with HIV and their infants, with a particular emphasis on sociodemographic characteristics, HIV testing and treatment profiles, and neonatal clinical data. Data were systematically collected using standardized forms.ResultsAnalysis of data from 98 participants revealed noteworthy findings. No significant associations were observed between age, marital status, and educational background regarding HIV vulnerability. Similarly, factors such as the status of sexual partners, spousal therapy, and the number of children had no significant impact. However, our analysis highlighted the critical role of treatment strategies for HIV-positive women and the timing of antiretroviral therapy initiation for women with HIV, both of which were associated with HIV transmission (P < 0.05). Additionally, factors such as feeding type, neonatal antiretroviral prophylaxis, and preventive treatment strategies showed significant associations, while the preventive treatment program for neonates demonstrated no significant impact.DiscussionThese findings provide valuable insights into the specific risk factors and barriers to HIV prevention faced by the migrant population in Dongguan. They underscore the importance of targeted interventions and policies aimed at curtailing mother-to-child HIV transmission. By addressing the unique challenges experienced by migrant mothers and their infants, this study contributes significantly to broader efforts in controlling the spread of HIV, ultimately enhancing the health outcomes and well-being of Dongguan's migrant population. Furthermore, our research introduces a distinctive perspective within the extensively examined domain of Prevention of Mother-to-Child Transmission (PMTCT) programs, focusing on the internally migrant Chinese population, an understudied demographic group in this context. This study, conducted in Dongguan, China, represents one of the pioneering investigations into pregnant women with HIV and their infants within this migrant community

Magnetic-coupled electronic landscape in bilayer-distorted titanium-based kagome metals

Quantum materials whose atoms are arranged on a lattice of corner-sharing triangles, $\textit{i.e.}$, the kagome lattice, have recently emerged as a captivating platform for investigating exotic correlated and topological electronic phenomena. Here, we combine ultra-low temperature angle-resolved photoemission spectroscopy (ARPES) with scanning tunneling microscopy and density functional theory calculations to reveal the fascinating electronic structure of the bilayer-distorted kagome material $\textit{Ln}$Ti${_3}$Bi${_4}$, where $\textit{Ln}$ stands for Nd and Yb. Distinct from other kagome materials, $\textit{Ln}$Ti${_3}$Bi${_4}$ exhibits two-fold, rather than six-fold, symmetries, stemming from the distorted kagome lattice, which leads to a unique electronic structure. Combining experiment and theory we map out the electronic structure and discover double flat bands as well as multiple van Hove singularities (VHSs), with one VHS exhibiting higher-order characteristics near the Fermi level. Notably, in the magnetic version NdTi${_3}$Bi${_4}$, the ultra-low base temperature ARPES measurements unveil an unconventional band splitting in the band dispersions which is induced by the ferromagnetic ordering. These findings reveal the potential of bilayer-distorted kagome metals $\textit{Ln}$Ti${_3}$Bi${_4}$ as a promising platform for exploring novel emergent phases of matter at the intersection of strong correlation and magnetism

Integrative scATAC-seq and scRNA-seq analyses map thymic iNKT cell development and identify Cbfβ for its commitment

Unlike conventional αβT cells, invariant natural killer T (iNKT) cells complete their terminal differentiation to functional iNKT1/2/17 cells in the thymus. However, underlying molecular programs that guide iNKT subset differentiation remain unclear. Here, we profiled the transcriptomes of over 17,000 iNKT cells and the chromatin accessibility states of over 39,000 iNKT cells across four thymic iNKT developmental stages using single-cell RNA sequencing (scRNA-seq) and single-cell assay for transposase-accessible chromatin sequencing (scATAC-seq) to define their developmental trajectories. Our study discovered novel features for iNKT precursors and different iNKT subsets and indicated that iNKT2 and iNKT17 lineage commitment may occur as early as stage 0 (ST0) by two distinct programs, while iNKT1 commitments may occur post ST0. Both iNKT1 and iNKT2 cells exhibit extensive phenotypic and functional heterogeneity, while iNKT17 cells are relatively homogenous. Furthermore, we identified that a novel transcription factor, Cbfβ, was highly expressed in iNKT progenitor commitment checkpoint, which showed a similar expression trajectory with other known transcription factors for iNKT cells development, Zbtb16 and Egr2, and could direct iNKT cells fate and drive their effector phenotype differentiation. Conditional deletion of Cbfβ blocked early iNKT cell development and led to severe impairment of iNKT1/2/17 cell differentiation. Overall, our findings uncovered distinct iNKT developmental programs as well as their cellular heterogeneity, and identified a novel transcription factor Cbfβ as a key regulator for early iNKT cell commitment

Surface translocation of ACE2 and TMPRSS2 upon TLR4/7/8 activation is required for SARS-CoV-2 infection in circulating monocytes

Infection of human peripheral blood cells by SARS-CoV-2 has been debated because immune cells lack mRNA expression of both angiotensin-converting enzyme 2 (ACE2) and transmembrane serine protease type 2 (TMPRSS2). Herein we demonstrate that resting primary monocytes harbor abundant cytoplasmic ACE2 and TMPRSS2 protein and that circulating exosomes contain significant ACE2 protein. Upon ex vivo TLR4/7/8 stimulation, cytoplasmic ACE2 was quickly translocated to the monocyte cell surface independently of ACE2 transcription, while TMPRSS2 surface translocation occurred in conjunction with elevated mRNA expression. The rapid translocation of ACE2 to the monocyte cell surface was blocked by the endosomal trafficking inhibitor endosidin 2, suggesting that endosomal ACE2 could be derived from circulating ACE2-containing exosomes. TLR-stimulated monocytes concurrently expressing ACE2 and TMPRSS2 on the cell surface were efficiently infected by SARS-CoV-2, which was significantly mitigated by remdesivir, TMPRSS2 inhibitor camostat, and anti-ACE2 antibody. Mass cytometry showed that ACE2 surface translocation in peripheral myeloid cells from patients with severe COVID-19 correlated with its hyperactivation and PD-L1 expression. Collectively, TLR4/7/8-induced ACE2 translocation with TMPRSS2 expression makes circulating monocytes permissive to SARS-CoV-2 infection

Identification of actionable targets for breast cancer intervention using a diversity outbred mouse model

HER2-targeted therapy has improved breast cancer survival, but treatment resistance and disease prevention remain major challenges. Genes that enable HER2/Neu oncogenesis are the next intervention targets. A bioinformatics discovery platform of HER2/Neu-expressing Diversity Outbred (DO) F1 Mice was established to identify cancer-enabling genes. Quantitative Trait Loci (QTL) associated with onset ages and growth rates of spontaneous mammary tumors were sought. Twenty-six genes in 3 QTL contain sequence variations unique to the genetic backgrounds that are linked to aggressive tumors and 21 genes are associated with human breast cancer survival. Concurrent identification of TSC22D3, a transcription factor, and its target gene LILRB4, a myeloid cell checkpoint receptor, suggests an immune axis for regulation, or intervention, of disease. We also investigated TIEG1 gene that impedes tumor immunity but suppresses tumor growth. Although not an actionable target, TIEG1 study revealed genetic regulation of tumor progression, forming the basis of the genetics-based discovery platform