GLIDE-RL: Grounded Language Instruction through DEmonstration in RL

One of the final frontiers in the development of complex human - AI collaborative systems is the ability of AI agents to comprehend the natural language and perform tasks accordingly. However, training efficient Reinforcement Learning (RL) agents grounded in natural language has been a long-standing challenge due to the complexity and ambiguity of the language and sparsity of the rewards, among other factors. Several advances in reinforcement learning, curriculum learning, continual learning, language models have independently contributed to effective training of grounded agents in various environments. Leveraging these developments, we present a novel algorithm, Grounded Language Instruction through DEmonstration in RL (GLIDE-RL) that introduces a teacher-instructor-student curriculum learning framework for training an RL agent capable of following natural language instructions that can generalize to previously unseen language instructions. In this multi-agent framework, the teacher and the student agents learn simultaneously based on the student's current skill level. We further demonstrate the necessity for training the student agent with not just one, but multiple teacher agents. Experiments on a complex sparse reward environment validates the effectiveness of our proposed approach.Comment: 12 pages, 6 figures, to be presented at AAMAS 202

Asymmetric Squares as Standing Waves in Rayleigh-Benard Convection

Possibility of asymmetric square convection is investigated numerically using a few mode Lorenz-like model for thermal convection in Boussinesq fluids confined between two stress free and conducting flat boundaries. For relatively large value of Rayleigh number, the stationary rolls become unstable and asymmetric squares appear as standing waves at the onset of secondary instability. Asymmetric squares, two dimensional rolls and again asymmetric squares with their corners shifted by half a wavelength form a stable limit cycle.Comment: 8 pages, 7 figure

Symptoms of anxiety and depression in school-aged children with active epilepsy: A population-based study

Children (5-15 years) with active epilepsy were screened using the parent-report (n=69) and self-report (n=48) versions of the Spence Children's Anxiety Scale (SCAS) and the self-report version of the Children's Depression Inventory (CDI) (n=48) in a population-based sample. A total of 32.2% of children (self-report) and 15.2% of children (parent-report) scored ≥1 SD above the mean on the SCAS total score. The subscales where most difficulty were reported on parent-report were Physical Injury and Separation Anxiety. There was less variation on self-report. On the CDI, 20.9% of young people scored ≥1 SD above the mean. Children reported significantly more symptoms of anxiety on the SCAS total score and three of the subscales (p<.05). There was a significant effect on the SCAS total score of respondents by seizure type interaction, suggesting higher scores on SCAS for children with generalized seizures on self- but not parent-report. Higher CDI scores were significantly associated with generalized seizures (p>.05).Symptoms of anxiety were more common based on self-report compared with parent-report. Children with generalized seizures reported more symptoms of depression and anxiety

Super-reflection of light from a random amplifying medium with disorder in the complex refractive index : Statistics of fluctuations

The probability distribution of the reflection coefficient for light reflected from a one-dimensional random amplifying medium with {\it cross-correlated} spatial disorder in the real and the imaginary parts of the refractive index is derived using the method of invariant imbedding. The statistics of fluctuations have been obtained for both the correlated telegraph noise and the Gaussian white-noise models for the disorder. In both cases, an enhanced backscattering (super-reflection with reflection coefficient greater than unity) results because of coherent feedback due to Anderson localization and coherent amplification in the medium. The results show that the effect of randomness in the imaginary part of the refractive index on localization and super-reflection is qualitatively different.Comment: RevTex 6 pages, 3 figures in ps file

Towards the Formalization of Fractional Calculus in Higher-Order Logic

Fractional calculus is a generalization of classical theories of integration and differentiation to arbitrary order (i.e., real or complex numbers). In the last two decades, this new mathematical modeling approach has been widely used to analyze a wide class of physical systems in various fields of science and engineering. In this paper, we describe an ongoing project which aims at formalizing the basic theories of fractional calculus in the HOL Light theorem prover. Mainly, we present the motivation and application of such formalization efforts, a roadmap to achieve our goals, current status of the project and future milestones.Comment: 9 page

Relativistic spine jets from Schwarzschild black holes: "Application to AGN radioloud sources"

The two types of Fanaroff-Riley radio loud galaxies, FRI and FRII, exhibit strong jets but with different properties. These differences may be associated to the central engine and/or the external medium. Aims: The AGN classification FRI and FRII can be linked to the rate of electromagnetic Poynting flux extraction from the inner corona of the central engine by the jet. The collimation results from the distribution of the total electromagnetic energy across the jet, as compared to the corresponding distribution of the thermal and gravitational energies. We use exact solutions of the fully relativistic magnetohydrodynamical (GRMHD) equations obtained by a nonlinear separation of the variables to study outflows from a Schwarzschild black hole corona. A strong correlation is found between the jet features and the energetic distribution of the plasma of the inner corona which may be related to the efficiency of the magnetic rotator. It is shown that observations of FRI and FRII jets may be partially constrained by our model for spine jets. The deceleration observed in FRI jets may be associated with a low magnetic efficiency of the central magnetic rotator and an important thermal confinement by the hot surrounding medium. Conversely, the strongly collimated and accelerated FRII outflows may be self collimated by their own magnetic field because of the high efficiency of the central magnetic rotator.Comment: Accepted for publication in the A&

Quasiperiodic waves at the onset of zero Prandtl number convection with rotation

We show the possibility of quasiperiodic waves at the onset of thermal convection in a thin horizontal layer of slowly rotating zero-Prandtl number Boussinesq fluid confined between stress-free conducting boundaries. Two independent frequencies emerge due to an interaction between a stationary instability and a self-tuned wavy instability in presence of coriolis force, if Taylor number is raised above a critical value. Constructing a dynamical system for the hydrodynamical problem, the competition between the interacting instabilities is analyzed. The forward bifurcation from the conductive state is self-tuned.Comment: 9 pages of text (LaTex), 5 figures (Jpeg format

Luminescent and paramagnetic properties of nanoparticles shed light on their interactions with proteins

Nanoparticles have been recognized as promising tools for targeted drug-delivery and protein therapeutics. However, the mechanisms of protein-nanoparticle interaction and the dynamics underlying the binding process are poorly understood. Here, we present a general methodology for the characterization of protein-nanoparticle interaction on a molecular level. To this end we combined biophysical techniques including nuclear magnetic resonance (NMR), circular dichroism (CD), resonance energy transfer (RET) and surface plasmon resonance (SPR). Particularly, we analyzed molecular mechanisms and dynamics of the interaction of CaF2nanoparticles with the prototypical calcium sensor calmodulin (CaM). We observed the transient formation of an intermediate encounter complex involving the structural region linking the two domains. Specific interaction of CaM with CaF2NPs is driven by the N-terminal EF-hands, which seem to recognize Ca2+on the surface of the nanoparticle. We conclude that CaF2NP-CaM interaction is fully compatible with potential applications in nanomedicine. Overall, the methods presented in this work can be extended to other systems and may be useful to quantitatively characterize structural and dynamic features of protein-NP interactions with important implications for nanomedicine and nano-biotechnology

Peroxiredoxin II Regulates Effector and Secondary Memory CD8+ T cell Responses

Reactive oxygen intermediates (ROI) generated in response to receptor stimulation play an important role in cellular responses. However, the effect of increased H2O2on an antigen-specific CD8+ T cell response was unknown. Following T cell receptor (TCR) stimulation, the expression and oxidation of peroxiredoxin II (PrdxII), a critical antioxidant enzyme, increased in CD8+ T cells. Deletion of PrdxII increased ROI, S phase entry, division, and death during in vitro division. During primary acute viral and bacterial infection, the number of effector CD8+ T cells in PrdxII-deficient mice was increased, while the number of memory cells were similar to those of the wild-type cells. Adoptive transfer of P14 TCR transgenic cells demonstrated that the increased expansion of effector cells was T cell autonomous. After rechallenge, effector CD8+ T cells in mutant animals were more skewed to memory phenotype than cells from wild-type mice, resulting in a larger secondary memory CD8+ T cell pool. During chronic viral infection, increased antigen-specific CD8+ T cells accumulated in the spleens of PrdxII mutant mice, causing mortality. These results demonstrate that PrdxII controls effector CD8+ T cell expansion, secondary memory generation, and immunopathology