Reinforcement Learning by Guided Safe Exploration

Safety is critical to broadening the application of reinforcement learning (RL). Often, we train RL agents in a controlled environment, such as a laboratory, before deploying them in the real world. However, the real-world target task might be unknown prior to deployment. Reward-free RL trains an agent without the reward to adapt quickly once the reward is revealed. We consider the constrained reward-free setting, where an agent (the guide) learns to explore safely without the reward signal. This agent is trained in a controlled environment, which allows unsafe interactions and still provides the safety signal. After the target task is revealed, safety violations are not allowed anymore. Thus, the guide is leveraged to compose a safe behaviour policy. Drawing from transfer learning, we also regularize a target policy (the student) towards the guide while the student is unreliable and gradually eliminate the influence of the guide as training progresses. The empirical analysis shows that this method can achieve safe transfer learning and helps the student solve the target task faster.Comment: Accecpted at ECAI 202

Can lightning be a noise source for a spherical gravitational wave antenna?

The detection of gravitational waves is a very active research field at the moment. In Brazil the gravitational wave detector is called Mario SCHENBERG. Due to its high sensitivity it is necessary to model mathematically all known noise sources so that digital filters can be developed that maximize the signal-to-noise ratio. One of the noise sources that must be considered are the disturbances caused by electromagnetic pulses due to lightning close to the experiment. Such disturbances may influence the vibrations of the antenna's normal modes and mask possible gravitational wave signals. In this work we model the interaction between lightning and SCHENBERG antenna and calculate the intensity of the noise due to a close lightning stroke in the detected signal. We find that the noise generated does not disturb the experiment significantly.Comment: 5 pages, 6 figure

Myocardial Work Brings New Insights into Left Ventricular Remodelling in Cardio-Oncology Patients

Serial transthoracic echocardiographic (TTE) assessment of 2D left ventricular ejection fraction (LVEF) and global longitudinal strain (GLS) are the gold standard screening methods for cancer therapeutics-related cardiac dysfunction (CTRCD). Non-invasive left ventricular (LV) pressure-strain loop (PSL) provides a novel method of quantifying myocardial work (MW) with potential advantages to evaluate the impact of cardiotoxic treatments on heart function. We prospectively assessed breast cancer female patients undergoing cancer therapy through serial monitoring by 2D and 3D TTE. Patients were evaluated at T0, T1 and T2 (before, 4-6 and 12-14 months after starting therapy, respectively). Through PSL analysis, MW indices were calculated. A total of 122 patients, with a mean age of 54.7 years, who received treatment with anthracyclines (77.0%) and anti-HER2 (75.4%) were included. During a mean follow-up of 14.9 ± 9.3 months, LVEF and GLS were significantly diminished, and 29.5% developed CTRCD. All MW indices were significantly reduced at T1 compared with baseline and tended to return to baseline values at T2. Global work index and global work efficiency showed a more pronounced variation in patients with CTRCD. The presence of more than one cardiovascular risk factor, obesity and baseline left atrium volume were predictors of changes in MW parameters. In conclusion, breast cancer treatment was associated with LV systolic dysfunction as assessed by MW, with its peak at 4-6 months and a partial recovery afterwards. Assessment of myocardial deformation parameters allows a more detailed characterization of cardiac remodelling and could enhance patient screening and selection for cardioprotective therapeutics.info:eu-repo/semantics/publishedVersio

Techonolgy of Qualea grandiflora Mart. (Vochysiaceae) seeds

Qualea grandiflora Mart. (Vochysiaceae), commonly known as "pau-terra", is an arborous species native to the Brazilian savannah which possess commercial interests, as it can be used either as an ornamental or as a medicinal plant. "Pau-terra" can also be used in the heterogeneous reforestation of areas which are destined for restoration of permanent preservation degraded areas. Propagation studies with this species are scarce, being necessary then further clarification regarding the factors that influences the germination process. In this context, the objective of this work was to evaluate the influence of different temperatures, substrates and light conditions on seed germination. We selected light brown seeds which were subjected to different interactions between temperatures (15-25, 20-30, 25 and 30°C), substrate (paper, sand and vermiculite) and light (light and dark). All seeds were later dry-incubated at 32°C for 3, 6 and 12 hours. After treatments, seeds were kept in BOD at 58% RH and the following parameters were calculated: germination (%G) and germination speed index (GSI); the formation of normal and abnormal seedlings and the number dead seeds. Interaction was observed for all variables. In the optimum temperature range, the seeds behaved as photoblastic neutral or indifferent. Under alternating temperatures, darkness enhanced the germination, especially when combined with the lower temperatures. We noted that the sowing in sand, at 25°C, allowed the maintenance of suitable combinations of germination and seedling development. With respect to desiccation tolerance, "pau-terra" seeds presented an orthodox behavior, with a linear increase of the vigor as function of drying

New FOCUS results on charm mixing and CP violation

We present a summary of recent results on CP violation and mixing in the charm quark sector based on a high statistics sample collected by photoproduction experiment FOCUS (E831 at Fermilab). We have measured the difference in lifetimes for the $D^0$ decays: $D^0 \to K^-\pi^+$ and $D^0 \to K^-K^+$. This translates into a measurement of the $y_{CP}$ mixing parameter in the \d0d0 system, under the assumptions that $K^-K^+$ is an equal mixture of CP odd and CP even eigenstates, and CP violation is negligible in the neutral charm meson system. We verified the latter assumption by searching for a CP violating asymmetry in the Cabibbo suppressed decay modes $D^+ \to K^-K^+\pi^+$, $D^0 \to K^-K^+$ and $D^0 \to \pi^-\pi^+$. We show preliminary results on a measurement of the branching ratio $\Gamma(D^{*+}\to \pi^+ (K^+\pi^-))/\Gamma(D^{*+}\to \pi^+ (K^-\pi^+))$.Comment: 9 pages, 6 figures, requires espcrc2.sty. Presented by S.Bianco at CPConf2000, September 2000, Ferrara (Italy). In this revision, fixed several stylistic flaws, add two significant references, fixed a typo in Tab.

A measurement of branching ratios of D+D^+ and Ds+D^+_s hadronic decays to four-body final states containing a KSK_S

We have studied hadronic four-body decays of $D^+$ and $D^+_s$ mesons with a $K_S$ in the final state using data recorded during the 1996-1997 fixed-target run at Fermilab high energy photoproduction experiment FOCUS. We report a new branching ratio measurement of $\Gamma(D^+\to K_S K^-\pi^+\pi^+)/\Gamma(D^+\to K_S \pi^+\pi^+\pi^-)=0.0768\pm0.0041\pm0.0032$. We make the first observation of three new decay modes with branching ratios $\Gamma(D^+\to K_S K^+\pi^+\pi^-)/\Gamma(D^+\to K_S \pi^+\pi^+\pi^-)=0.0562\pm0.0039\pm0.0040$, \Gamma(D^+\to\K_S K^+ K^-\pi^+)/\Gamma(D^+\to K_S \pi^+\pi^+\pi^-)=0.0077\pm0.0015\pm0.0009, and $\Gamma(D^+_s\to K_S K^+\pi^+\pi^-)/\Gamma(D^+_s\to K_S K^-\pi^+\pi^+)=0.586\pm0.052\pm0.043$, where in each case the first error is statistical and the second error is systematic.Comment: 4 pages, 1 table, 2 figures, submitted to Physical Review Letter