Extreme State Aggregation Beyond MDPs

We consider a Reinforcement Learning setup where an agent interacts with an environment in observation-reward-action cycles without any (esp.\ MDP) assumptions on the environment. State aggregation and more generally feature reinforcement learning is concerned with mapping histories/raw-states to reduced/aggregated states. The idea behind both is that the resulting reduced process (approximately) forms a small stationary finite-state MDP, which can then be efficiently solved or learnt. We considerably generalize existing aggregation results by showing that even if the reduced process is not an MDP, the (q-)value functions and (optimal) policies of an associated MDP with same state-space size solve the original problem, as long as the solution can approximately be represented as a function of the reduced states. This implies an upper bound on the required state space size that holds uniformly for all RL problems. It may also explain why RL algorithms designed for MDPs sometimes perform well beyond MDPs.Comment: 28 LaTeX pages. 8 Theorem

Observation of inverse Compton emission from a long γ-ray burst.

Long-duration γ-ray bursts (GRBs) originate from ultra-relativistic jets launched from the collapsing cores of dying massive stars. They are characterized by an initial phase of bright and highly variable radiation in the kiloelectronvolt-to-megaelectronvolt band, which is probably produced within the jet and lasts from milliseconds to minutes, known as the prompt emission1,2. Subsequently, the interaction of the jet with the surrounding medium generates shock waves that are responsible for the afterglow emission, which lasts from days to months and occurs over a broad energy range from the radio to the gigaelectronvolt bands1-6. The afterglow emission is generally well explained as synchrotron radiation emitted by electrons accelerated by the external shock7-9. Recently, intense long-lasting emission between 0.2 and 1 teraelectronvolts was observed from GRB 190114C10,11. Here we report multi-frequency observations of GRB 190114C, and study the evolution in time of the GRB emission across 17 orders of magnitude in energy, from 5 × 10-6 to 1012 electronvolts. We find that the broadband spectral energy distribution is double-peaked, with the teraelectronvolt emission constituting a distinct spectral component with power comparable to the synchrotron component. This component is associated with the afterglow and is satisfactorily explained by inverse Compton up-scattering of synchrotron photons by high-energy electrons. We find that the conditions required to account for the observed teraelectronvolt component are typical for GRBs, supporting the possibility that inverse Compton emission is commonly produced in GRBs

Observation of a sudden cessation of a very-high-energy gamma-ray flare in PKS 1510-089 with H.E.S.S. and MAGIC in May 2016

The flat spectrum radio quasar (FSRQ) PKS 1510-089 is known for its complex multiwavelength behavior, and is one of only a few FSRQs detected at very high energy (VHE, E >100 GeV) -rays. VHE -ray observations with H.E.S.S. and MAGIC during late May and early June 2016 resulted in the detection of an unprecedented flare, which reveals for the first time VHE -ray intranight variability in this source. While a common variability timescale of 1.5 hr is found, there is a significant deviation near the end of the flare with a timescale of ∼ 20 min marking the cessation of the event. The peak flux is nearly two orders of magnitude above the low-level emission. For the first time, curvature is detected in the VHE -ray spectrum of PKS 1510-089, which is fully explained through absorption by the extragalactic background light. Optical R-band observations with ATOM reveal a counterpart of the -ray flare, even though the detailed flux evolution differs from the VHE lightcurve. Interestingly, a steep flux decrease is observed at the same time as the cessation of the VHE flare. In the high energy (HE, E >100 MeV) -ray band only a moderate flux increase is observed with Fermi-LAT, while the HE -ray spectrum significantly hardens up to a photon index of 1.6. A search for broad-line region (BLR) absorption features in the -ray spectrum indicates that the emission region is located outside of the BLR. Radio VLBI observations reveal a fast moving knot interacting with a standing jet feature around the time of the flare. As the standing feature is located ∼ 50 pc from the black hole, the emission region of the flare may have been located at a significant distance from the black hole. If this correlation is indeed true, VHE rays have been produced far down the jet where turbulent plasma crosses a standing shock.Accepted manuscrip

Desempenho produtivo e atividade microbiana cecal de coelhos alimentados com dietas contendo diferentes níveis de amido Performance and cecal microbial activity of growing rabbits fed diets with different starch levels

Com o objetivo de avaliar a influência do amido dietético sobre o rendimento produtivo e a atividade microbiana cecal de coelhos em crescimento, quatro dietas experimentais foram elaboradas de forma a conter níveis crescentes de amido (23, 28, 33 e 38% de amido total na base da MS), os quais foram fornecidos a 32 coelhos da raça Nova Zelândia Branco, distribuídos em gaiolas de engorda individuais, seguindo um delineamento em blocos casualizados. Houve efeito linear decrescente para consumo e conversão alimentar, em que valores de 108,67 g/d e 3,216, respectivamente, foram obtidos para os animais alimentados com 38% de amido dietético. No entanto, o ganho de peso e o rendimento de carcaça não foram influenciados pelos tratamentos. Por outro lado, os valores de pH, as concentrações totais e as proporções molares dos ácidos graxos voláteis não foram influenciados pelos tratamentos, porém, para o ácido propiônico, houve efeito linear decrescente, sendo a maior proporção molar (12,06%) verificada no conteúdo cecal de coelhos alimentados com 23% de amido dietético. O milho-grão apresentou maior influência sobre a atividade microbiana cecal que o amido de milho purificado, porém, sem alterar o desempenho e rendimento de carcaça.<br>With the objective to evaluate the effect of dietary starch on the productive yield and cecal microbial activity for rabbits in the growing, four experimental diets were formulated to contain increasing corn starch levels (23, 28, 33 and 38 % total starch levels in dry matter basis). A total of 32 White New Zealand rabbits were allotted to finishing cages in a completely randomized block design. The results showed a decreasing linear effect for the feed intake and feed:gain ratio, where values of 108.67g/d and 3.216, respectively, were recorded for animals fed 38% dietary starch. However, no difference was observed for the weight gain and carcass yield. Regarding to cecal microbial activity, pH and volatile fatty acid production were not affected by the treatments, but the propionic acid concentration showed a decreasing linear effect, in such a way that higher molar proportion (12,06 %) was observed in the rabbits fed 23% dietary starch. The starch from corn grain showed higher effect on the cecal microbial activity that the purified corn starch, but did not change the performance and carcass yield

Multi-wavelength study of the galactic PeVatron candidate LHAASO J2108+5157

LHAASO J2108+5157 is one of the few known unidentified Ultra-High-Energy (UHE) gamma-ray sources with no Very-High-Energy (VHE) counterpart, recently discovered by the LHAASO collaboration. We observed LHAASO J2108+5157 in the X-ray band with XMM-Newton in 2021 for a total of 3.8 hours and at TeV energies with the Large-Sized Telescope prototype (LST-1), yielding 49 hours of good quality data. In addition, we analyzed 12 years of Fermi-LAT data, to better constrain emission of its High-Energy (HE) counterpart 4FGL J2108.0+5155. We found an excess (3.7 sigma) in the LST-1 data at energies E > 3 TeV. Further analysis in the whole LST-1 energy range assuming a point-like source, resulted in a hint (2.2 sigma) of hard emission which can be described with a single power law with photon index Gamma = 1.6 +- 0.2 between 0.3 - 100 TeV. We did not find any significant extended emission which could be related to a Supernova Remnant (SNR) or Pulsar Wind Nebula (PWN) in the XMM-Newton data, which puts strong constraints on possible synchrotron emission of relativistic electrons. The LST-1 and LHAASO observations can be explained as inverse Compton dominated leptonic emission of relativistic electrons with cutoff energy of 100+70-30 TeV. The low magnetic field in the source imposed by the X-ray upper limits on synchrotron emission is compatible with a hypothesis of a TeV halo. Furthermore, the spectral properties of the HE counterpart are consistent with a hypothesis of Geminga-like pulsar, which would be able to power the VHE-UHE emission. LST-1 and Fermi-LAT upper limits impose strong constraints on hadronic scenario of pi-0 decay dominated emission from accelerated protons interacting with nearby molecular clouds, requiring hard spectral index, which is incompatible with the standard diffusive acceleration scenario

Star tracking for pointing determination of Imaging Atmospheric Cherenkov Telescopes. Application to the Large-Sized Telescope of the Cherenkov Telescope Array

International audienc

Multi-wavelength study of the galactic PeVatron candidate LHAASO J2108+5157

LHAASO J2108+5157 is one of the few known unidentified Ultra-High-Energy (UHE) gamma-ray sources with no Very-High-Energy (VHE) counterpart, recently discovered by the LHAASO collaboration. We observed LHAASO J2108+5157 in the X-ray band with XMM-Newton in 2021 for a total of 3.8 hours and at TeV energies with the Large-Sized Telescope prototype (LST-1), yielding 49 hours of good quality data. In addition, we analyzed 12 years of Fermi-LAT data, to better constrain emission of its High-Energy (HE) counterpart 4FGL J2108.0+5155. We found an excess (3.7 sigma) in the LST-1 data at energies E > 3 TeV. Further analysis in the whole LST-1 energy range assuming a point-like source, resulted in a hint (2.2 sigma) of hard emission which can be described with a single power law with photon index Gamma = 1.6 +- 0.2 between 0.3 - 100 TeV. We did not find any significant extended emission which could be related to a Supernova Remnant (SNR) or Pulsar Wind Nebula (PWN) in the XMM-Newton data, which puts strong constraints on possible synchrotron emission of relativistic electrons. The LST-1 and LHAASO observations can be explained as inverse Compton dominated leptonic emission of relativistic electrons with cutoff energy of 100+70-30 TeV. The low magnetic field in the source imposed by the X-ray upper limits on synchrotron emission is compatible with a hypothesis of a TeV halo. Furthermore, the spectral properties of the HE counterpart are consistent with a hypothesis of Geminga-like pulsar, which would be able to power the VHE-UHE emission. LST-1 and Fermi-LAT upper limits impose strong constraints on hadronic scenario of pi-0 decay dominated emission from accelerated protons interacting with nearby molecular clouds, requiring hard spectral index, which is incompatible with the standard diffusive acceleration scenario