Probabilistic Inference for Fast Learning in Control

We provide a novel framework for very fast model-based reinforcement learning in continuous state and action spaces. The framework requires probabilistic models that explicitly characterize their levels of confidence. Within this framework, we use flexible, non-parametric models to describe the world based on previously collected experience. We demonstrate learning on the cart-pole problem in a setting where we provide very limited prior knowledge about the task. Learning progresses rapidly, and a good policy is found after only a hand-full of iterations

Metamorphosis and Taxonomy of Andreev Bound States

We analyze the spatial and energy dependence of the local density of states in a SNS junction. We model our system as a one-dimensional tight-binding chain which we solve exactly by numerical diagonalization. We calculate the dependence of the Andreev bound states on position, phase difference, gate voltage, and coupling with the superconducting leads. Our results confirm the physics predicted by certain analytical approximations, but reveal a much richer set of phenomena beyond the grasp of these approximations, such as the metamorphosis of the discrete states of the normal link (the normal bound states) into Andreev bound states as the leads become superconducting.Comment: 23 pages, 15 figure

FUV and X-ray absorption in the Warm-Hot Intergalactic Medium

The Warm-Hot Intergalactic Medium (WHIM) arises from shock-heated gas collapsing in large-scale filaments and probably harbours a substantial fraction of the baryons in the local Universe. Absorption-line measurements in the ultraviolet (UV) and in the X-ray band currently represent the best method to study the WHIM at low redshifts. We here describe the physical properties of the WHIM and the concepts behind WHIM absorption line measurements of H I and high ions such as O VI, O VII, and O VIII in the far-ultraviolet and X-ray band. We review results of recent WHIM absorption line studies carried out with UV and X-ray satellites such as FUSE, HST, Chandra, and XMM-Newton and discuss their implications for our knowledge of the WHIM.Comment: 26 pages, 9 figures, accepted for publication in Space Science Reviews, special issue "Clusters of galaxies: beyond the thermal view", Editor J.S. Kaastra, Chapter 3; work done by an international team at the International Space Science Institute (ISSI), Bern, organised by J.S. Kaastra, A.M. Bykov, S. Schindler & J.A.M. Bleeke

Animal models for COVID-19

Severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) is the aetiological agent of coronavirus disease 2019 (COVID-19), an emerging respiratory infection caused by the introduction of a novel coronavirus into humans late in 2019 (first detected in Hubei province, China). As of 18 September 2020, SARS-CoV-2 has spread to 215 countries, has infected more than 30 million people and has caused more than 950,000 deaths. As humans do not have pre-existing immunity to SARS-CoV-2, there is an urgent need to develop therapeutic agents and vaccines to mitigate the current pandemic and to prevent the re-emergence of COVID-19. In February 2020, the World Health Organization (WHO) assembled an international panel to develop animal models for COVID-19 to accelerate the testing of vaccines and therapeutic agents. Here we summarize the findings to date and provides relevant information for preclinical testing of vaccine candidates and therapeutic agents for COVID-19

The Southern Ocean Exchange: Porous boundaries between humpback whale breeding populations in southern polar waters

Humpback whales (Megaptera novaeangliae) are a cosmopolitan species and perform long annual migrations between low-latitude breeding areas and high-latitude feeding areas. Their breeding populations appear to be spatially and genetically segregated due to long-term, maternally inherited fidelity to natal breeding areas. In the Southern Hemisphere, some humpback whale breeding populations mix in Southern Ocean waters in summer, but very little movement between Pacific and Atlantic waters has been identified to date, suggesting these waters constituted an oceanic boundary between genetically distinct populations. Here, we present new evidence of summer co-occurrence in the West Antarctic Peninsula feeding area of two recovering humpback whale breeding populations from the Atlantic (Brazil) and Pacific (Central and South America). As humpback whale populations recover, observations like this point to the need to revise our perceptions of boundaries between stocks, particularly on high latitude feeding grounds. We suggest that this “Southern Ocean Exchange” may become more frequent as populations recover from commercial whaling and climate change modifies environmental dynamics and humpback whale prey availability

Baryons: What, When and Where?

We review the current state of empirical knowledge of the total budget of baryonic matter in the Universe as observed since the epoch of reionization. Our summary examines on three milestone redshifts since the reionization of H in the IGM, z = 3, 1, and 0, with emphasis on the endpoints. We review the observational techniques used to discover and characterize the phases of baryons. In the spirit of the meeting, the level is aimed at a diverse and non-expert audience and additional attention is given to describe how space missions expected to launch within the next decade will impact this scientific field.Comment: Proceedings Review for "Astrophysics in the Next Decade: JWST and Concurrent Facilities", ed. X. Tielens, 38 pages, 10 color figures. Revised to address comments from the communit