Lenient multi-agent deep reinforcement learning

Much of the success of single agent deep reinforcement learning (DRL) in recent years can be attributed to the use of experience replay memories (ERM), which allow Deep Q-Networks (DQNs) to be trained efficiently through sampling stored state transitions. However, care is required when using ERMs for multi-agent deep reinforcement learning (MA-DRL), as stored transitions can become outdated because agents update their policies in parallel [11]. In this work we apply leniency [23] to MA-DRL. Lenient agents map state-action pairs to decaying temperature values that control the amount of leniency applied towards negative policy updates that are sampled from the ERM. This introduces optimism in the value-function update, and has been shown to facilitate cooperation in tabular fully-cooperative multi-agent reinforcement learning problems. We evaluate our Lenient-DQN (LDQN) empirically against the related Hysteretic-DQN (HDQN) algorithm [22] as well as a modified version we call scheduled-HDQN, that uses average reward learning near terminal states. Evaluations take place in extended variations of the Coordinated Multi-Agent Object Transportation Problem (CMOTP) [8] which include fully-cooperative sub-tasks and stochastic rewards. We find that LDQN agents are more likely to converge to the optimal policy in a stochastic reward CMOTP compared to standard and scheduled-HDQN agents

Ambiguous figures and the content of experience

Representationalism is the position that the phenomenal character of an experience is either identical with, or supervenes on, the content of that experience. Many representationalists hold that the relevant content of experience is nonconceptual. I propose a counterexample to this form of representationalism that arises from the phenomenon of Gestalt switching, which occurs when viewing ambiguous figures. First, I argue that one does not need to appeal to the conceptual content of experience or to judgements to account for Gestalt switching. I then argue that experiences of certain ambiguous figures are problematic because they have different phenomenal characters but that no difference in the nonconceptual content of these experiences can be identified. I consider three solutions to this problem that have been proposed by both philosophers and psychologists and conclude that none can account for all the ambiguous figures that pose the problem. I conclude that the onus is on representationalists to specify the relevant difference in content or to abandon their position

Neutrino Propagation In Color Superconducting Quark Matter

We calculate the neutrino mean free path in color superconducting quark matter, and employ it to study the cooling of matter via neutrino diffusion in the superconducting phase as compared to a free quark phase. The cooling process slows when quark matter undergoes a second order phase transition to a superconducting phase at the critical temperature $T_c$. Cooling subsequently accelerates as the temperature decreases below $T_c$. This will directly impact the early evolution of a newly born neutron star should its core contain quark matter. Consequently, there may be observable changes in the early neutrino emission which would provide evidence for superconductivity in hot and dense matter.Comment: 12 pages, 5 figure

Spinons in a Crossed-Chains Model of a 2D Spin Liquid

Using Random Phase Approximation, we show that a crossed-chains model of a spin-1/2 Heisenberg spins, with frustrated interchain couplings, has a non-dimerized spin-liquid ground state in 2D, with deconfined spinons as the elementary excitations. The results are confirmed by a bosonization study, which shows that the system is an example of a `sliding Luttinger liquid'. In an external field, the system develops an incommensurate field-induced long range order with a finite transition temperature.Comment: 4 pages, 3 figures; added references; scaling analysis, preserving spin rotational invariance, is extended to finite temperatur

Status of Muon Collider Research and Development and Future Plans

The status of the research on muon colliders is discussed and plans are outlined for future theoretical and experimental studies. Besides continued work on the parameters of a 3-4 and 0.5 TeV center-of-mass (CoM) energy collider, many studies are now concentrating on a machine near 0.1 TeV (CoM) that could be a factory for the s-channel production of Higgs particles. We discuss the research on the various components in such muon colliders, starting from the proton accelerator needed to generate pions from a heavy-Z target and proceeding through the phase rotation and decay ($\pi \to \mu \nu_{\mu}$) channel, muon cooling, acceleration, storage in a collider ring and the collider detector. We also present theoretical and experimental R & D plans for the next several years that should lead to a better understanding of the design and feasibility issues for all of the components. This report is an update of the progress on the R & D since the Feasibility Study of Muon Colliders presented at the Snowmass'96 Workshop [R. B. Palmer, A. Sessler and A. Tollestrup, Proceedings of the 1996 DPF/DPB Summer Study on High-Energy Physics (Stanford Linear Accelerator Center, Menlo Park, CA, 1997)].Comment: 95 pages, 75 figures. Submitted to Physical Review Special Topics, Accelerators and Beam

Aesthetic response to color combinations: preference, harmony, and similarity

Previous studies of preference for and harmony of color combinations have produced confusing results. For example, some claim that harmony increases with hue similarity, whereas others claim that it decreases. We argue that such confusions are resolved by distinguishing among three types of judgments about color pairs: (1) preference for the pair as a whole, (2) harmony of the pair as a whole, and (3) preference for its figural color when viewed against its colored background. Empirical support for this distinction shows that pair preference and harmony both increase as hue similarity increases, but preference relies more strongly on component color preference and lightness contrast. Although pairs with highly contrastive hues are generally judged to be neither preferable nor harmonious, figural color preference ratings increase as hue contrast with the background increases. The present results thus refine and clarify some of the best-known and most contentious claims of color theorists

Climate model biases in jet streams, blocking and storm tracks resulting from missing orographic drag

State-of-the art climate models generally struggle to represent important features of the large-scale circulation. Common model deficiencies include an equatorward bias in the location of the midlatitude westerlies and an overly zonal orientation of the North Atlantic storm track. Orography is known to strongly affect the atmospheric circulation and is notoriously difficult to represent in coarse-resolution climate models. Yet how the representation of orography affects circulation biases in current climate models is not understood. Here we show that the effects of switching off the parameterization of drag from low-level orographic blocking in one climate model resemble the biases of the Coupled Model Intercomparison Project Phase 5 ensemble: An overly zonal wintertime North Atlantic storm track and less European blocking events, and an equatorward shift in the Southern Hemispheric jet and increase in the Southern Annular Mode time scale. This suggests that typical circulation biases in coarse-resolution climate models may be alleviated by improved parameterizations of low-level drag

The Framework for Assessing Changes To Sea-level (FACTS) v1.0: a platform for characterizing parametric and structural uncertainty in future global, relative, and extreme sea-level change

Future sea-level rise projections are characterized by both quantifiable uncertainty and unquantifiable structural uncertainty. Thorough scientific assessment of sea-level rise projections requires analysis of both dimensions of uncertainty. Probabilistic sea-level rise projections evaluate the quantifiable dimension of uncertainty; comparison of alternative probabilistic methods provides an indication of structural uncertainty. Here we describe the Framework for Assessing Changes To Sea-level (FACTS), a modular platform for characterizing different probability distributions for the drivers of sea-level change and their consequences for global mean, regional, and extreme sea-level change. We demonstrate its application by generating seven alternative probability distributions under multiple emissions scenarios for both future global mean sea-level change and future relative and extreme sea-level change at New York City. These distributions, closely aligned with those presented in the Intergovernmental Panel on Climate Change Sixth Assessment Report, emphasize the role of the Antarctic and Greenland ice sheets as drivers of structural uncertainty in sea-level change projections.</p

Holographic Vitrification

We establish the existence of stable and metastable stationary black hole bound states at finite temperature and chemical potentials in global and planar four-dimensional asymptotically anti-de Sitter space. We determine a number of features of their holographic duals and argue they represent structural glasses. We map out their thermodynamic landscape in the probe approximation, and show their relaxation dynamics exhibits logarithmic aging, with aging rates determined by the distribution of barriers.Comment: 100 pages, 25 figure

The evolution of 21st century sea-level projections from IPCC AR5 to AR6 and beyond

Sea-level science has seen many recent developments in observations and modelling of the different contributions and the total mean sea-level change. In this overview, we discuss (1) the evolution of the Intergovernmental Panel on Climate Change (IPCC) projections, (2) how the projections compare to observations and (3) the outlook for further improving projections. We start by discussing how the model projections of 21st century sea-level change have changed from the IPCC AR5 report (2013) to SROCC (2019) and AR6 (2021), highlighting similarities and differences in the methodologies and comparing the global mean and regional projections. This shows that there is good agreement in the median values, but also highlights some differences. In addition, we discuss how the different reports included high-end projections. We then show how the AR5 projections (from 2007 onwards) compare against the observations and find that they are highly consistent with each other. Finally, we discuss how to further improve sea-level projections using high-resolution ocean modelling and recent vertical land motion estimates