A two-armed bandit based scheme for accelerated decentralized learning

The two-armed bandit problem is a classical optimization problem where a decision maker sequentially pulls one of two arms attached to a gambling machine, with each pull resulting in a random reward. The reward distributions are unknown, and thus, one must balance between exploiting existing knowledge about the arms, and obtaining new information. Bandit problems are particularly fascinating because a large class of real world problems, including routing, QoS control, game playing, and resource allocation, can be solved in a decentralized manner when modeled as a system of interacting gambling machines. Although computationally intractable in many cases, Bayesian methods provide a standard for optimal decision making. This paper proposes a novel scheme for decentralized decision making based on the Goore Game in which each decision maker is inherently Bayesian in nature, yet avoids computational intractability by relying simply on updating the hyper parameters of sibling conjugate priors, and on random sampling from these posteriors. We further report theoretical results on the variance of the random rewards experienced by each individual decision maker. Based on these theoretical results, each decision maker is able to accelerate its own learning by taking advantage of the increasingly more reliable feedback that is obtained as exploration gradually turns into exploitation in bandit problem based learning. Extensive experiments demonstrate that the accelerated learning allows us to combine the benefits of conservative learning, which is high accuracy, with the benefits of hurried learning, which is fast convergence. In this manner, our scheme outperforms recently proposed Goore Game solution schemes, where one has to trade off accuracy with speed. We thus believe that our methodology opens avenues for improved performance in a number of applications of bandit based decentralized decision making

Absence of a True Vortex-Glass Phase above the Bragg Glass Transition Line in Bi-2212

In magnetic measurements on Bi$_2$Sr$_2$CaCu$_2$O$_{8+\delta}$ (Bi-2212) single crystals, a general peak with a dynamical feature on both $S-H$ and $S-T$ curves was found with S the magnetic relaxation rate. At higher fields, the characteristic exponent $\mu$ becomes negative, together with the positive curvature of $logE$ vs. $logj$ and the scaling based on the 2D vortex glass theory or plastic creep theory, we conclude that the vortex motion above the second peak is plastic when $j\to 0$ and there is no vortex glass phase at finite temperatures in Bi-2212. The peak of S is then explained as the crossover between different meta-stable vortex states.Comment: 10 pages, 5 figures, To appear in Physica

Effect of pressure on the superconducting transition temperature of doped and neutron-damaged MgB2

Measurements of the superconducting transition temperatures for Al-doped, C-doped and neutron-damaged-annealed MgB2 samples under pressure up to ~8 kbar are presented. The dT_c/dP values change systematically with the decrease of the ambient pressure T_c in a regular fashion. The evolution of the pressure derivatives can be understood assuming that the change in phonon spectrum is a dominant contribution to dT_c/dP

Multibeam Maser Survey of methanol and excited OH in the Magellanic clouds: new detections and maser abundance estimates

‘The definitive version is available at www.blackwell-synergy.com.’ Copyright Blackwell Publishing DOI: 10.1111/j.1365-2966.2008.12888.xPeer reviewe

Preparation of non-aqueous Pickering emulsions using anisotropic block copolymer nanoparticles

In this work, we show that amphiphilic diblock copolymer worms prepared via alcoholic RAFT dispersion polymerization can be used to stabilize non-aqueous Pickering emulsions. A previously reported synthesis protocol based on polymerization-induced self-assembly (PISA) was modified to enable the preparation of poly(2-(dimethylamino)ethyl methacrylate)-poly(benzyl methacrylate) (PDMA-PBzMA) worm-like particles directly in methanol at relatively high solids. A dilute dispersion of these highly anisotropic nanoparticles was then homogenized with sunflower oil to produce sunflower oil-in-methanol emulsions. The mean droplet diameter ranged from 9 to 104 μm, depending on the nanoparticle concentration and the stirring rate used for homogenization. The sunflower oil content was increased systematically, with stable emulsions being obtained up to a volume fraction of 0.60. In all cases, the sunflower oil droplets gradually increase in size on ageing for up to 4 days. However, stable emulsions were obtained after this time period, with no further change in the mean droplet diameter for at least 2 months on standing at ambient temperature. Turbidimetry studies of the continuous phase after sedimentation of the relatively dense emulsion droplets indicated that the initial adsorption efficiency of the PDMA-PBzMA worms is very high, but this is reduced significantly as the droplet diameter gradually increases during ageing. There is a concomitant increase in fractional surface coverage over the same time period, suggesting that the increase in droplet diameter is the result of limited coalescence, rather than an Ostwald ripening mechanism

Perfluorinated alkyl acids in the serum and follicular fluid of UK women with and without polycystic ovarian syndrome undergoing fertility treatment and associations with hormonal and metabolic parameters

© 2018 Women with polycystic ovarian syndrome (PCOS) undergoing treatment for infertility could be a sensitive subpopulation for endocrine effects of exposure to perfluorinated alkyl acids (PFAAs), persistent organic pollutants with potential endocrine activity. Women with, PCOS (n = 30) and age- and BMI-matched controls (n = 29) were recruited from a UK fertility clinic in 2015. Paired serum and follicular fluid samples were collected and analysed for 13 PFAAs. Sex steroid and thyroid hormones, and metabolic markers were measured and assessed for associations with serum PFAAs. Four PFAAs were detected in all serum and follicular fluid samples and concentrations in the two matrices were highly correlated (R2 > 0.95): perfluorooctane sulfonate (PFOS), perfluorooctanoic acid (PFOA), perfluorohexane sulfonate (PFHxS), and perfluorononanoic acid (PFNA). Serum PFOS was positively associated with age (1 ng/mL per yr, p < 0.05) and was higher in PCOS cases than controls (geometric mean [GM] 3.9 vs. 3.1 ng/mL, p < 0.05) and in women with irregular vs. regular menstrual cycles (GM 3.9 vs. 3.0 ng/mL, p = 0.01). After adjustment for confounders, serum testosterone was significantly associated with PFOA, PFHxS, PFNA, and the molar sum of the four frequently detected serum PFAAs (approximately 50 percent increase per ln-unit) among controls but not PCOS cases. HbA1c in PCOS cases was inversely associated with serum PFOA, PFHxs, and sum of PFAAs (2–3 mmol/mol per ln-unit). In controls, fasting glucose was positively associated with serum PFOA and sum of PFAAs (0.25 nmol/L per ln-unit increase in PFAAs). Few other associations were observed. The analyses and findings here should be considered exploratory in light of the relatively small sample sizes and large number of statistical comparisons conducted. However, the data do not suggest increased sensitivity to potential endocrine effects of PFAAs in PCOS patients

Gaussian quantum marginal problem

The quantum marginal problem asks what local spectra are consistent with a given spectrum of a joint state of a composite quantum system. This setting, also referred to as the question of the compatibility of local spectra, has several applications in quantum information theory. Here, we introduce the analogue of this statement for Gaussian states for any number of modes, and solve it in generality, for pure and mixed states, both concerning necessary and sufficient conditions. Formally, our result can be viewed as an analogue of the Sing-Thompson Theorem (respectively Horn's Lemma), characterizing the relationship between main diagonal elements and singular values of a complex matrix: We find necessary and sufficient conditions for vectors (d1, ..., dn) and (c1, ..., cn) to be the symplectic eigenvalues and symplectic main diagonal elements of a strictly positive real matrix, respectively. More physically speaking, this result determines what local temperatures or entropies are consistent with a pure or mixed Gaussian state of several modes. We find that this result implies a solution to the problem of sharing of entanglement in pure Gaussian states and allows for estimating the global entropy of non-Gaussian states based on local measurements. Implications to the actual preparation of multi-mode continuous-variable entangled states are discussed. We compare the findings with the marginal problem for qubits, the solution of which for pure states has a strikingly similar and in fact simple form.Comment: 18 pages, 1 figure, material added, references updated, except from figure identical with version to appear in Commun. Math. Phy

Energy calibration of large underwater detectors using stopping muons

We propose to use stopping cosmic-ray muons in the energy calibration of planned and deployed large underwater detectors. The method is based on the proportionality between the incident muon energy and the length of the muon path before it stops. Simultaneous measurements of the muon path and the amplitude of the signal from the photomultiplier tubes allow a relation between the energy deposited in the sensitive volume of the detector and the observed signal to be derived, and also provide a test of detector simulations. We describe the proposed method and present the results of simulations