Tuning bandit algorithms in stochastic environments

International audienceAlgorithms based on upper-confidence bounds for balancing exploration and exploitation are gaining popularity since they are easy to implement, efficient and effective. In this paper we consider a variant of the basic algorithm for the stochastic, multi-armed bandit problem that takes into account the empirical variance of the different arms. In earlier experimental works, such algorithms were found to outperform the competing algorithms. The purpose of this paper is to provide a theoretical explanation of these findings and provide theoretical guidelines for the tuning of the parameters of these algorithms. For this we analyze the expected regret and for the first time the concentration of the regret. The analysis of the expected regret shows that variance estimates can be especially advantageous when the payoffs of suboptimal arms have low variance. The risk analysis, rather unexpectedly, reveals that except for some very special bandit problems, the regret, for upper confidence bounds based algorithms with standard bias sequences, concentrates only at a polynomial rate. Hence, although these algorithms achieve logarithmic expected regret rates, they seem less attractive when the risk of suffering much worse than logarithmic regret is also taken into account

Simulation of Eu3+ luminescence spectra of borosilicate glasses by molecular dynamics calculations

Simplified inactive rare-earths doped nuclear waste glasses have been obtained by molecular dynamics (MD) simulation in order to investigate the local structure around the rare-earth by luminescence studies. MD calculations were performed with modified Born–Mayer–Huggins potentials and three body angular terms representing Coulomb and covalent interactions. Atomic positions within the glasses are then determined. Simulations of luminescence spectra were then obtained by calculation of the ligand field parameters affecting each luminescent ion. Considering the C2v symmetry, it is possible to calculate the radiative transition probabilities between the emitter level, 5D0, and the splitted receptor levels, 7FJ (J = 0–3) for each Eu3+ ion. The simulated emission spectra are obtained by convolution of all the Eu3+ ions contributions. A comparison with the experimental data issue from fluorescence line narrowing and microluminescence spectroscopies allowed us not only to validate the simulation of luminescence spectra from simulated environments, but also to confirm the presence and the identification of two major Eu3+ sites distribution in the nuclear glasses thanks to spectra-structure correlations

Coupling Raman, Brillouin and Nd3+ Photo Luminescence Spectroscopy to Distinguish the Effect of Uniaxial Stress from Cooling Rate on Soda−Lime Silicate Glass

Evolution of spectroscopic properties of a soda–lime silicate glass with different thermal history and under applied uniaxial stress was investigated using Raman and Brillouin spectroscopies as well as Nd3+ photoluminescence techniques. Samples of soda–lime silicate with a cooling rate from 6 × 10−4 to 650 K/min were prepared either by controlled cooling from the melt using a differential scanning calorimeter or by a conventional annealing procedure. Uniaxial stress effects in a range from 0 to −1.3 GPa were investigated in situ by compression of the glass cylinders. The spectroscopic observations of rearrangements in the network structure were related to the set cooling rates or the applied uniaxial stress to calculate an interrelated set of calibrations. Comparing the results from Raman and Brillouin spectroscopy with Nd3+ photoluminescence analysis, we find a linear dependence that can be used to identify uniaxial stress and cooling rate in any given combination concurrently. The interrelated calibrations and linear dependence models are established and evaluated, and equations relating the change of glass network due to effects of cooling rate or uniaxial stress are given.Deutsche ForschungsgemeinschaftPeer Reviewe

Luminescent properties of Eu-doped calcium aluminosilicate glass-ceramics: A potential tunable luminophore

International audienc