Bayesian Nonparametric Inverse Reinforcement Learning

Inverse reinforcement learning (IRL) is the task of learning the reward function of a Markov Decision Process (MDP) given the transition function and a set of observed demonstrations in the form of state-action pairs. Current IRL algorithms attempt to find a single reward function which explains the entire observation set. In practice, this leads to a computationally-costly search over a large (typically infinite) space of complex reward functions. This paper proposes the notion that if the observations can be partitioned into smaller groups, a class of much simpler reward functions can be used to explain each group. The proposed method uses a Bayesian nonparametric mixture model to automatically partition the data and find a set of simple reward functions corresponding to each partition. The simple rewards are interpreted intuitively as subgoals, which can be used to predict actions or analyze which states are important to the demonstrator. Experimental results are given for simple examples showing comparable performance to other IRL algorithms in nominal situations. Moreover, the proposed method handles cyclic tasks (where the agent begins and ends in the same state) that would break existing algorithms without modification. Finally, the new algorithm has a fundamentally different structure than previous methods, making it more computationally efficient in a real-world learning scenario where the state space is large but the demonstration set is small

Sedation during Spinal Anesthesia

Background: Central neuraxial anesthesia has been reported to decrease the dose of both intravenous and inhalational anesthetics needed to reach a defined level of sedation. The mechanism behind this phenomenon is speculated to be decreased afferent stimulation of the reticular activating system. The authors performed a two-part study (nonrandomized pilot study and a subsequent randomized, double-blind, placebo-controlled study) using the Bispectral Index (BIS) monitor to quantify the degree of sedation in unmedicated volunteers undergoing spinal anesthesia. Methods: Twelve volunteers underwent BIS monitoring and observer sedation scoring (Observer's Assessment of Alertness/ Sedation Scale [OAA/S]) before and after spinal anesthesia with 50 mg hyperbaric lidocaine, 5%. Subsequently, 16 volunteers blinded to the study were randomized to receive spinal anesthesia with 50 mg hyperbaric lidocaine, 5% (n ‫؍‬ 10) or placebo (n ‫؍‬ 6) and underwent BIS and OAA/S monitoring. Results: In part I, significant changes in BIS scores of the volunteers occurred progressively ( P ‫؍‬ 0.003). The greatest variations from baseline BIS measurement occurred at 30 and 70 min. In part II, there were significant decreases in OAA/S and self-sedation scores for patients receiving spinal anesthesia versus control patients (P ‫؍‬ 0.04 and 0.01, respectively). The greatest decrease in OAA/S scores occurred at 60 min. BIS scores were similar between groups (P ‫؍‬ 0.4)

Surgery Poster - 2019

Surgery Poster - 2019https://scholarlycommons.libraryinfo.bhs.org/research_education/1016/thumbnail.jp

A Nearly Linear-Time PTAS for Explicit Fractional Packing and Covering Linear Programs

We give an approximation algorithm for packing and covering linear programs (linear programs with non-negative coefficients). Given a constraint matrix with n non-zeros, r rows, and c columns, the algorithm computes feasible primal and dual solutions whose costs are within a factor of 1+eps of the optimal cost in time O((r+c)log(n)/eps^2 + n).Comment: corrected version of FOCS 2007 paper: 10.1109/FOCS.2007.62. Accepted to Algorithmica, 201

Heavy episodic drinking on college campuses: Does changing the legal drinking age make a difference

ABSTRACT. Objective: This article extends the compartmental model previously developed by Scribner et al. in the context of college drinking to a mathematical model of the consequences of lowering the legal drinking age. Method: Using data available from 32 U.S. campuses, the analyses separate underage and legal age drinking groups into an eight-compartment model with different alcohol availability (wetness) for the underage and legal age groups. The model evaluates the likelihood that underage students will incorrectly perceive normative drinking levels to be higher than they actually are (i.e., misperception) and adjust their drinking accordingly by varying the interaction between underage students in social and heavy episodic drinking compartments. Results: The results evaluate the total heavy episodic drinker population and its dependence on the difference in misperception, as well as its dependence on underage wetness, legal age wetness, and drinking age. Conclusions: Results suggest that an unrealistically extreme combination of high wetness and low enforcement would be needed for the policies related to lowering the drinking age to be effective. (J. Stud. Alcohol Drugs, 72

Measurement of the Charged Multiplicities in b, c and Light Quark Events from Z0 Decays

Average charged multiplicities have been measured separately in $b$, $c$ and light quark ($u,d,s$) events from $Z^0$ decays measured in the SLD experiment. Impact parameters of charged tracks were used to select enriched samples of $b$ and light quark events, and reconstructed charmed mesons were used to select $c$ quark events. We measured the charged multiplicities: $\bar{n}_{uds} = 20.21 \pm 0.10 (\rm{stat.})\pm 0.22(\rm{syst.})$, $\bar{n}_{c} = 21.28 \pm 0.46(\rm{stat.}) ^{+0.41}_{-0.36}(\rm{syst.})$ $\bar{n}_{b} = 23.14 \pm 0.10(\rm{stat.}) ^{+0.38}_{-0.37}(\rm{syst.})$, from which we derived the differences between the total average charged multiplicities of $c$ or $b$ quark events and light quark events: $\Delta \bar{n}_c = 1.07 \pm 0.47(\rm{stat.})^{+0.36}_{-0.30}(\rm{syst.})$ and $\Delta \bar{n}_b = 2.93 \pm 0.14(\rm{stat.})^{+0.30}_{-0.29}(\rm{syst.})$. We compared these measurements with those at lower center-of-mass energies and with perturbative QCD predictions. These combined results are in agreement with the QCD expectations and disfavor the hypothesis of flavor-independent fragmentation.Comment: 19 pages LaTex, 4 EPS figures, to appear in Physics Letters

A measurement of the tau mass and the first CPT test with tau leptons

We measure the mass of the tau lepton to be 1775.1+-1.6(stat)+-1.0(syst.) MeV using tau pairs from Z0 decays. To test CPT invariance we compare the masses of the positively and negatively charged tau leptons. The relative mass difference is found to be smaller than 3.0 10^-3 at the 90% confidence level.Comment: 10 pages, 4 figures, Submitted to Phys. Letts.

First Measurement of Z/gamma* Production in Compton Scattering of Quasi-real Photons

We report the first observation of Z/gamma* production in Compton scattering of quasi-real photons. This is a subprocess of the reaction e+e- to e+e-Z/gamma*, where one of the final state electrons is undetected. Approximately 55 pb-1 of data collected in the year 1997 at an e+e- centre-of-mass energy of 183 GeV with the OPAL detector at LEP have been analysed. The Z/gamma* from Compton scattering has been detected in the hadronic decay channel. Within well defined kinematic bounds, we measure the product of cross-section and Z/gamma* branching ratio to hadrons to be (0.9+-0.3+-0.1) pb for events with a hadronic mass larger than 60 GeV, dominated by (e)eZ production. In the hadronic mass region between 5 GeV and 60 GeV, dominated by (e)egamma* production, this product is found to be (4.1+-1.6+-0.6) pb. Our results agree with the predictions of two Monte Carlo event generators, grc4f and PYTHIA.Comment: 18 pages, LaTeX, 5 eps figures included, submitted to Physics Letters

Search for Higgs Bosons in e+e- Collisions at 183 GeV

The data collected by the OPAL experiment at sqrts=183 GeV were used to search for Higgs bosons which are predicted by the Standard Model and various extensions, such as general models with two Higgs field doublets and the Minimal Supersymmetric Standard Model (MSSM). The data correspond to an integrated luminosity of approximately 54pb-1. None of the searches for neutral and charged Higgs bosons have revealed an excess of events beyond the expected background. This negative outcome, in combination with similar results from searches at lower energies, leads to new limits for the Higgs boson masses and other model parameters. In particular, the 95% confidence level lower limit for the mass of the Standard Model Higgs boson is 88.3 GeV. Charged Higgs bosons can be excluded for masses up to 59.5 GeV. In the MSSM, mh > 70.5 GeV and mA > 72.0 GeV are obtained for tan{beta}>1, no and maximal scalar top mixing and soft SUSY-breaking masses of 1 TeV. The range 0.8 < tanb < 1.9 is excluded for minimal scalar top mixing and m{top} < 175 GeV. More general scans of the MSSM parameter space are also considered.Comment: 49 pages. LaTeX, including 33 eps figures, submitted to European Physical Journal

A Measurement of the Product Branching Ratio f(b->Lambda_b).BR(Lambda_b->Lambda X) in Z0 Decays

The product branching ratio, f(b->Lambda_b).BR(Lambda_b->Lambda X), where Lambda_b denotes any weakly-decaying b-baryon, has been measured using the OPAL detector at LEP. Lambda_b are selected by the presence of energetic Lambda particles in bottom events tagged by the presence of displaced secondary vertices. A fit to the momenta of the Lambda particles separates signal from B meson and fragmentation backgrounds. The measured product branching ratio is f(b->Lambda_b).BR(Lambda_b->Lambda X) = (2.67+-0.38(stat)+0.67-0.60(sys))% Combined with a previous OPAL measurement, one obtains f(b->Lambda_b).BR(Lambda_b->Lambda X) = (3.50+-0.32(stat)+-0.35(sys))%.Comment: 16 pages, LaTeX, 3 eps figs included, submitted to the European Physical Journal