Minimax Exploiter: A Data Efficient Approach for Competitive Self-Play

Recent advances in Competitive Self-Play (CSP) have achieved, or even surpassed, human level performance in complex game environments such as Dota 2 and StarCraft II using Distributed Multi-Agent Reinforcement Learning (MARL). One core component of these methods relies on creating a pool of learning agents -- consisting of the Main Agent, past versions of this agent, and Exploiter Agents -- where Exploiter Agents learn counter-strategies to the Main Agents. A key drawback of these approaches is the large computational cost and physical time that is required to train the system, making them impractical to deploy in highly iterative real-life settings such as video game productions. In this paper, we propose the Minimax Exploiter, a game theoretic approach to exploiting Main Agents that leverages knowledge of its opponents, leading to significant increases in data efficiency. We validate our approach in a diversity of settings, including simple turn based games, the arcade learning environment, and For Honor, a modern video game. The Minimax Exploiter consistently outperforms strong baselines, demonstrating improved stability and data efficiency, leading to a robust CSP-MARL method that is both flexible and easy to deploy

Ice Hockey Goaltender Physiology Profile and Physical Testing: A Systematic Review and Meta-Analysis

International Journal of Exercise Science 14(6): 855-875, 2021. This review aims to 1) be the first systematic review and meta-analysis of the literature examining the physiology and assessment of goaltenders, and 2) present a physiological profile of ice-hockey goaltenders. It will 1) highlight physiological differences between goaltenders and players at other positions, 2) determine strengths and weaknesses of ice hockey goaltenders, and 3) offer possible guidelines for strength and conditioning coaches. Six electronic databases were systematically searched in October 2019 using the PRISMA model. A total of twelve scientific articles published in peer-reviewed journals were included. Professional male (PM) goaltenders had the following profile for age (A) 26.8 ± 2.5 years, body weight (BW) 85.64 ± 3.79 kg, height (H) 184.38 ± 2.79 cm, body fat % (BF%) 11.9 ± 2.22, VO2max 49.9 ± 4.45 ml/kg/min, anaerobic power (AP) 12.78 ± 1.63 W/kg, and combined hand grip strength (GS) 120.7 ± 15 kg. Amateur male (AM) goaltenders presented the following: A: 18.2 ± 0.75, BW: 83.85 ± 4.51, H: 184.96 ± 2.06, BF%: 10.51 ± 1.61, VO2max: 55.73 ± 4.57, AP: 10.9 ± 1.2 and GS: 109.08 ± 14.06. Amateur female (AF) goaltenders presented the following: A: 21.04 ± 1.84, BW: 63.4 ± 5.14, H: 164.86 ± 5.73, BF%: 22.12 ± 2.27 and VO2max: 42.84 ± 3.59. Overall, PM goaltenders are heavier, have a higher BF%, and exhibit greater GS and abdominal muscular endurance than AM, while AM goaltenders are heavier, taller, leaner, and can generate greater lower-body muscular power than AF goaltenders. In the current literature, there were a small number of studies on women players and a lack of distinction between player position in reported results. Specific physiological assessments during NHL Combines should be developed for goaltenders in accordance with their specific positional demands

Cross-Sectional Associations of 24-Hour Sedentary Time, Physical Activity, and Sleep Duration Compositions with Sleep Quality and Habits in Preschoolers

Although some studies indicate physical activity and sleep quality are positively associated in children, most reports examined physical activity independent of other 24-h behaviors and focused on older children. The aim of this cross-sectional study was to examine the predicted changes in sleep efficiency and habits when reallocating time between movement behaviors using compositional isotemporal substitution in preschool-aged children. Accelerometers were worn by 288 participants (51.6 ± 9.5 months) for up to 16 days. Sleep outcomes included sleep efficiency, nap frequency, sleep disturbances, and bedtime resistance. Compositional isotemporal substitution analyses demonstrated that the combined effect of 24-h movement behaviors was associated with sleep efficiency (p \u3c 0.001) and nap frequency (p \u3c 0.003). When sleep increased by 30 min at the expense of stationary time or light physical activity, estimates of sleep efficiency and bedtime resistance decreased while nap frequency increased. When stationary time increased by 30 min from moderate to vigorous physical activity, estimated sleep efficiency increased and sleep disturbances decreased. Although this study presents preliminary evidence that 24-h movement behavior compositions in early childhood are associated with sleep quality and nap frequency, estimated effects from theoretical time reallocations across sleep outcomes were mixed

Novel Ground-State Crystals with Controlled Vacancy Concentrations: From Kagom\'{e} to Honeycomb to Stripes

We introduce a one-parameter family, $0 \leq H \leq 1$, of pair potential functions with a single relative energy minimum that stabilize a range of vacancy-riddled crystals as ground states. The "quintic potential" is a short-ranged, nonnegative pair potential with a single local minimum of height $H$ at unit distance and vanishes cubically at a distance of \rt. We have developed this potential to produce ground states with the symmetry of the triangular lattice while favoring the presence of vacancies. After an exhaustive search using various optimization and simulation methods, we believe that we have determined the ground states for all pressures, densities, and $0 \leq H \leq 1$. For specific areas below 3\rt/2, the ground states of the "quintic potential" include high-density and low-density triangular lattices, kagom\'{e} and honeycomb crystals, and stripes. We find that these ground states are mechanically stable but are difficult to self-assemble in computer simulations without defects. For specific areas above 3\rt/2, these systems have a ground-state phase diagram that corresponds to hard disks with radius \rt. For the special case of H=0, a broad range of ground states is available. Analysis of this case suggests that among many ground states, a high-density triangular lattice, low-density triangular lattice, and striped phases have the highest entropy for certain densities. The simplicity of this potential makes it an attractive candidate for experimental realization with application to the development of novel colloidal crystals or photonic materials.Comment: 25 pages, 11 figure

Test-Retest Reliability of Standard Deviation of Lane Position as Assessed on a PC-Based Driving Simulator

Driving is an everyday activity that is commonly affected by neurologic disorders and medical treatments. A frequently used metric for assessing driving ability is the standard deviation of lane position (SDLP), or the amount that subjects “swerve” within their driving lane. This measurement has been used with individuals under the influence of alcohol, illicit drugs, and prescribed medications in both on-road and simulator studies. Although good test-retest reliability is critical if one is to measure change in individuals over time, there is surprisingly limited data regarding the test-retest reliability of SDLP. Objective. To examine the test-retest reliability of SDLP in subjects tested at (1) a 3-month retest interval (a time frame common to clinical trials), and (2) a year or longer retest interval (a time period over which one might track changes in neurologic patients. Methods. Group 1 completed retesting an average of 84 (s.d. = 8.1) days after their initial simulator assessment. Both HIV negative (HIV-; n = 16) and positive (HIV+; n = 13) subjects were included to explore short-term reliability in control and mildly ill patient groups. All HIV+ subjects were medically asymptomatic, and unlikely to experience HIV-related changes over this interval. Two HIV+ subjects were neuropsychologically (NP) impaired. Group 2 (n = 31), a different cohort, was retested an average of 19.8 (8.3) months after baseline. All subjects completed NP evaluations at baseline and follow-up, with NP status rated on a scale of 1 (above average) to 9 (severe impairment) by a clinician blinded to simulator performance. Twelve subjects (39%) were NP impaired. In order to examine reliability in a stable neurologic cohort, all subjects were selected because they remained at the same level of NP functioning at follow-up. SDLP was assessed in both groups using an interactive PC-based driving simulator that consisted of a monitor, steering wheel, and brake/accelerator pedals. Participants were required to maintain lane position while holding a constant speed (55 mph) and responding to divided attention tasks in the corner of the monitor. Group 2 completed an existing, standardized scenario (TOPS), while Group 1 completed a newly developed driving scenario. Both simulations lasted approximately 7 minutes. Results. Combined reliability for Group 1 was .74. Test-retest reliability was .68 for the HIVand .83 for the HIV+ subjects. For Group 2, SDLP was significantly correlated with NP functioning at baseline (r = .5, p = .005) and follow-up (r = .48, p = .006), with impaired subjects evidencing a higher SDLP than NP normal subjects at both baseline (mean of 1.9 vs 1.2; p = .006) and follow-up (1.7 vs 1.1, p = .01). Combined test-retest reliability for Group 2 was .86. The NP normal group had a test-retest reliability of .74; test-retest reliability for the NP impaired group was .87. Conclusions. SDLP is a reliable measure for periods ranging from months to years when assessed in cognitively stable subjects. As such, this may serve as a useful tool in tracking the effects of neurologic disorders and pharmacologic treatments on driving abilities

Validation of a liquid chromatography-tandem mass spectrometry method for analyzing cannabinoids in oral fluid.

A liquid chromatography tandem mass spectrometry method was developed for quantifying ten cannabinoids in oral fluid (OF). This method utilizes OF collected by the Quantisal™ device and concurrently quantifies cannabinol (CBN), cannabidiol (CBD), Δ9-tetrahydrocannabinol (THC), 11-hydroxy-Δ9-THC (11-OH-THC), 11-nor-9-carboxy-Δ9-THC (THC-COOH), 11-nor-9-carboxy-Δ9-THC glucuronide (THC-COOH-gluc), Δ9-THC glucuronide (THC-gluc), cannabigerol (CBG), tetrahydrocannabiverin (THCV), and Δ9-tetrahydrocannabinolic acid A (THCA-A). Solid phase extraction was optimized using Oasis Prime HLB 30 mg 96-well plates. Cannabinoids were separated by liquid chromatography over a BEH C18 column and detected by a Waters TQ-S micro tandem mass spectrometer. The lower limits of quantification (LLOQ) were 0.4 ng/mL for CBN, CBD, THC, 11-OH-THC, THC-gluc, and THCV; and 1.0 ng/mL for THC-COOH, THC-COOH-gluc, CBG and THCA-A. Linear ranges extended to 2000 ng/mL for THC and 200 ng/mL for all other analytes. Inter-day analytical bias and imprecision at three levels of quality control (QC) was within ±15%. Mean extraction efficiencies ranged from 26.0-98.8%. Applicability of this method was tested using samples collected from individuals randomly assigned to smoke either a joint containing <0.1%, 5.9%, or 13.4% THC content. This method was able to identify and calculate the concentration of 6 of 10 cannabinoids validated in this method

Validation of a liquid chromatography tandem mass spectrometry (LC-MS/MS) method to detect cannabinoids in whole blood and breath.

Background The widespread availability of cannabis raises concerns regarding its effect on driving performance and operation of complex equipment. Currently, there are no established safe driving limits regarding ∆9-tetrahydrocannabinol (THC) concentrations in blood or breath. Daily cannabis users build up a large body burden of THC with residual excretion for days or weeks after the start of abstinence. Therefore, it is critical to have a sensitive and specific analytical assay that quantifies THC, the main psychoactive component of cannabis, and multiple metabolites to improve interpretation of cannabinoids in blood; some analytes may indicate recent use. Methods A liquid chromatography tandem mass spectrometry (LC-MS/MS) method was developed to quantify THC, cannabinol (CBN), cannabidiol (CBD), 11-hydroxy-THC (11-OH-THC), (±)-11-nor-9-carboxy-Δ9-THC (THCCOOH), (+)-11-nor-Δ9-THC-9-carboxylic acid glucuronide (THCCOOH-gluc), cannabigerol (CBG), and tetrahydrocannabivarin (THCV) in whole blood (WB). WB samples were prepared by solid-phase extraction (SPE) and quantified by LC-MS/MS. A rapid and simple method involving methanol elution of THC in breath collected in SensAbues® devices was optimized. Results Lower limits of quantification ranged from 0.5 to 2 μg/L in WB. An LLOQ of 80 pg/pad was achieved for THC concentrations in breath. Calibration curves were linear (R2>0.995) with calibrator concentrations within ±15% of their target and quality control (QC) bias and imprecision ≤15%. No major matrix effects or drug interferences were observed. Conclusions The methods were robust and adequately quantified cannabinoids in biological blood and breath samples. These methods will be used to identify cannabinoid concentrations in an upcoming study of the effects of cannabis on driving

Rational mutagenesis to support structure-based drug design: MAPKAP kinase 2 as a case study

<p>Abstract</p> <p>Background</p> <p>Structure-based drug design (SBDD) can provide valuable guidance to drug discovery programs. Robust construct design and expression, protein purification and characterization, protein crystallization, and high-resolution diffraction are all needed for rapid, iterative inhibitor design. We describe here robust methods to support SBDD on an oral anti-cytokine drug target, human MAPKAP kinase 2 (MK2). Our goal was to obtain useful diffraction data with a large number of chemically diverse lead compounds. Although MK2 structures and structural methods have been reported previously, reproducibility was low and improved methods were needed.</p> <p>Results</p> <p>Our construct design strategy had four tactics: <it>N</it>- and <it>C</it>-terminal variations; entropy-reducing surface mutations; activation loop deletions; and pseudoactivation mutations. Generic, high-throughput methods for cloning and expression were coupled with automated liquid dispensing for the rapid testing of crystallization conditions with minimal sample requirements. Initial results led to development of a novel, customized robotic crystallization screen that yielded MK2/inhibitor complex crystals under many conditions in seven crystal forms. In all, 44 MK2 constructs were generated, ~500 crystals were tested for diffraction, and ~30 structures were determined, delivering high-impact structural data to support our MK2 drug design effort.</p> <p>Conclusion</p> <p>Key lessons included setting reasonable criteria for construct performance and prioritization, a willingness to design and use customized crystallization screens, and, crucially, initiation of high-throughput construct exploration very early in the drug discovery process.</p

Global NeuroAIDS Roundtable

In May 2012, the Division of AIDS Research at the National Institute of Mental Health (NIMH) organized the “Global NeuroAIDS Roundtable” in conjunction with the 11th International Symposium on Neurovirology and the 2012 Conference on HIV in the Nervous System. The meeting was held in New York, NY, USA and brought together NIMH-funded investigators who are currently working on projects related to the neurological complications of AIDS (NeuroAIDS) in Africa, Asia, Eastern Europe, and Latin America in order to provide an opportunity to share their recent findings and discuss the challenges encountered within each country. The major goals of the roundtable were to evaluate HIV-associated neurocognitive impairment and determine if it may be directly attributable to distinct HIV subtypes or clades and to discuss the future priorities for global NeuroAIDS research. At the “Global NeuroAIDS Roundtable”, presentations of preliminary research indicated that HIV-associated neurocognitive impairment is prevalent in all countries examined regardless of which HIV clade is present in the region. The only clear-cut difference between HIV-1 clades was in relation to subtypes A and D in Uganda. However, a key point that emerged from the discussions was that there is an urgent need to standardize neurocognitive assessment methodologies across the globe before definitive conclusions can be drawn regarding the relationship between HIV clade diversity and neuropathogenesis. Future research directions were also discussed at the roundtable with particular emphasis on the potential of viral and host factor molecular interactions to impact the pathophysiology of HIV-associated neurocognitive disorders (HAND) from a global perspective