Solving Games with Functional Regret Estimation

We propose a novel online learning method for minimizing regret in large extensive-form games. The approach learns a function approximator online to estimate the regret for choosing a particular action. A no-regret algorithm uses these estimates in place of the true regrets to define a sequence of policies. We prove the approach sound by providing a bound relating the quality of the function approximation and regret of the algorithm. A corollary being that the method is guaranteed to converge to a Nash equilibrium in self-play so long as the regrets are ultimately realizable by the function approximator. Our technique can be understood as a principled generalization of existing work on abstraction in large games; in our work, both the abstraction as well as the equilibrium are learned during self-play. We demonstrate empirically the method achieves higher quality strategies than state-of-the-art abstraction techniques given the same resources.Comment: AAAI Conference on Artificial Intelligence 201

THE EFFECTS OF ALTERNATE COW FRESHENING DISTRIBUTIONS ON MILK PRODUCTION AND IMPORTS IN FLORIDA

Seasonal swings in milk production in Florida result in a need to import milk on a seasonal basis. A linear programming analysis is used to analyze alternate freshening-date distributions and project the cost savings to Florida dairy farmers from reduced milk imports.Farm Management,

Hindsight and Sequential Rationality of Correlated Play

Driven by recent successes in two-player, zero-sum game solving and playing, artificial intelligence work on games has increasingly focused on algorithms that produce equilibrium-based strategies. However, this approach has been less effective at producing competent players in general-sum games or those with more than two players than in two-player, zero-sum games. An appealing alternative is to consider adaptive algorithms that ensure strong performance in hindsight relative to what could have been achieved with modified behavior. This approach also leads to a game-theoretic analysis, but in the correlated play that arises from joint learning dynamics rather than factored agent behavior at equilibrium. We develop and advocate for this hindsight rationality framing of learning in general sequential decision-making settings. To this end, we re-examine mediated equilibrium and deviation types in extensive-form games, thereby gaining a more complete understanding and resolving past misconceptions. We present a set of examples illustrating the distinct strengths and weaknesses of each type of equilibrium in the literature, and prove that no tractable concept subsumes all others. This line of inquiry culminates in the definition of the deviation and equilibrium classes that correspond to algorithms in the counterfactual regret minimization (CFR) family, relating them to all others in the literature. Examining CFR in greater detail further leads to a new recursive definition of rationality in correlated play that extends sequential rationality in a way that naturally applies to hindsight evaluation.Comment: Technical report for a paper in the proceedings of the thirty-fifth AAAI Conference on Artificial Intelligence (AAAI-21), February 2-9, 2021, Virtual. 26 pages and 15 figure

A pharmacist-driven academic detailing program to increase adult pneumococcal vaccination

Objectives To describe our statewide, pharmacist-led education campaign to increase knowledge and awareness of pneumococcal immunization recommendations. Setting Immunization providers and residents in the state of Rhode Island. Practice description A clinical pathway (i.e., decision-support tool) was developed to educate health professionals about appropriate indications, administration schedules, and frequently asked questions for the 2 different adult pneumococcal vaccines. Academic detailing and distribution of the clinical pathway to health professionals was conducted across Rhode Island. Community outreach activities included radio ads as well as distribution of patient handouts and wallet cards at community events. Practice innovation To our knowledge, this was the first statewide, pharmacist-driven academic detailing and community outreach campaign to promote adult pneumococcal vaccination. Evaluation Academically detailed immunization providers received a 6-question survey. Pneumococcal disease rate differences between the study periods were evaluated with the use of Fisher exact tests, whereas changes in vaccination were assessed with the use of chi-square tests. Results From November 2013 through July 2015, our academic detailers visited and distributed our vaccination pathway materials to more than 400 practice sites across Rhode Island, including 68% of community pharmacies and all adult acute care hospitals. Of the 413 surveys completed, 92% of respondents agreed that their knowledge of the pneumococcal conjugate vaccine, 13-valent and pneumococcal polysaccharide vaccine, 23-valent had improved. Pneumococcal vaccination increased significantly (absolute difference 3.9%, percentage change in proportion 5.4%; P = 0.01), and pneumococcal disease decreased significantly between the preintervention and intervention periods (−2.74/10,000 discharges [95% CI −5.15 to −0.32], P = 0.02). Invasive pneumococcal disease decreased by 21 cases per 1,000,000 population per year between the preintervention and postintervention periods (−42.25 to 0.14, P = 0.05). Conclusion Our statewide, pharmacist-driven pneumococcal vaccination educational outreach program resulted in favorable provider feedback relative to knowledge change and perceptions. Vaccination increased and pneumococcal disease decreased during the study period

Identification of the lipopolysaccharide modifications controlled by the Salmonella PmrA/PmrB system mediating resistance to Fe(III) and Al(III)

Iron is an essential metal but can be toxic in excess. While several homeostatic mechanisms prevent oxygen-dependent killing promoted by Fe(II), little is known about how cells cope with Fe(III), which kills by oxygen-independent means. Several Gram-negative bacterial species harbour a regulatory system – termed PmrA/PmrB – that is activated by and required for resistance to Fe(III). We now report the identification of the PmrA-regulated determinants mediating resistance to Fe(III) and Al(III) in Salmonella enterica serovar Typhimurium. We establish that these determinants remodel two regions of the lipopolysaccharide, decreasing the negative charge of this major constituent of the outer membrane. Remodelling entails the covalent modification of the two phosphates in the lipid A region with phosphoethanolamine and 4-aminoarabinose, which has been previously implicated in resistance to polymyxin B, as well as dephosphorylation of the Hep(II) phosphate in the core region by the PmrG protein. A mutant lacking the PmrA-regulated Fe(III) resistance genes bound more Fe(III) than the wild-type strain and was defective for survival in soil, suggesting that these PmrA-regulated lipopolysaccharide modifications aid Salmonella's survival and spread in non-host environments

Chemotactic and Inflammatory Responses in the Liver and Brain Are Associated with Pathogenesis of Rift Valley Fever Virus Infection in the Mouse

Rift Valley fever virus (RVFV) is a major human and animal pathogen associated with severe disease including hemorrhagic fever or encephalitis. RVFV is endemic to parts of Africa and the Arabian Peninsula, but there is significant concern regarding its introduction into non-endemic regions and the potentially devastating effect to livestock populations with concurrent infections of humans. To date, there is little detailed data directly comparing the host response to infection with wild-type or vaccine strains of RVFV and correlation with viral pathogenesis. Here we characterized clinical and systemic immune responses to infection with wild-type strain ZH501 or IND vaccine strain MP-12 in the C57BL/6 mouse. Animals infected with live-attenuated MP-12 survived productive viral infection with little evidence of clinical disease and minimal cytokine response in evaluated tissues. In contrast, ZH501 infection was lethal, caused depletion of lymphocytes and platelets and elicited a strong, systemic cytokine response which correlated with high virus titers and significant tissue pathology. Lymphopenia and platelet depletion were indicators of disease onset with indications of lymphocyte recovery correlating with increases in G-CSF production. RVFV is hepatotropic and in these studies significant clinical and histological data supported these findings; however, significant evidence of a pro-inflammatory response in the liver was not apparent. Rather, viral infection resulted in a chemokine response indicating infiltration of immunoreactive cells, such as neutrophils, which was supported by histological data. In brains of ZH501 infected mice, a significant chemokine and pro-inflammatory cytokine response was evident, but with little pathology indicating meningoencephalitis. These data suggest that RVFV pathogenesis in mice is associated with a loss of liver function due to liver necrosis and hepatitis yet the long-term course of disease for those that might survive the initial hepatitis is neurologic in nature which is supported by observations of human disease and the BALB/c mouse model

ANKRD24 organizes TRIOBP to reinforce stereocilia insertion points

The stereocilia rootlet is a key structure in vertebrate hair cells, anchoring stereocilia firmly into the cell’s cuticular plate and protecting them from overstimulation. Using superresolution microscopy, we show that the ankyrin-repeat protein ANKRD24 concentrates at the stereocilia insertion point, forming a ring at the junction between the lower and upper rootlets. Annular ANKRD24 continues into the lower rootlet, where it surrounds and binds TRIOBP-5, which itself bundles rootlet F-actin. TRIOBP-5 is mislocalized in Ankrd24KO/KO hair cells, and ANKRD24 no longer localizes with rootlets in mice lacking TRIOBP-5; exogenous DsRed–TRIOBP-5 restores endogenous ANKRD24 to rootlets in these mice. Ankrd24KO/KO mice show progressive hearing loss and diminished recovery of auditory function after noise damage, as well as increased susceptibility to overstimulation of the hair bundle. We propose that ANKRD24 bridges the apical plasma membrane with the lower rootlet, maintaining a normal distribution of TRIOBP-5. Together with TRIOBP-5, ANKRD24 organizes rootlets to enable hearing with long-term resilience

Canvass: a crowd-sourced, natural-product screening library for exploring biological space

NCATS thanks Dingyin Tao for assistance with compound characterization. This research was supported by the Intramural Research Program of the National Center for Advancing Translational Sciences, National Institutes of Health (NIH). R.B.A. acknowledges support from NSF (CHE-1665145) and NIH (GM126221). M.K.B. acknowledges support from NIH (5R01GM110131). N.Z.B. thanks support from NIGMS, NIH (R01GM114061). J.K.C. acknowledges support from NSF (CHE-1665331). J.C. acknowledges support from the Fogarty International Center, NIH (TW009872). P.A.C. acknowledges support from the National Cancer Institute (NCI), NIH (R01 CA158275), and the NIH/National Institute of Aging (P01 AG012411). N.K.G. acknowledges support from NSF (CHE-1464898). B.C.G. thanks the support of NSF (RUI: 213569), the Camille and Henry Dreyfus Foundation, and the Arnold and Mabel Beckman Foundation. C.C.H. thanks the start-up funds from the Scripps Institution of Oceanography for support. J.N.J. acknowledges support from NIH (GM 063557, GM 084333). A.D.K. thanks the support from NCI, NIH (P01CA125066). D.G.I.K. acknowledges support from the National Center for Complementary and Integrative Health (1 R01 AT008088) and the Fogarty International Center, NIH (U01 TW00313), and gratefully acknowledges courtesies extended by the Government of Madagascar (Ministere des Eaux et Forets). O.K. thanks NIH (R01GM071779) for financial support. T.J.M. acknowledges support from NIH (GM116952). S.M. acknowledges support from NIH (DA045884-01, DA046487-01, AA026949-01), the Office of the Assistant Secretary of Defense for Health Affairs through the Peer Reviewed Medical Research Program (W81XWH-17-1-0256), and NCI, NIH, through a Cancer Center Support Grant (P30 CA008748). K.N.M. thanks the California Department of Food and Agriculture Pierce's Disease and Glassy Winged Sharpshooter Board for support. B.T.M. thanks Michael Mullowney for his contribution in the isolation, elucidation, and submission of the compounds in this work. P.N. acknowledges support from NIH (R01 GM111476). L.E.O. acknowledges support from NIH (R01-HL25854, R01-GM30859, R0-1-NS-12389). L.E.B., J.K.S., and J.A.P. thank the NIH (R35 GM-118173, R24 GM-111625) for research support. F.R. thanks the American Lebanese Syrian Associated Charities (ALSAC) for financial support. I.S. thanks the University of Oklahoma Startup funds for support. J.T.S. acknowledges support from ACS PRF (53767-ND1) and NSF (CHE-1414298), and thanks Drs. Kellan N. Lamb and Michael J. Di Maso for their synthetic contribution. B.S. acknowledges support from NIH (CA78747, CA106150, GM114353, GM115575). W.S. acknowledges support from NIGMS, NIH (R15GM116032, P30 GM103450), and thanks the University of Arkansas for startup funds and the Arkansas Biosciences Institute (ABI) for seed money. C.R.J.S. acknowledges support from NIH (R01GM121656). D.S.T. thanks the support of NIH (T32 CA062948-Gudas) and PhRMA Foundation to A.L.V., NIH (P41 GM076267) to D.S.T., and CCSG NIH (P30 CA008748) to C.B. Thompson. R.E.T. acknowledges support from NIGMS, NIH (GM129465). R.J.T. thanks the American Cancer Society (RSG-12-253-01-CDD) and NSF (CHE1361173) for support. D.A.V. thanks the Camille and Henry Dreyfus Foundation, the National Science Foundation (CHE-0353662, CHE-1005253, and CHE-1725142), the Beckman Foundation, the Sherman Fairchild Foundation, the John Stauffer Charitable Trust, and the Christian Scholars Foundation for support. J.W. acknowledges support from the American Cancer Society through the Research Scholar Grant (RSG-13-011-01-CDD). W.M.W.acknowledges support from NIGMS, NIH (GM119426), and NSF (CHE1755698). A.Z. acknowledges support from NSF (CHE-1463819). (Intramural Research Program of the National Center for Advancing Translational Sciences, National Institutes of Health (NIH); CHE-1665145 - NSF; CHE-1665331 - NSF; CHE-1464898 - NSF; RUI: 213569 - NSF; CHE-1414298 - NSF; CHE1361173 - NSF; CHE1755698 - NSF; CHE-1463819 - NSF; GM126221 - NIH; 5R01GM110131 - NIH; GM 063557 - NIH; GM 084333 - NIH; R01GM071779 - NIH; GM116952 - NIH; DA045884-01 - NIH; DA046487-01 - NIH; AA026949-01 - NIH; R01 GM111476 - NIH; R01-HL25854 - NIH; R01-GM30859 - NIH; R0-1-NS-12389 - NIH; R35 GM-118173 - NIH; R24 GM-111625 - NIH; CA78747 - NIH; CA106150 - NIH; GM114353 - NIH; GM115575 - NIH; R01GM121656 - NIH; T32 CA062948-Gudas - NIH; P41 GM076267 - NIH; R01GM114061 - NIGMS, NIH; R15GM116032 - NIGMS, NIH; P30 GM103450 - NIGMS, NIH; GM129465 - NIGMS, NIH; GM119426 - NIGMS, NIH; TW009872 - Fogarty International Center, NIH; U01 TW00313 - Fogarty International Center, NIH; R01 CA158275 - National Cancer Institute (NCI), NIH; P01 AG012411 - NIH/National Institute of Aging; Camille and Henry Dreyfus Foundation; Arnold and Mabel Beckman Foundation; Scripps Institution of Oceanography; P01CA125066 - NCI, NIH; 1 R01 AT008088 - National Center for Complementary and Integrative Health; W81XWH-17-1-0256 - Office of the Assistant Secretary of Defense for Health Affairs through the Peer Reviewed Medical Research Program; P30 CA008748 - NCI, NIH, through a Cancer Center Support Grant; California Department of Food and Agriculture Pierce's Disease and Glassy Winged Sharpshooter Board; American Lebanese Syrian Associated Charities (ALSAC); University of Oklahoma Startup funds; 53767-ND1 - ACS PRF; PhRMA Foundation; P30 CA008748 - CCSG NIH; RSG-12-253-01-CDD - American Cancer Society; RSG-13-011-01-CDD - American Cancer Society; CHE-0353662 - National Science Foundation; CHE-1005253 - National Science Foundation; CHE-1725142 - National Science Foundation; Beckman Foundation; Sherman Fairchild Foundation; John Stauffer Charitable Trust; Christian Scholars Foundation)Published versionSupporting documentatio