Coping with the Curse of Dimensionality by Combining Linear Programming and Reinforcement Learning

Reinforcement learning techniques offer a very powerful method of finding solutions in unpredictable problem environments where human supervision is not possible. However, in many real world situations, the state space needed to represent the solutions becomes so large that using these methods becomes infeasible. Often the vast majority of these states are not valuable in finding the optimal solution. This work introduces a novel method of using linear programming to identify and represent the small area of the state space that is most likely to lead to a near-optimal solution, significantly reducing the memory requirements and time needed to arrive at a solution. An empirical study is provided to show the validity of this method with respect to a specific problem in vehicle dispatching. This study demonstrates that, in problems that are too large for a traditional reinforcement learning agent, this new approach yields solutions that are a significant improvement over other nonlearning methods. In addition, this new method is shown to be robust to changing conditions both during training and execution. Finally, some areas of future work are outlined to introduce how this new approach might be applied to additional problems and environments

Hydrogeophysical Investigations at Hidden Dam, Raymond, California

Self-potential and direct current resistivity surveys are carried out at the Hidden Dam site in Raymond, California to assess present-day seepage patterns and better understand the hydrogeologic mechanisms that likely influence seepage. Numerical modeling is utilized in conjunction with the geophysical measurements to predict variably-saturated flow through typical two-dimensional dam cross-sections as a function of reservoir elevation. Several different flow scenarios are investigated based on the known hydrogeology, as well as information about typical subsurface structures gained from the resistivity survey. The flow models are also used to simulate the bulk electrical resistivity in the subsurface under varying saturation conditions, as well as the self-potential response using petrophysical relationships and electrokinetic coupling equations. The self-potential survey consists of 512 measurements on the downstream area of the dam, and corroborates known seepage areas on the northwest side of the dam. Two direct current resistivity profiles, each approximately 2,500 ft (762 m) long, indicate a broad sediment channel under the northwest side of the dam, which may be a significant seepage pathway through the foundation. A focusing of seepage in low-topography areas downstream of the dam is confirmed from the numerical flow simulations, which is also consistent with past observations. Little evidence of seepage is identified from the self-potential data on the southeast side of the dam, also consistent with historical records, though one possible area of focused seepage is identified near the outlet works. Integration of the geophysical surveys, numerical modeling, and observation well data provides a framework for better understanding seepage at the site through a combined hydrogeophysical approach

Evaluation Research and Institutional Pressures: Challenges in Public-Nonprofit Contracting

This article examines the connection between program evaluation research and decision-making by public managers. Drawing on neo-institutional theory, a framework is presented for diagnosing the pressures and conditions that lead alternatively toward or away the rational use of evaluation research. Three cases of public-nonprofit contracting for the delivery of major programs are presented to clarify the way coercive, mimetic, and normative pressures interfere with a sound connection being made between research and implementation. The article concludes by considering how public managers can respond to the isomorphic pressures in their environment that make it hard to act on data relating to program performance.This publication is Hauser Center Working Paper No. 23. The Hauser Center Working Paper Series was launched during the summer of 2000. The Series enables the Hauser Center to share with a broad audience important works-in-progress written by Hauser Center scholars and researchers

Joint analysis of stressors and ecosystem services to enhance restoration effectiveness

With increasing pressure placed on natural systems by growing human populations, both scientists and resource managers need a better understanding of the relationships between cumulative stress from human activities and valued ecosystem services. Societies often seek to mitigate threats to these services through large-scale, costly restoration projects, such as the over one billion dollar Great Lakes Restoration Initiative currently underway. To help inform these efforts, we merged high-resolution spatial analyses of environmental stressors with mapping of ecosystem services for all five Great Lakes. Cumulative ecosystem stress is highest in near-shore habitats, but also extends offshore in Lakes Erie, Ontario, and Michigan. Variation in cumulative stress is driven largely by spatial concordance among multiple stressors, indicating the importance of considering all stressors when planning restoration activities. In addition, highly stressed areas reflect numerous different combinations of stressors rather than a single suite of problems, suggesting that a detailed understanding of the stressors needing alleviation could improve restoration planning. We also find that many important areas for fisheries and recreation are subject to high stress, indicating that ecosystem degradation could be threatening key services. Current restoration efforts have targeted high-stress sites almost exclusively, but generally without knowledge of the full range of stressors affecting these locations or differences among sites in service provisioning. Our results demonstrate that joint spatial analysis of stressors and ecosystem services can provide a critical foundation for maximizing social and ecological benefits from restoration investments. www.pnas.org/lookup/suppl/doi:10.1073/pnas.1213841110/-/DCSupplementa

Responsible participation and housing: restoring democratic theory to the scene

Tensions between individual liberty and collective social justice characterise many advanced liberal societies. These tensions are reflected in the challenges posed for representative democracy both by participatory democratic practices and by the current emphasis on (so-called) responsible participation. Based on the example of ‘community’ housing associations in Scotland, this paper explores these tensions. It is argued that the critique of responsibility may have been over-stated – that, in particular, ‘community’ housing associations offer the basis for relatively more inclusive and effective processes of decision-making than council housing, which relies on the traditional processes and institutions of representative local government for its legitimacy

Estimation of the national disease burden of influenza-associated severe acute respiratory illness in Kenya and Guatemala : a novel methodology

Background: Knowing the national disease burden of severe influenza in low-income countries can inform policy decisions around influenza treatment and prevention. We present a novel methodology using locally generated data for estimating this burden. Methods and Findings: This method begins with calculating the hospitalized severe acute respiratory illness (SARI) incidence for children <5 years old and persons ≥5 years old from population-based surveillance in one province. This base rate of SARI is then adjusted for each province based on the prevalence of risk factors and healthcare-seeking behavior. The percentage of SARI with influenza virus detected is determined from provincial-level sentinel surveillance and applied to the adjusted provincial rates of hospitalized SARI. Healthcare-seeking data from healthcare utilization surveys is used to estimate non-hospitalized influenza-associated SARI. Rates of hospitalized and non-hospitalized influenza-associated SARI are applied to census data to calculate the national number of cases. The method was field-tested in Kenya, and validated in Guatemala, using data from August 2009–July 2011. In Kenya (2009 population 38.6 million persons), the annual number of hospitalized influenza-associated SARI cases ranged from 17,129–27,659 for children <5 years old (2.9–4.7 per 1,000 persons) and 6,882–7,836 for persons ≥5 years old (0.21–0.24 per 1,000 persons), depending on year and base rate used. In Guatemala (2011 population 14.7 million persons), the annual number of hospitalized cases of influenza-associated pneumonia ranged from 1,065–2,259 (0.5–1.0 per 1,000 persons) among children <5 years old and 779–2,252 cases (0.1–0.2 per 1,000 persons) for persons ≥5 years old, depending on year and base rate used. In both countries, the number of non-hospitalized influenza-associated cases was several-fold higher than the hospitalized cases. Conclusions: Influenza virus was associated with a substantial amount of severe disease in Kenya and Guatemala. This method can be performed in most low and lower-middle income countries

Training of Instrumentalists and Development of New Technologies on SOFIA

This white paper is submitted to the Astronomy and Astrophysics 2010 Decadal Survey (Astro2010)1 Committee on the State of the Profession to emphasize the potential of the Stratospheric Observatory for Infrared Astronomy (SOFIA) to contribute to the training of instrumentalists and observers, and to related technology developments. This potential goes beyond the primary mission of SOFIA, which is to carry out unique, high priority astronomical research. SOFIA is a Boeing 747SP aircraft with a 2.5 meter telescope. It will enable astronomical observations anywhere, any time, and at most wavelengths between 0.3 microns and 1.6 mm not accessible from ground-based observatories. These attributes, accruing from the mobility and flight altitude of SOFIA, guarantee a wealth of scientific return. Its instrument teams (nine in the first generation) and guest investigators will do suborbital astronomy in a shirt-sleeve environment. The project will invest $10M per year in science instrument development over a lifetime of 20 years. This, frequent flight opportunities, and operation that enables rapid changes of science instruments and hands-on in-flight access to the instruments, assure a unique and extensive potential - both for training young instrumentalists and for encouraging and deploying nascent technologies. Novel instruments covering optical, infrared, and submillimeter bands can be developed for and tested on SOFIA by their developers (including apprentices) for their own observations and for those of guest observers, to validate technologies and maximize observational effectiveness.Comment: 10 pages, no figures, White Paper for Astro 2010 Survey Committee on State of the Professio

1939: Abilene Christian College Bible Lectures - Full Text

Delivered in the Auditorium of Abilene Christian College, February, 1939, Abilene, Texas Published October, 1939 PRICE, $1.00 FIRM FOUNDATION PUBLISHING HOUSE Austin, Texas

International cancer microbiome consortium consensus statement on the role of the human microbiome in carcinogenesis

Objective In this consensus statement, an international panel of experts deliver their opinions on key questions regarding the contribution of the human microbiome to carcinogenesis.Design International experts in oncology and/or microbiome research were approached by personal communication to form a panel. A structured, iterative, methodology based around a 1-day roundtable discussion was employed to derive expert consensus on key questions in microbiome-oncology research.Results Some 18 experts convened for the roundtable discussion and five key questions were identified regarding: (1) the relevance of dysbiosis/an altered gut microbiome to carcinogenesis; (2) potential mechanisms of microbiota-induced carcinogenesis; (3) conceptual frameworks describing how the human microbiome may drive carcinogenesis; (4) causation versus association; and (5) future directions for research in the field.The panel considered that, despite mechanistic and supporting evidence from animal and human studies, there is currently no direct evidence that the human commensal microbiome is a key determinant in the aetiopathogenesis of cancer. The panel cited the lack of large longitudinal, cohort studies as a principal deciding factor and agreed that this should be a future research priority. However, while acknowledging gaps in the evidence, expert opinion was that the microbiome, alongside environmental factors and an epigenetically/genetically vulnerable host, represents one apex of a tripartite, multidirectional interactome that drives carcinogenesis.Conclusion Data from longitudinal cohort studies are needed to confirm the role of the human microbiome as a key driver in the aetiopathogenesis of cancer

Implementing health research through academic and clinical partnerships : a realistic evaluation of the Collaborations for Leadership in Applied Health Research and Care (CLAHRC)

Background: The English National Health Service has made a major investment in nine partnerships between higher education institutions and local health services called Collaborations for Leadership in Applied Health Research and Care (CLAHRC). They have been funded to increase capacity and capability to produce and implement research through sustained interactions between academics and health services. CLAHRCs provide a natural ‘test bed’ for exploring questions about research implementation within a partnership model of delivery. This protocol describes an externally funded evaluation that focuses on implementation mechanisms and processes within three CLAHRCs. It seeks to uncover what works, for whom, how, and in what circumstances. Design and methods: This study is a longitudinal three-phase, multi-method realistic evaluation, which deliberately aims to explore the boundaries around knowledge use in context. The evaluation funder wishes to see it conducted for the process of learning, not for judging performance. The study is underpinned by a conceptual framework that combines the Promoting Action on Research Implementation in Health Services and Knowledge to Action frameworks to reflect the complexities of implementation. Three participating CLARHCS will provide indepth comparative case studies of research implementation using multiple data collection methods including interviews, observation, documents, and publicly available data to test and refine hypotheses over four rounds of data collection. We will test the wider applicability of emerging findings with a wider community using an interpretative forum. Discussion: The idea that collaboration between academics and services might lead to more applicable health research that is actually used in practice is theoretically and intuitively appealing; however the evidence for it is limited. Our evaluation is designed to capture the processes and impacts of collaborative approaches for implementing research, and therefore should contribute to the evidence base about an increasingly popular (e.g., Mode two, integrated knowledge transfer, interactive research), but poorly understood approach to knowledge translation. Additionally we hope to develop approaches for evaluating implementation processes and impacts particularly with respect to integrated stakeholder involvement