Using the online cross-entropy method to learn relational policies for playing different games

By defining a video-game environment as a collection of objects, relations, actions and rewards, the relational reinforcement learning algorithm presented in this paper generates and optimises a set of concise, human-readable relational rules for achieving maximal reward. Rule learning is achieved using a combination of incremental specialisation of rules and a modified online cross-entropy method, which dynamically adjusts the rate of learning as the agent progresses. The algorithm is tested on the Ms. Pac-Man and Mario environments, with results indicating the agent learns an effective policy for acting within each environment

Through the eye of a needle : The Role of Pietistic and Mystical Thought among the Anglican Elite in the Eighteenth Century Lowcountry South

This dissertation examines the transmission and eventual manifestation of Christian pietistic and mystical thought into the Colonial and Revolutionary lowcountry South. The facilitators of this transmission include the Continental Pietists, who were themselves heavily influenced by the mystics, and British Evangelicals such as John Wesley and George Whitefield, who, even in their public denials of mysticism, nevertheless demonstrated its strong influence in their ministries. Mystical and pietistic expressions impacted the religious, social, and political life of the lowcountry more than has been previously recognized. Evangelical Pietism\u27s mid-eighteenth century infusion prompted some to correctly recognize its subjective (i.e. inwardly focused and feelings oriented) roots in medieval Catholic mysticism. Such association led them to wrongly conclude, however, that Evangelicals were secret emissaries of Rome sent to disrupt social and religious stability in the region. Enthusiastic religion did not play the disruptive role that many feared it would. Granted, misguided notions led to early concerns in the lowcountry, but in the end, Evangelical Pietism\u27s transcendent and flexible qualities contributed to the formation of political and social consensus, provided a new means to obtain significance in the larger British world, helped transform the image of slavery into a uniquely Christian institution, and supplied impulse for unified action during the Revolutionary Era

The Great Awokening

The Great “Awokening”[1] “Were you to see him in his most violent agitations, you would be apt to think that he was a madman just broke from his chains.”—Boston Evening Post on James Davenport, Aug. 2, 1742. “I\u27m actually not a fan of the word \u27woke.\u27 I think the connotation of that means being socially aware, which is a beautiful thing to be. But it does not take into account being self-aware.”—India Arie Most of my historical research has been on The First Great Awakening, an eighteenth-century revival movement that played a major role in shaping the religious and social landscape of early America.[2] This season of revival did much good throughout the American colonies, ushering many souls into the Kingdom of God. But it also did much harm. Some like Jonathan Edwards, who reflected deeply on the Great Awakening, concluded that many, far too many, even of his own converts, blindly rushed into the emotional grand gesturing of the moment, only to fall away in due course. One of the negatives connected to the Great Awakening was a propensity toward an excessively judgmental spirit. Revivalist preachers (New Lights) in colonial America often called into question the salvation of main-line, non-revivalist ministers (Old Lights). For example, if anyone, including ministers, could not recall a specific time and place of immediate conversion, their faith was suspect. [1] This article is an adaptation from chapter 5 of my book Among the Deplorables: Confessions of a Populist Evangelical (KDP, 2020). [2] See my A Cautious Enthusiasm: Mystical Piety and Evangelicalism in Colonial South Carolina (Columbia: University of South Carolina Press, 2013)

Estimating oil concentration and flow rate with calibrated vessel-mounted acoustic echo sounders

As part of a larger program aimed at evaluating acoustic techniques for mapping the distribution of subsurface oil and gas associated with the Deepwater Horizon-Macondo oil spill, observations were made on June 24 and 25, 2010 using vessel-mounted calibrated single-beam echo sounders on the National Oceanic and Atmospheric Administration ship Thomas Jefferson. Coincident with visual observations of oil at the sea surface, the 200-kHz echo sounder showed anomalously high-volume scattering strength in the upper 200 m on the western side of the wellhead, more than 100 times higher than the surrounding waters at 1,800-m distance from the wellhead, and weakening with increasing distance out to 5,000 m. Similar high-volume scattering anomalies were not observed at 12 or 38 kHz, although observations of anomalously low-volume scattering strength were made in the deep scattering layer at these frequencies at approximately the same locations. Together with observations of ocean currents, the acoustic observations are consistent with a rising plume of small (\u3c 1-mm radius) oil droplets. Using simplistic but reasonable assumptions about the properties of the oil droplets, an estimate of the flow rate was made that is remarkably consistent with those made at the wellhead by other means. The uncertainty in this acoustically derived estimate is high due to lack of knowledge of the size distribution and rise speed of the oil droplets. If properly constrained, these types of acoustic measurements can be used to rapidly estimate the flow rate of oil reaching the surface over large temporal and spatial scales

Starch mobilization in leaves

Starch mobilization is well understood in cereal endosperms, but both the pathway and the regulation of the process are poorly characterized in other types of plant organs. Arabidopsis leaves offer the opportunity for rapid progress in this area, because of the genomic resources available in this species and the ease with which starch synthesis and degradation can be monitored and manipulated. Progress in understanding three aspects of starch degradation is described: the role of disproportionating enzyme, the importance of phosphorolytic degradation, and new evidence about the involvement of a starch‐phosphorylating enzyme in the degradative process. Major areas requiring further research are outline

The Effects of Very Light Jet Air Taxi Operations on Commercial Air Traffic

This study investigates the potential effects of Very Light Jet (VLJ) air taxi operations adding to delays experienced by commercial passenger air transportation in the year 2025. The affordable cost relative to existing business jets and ability to use many of the existing small, minimally equipped, but conveniently located airports is projected to stimulate a large demand for the aircraft. The resulting increase in air traffic operations will mainly be at smaller airports, but this study indicates that VLJs have the potential to increase further the pressure of demand at some medium and large airports, some of which are already operating at or near capacity at peak times. The additional delays to commercial passenger air transportation due to VLJ air taxi operations are obtained from simulation results using the Airspace Concepts Evaluation System (ACES) simulator. The direct increase in operating cost due to additional delays is estimated. VLJs will also cause an increase in traffic density, and this study shows increased potential for conflicts due to VLJ operations

Enhancing polyimide\u27s water barrier properties through addition of functionalized graphene oxide

Graphene oxide produced by Tour\u27s method (GO) and GO functionalized with 4-4\u27 oxydianiline (ODAGO) are incorporated at 0.01 to 0.10 weight percent (wt%) into a polyimide (PI) made from 3,3\u27-benzophe-nonetetracarboxylic dianhydride (BTDA) and 4-4\u27 oxydianiline (ODA). The performance properties of these two systems GO-PI and ODAGO-PI at extremely low GO concentrations are compared. ODAGO-PI nanocomposite\u27s performance properties are comparable to previous results citing concentrations 10 times higher and displayed significantly greater improvement than unfunctionalized GO-PI films. The 0.01 wt% ODAGO-PI film demonstrated a factor of ten decrease in water vapor permeability. The 0.10 wt% ODAGO-PI film displayed the maximum increase of 82% in Young\u27s modulus. The water vapor permeability results were fit to the Nielsen law. We found that the model yielded unphysically large aspect ratios for the 0.01 wt% ODAGO-PI, 100 times larger than the AFM-measured value. For the GO-PI, we observe less enhancement of the barrier properties. The large aspect ratio indicates tortuosity effects alone cannot explain the enhanced barrier properties. We propose that the improved barrier properties are also due to a stabilizing effect of the flakes on the polymer matrix, where reduced mobility of the PI chain reduces diffusion through the polymer matrix. ATR-FTIR, WAXS, Raman and T-g results support this view. (C) 2016 Elsevier Ltd. All rights reserved

Patients Who Request a Female Psychotherapist

Upon arriving at an outpatient clinic, many patients request to see a female psychotherapist. Yet little has been written on this topic. The aim of this study was to explore the demographic and clinical characteristics of such patients. We compared patients who voiced a preference for a female therapist with controls on the demographic variables of age, sex, race, marital and financial status and the clinical characteristics of diagnosis, history of sexual abuse, sexual preference, overt presence of sexual or social difficulties, history of prior treatment, gender of the previous therapist, and treatment drop out rate. A chi square analysis for categorical data was used to measure differences between the two populations. We found that patients who voiced a request for a female therapist were more often white, young, or had voiced sexual or social difficulties in their chief complaint. The treatment drop out rate of study patients whose request was granted was greater than control patients who received a female therapist. The request for a female therapist may be reflective of an age or race based comfort in expressing preference, or related to specific presenting complaints in the realm of sexual or social relationships. Granting such a request without an understanding of its significance may result in premature termination of treatment

Soil Microbial Networks Shift Across a High-Elevation Successional Gradient.

While it is well established that microbial composition and diversity shift along environmental gradients, how interactions among microbes change is poorly understood. Here, we tested how community structure and species interactions among diverse groups of soil microbes (bacteria, fungi, non-fungal eukaryotes) change across a fundamental ecological gradient, succession. Our study system is a high-elevation alpine ecosystem that exhibits variability in successional stage due to topography and harsh environmental conditions. We used hierarchical Bayesian joint distribution modeling to remove the influence of environmental covariates on species distributions and generated interaction networks using the residual species-to-species variance-covariance matrix. We hypothesized that as ecological succession proceeds, diversity will increase, species composition will change, and soil microbial networks will become more complex. As expected, we found that diversity of most taxonomic groups increased over succession, and species composition changed considerably. Interestingly, and contrary to our hypothesis, interaction networks became less complex over succession (fewer interactions per taxon). Interactions between photosynthetic microbes and any other organism became less frequent over the gradient, whereas interactions between plants or soil microfauna and any other organism were more abundant in late succession. Results demonstrate that patterns in diversity and composition do not necessarily relate to patterns in network complexity and suggest that network analyses provide new insight into the ecology of highly diverse, microscopic communities