Comparing policy gradient and value function based reinforcement learning methods in simulated electrical power trade

In electrical power engineering, reinforcement learning algorithms can be used to model the strategies of electricity market participants. However, traditional value function based reinforcement learning algorithms suffer from convergence issues when used with value function approximators. Function approximation is required in this domain to capture the characteristics of the complex and continuous multivariate problem space. The contribution of this paper is the comparison of policy gradient reinforcement learning methods, using artificial neural networks for policy function approximation, with traditional value function based methods in simulations of electricity trade. The methods are compared using an AC optimal power flow based power exchange auction market model and a reference electric power system model

Direction-Dependent Polarised Primary Beams in Wide-Field Synthesis Imaging

The process of wide-field synthesis imaging is explored, with the aim of understanding the implications of variable, polarised primary beams for forthcoming Epoch of Reionisation experiments. These experiments seek to detect weak signatures from redshifted 21cm emission in deep residual datasets, after suppression and subtraction of foreground emission. Many subtraction algorithms benefit from low side-lobes and polarisation leakage at the outset, and both of these are intimately linked to how the polarised primary beams are handled. Building on previous contributions from a number of authors, in which direction-dependent corrections are incorporated into visibility gridding kernels, we consider the special characteristics of arrays of fixed dipole antennas operating around 100-200 MHz, looking towards instruments such as the Square Kilometre Array (SKA) and the Hydrogen Epoch of Reionization Arrays (HERA). We show that integrating snapshots in the image domain can help to produce compact gridding kernels, and also reduce the need to make complicated polarised leakage corrections during gridding. We also investigate an alternative form for the gridding kernel that can suppress variations in the direction-dependent weighting of gridded visibilities by 10s of dB, while maintaining compact support.Comment: 15 pages, 4 figures. Accepted for publication in JA

The hypocretin/orexin antagonist almorexant promotes sleep without impairment of performance in rats.

The hypocretin receptor (HcrtR) antagonist almorexant (ALM) has potent hypnotic actions but little is known about neurocognitive performance in the presence of ALM. HcrtR antagonists are hypothesized to induce sleep by disfacilitation of wake-promoting systems whereas GABAA receptor modulators such as zolpidem (ZOL) induce sleep through general inhibition of neural activity. To test the hypothesis that less functional impairment results from HcrtR antagonist-induced sleep, we evaluated the performance of rats in the Morris Water Maze in the presence of ALM vs. ZOL. Performance in spatial reference memory (SRM) and spatial working memory (SWM) tasks were assessed during the dark period after equipotent sleep-promoting doses (100 mg/kg, po) following undisturbed and sleep deprivation (SD) conditions. ALM-treated rats were indistinguishable from vehicle (VEH)-treated rats for all SRM performance measures (distance traveled, latency to enter, time within, and number of entries into, the target quadrant) after both the undisturbed and 6 h SD conditions. In contrast, rats administered ZOL showed impairments in all parameters measured compared to VEH or ALM in the undisturbed conditions. Following SD, ZOL-treated rats also showed impairments in all measures. ALM-treated rats were similar to VEH-treated rats for all SWM measures (velocity, time to locate the platform and success rate at finding the platform within 60 s) after both the undisturbed and SD conditions. In contrast, ZOL-treated rats showed impairments in velocity and in the time to locate the platform. Importantly, ZOL rats only completed the task 23-50% of the time while ALM and VEH rats completed the task 79-100% of the time. Thus, following equipotent sleep-promoting doses, ZOL impaired rats in both memory tasks while ALM rats performed at levels comparable to VEH rats. These results are consistent with the hypothesis that less impairment results from HcrtR antagonism than from GABAA-induced inhibition

High fidelity radiosity rendering at interactive rates

Thesis (M. Eng.)--Massachusetts Institute of Technology, Dept. of Electrical Engineering and Computer Science, 1996.Includes bibliographical references (p. 66-69).by Stephen Lincoln Hardt.M.Eng

The Scalable Systems Laboratory: a Platform for Software Innovation for HEP

The Scalable Systems Laboratory (SSL), part of the IRIS-HEP Software Institute, provides Institute participants and HEP software developers generally with a means to transition their R&D from conceptual toys to testbeds to production-scale prototypes. The SSL enables tooling, infrastructure, and services supporting the innovation of novel analysis and data architectures, development of software elements and tool-chains, reproducible functional and scalability testing of service components, and foundational systems R&D for accelerated services developed by the Institute. The SSL is constructed with a core team having expertise in scale testing and deployment of services across a wide range of cyberinfrastructure. The core team embeds and partners with other areas in the Institute, and with LHC and other HEP development and operations teams as appropriate, to define investigations and required service deployment patterns. We describe the approach and experiences with early application deployments, including analysis platforms and intelligent data delivery systems

hivstigma.com, an innovative web-supported stigma-reduction intervention for gay and bisexual men

An intervention to address stigma directed toward HIV-positive men and to enhance the sexual health of gay and bisexual men was developed through a community-based process involving HIV prevention workers, public health, government, and researchers. The intervention aimed to diminish stigma, create greater support for HIV-positive men, make disclosure safer and easier, discourage reliance on disclosure to prevent transmission, and encourage testing. The question, “If you were rejected every time you disclosed, would you?” was widely disseminated in the gay community and supported by the website, hivstigma.com, to encourage participation in blog-based discussions. Eight bloggers moderated lively discussions over 5 months. There were 20,844 unique visitors to the site averaging more than 5 minutes each; 4,384 visitors returned more than 10 times. 1,942 men answered a pre-test survey on a popular gay dating site and 1,791, a post-test evaluation. Results show a statistically significant shift among those aware of the intervention toward reduced stigma-related attitudes and behaviors, and toward recognition that HIV positive gay men face stigma in the gay community and that stigma reduces the likelihood of HIV disclosure