Towards Feature Selection In Actor-Critic Algorithms

Choosing features for the critic in actor-critic algorithms with function approximation is known to be a challenge. Too few critic features can lead to degeneracy of the actor gradient, and too many features may lead to slower convergence of the learner. In this paper, we show that a well-studied class of actor policies satisfy the known requirements for convergence when the actor features are selected carefully. We demonstrate that two popular representations for value methods - the barycentric interpolators and the graph Laplacian proto-value functions - can be used to represent the actor in order to satisfy these conditions. A consequence of this work is a generalization of the proto-value function methods to the continuous action actor-critic domain. Finally, we analyze the performance of this approach using a simulation of a torque-limited inverted pendulum

Mirroring to Build Trust in Digital Assistants

We describe experiments towards building a conversational digital assistant that considers the preferred conversational style of the user. In particular, these experiments are designed to measure whether users prefer and trust an assistant whose conversational style matches their own. To this end we conducted a user study where subjects interacted with a digital assistant that responded in a way that either matched their conversational style, or did not. Using self-reported personality attributes and subjects' feedback on the interactions, we built models that can reliably predict a user's preferred conversational style.Comment: Preprin

Predicting drug side-effects by chemical systems biology

Chemical systems biology approaches can explain unexpected observations of drug inefficacy or side-effects

Coherent Functional Modules Improve Transcription Factor Target Identification, Cooperativity Prediction, and Disease Association

Transcription factors (TFs) are fundamental controllers of cellular regulation that function in a complex and combinatorial manner. Accurate identification of a transcription factor's targets is essential to understanding the role that factors play in disease biology. However, due to a high false positive rate, identifying coherent functional target sets is difficult. We have created an improved mapping of targets by integrating ChIP-Seq data with 423 functional modules derived from 9,395 human expression experiments. We identified 5,002 TF-module relationships, significantly improved TF target prediction, and found 30 high-confidence TF-TF associations, of which 14 are known. Importantly, we also connected TFs to diseases through these functional modules and identified 3,859 significant TF-disease relationships. As an example, we found a link between MEF2A and Crohn's disease, which we validated in an independent expression dataset. These results show the power of combining expression data and ChIP-Seq data to remove noise and better extract the associations between TFs, functional modules, and disease

An integrative method for scoring candidate genes from association studies: application to warfarin dosing

BackgroundA key challenge in pharmacogenomics is the identification of genes whose variants contribute to drug response phenotypes, which can include severe adverse effects. Pharmacogenomics GWAS attempt to elucidate genotypes predictive of drug response. However, the size of these studies has severely limited their power and potential application. We propose a novel knowledge integration and SNP aggregation approach for identifying genes impacting drug response. Our SNP aggregation method characterizes the degree to which uncommon alleles of a gene are associated with drug response. We first use pre-existing knowledge sources to rank pharmacogenes by their likelihood to affect drug response. We then define a summary score for each gene based on allele frequencies and train linear and logistic regression classifiers to predict drug response phenotypes.ResultsWe applied our method to a published warfarin GWAS data set comprising 181 individuals. We find that our method can increase the power of the GWAS to identify both VKORC1 and CYP2C9 as warfarin pharmacogenes, where the original analysis had only identified VKORC1. Additionally, we find that our method can be used to discriminate between low-dose (AUROC=0.886) and high-dose (AUROC=0.764) responders.ConclusionsOur method offers a new route for candidate pharmacogene discovery from pharmacogenomics GWAS, and serves as a foundation for future work in methods for predictive pharmacogenomics

Crossing the Communication Chasm: Challenges and Opportunities in Transitions of Care from the Hospital to the Primary Care Clinic

Background Transitions of care from specialty and acute settings to primary care abound. Compared to the continuity in end-of-shift handoffs, care transitions involve provider communication between practices and facilities with their own cultures and bureaucracies. Using the transition from acute care to outpatient primary care for stroke/transient ischemic attack (TIA) patients as a case study, this qualitative research explored communication practices and institutional arrangements among clinical providers responsible for longitudinal management of hypertension. In this study, researchers investigated the barriers and facilitators of effective communication between acute stroke/TIA inpatient and primary care providers at a Veterans Affairs Medical Center. Methods A multidisciplinary team conducted consensus-based coding and thematic analysis of semistructured interviews with 21 clinical providers (9 with primary responsibilities for inpatient care and 12 with primary responsibilities in outpatient, primary care). Results Thematic analysis of responses identified three factors that influenced communication between clinical providers: (1) consistent, concise but complete medication and treatment plans; (2) reliable, standardized discharge documentation; (3) use of multiple modes of communication. Participants identified cultural barriers, including challenges with rotating providers at a teaching hospital and local discharge practices. Conclusion Ambiguity about who is being handed off to and time pressures in the acute setting may lead inpatient providers to give lower priority to discharge communication, leaving outpatient providers with low-quality information. While electronic templates have standardized key components of discharge documentation, improvement opportunities remain. Increased awareness of the challenges and opportunities on each side of the care transfer could foster communication practices that systematically account for the information needs of inpatient and outpatient providers

Astronomy below the survey threshold in the SKA era

Astronomy at or below the 'survey threshold' has expanded significantly since the publication of the original 'Science with the Square Kilometer Array' in 1999 and its update in 2004. The techniques in this regime may be broadly (but far from exclusively) defined as 'confusion' or 'P(D)' analyses (analyses of one-point statistics), and 'stacking', accounting for the flux-density distribution of noise-limited images co-added at the positions of objects detected/isolated in a different waveband. Here we discuss the relevant issues, present some examples of recent analyses, and consider some of the consequences for the design and use of surveys with the SKA and its pathfinders

WHY ARE RAPIDLY ROTATING M DWARFS IN THE PLEIADES SO (INFRA)RED? NEW PERIOD MEASUREMENTS CONFIRM ROTATION-DEPENDENT COLOR OFFSETS FROM THE CLUSTER SEQUENCE

Stellar rotation periods ( P {sub rot}) measured in open clusters have proved to be extremely useful for studying stars’ angular momentum content and rotationally driven magnetic activity, which are both age- and mass-dependent processes. While P {sub rot} measurements have been obtained for hundreds of solar-mass members of the Pleiades, measurements exist for only a few low-mass (<0.5 M {sub ⊙}) members of this key laboratory for stellar evolution theory. To fill this gap, we report P {sub rot} for 132 low-mass Pleiades members (including nearly 100 with M ≤ 0.45 M {sub ⊙}), measured from photometric monitoring of the cluster conducted by the Palomar Transient Factory in late 2011 and early 2012. These periods extend the portrait of stellar rotation at 125 Myr to the lowest-mass stars and re-establish the Pleiades as a key benchmark for models of the transport and evolution of stellar angular momentum. Combining our new P {sub rot} with precise BVIJHK photometry reported by Stauffer et al. and Kamai et al., we investigate known anomalies in the photometric properties of K and M Pleiades members. We confirm the correlation detected by Kamai et al. between a star's P {sub rot} and position relative tomore » the main sequence in the cluster's color–magnitude diagram. We find that rapid rotators have redder ( V − K ) colors than slower rotators at the same V , indicating that rapid and slow rotators have different binary frequencies and/or photospheric properties. We find no difference in the photometric amplitudes of rapid and slow rotators, indicating that asymmetries in the longitudinal distribution of starspots do not scale grossly with rotation rate.« les

Senescence in vitro and ionising radiations—the human diploid fibroblast model

The influence of ionising radiations on ageing is still controversial. Since Hayflick established the concept that diploid cells have finite lifespan in vitro, human diploid fibroblast (HDF) cultures have been recognised as a potent experimental model for cytogerontological investigations. In this study HDF cultures in phase II were exposed to acute irradiation with either X-rays on fast neutrons. The replicative potentials and labelling indices with [3H]thymidine were measured post irradiation until the cultures ceased growth in phase III. Cell mortality was measured by cloning. The apparent loss in replicative potential of irradiated mass cultures was wholly attributable to the loss of viable clonogenic cells. The current concept of precocious clonal senescence in vitro as a late effect of irradiation in clonogenic survivors is not supported by the present experiments. Instead, our results suggest that exposure to a single dose of ionising radiations either causes total replicative incapacitation (killing) of HDF cells and their progeny early after irradiation or leaves their replicative potentials unperturbed

Aurora: A Software Radio for Electromagnetic Vector Sensors in Space

The AERO (Auroral Emission Radio Observer) and VISTA (Vector Interferometry Space Technology using AERO) missions will advance auroral radio science and radio interferometry technology. AERO is intended to qualify and validate electromagnetic vector sensor technology in space while also answering key scientific questions about the nature and sources of auroral radio emissions. These questions cannot be addressed from the ground due to shielding by the ionosphere. VISTA, together with AERO, will provide the first demonstration of interferometric imaging, beamforming, and nulling using electromagnetic vector sensors at low frequencies (100 kHz – 15 MHz) using Space based sensors. A key component of the AERO-VISTA joint mission is the Aurora software radio system which forms the primary mission payload when combined with an electromagnetic vector sensor antenna (VSA). This radio combines the analog, digital, and signal processing necessary to detect and digitize the signals associated with the radio aurora. We provide a detailed discussion of the radio design, implementation, and performance results from early testing of our engineering model units