Fitted Q-Learning for Relational Domains

We consider the problem of Approximate Dynamic Programming in relational domains. Inspired by the success of fitted Q-learning methods in propositional settings, we develop the first relational fitted Q-learning algorithms by representing the value function and Bellman residuals. When we fit the Q-functions, we show how the two steps of Bellman operator; application and projection steps can be performed using a gradient-boosting technique. Our proposed framework performs reasonably well on standard domains without using domain models and using fewer training trajectories.Comment: 10 pages, 12 figure

Paget-Schroetter Syndrome: Review of Pathogenesis and Treatment of Effort Thrombosis

Effort thrombosis, or Paget-Schroetter Syndrome, refers to axillary-subclavian vein thrombosis associated with strenuous and repetitive activity of the upper extremities. Anatomical abnormalities at the thoracic outlet and repetitive trauma to the endothelium of the subclavian vein are key factors in its initiation and progression. The role of hereditary and acquired thrombophilias is unclear. The pathogenesis of effort thrombosis is thus distinct from other venous thromboembolic disorders. Doppler ultrasonography is the preferred initial test, while contrast venography remains the gold standard for diagnosis. Computed tomographic venography and magnetic resonance venography are comparable to conventional venography and are being increasingly used. Conservative management with anticoagulation alone is inadequate and leads to significant residual disability. An aggressive multimodal treatment strategy consisting of catheter-directed thrombolysis, with or without early thoracic outlet decompression, is essential for optimizing outcomes. Despite excellent insights into its pathogenesis and advances in treatment, a significant number of patients with effort thrombosis continue to be treated suboptimally. Hence, there is an urgent need for increasing physician awareness about risk factors, etiology and the management of this unique and relatively infrequent disorder

Solution structure and DNA-binding properties of the phosphoesterase domain of DNA ligase D

The phosphoesterase (PE) domain of the bacterial DNA repair enzyme LigD possesses distinctive manganese-dependent 3′-phosphomonoesterase and 3′-phosphodiesterase activities. PE exemplifies a new family of DNA end-healing enzymes found in all phylogenetic domains. Here, we determined the structure of the PE domain of Pseudomonas aeruginosa LigD (PaePE) using solution NMR methodology. PaePE has a disordered N-terminus and a well-folded core that differs in instructive ways from the crystal structure of a PaePE•Mn2+• sulfate complex, especially at the active site that is found to be conformationally dynamic. Chemical shift perturbations in the presence of primer-template duplexes with 3′-deoxynucleotide, 3′-deoxynucleotide 3′-phosphate, or 3′ ribonucleotide termini reveal the surface used by PaePE to bind substrate DNA and suggest a more efficient engagement in the presence of a 3′-ribonucleotide. Spectral perturbations measured in the presence of weakly catalytic (Cd2+) and inhibitory (Zn2+) metals provide evidence for significant conformational changes at and near the active site, compared to the relatively modest changes elicited by Mn2+

Portable Microfluidic Integrated Plasmonic Platform for Pathogen Detection

Timely detection of infectious agents is critical in early diagnosis and treatment of infectious diseases. Conventional pathogen detection methods, such as enzyme linked immunosorbent assay (ELISA), culturing or polymerase chain reaction (PCR) require long assay times, and complex and expensive instruments, which are not adaptable to point-of-care (POC) needs at resource-constrained as well as primary care settings. Therefore, there is an unmet need to develop simple, rapid, and accurate methods for detection of pathogens at the POC. Here, we present a portable, multiplex, inexpensive microfluidic-integrated surface plasmon resonance (SPR) platform that detects and quantifies bacteria, i.e., Escherichia coli (E. coli) and Staphylococcus aureus (S. aureus) rapidly. The platform presented reliable capture and detection of E. coli at concentrations ranging from ~105 to 3.2 × 107 CFUs/mL in phosphate buffered saline (PBS) and peritoneal dialysis (PD) fluid. The multiplexing and specificity capability of the platform was also tested with S. aureus samples. The presented platform technology could potentially be applicable to capture and detect other pathogens at the POC and primary care settings

Genetic Analysis in UK Biobank Links Insulin Resistance and Transendothelial Migration Pathways to Coronary Artery Disease

UK Biobank is among the world’s largest repositories for phenotypic and genotypic information in individuals of European ancestry1. We performed a genome-wide association study in UK Biobank testing ~9 million DNA sequence variants for association with coronary artery disease (4,831 cases; 115,455 controls) and carried out meta-analysis with previously published results. We identified fifteen novel loci, bringing the total number of coronary artery disease-associated loci to 95. Phenome-wide association scanning revealed that CCDC92 likely affects coronary artery disease through insulin resistance pathways whereas experimental analysis suggests that ARHGEF26 impacts the transendothelial migration of leukocytes

A Universal Power-law Prescription for Variability from Synthetic Images of Black Hole Accretion Flows

We present a framework for characterizing the spatiotemporal power spectrum of the variability expected from the horizon-scale emission structure around supermassive black holes, and we apply this framework to a library of general relativistic magnetohydrodynamic (GRMHD) simulations and associated general relativistic ray-traced images relevant for Event Horizon Telescope (EHT) observations of Sgr A*. We find that the variability power spectrum is generically a red-noise process in both the temporal and spatial dimensions, with the peak in power occurring on the longest timescales and largest spatial scales. When both the time-averaged source structure and the spatially integrated light-curve variability are removed, the residual power spectrum exhibits a universal broken power-law behavior. On small spatial frequencies, the residual power spectrum rises as the square of the spatial frequency and is proportional to the variance in the centroid of emission. Beyond some peak in variability power, the residual power spectrum falls as that of the time-averaged source structure, which is similar across simulations; this behavior can be naturally explained if the variability arises from a multiplicative random field that has a steeper high-frequency power-law index than that of the time-averaged source structure. We briefly explore the ability of power spectral variability studies to constrain physical parameters relevant for the GRMHD simulations, which can be scaled to provide predictions for black holes in a range of systems in the optically thin regime. We present specific expectations for the behavior of the M87* and Sgr A* accretion flows as observed by the EHT

Guidelines for the use and interpretation of assays for monitoring autophagy (3rd edition)

In 2008 we published the first set of guidelines for standardizing research in autophagy. Since then, research on this topic has continued to accelerate, and many new scientists have entered the field. Our knowledge base and relevant new technologies have also been expanding. Accordingly, it is important to update these guidelines for monitoring autophagy in different organisms. Various reviews have described the range of assays that have been used for this purpose. Nevertheless, there continues to be confusion regarding acceptable methods to measure autophagy, especially in multicellular eukaryotes. For example, a key point that needs to be emphasized is that there is a difference between measurements that monitor the numbers or volume of autophagic elements (e.g., autophagosomes or autolysosomes) at any stage of the autophagic process versus those that measure fl ux through the autophagy pathway (i.e., the complete process including the amount and rate of cargo sequestered and degraded). In particular, a block in macroautophagy that results in autophagosome accumulation must be differentiated from stimuli that increase autophagic activity, defi ned as increased autophagy induction coupled with increased delivery to, and degradation within, lysosomes (inmost higher eukaryotes and some protists such as Dictyostelium ) or the vacuole (in plants and fungi). In other words, it is especially important that investigators new to the fi eld understand that the appearance of more autophagosomes does not necessarily equate with more autophagy. In fact, in many cases, autophagosomes accumulate because of a block in trafficking to lysosomes without a concomitant change in autophagosome biogenesis, whereas an increase in autolysosomes may reflect a reduction in degradative activity. It is worth emphasizing here that lysosomal digestion is a stage of autophagy and evaluating its competence is a crucial part of the evaluation of autophagic flux, or complete autophagy. Here, we present a set of guidelines for the selection and interpretation of methods for use by investigators who aim to examine macroautophagy and related processes, as well as for reviewers who need to provide realistic and reasonable critiques of papers that are focused on these processes. These guidelines are not meant to be a formulaic set of rules, because the appropriate assays depend in part on the question being asked and the system being used. In addition, we emphasize that no individual assay is guaranteed to be the most appropriate one in every situation, and we strongly recommend the use of multiple assays to monitor autophagy. Along these lines, because of the potential for pleiotropic effects due to blocking autophagy through genetic manipulation it is imperative to delete or knock down more than one autophagy-related gene. In addition, some individual Atg proteins, or groups of proteins, are involved in other cellular pathways so not all Atg proteins can be used as a specific marker for an autophagic process. In these guidelines, we consider these various methods of assessing autophagy and what information can, or cannot, be obtained from them. Finally, by discussing the merits and limits of particular autophagy assays, we hope to encourage technical innovation in the field

First Sagittarius A* Event Horizon Telescope Results. IV. Variability, Morphology, and Black Hole Mass

In this paper we quantify the temporal variability and image morphology of the horizon-scale emission from Sgr A*, as observed by the EHT in 2017 April at a wavelength of 1.3 mm. We find that the Sgr A* data exhibit variability that exceeds what can be explained by the uncertainties in the data or by the effects of interstellar scattering. The magnitude of this variability can be a substantial fraction of the correlated flux density, reaching ∼100% on some baselines. Through an exploration of simple geometric source models, we demonstrate that ring-like morphologies provide better fits to the Sgr A* data than do other morphologies with comparable complexity. We develop two strategies for fitting static geometric ring models to the time-variable Sgr A* data; one strategy fits models to short segments of data over which the source is static and averages these independent fits, while the other fits models to the full data set using a parametric model for the structural variability power spectrum around the average source structure. Both geometric modeling and image-domain feature extraction techniques determine the ring diameter to be 51.8 ± 2.3 μas (68% credible intervals), with the ring thickness constrained to have an FWHM between ∼30% and 50% of the ring diameter. To bring the diameter measurements to a common physical scale, we calibrate them using synthetic data generated from GRMHD simulations. This calibration constrains the angular size of the gravitational radius to be 4.8−0.7+1.4 μas, which we combine with an independent distance measurement from maser parallaxes to determine the mass of Sgr A* to be 4.0−0.6+1.1×106 M ⊙