Reinforcement learning or active inference?

This paper questions the need for reinforcement learning or control theory when optimising behaviour. We show that it is fairly simple to teach an agent complicated and adaptive behaviours using a free-energy formulation of perception. In this formulation, agents adjust their internal states and sampling of the environment to minimize their free-energy. Such agents learn causal structure in the environment and sample it in an adaptive and self-supervised fashion. This results in behavioural policies that reproduce those optimised by reinforcement learning and dynamic programming. Critically, we do not need to invoke the notion of reward, value or utility. We illustrate these points by solving a benchmark problem in dynamic programming; namely the mountain-car problem, using active perception or inference under the free-energy principle. The ensuing proof-of-concept may be important because the free-energy formulation furnishes a unified account of both action and perception and may speak to a reappraisal of the role of dopamine in the brain

Male infertility-linked point mutation disrupts the Ca2+ oscillation-inducing and PIP2 hydrolysis activity of sperm PLCζ

A male infertility-linked human PLCζ (phospholipase Cζ) mutation introduced into mouse PLCζ completely abolishes both in vitro PIP2 (phosphatidylinositol 4,5-bisphosphate) hydrolysis activity and the ability to trigger in vivo Ca2+ oscillations in mouse eggs. Wild-type PLCζ initiated a normal pattern of Ca2+ oscillations in eggs in the presence of 10-fold higher mutant PLCζ, suggesting that infertility is not mediated by a dominant-negative mechanism

The Reproducibility of a Kinematically-Derived Axis of the Knee versus Digitized Anatomical Landmarks using a Knee Navigation System

Component position is critical to longevity of knee arthroplasties. Femoral component rotation is typically referenced from the transepicondylar axis (TEA), the anterior-posterior (AP) axis or the posterior condylar axis. Other studies have shown high variability in locating the TEA while proposing digitization of other landmarks such as the AP axis as a less-variable reference. This study uses a navigation system to compare the reproducibility of computing a kinematically-derived, navigated knee axis (NKA) to digitizing the TEA and AP axis. Twelve knees from unembalmed cadavers were tested. Four arthroplasty surgeons digitized the femoral epicondyles and the AP axis direction as well as flexed and extended the knee repeatedly to allow for NKA determination. The variance of the NKA axis determined under neutral loading conditions was smaller than the variance of the TEA axis when the kinematics were measured in the closed surgical condition (P<0.001). However, varus, valgus, and internal loading of the leg increased the variability of the NKA. Distraction of the leg during knee flexion and extension preserved the low variability of the NKA. In conclusion, a kinematically-derived NKA under neutral or distraction loading is more reproducible than the TEA and AP axis determined by digitization

Search for transient optical counterparts to high-energy IceCube neutrinos with Pan-STARRS1

In order to identify the sources of the observed diffuse high-energy neutrino flux, it is crucial to discover their electromagnetic counterparts. IceCube began releasing alerts for single high-energy ($E > 60$ TeV) neutrino detections with sky localisation regions of order 1 deg radius in 2016. We used Pan-STARRS1 to follow-up five of these alerts during 2016-2017 to search for any optical transients that may be related to the neutrinos. Typically 10-20 faint ($m < 22.5$ mag) extragalactic transients are found within the Pan-STARRS1 footprints and are generally consistent with being unrelated field supernovae (SNe) and AGN. We looked for unusual properties of the detected transients, such as temporal coincidence of explosion epoch with the IceCube timestamp. We found only one transient that had properties worthy of a specific follow-up. In the Pan-STARRS1 imaging for IceCube-160427A (probability to be of astrophysical origin of $\sim$50 %), we found a SN PS16cgx, located at 10.0' from the nominal IceCube direction. Spectroscopic observations of PS16cgx showed that it was an H-poor SN at z = 0.2895. The spectra and light curve resemble some high-energy Type Ic SNe, raising the possibility of a jet driven SN with an explosion epoch temporally coincident with the neutrino detection. However, distinguishing Type Ia and Type Ic SNe at this redshift is notoriously difficult. Based on all available data we conclude that the transient is more likely to be a Type Ia with relatively weak SiII absorption and a fairly normal rest-frame r-band light curve. If, as predicted, there is no high-energy neutrino emission from Type Ia SNe, then PS16cgx must be a random coincidence, and unrelated to the IceCube-160427A. We find no other plausible optical transient for any of the five IceCube events observed down to a 5$\sigma$ limiting magnitude of $m \sim 22$ mag, between 1 day and 25 days after detection.Comment: 20 pages, 6 figures, accepted to A&

Co-Crystal Structures of PKG Iβ (92–227) with cGMP and cAMP Reveal the Molecular Details of Cyclic-Nucleotide Binding

Cyclic GMP-dependent protein kinases (PKGs) are central mediators of the NO-cGMP signaling pathway and phosphorylate downstream substrates that are crucial for regulating smooth muscle tone, platelet activation, nociception and memory formation. As one of the main receptors for cGMP, PKGs mediate most of the effects of cGMP elevating drugs, such as nitric oxide-releasing agents and phosphodiesterase inhibitors which are used for the treatment of angina pectoris and erectile dysfunction, respectively. configuration, with a conserved threonine residue anchoring both cyclic phosphate and guanine moieties. The structure of CNBD-A in the absence of bound cyclic nucleotide was similar to that of the cyclic nucleotide bound structures. Surprisingly, isothermal titration calorimetry experiments demonstrated that CNBD-A binds both cGMP and cAMP with a relatively high affinity, showing an approximately two-fold preference for cGMP. conformation through its interaction with Thr193 and an unusual cis-peptide forming residues Leu172 and Cys173. Although these studies provide the first structural insights into cyclic nucleotide binding to PKG, our ITC results show only a two-fold preference for cGMP, indicating that other domains are required for the previously reported cyclic nucleotide selectivity

Genomic, Pathway Network, and Immunologic Features Distinguishing Squamous Carcinomas

This integrated, multiplatform PanCancer Atlas study co-mapped and identified distinguishing molecular features of squamous cell carcinomas (SCCs) from five sites associated with smokin

Pan-Cancer Analysis of lncRNA Regulation Supports Their Targeting of Cancer Genes in Each Tumor Context

Long noncoding RNAs (lncRNAs) are commonly dys-regulated in tumors, but only a handful are known toplay pathophysiological roles in cancer. We inferredlncRNAs that dysregulate cancer pathways, onco-genes, and tumor suppressors (cancer genes) bymodeling their effects on the activity of transcriptionfactors, RNA-binding proteins, and microRNAs in5,185 TCGA tumors and 1,019 ENCODE assays.Our predictions included hundreds of candidateonco- and tumor-suppressor lncRNAs (cancerlncRNAs) whose somatic alterations account for thedysregulation of dozens of cancer genes and path-ways in each of 14 tumor contexts. To demonstrateproof of concept, we showed that perturbations tar-geting OIP5-AS1 (an inferred tumor suppressor) andTUG1 and WT1-AS (inferred onco-lncRNAs) dysre-gulated cancer genes and altered proliferation ofbreast and gynecologic cancer cells. Our analysis in-dicates that, although most lncRNAs are dysregu-lated in a tumor-specific manner, some, includingOIP5-AS1, TUG1, NEAT1, MEG3, and TSIX, synergis-tically dysregulate cancer pathways in multiple tumorcontexts

Pan-cancer Alterations of the MYC Oncogene and Its Proximal Network across the Cancer Genome Atlas

Although theMYConcogene has been implicated incancer, a systematic assessment of alterations ofMYC, related transcription factors, and co-regulatoryproteins, forming the proximal MYC network (PMN),across human cancers is lacking. Using computa-tional approaches, we define genomic and proteo-mic features associated with MYC and the PMNacross the 33 cancers of The Cancer Genome Atlas.Pan-cancer, 28% of all samples had at least one ofthe MYC paralogs amplified. In contrast, the MYCantagonists MGA and MNT were the most frequentlymutated or deleted members, proposing a roleas tumor suppressors.MYCalterations were mutu-ally exclusive withPIK3CA,PTEN,APC,orBRAFalterations, suggesting that MYC is a distinct onco-genic driver. Expression analysis revealed MYC-associated pathways in tumor subtypes, such asimmune response and growth factor signaling; chro-matin, translation, and DNA replication/repair wereconserved pan-cancer. This analysis reveals insightsinto MYC biology and is a reference for biomarkersand therapeutics for cancers with alterations ofMYC or the PMN

Spatial Organization and Molecular Correlation of Tumor-Infiltrating Lymphocytes Using Deep Learning on Pathology Images

Beyond sample curation and basic pathologic characterization, the digitized H&E-stained images of TCGA samples remain underutilized. To highlight this resource, we present mappings of tumorinfiltrating lymphocytes (TILs) based on H&E images from 13 TCGA tumor types. These TIL maps are derived through computational staining using a convolutional neural network trained to classify patches of images. Affinity propagation revealed local spatial structure in TIL patterns and correlation with overall survival. TIL map structural patterns were grouped using standard histopathological parameters. These patterns are enriched in particular T cell subpopulations derived from molecular measures. TIL densities and spatial structure were differentially enriched among tumor types, immune subtypes, and tumor molecular subtypes, implying that spatial infiltrate state could reflect particular tumor cell aberration states. Obtaining spatial lymphocytic patterns linked to the rich genomic characterization of TCGA samples demonstrates one use for the TCGA image archives with insights into the tumor-immune microenvironment