MDP Homomorphic Networks: Group Symmetries in Reinforcement Learning

This paper introduces MDP homomorphic networks for deep reinforcement learning. MDP homomorphic networks are neural networks that are equivariant under symmetries in the joint state-action space of an MDP. Current approaches to deep reinforcement learning do not usually exploit knowledge about such structure. By building this prior knowledge into policy and value networks using an equivariance constraint, we can reduce the size of the solution space. We specifically focus on group-structured symmetries (invertible transformations). Additionally, we introduce an easy method for constructing equivariant network layers numerically, so the system designer need not solve the constraints by hand, as is typically done. We construct MDP homomorphic MLPs and CNNs that are equivariant under either a group of reflections or rotations. We show that such networks converge faster than unstructured baselines on CartPole, a grid world and Pong

Determining the safety of ultrafocal salvage high-dose-rate brachytherapy for radiorecurrent prostate cancer: A toxicity assessment of 150 patients

Background and purpose: Local re-treatment of radiorecurrent prostate cancer is potentially curative. However, the increased risk of severe toxicity may outweigh the opportunity of cancer control. This study aims to evaluate treatment-related toxicity from ultrafocal salvage high-dose-rate brachytherapy (HDR-BT) and to investigate potential risk factors. Materials and methods: Toxicity data from 150 treated patients (July 2013-November 2019) was collected from a prospective registry. The treatment aim was to deliver a single dose of 19 Gy to the recurrent lesion as identified on multiparametric MRI and PET-CT. Treating physicians graded genitourinary (GU) and gastro-intestinal (GI) toxicity and erectile dysfunction (ED) using the Common Terminology Criteria for Adverse Events (CTCAE) 4.0, at baseline and during follow-up. Domains with substantial (≥10%) new-onset grade ≥ 2 toxicity were further evaluated using mixed effects logistic regression to find potential risk factors. Results: Median follow-up time was 20 months (IQR 12-31). Over time, new-onset grade 2 and 3 toxicity was recorded in 41% and 3% (GU), 5% and 0% (GI) and 22% and 15% (ED). While GI toxicity remained stably low, grade ≥ 2 GU toxicity and ED were seen twice as frequent in the late phase (>3 months after treatment). Significant risk factors for grade ≥ 2 toxicity were baseline GU toxicity (grade ≥ 2), baseline ED (grade ≥ 2), IPSS (cut-off ≥ 14) and urethral dose (D10%, cut-off ≥ 17 Gy). Conclusion: Ultrafocal salvage HDR-BT is a safe re-treatment option, especially in patients with a favorable symptom profile at baseline. Adherence to urethral dose constraints is important to avoid GU toxicity

Recurrence characteristics after focal salvage HDR brachytherapy in prostate cancer

Background and purpose: Radiorecurrent prostate cancer is often confined to the prostate, predominantly near the index lesion. The purpose of this study was to look at recurrence characteristics in patients treated with focal salvage high dose-rate (HDR) brachytherapy. Materials and methods: Patients treated with MRI-guided HDR brachytherapy, with a single fraction of 19 Gy from July 2013 to October 2021 as focal salvage treatment, were prospectively included in the current study. Imaging data were collected regarding the occurrence of local, regional and distant recurrences, including location of local recurrences (LR) in relation to the HDR radiotherapy field. Results: One hundred seventy-five patients were included after focal salvage HDR brachytherapy (median follow-up 36 months (IQR 23–50)). Three-years biochemical recurrence-free survival, LR-free survival, in-field LR-free survival, out-of-field LR-free survival, any-recurrence-free survival and ADT-free survival were 43% (95%CI 34%–52%), 51% (41%–61%), 70% (61%–80%), 92% (88%–97%), 42% (32%–52%) and 86% (80%–92%), respectively. Larger GTV-size and shorter PSA doubling time were associated with in-field LR in multivariable analysis. Conclusion: After focal salvage HDR brachytherapy with a dose of 1x19 Gy for local prostate cancer recurrence, subsequent recurrences are mostly local and in-field

Development and internal validation of multivariable prediction models for biochemical failure after MRI-guided focal salvage high-dose-rate brachytherapy for radiorecurrent prostate cancer

Background and purpose: Magnetic resonance-guided focal salvage high-dose-rate brachytherapy (FS-HDR-BT) for radiorecurrent prostate cancer (PCa) shows low toxicity rates. However, biochemical failure (BF) after treatment occurs frequently. We developed two prediction models for BF (Phoenix definition) with the aim of enhancing patient counselling before FS-HDR-BT and during follow-up. Materials and methods: A prospective cohort of 150 radiorecurrent PCa patients treated with FS-HDR-BT between 2013 and 2020 was used for model development and internal validation. Multivariable Cox Proportional Hazards regression was applied. For model 1, only pre-salvage variables were included as candidate predictors. For model 2, additional (post-)salvage characteristics were tested. After calibration, nomograms and webtools were constructed. Finally, three risk groups were identified. Results: Sixty-one patients (41%) experienced BF. At baseline (model 1), age, gross tumour volume, pre-salvage PSA, and pre-salvage PSA doubling time (PSADT) were predictive of BF. During follow-up (model 2), age, pre-salvage PSA and PSADT, seminal vesicle involvement, post-salvage time to PSA nadir, and percentage PSA reduction were predictive of BF. The adjusted C-statistics were 0.73 (95% CI: 0.66-0.81) and 0.84 (95% CI: 0.78-0.90), respectively, with acceptable calibration. Estimated 2-year biochemical disease-free survival for the low-, intermediate-, and high-risk groups were 84%, 70%, and 31% (model 1), and 100%, 71%, and 5% (model 2). Conclusion: Two models are provided for prediction of BF in patients with radiorecurrent PCa treated with FS-HDR-BT. Based on pre- and post-salvage characteristics, we are able to identify patients with a high risk of BF. These findings can aid patient counselling for FS-HDR-BT

Immune monitoring and TCR sequencing of CD4 T cells in a long term responsive patient with metastasized pancreatic ductal carcinoma treated with individualized, neoepitope-derived multipeptide vaccines : a case report

Abstract Background Cancer vaccines can effectively establish clinically relevant tumor immunity. Novel sequencing approaches rapidly identify the mutational fingerprint of tumors, thus allowing to generate personalized tumor vaccines within a few weeks from diagnosis. Here, we report the case of a 62-year-old patient receiving a four-peptide-vaccine targeting the two sole mutations of his pancreatic tumor, identified via exome sequencing. Methods Vaccination started during chemotherapy in second complete remission and continued monthly thereafter. We tracked IFN-γ+ T cell responses against vaccine peptides in peripheral blood after 12, 17 and 34 vaccinations by analyzing T-cell receptor (TCR) repertoire diversity and epitope-binding regions of peptide-reactive T-cell lines and clones. By restricting analysis to sorted IFN-γ-producing T cells we could assure epitope-specificity, functionality, and TH1 polarization. Results A peptide-specific T-cell response against three of the four vaccine peptides could be detected sequentially. Molecular TCR analysis revealed a broad vaccine-reactive TCR repertoire with clones of discernible specificity. Four identical or convergent TCR sequences could be identified at more than one time-point, indicating timely persistence of vaccine-reactive T cells. One dominant TCR expressing a dual TCRVα chain could be found in three T-cell clones. The observed T-cell responses possibly contributed to clinical outcome: The patient is alive 6 years after initial diagnosis and in complete remission for 4 years now. Conclusions Therapeutic vaccination with a neoantigen-derived four-peptide vaccine resulted in a diverse and long-lasting immune response against these targets which was associated with prolonged clinical remission. These data warrant confirmation in a larger proof-of concept clinical trial

Untangling the dinosaur family tree

For over a century, the standard classification scheme has split dinosaurs into two fundamental groups: ‘lizard-hipped’ saurischians (including meat-eating theropods and long-necked sauropodomorphs) and ‘bird-hipped’ ornithischians (including a variety of herbivorous species).In a recent paper, Baron et al. challenged this paradigm with a new phylogenetic analysis that places theropods and ornithischians together in a group called Ornithoscelida, to the exclusion of sauropodomorphs, and used their phylogeny to argue that dinosaurs may have originated in northern Pangaea, not in the southern part of the supercontinent, as has more commonly been considered. Here we evaluate and reanalyse the morphological dataset underpinning the proposal by Baron et al. and provide quantitative biogeographic analyses, which challenge the key results of their study by recovering a classical monophyletic Saurischia and a Gondwanan origin for dinosaurs. This shows that the Ornithoscelida hypothesis is not the final word, and that there is still great uncertainty around the basic structure of the dinosaur family tree.Fil: Langer, Max C.. Universidade de Sao Paulo; BrasilFil: Ezcurra, Martin Daniel. Consejo Nacional de Investigaciones Científicas y Técnicas. Oficina de Coordinación Administrativa Parque Centenario. Museo Argentino de Ciencias Naturales “Bernardino Rivadavia”; ArgentinaFil: Rauhut, Oliver Walter Mischa. Ludwig Maximilians Universitat; AlemaniaFil: Benton, Michael J.. University of Bristol; Reino UnidoFil: Knoll, Fabien. University of Manchester; Reino UnidoFil: McPhee, Blair W.. Universidade de Sao Paulo; BrasilFil: Novas, Fernando Emilio. Consejo Nacional de Investigaciones Científicas y Técnicas. Oficina de Coordinación Administrativa Parque Centenario. Museo Argentino de Ciencias Naturales “Bernardino Rivadavia”; ArgentinaFil: Pol, Diego. Museo Paleontológico Egidio Feruglio; Argentina. Consejo Nacional de Investigaciones Científicas y Técnicas; ArgentinaFil: Brusatte, Stephen L.. University of Edinburgh; Reino Unid