Reinforcement learning in large, structured action spaces: A simulation study of decision support for spinal cord injury rehabilitation

Reinforcement learning (RL) has helped improve decision-making in several applications. However, applying traditional RL is challenging in some applications, such as rehabilitation of people with a spinal cord injury (SCI). Among other factors, using RL in this domain is difficult because there are many possible treatments (i.e., large action space) and few patients (i.e., limited training data). Treatments for SCIs have natural groupings, so we propose two approaches to grouping treatments so that an RL agent can learn effectively from limited data. One relies on domain knowledge of SCI rehabilitation and the other learns similarities among treatments using an embedding technique. We then use Fitted Q Iteration to train an agent that learns optimal treatments. Through a simulation study designed to reflect the properties of SCI rehabilitation, we find that both methods can help improve the treatment decisions of physiotherapists, but the approach based on domain knowledge offers better performance. Our findings provide a "proof of concept" that RL can be used to help improve the treatment of those with an SCI and indicates that continued efforts to gather data and apply RL to this domain are worthwhile.Comment: 31 pages, 7 figure

Quantitative PET reporter gene imaging of CD8+ T cells specific for a melanoma-expressed self-antigen

Adoptive transfer (AT) T-cell therapy provides significant clinical benefits in patients with advanced melanoma. However, approaches to non-invasively visualize the persistence of transferred T cells are lacking. We examined whether positron emission tomography (PET) can monitor the distribution of self-antigen-specific T cells engineered to express an herpes simplex virus 1 thymidine kinase (sr39tk) PET reporter gene. Micro-PET imaging using the sr39tk-specific substrate 9-[4-[18F]fluoro-3-(hydroxymethyl)-butyl]guanine ([18F]FHBG) enabled the detection of transplanted T cells in secondary lymphoid organs of recipient mice over a 3-week period. Tumor responses could be predicted as early as 3 days following AT when a >25-fold increase of micro-PET signal in the spleen and 2-fold increase in lymph nodes (LNs) were observed in mice receiving combined immunotherapy versus control mice. The lower limit of detection was ∼7 × 105 T cells in the spleen and 1 × 104 T cells in LNs. Quantification of transplanted T cells in the tumor was hampered by the sr39tk-independent trapping of [18F]FHBG within the tumor architecture. These data support the feasibility of using PET to visualize the expansion, homing and persistence of transferred T cells. PET may have significant clinical utility by providing the means to quantify anti-tumor T cells throughout the body and provide early correlates for treatment efficacy

The affective modulation of motor awareness in anosognosia for hemiplegia : Behavioural and lesion evidence

© 2015 The Authors. Published by Elsevier Ltd. This is an open access article under the CC BY license (http://creativecommons.org/licenses/by/4.0/).The possible role of emotion in anosognosia for hemiplegia (i.e., denial of motor deficits contralateral to a brain lesion), has long been debated between psychodynamic and neurocognitive theories. However, there are only a handful of case studies focussing on this topic, and the precise role of emotion in anosognosia for hemiplegia requires empirical investigation. In the present study, we aimed to investigate how negative and positive emotions influence motor awareness in anosognosia. Positive and negative emotions were induced under carefully-controlled experimental conditions in right-hemisphere stroke patients with anosognosia for hemiplegia (n = 11) and controls with clinically normal awareness (n = 10). Only the negative, emotion induction condition resulted in a significant improvement of motor awareness in anosognosic patients compared to controls; the positive emotion induction did not. Using lesion overlay and voxel-based lesion-symptom mapping approaches, we also investigated the brain lesions associated with the diagnosis of anosognosia, as well as with performance on the experimental task. Anatomical areas that are commonly damaged in AHP included the right-hemisphere motor and sensory cortices, the inferior frontal cortex, and the insula. Additionally, the insula, putamen and anterior periventricular white matter were associated with less awareness change following the negative emotion induction. This study suggests that motor unawareness and the observed lack of negative emotions about one's disabilities cannot be adequately explained by either purely motivational or neurocognitive accounts. Instead, we propose an integrative account in which insular and striatal lesions result in weak interoceptive and motivational signals. These deficits lead to faulty inferences about the self, involving a difficulty to personalise new sensorimotor information, and an abnormal adherence to premorbid beliefs about the body.Peer reviewedFinal Published versio

Observation Versus Intervention for Low-Grade Intracranial Dural Arteriovenous Fistulas

BACKGROUND: Low-grade intracranial dural arteriovenous fistulas (dAVF) have a benign natural history in the majority of cases. The benefit from treatment of these lesions is controversial. OBJECTIVE: To compare the outcomes of observation versus intervention for low-grade dAVFs. METHODS: We retrospectively reviewed dAVF patients from institutions participating in the CONsortium for Dural arteriovenous fistula Outcomes Research (CONDOR). Patients with low-grade (Borden type I) dAVFs were included and categorized into intervention or observation cohorts. The intervention and observation cohorts were matched in a 1:1 ratio using propensity scores. Primary outcome was modified Rankin Scale (mRS) at final follow-up. Secondary outcomes were excellent (mRS 0-1) and good (mRS 0-2) outcomes, symptomatic improvement, mortality, and obliteration at final follow-up. RESULTS: The intervention and observation cohorts comprised 230 and 125 patients, respectively. We found no differences in primary or secondary outcomes between the 2 unmatched cohorts at last follow-up (mean duration 36 mo), except obliteration rate was higher in the intervention cohort (78.5% vs 24.1%, P < .001). The matched intervention and observation cohorts each comprised 78 patients. We also found no differences in primary or secondary outcomes between the matched cohorts except obliteration was also more likely in the matched intervention cohort (P < .001). Procedural complication rates in the unmatched and matched intervention cohorts were 15.4% and 19.2%, respectively. CONCLUSION: Intervention for low-grade intracranial dAVFs achieves superior obliteration rates compared to conservative management, but it fails to improve neurological or functional outcomes. Our findings do not support the routine treatment of low-grade dAVFs

Risk of Early Versus Later Rebleeding From Dural Arteriovenous Fistulas With Cortical Venous Drainage

Background: Cranial dural arteriovenous fistulas with cortical venous drainage are rare lesions that can present with hemorrhage. A high rate of rebleeding in the early period following hemorrhage has been reported, but published long-term rates are much lower. No study has examined how risk of rebleeding changes over time. Our objective was to quantify the relative incidence of rebleeding in the early and later periods following hemorrhage. Methods: Patients with dural arteriovenous fistula and cortical venous drainage presenting with hemorrhage were identified from the multinational CONDOR (Consortium for Dural Fistula Outcomes Research) database. Natural history follow-up was defined as time from hemorrhage to first treatment, rebleed, or last follow-up. Rebleeding in the first 2 weeks and first year were compared using incidence rate ratio and difference. Results: Of 1077 patients, 250 met the inclusion criteria and had 95 cumulative person-years natural history follow-up. The overall annualized rebleed rate was 7.3% (95% CI, 3.2-14.5). The incidence rate of rebleeding in the first 2 weeks was 0.0011 per person-day; an early rebleed risk of 1.6% in the first 14 days (95% CI, 0.3-5.1). For the remainder of the first year, the incidence rate was 0.00015 per person-day; a rebleed rate of 5.3% (CI, 1.7-12.4) over 1 year. The incidence rate ratio was 7.3 (95% CI, 1.4-37.7; P, 0.026). Conclusions: The risk of rebleeding of a dural arteriovenous fistula with cortical venous drainage presenting with hemorrhage is increased in the first 2 weeks justifying early treatment. However, the magnitude of this increase may be considerably lower than previously thought. Treatment within 5 days was associated with a low rate of rebleeding and appears an appropriate timeframe

Development of 2nd generation aminomethyl spectinomycins that overcome native efflux in Mycobacterium abscessus

Mycobacterium abscessus (Mab), a nontuberculous mycobacterial (NTM) species, is an emerging pathogen with high intrinsic drug resistance. Current standard-of-care therapy results in poor outcomes, demonstrating the urgent need to develop effective antimycobacterial regimens. Through synthetic modification of spectinomycin (SPC), we have identified a distinct structural subclass of N-ethylene linked aminomethyl SPCs (eAmSPCs) that are up to 64-fold more potent against Mab over the parent SPC. Mechanism of action and crystallography studies demonstrate that the eAmSPCs display a mode of ribosomal inhibition consistent with SPC. However, they exert their increased antimicrobial activity through enhanced accumulation, largely by circumventing efflux mechanisms. The N-ethylene linkage within this series plays a critical role in avoiding TetV-mediated efflux, as lead eAmSPC 2593 displays a mere fourfold susceptibility improvement against Mab ΔtetV, in contrast to the 64-fold increase for SPC. Even a minor shortening of the linkage by a single carbon, akin to 1st generation AmSPC 1950, results in a substantial increase in MICs and a 16-fold rise in susceptibility against Mab ΔtetV. These shifts suggest that longer linkages might modify the kinetics of drug expulsion by TetV, ultimately shifting the equilibrium towards heightened intracellular concentrations and enhanced antimicrobial efficacy. Furthermore, lead eAmSPCs were also shown to synergize with various classes of anti-Mab antibiotics and retain activity against clinical isolates and other mycobacterial strains. Encouraging pharmacokinetic profiles coupled with robust efficacy in Mab murine infection models suggest that eAmSPCs hold the potential to be developed into treatments for Mab and other NTM infections

Onyx embolization for dural arteriovenous fistulas:a multi-institutional study

BACKGROUND: Although the liquid embolic agent, Onyx, is often the preferred embolic treatment for cerebral dural arteriovenous fistulas (DAVFs), there have only been a limited number of single-center studies to evaluate its performance. OBJECTIVE: To carry out a multicenter study to determine the predictors of complications, obliteration, and functional outcomes associated with primary Onyx embolization of DAVFs. METHODS: From the Consortium for Dural Arteriovenous Fistula Outcomes Research (CONDOR) database, we identified patients who were treated for DAVF with Onyx-only embolization as the primary treatment between 2000 and 2013. Obliteration rate after initial embolization was determined based on the final angiographic run. Factors predictive of complete obliteration, complications, and functional independence were evaluated with multivariate logistic regression models. RESULTS: A total 146 patients with DAVFs were primarily embolized with Onyx. Mean follow-up was 29 months (range 0-129 months). Complete obliteration was achieved in 80 (55%) patients after initial embolization. Major cerebral complications occurred in six patients (4.1%). At last follow-up, 84% patients were functionally independent. Presence of flow symptoms, age over 65, presence of an occipital artery feeder, and preprocedural home anticoagulation use were predictive of non-obliteration. The transverse-sigmoid sinus junction location was associated with fewer complications, whereas the tentorial location was predictive of poor functional outcomes. CONCLUSIONS: In this multicenter study, we report satisfactory performance of Onyx as a primary DAVF embolic agent. The tentorium remains a more challenging location for DAVF embolization, whereas DAVFs located at the transverse-sigmoid sinus junction are associated with fewer complications

Consortium for Dural Arteriovenous Fistula Outcomes Research (CONDOR):rationale, design, and initial characterization of patient cohort

OBJECTIVE: Cranial dural arteriovenous fistulas (dAVFs) are rare lesions, hampering efforts to understand them and improve their care. To address this challenge, investigators with an established record of dAVF investigation formed an international, multicenter consortium aimed at better elucidating dAVF pathophysiology, imaging characteristics, natural history, and patient outcomes. This report describes the design of the Consortium for Dural Arteriovenous Fistula Outcomes Research (CONDOR) and includes characterization of the 1077-patient cohort. METHODS: Potential collaborators with established interest in the field were identified via systematic review of the literature. To ensure uniformity of data collection, a quality control process was instituted. Data were retrospectively obtained. RESULTS: CONDOR comprises 14 centers in the United States, the United Kingdom, the Netherlands, and Japan that have pooled their data from 1077 dAVF patients seen between 1990 and 2017. The cohort includes 359 patients (33%) with Borden type I dAVFs, 175 (16%) with Borden type II fistulas, and 529 (49%) with Borden type III fistulas. Overall, 852 patients (79%) presented with fistula-related symptoms: 427 (40%) presented with nonaggressive symptoms such as tinnitus or orbital phenomena, 258 (24%) presented with intracranial hemorrhage, and 167 (16%) presented with nonhemorrhagic neurological deficits. A smaller proportion (224 patients, 21%), whose dAVFs were discovered incidentally, were asymptomatic. Many patients (85%, 911/1077) underwent treatment via endovascular embolization (55%, 587/1077), surgery (10%, 103/1077), radiosurgery (3%, 36/1077), or multimodal therapy (17%, 184/1077). The overall angiographic cure rate was 83% (758/911 treated), and treatment-related permanent neurological morbidity was 2% (27/1467 total procedures). The median time from diagnosis to follow-up was 380 days (IQR 120-1038.5 days). CONCLUSIONS: With more than 1000 patients, the CONDOR registry represents the largest registry of cranial dAVF patient data in the world. These unique, well-annotated data will enable multiple future analyses to be performed to better understand dAVFs and their management