Bayesian Policy Reuse

A long-lived autonomous agent should be able to respond online to novel instances of tasks from a familiar domain. Acting online requires 'fast' responses, in terms of rapid convergence, especially when the task instance has a short duration, such as in applications involving interactions with humans. These requirements can be problematic for many established methods for learning to act. In domains where the agent knows that the task instance is drawn from a family of related tasks, albeit without access to the label of any given instance, it can choose to act through a process of policy reuse from a library, rather than policy learning from scratch. In policy reuse, the agent has prior knowledge of the class of tasks in the form of a library of policies that were learnt from sample task instances during an offline training phase. We formalise the problem of policy reuse, and present an algorithm for efficiently responding to a novel task instance by reusing a policy from the library of existing policies, where the choice is based on observed 'signals' which correlate to policy performance. We achieve this by posing the problem as a Bayesian choice problem with a corresponding notion of an optimal response, but the computation of that response is in many cases intractable. Therefore, to reduce the computation cost of the posterior, we follow a Bayesian optimisation approach and define a set of policy selection functions, which balance exploration in the policy library against exploitation of previously tried policies, together with a model of expected performance of the policy library on their corresponding task instances. We validate our method in several simulated domains of interactive, short-duration episodic tasks, showing rapid convergence in unknown task variations.Comment: 32 pages, submitted to the Machine Learning Journa

Successful outcome of six-level cervicothoracic corpectomy and circumferential reconstruction: case report and review of literature on multilevel cervicothoracic corpectomy

The authors report the successful outcome of a six-level corpectomy across the cervico-thoracic spine with circumferential reconstruction in a patient with extensive osteomyelitis of the cervical and upper thoracic spine. To the authors’ knowledge, this is the first report of a corpectomy extending across six levels of the cervico-thoracic spine. Clinical relevance: the authors recommend anterior cage and plate-assisted reconstruction and additional posterior instrumentation using modern spinal surgical techniques and implants

Surgical complications in neuromuscular scoliosis operated with posterior- only approach using pedicle screw fixation

<p>Abstract</p> <p>Background</p> <p>There are no reports describing complications with posterior spinal fusion (PSF) with segmental spinal instrumentation (SSI) using pedicle screw fixation in patients with neuromuscular scoliosis.</p> <p>Methods</p> <p>Fifty neuromuscular patients (18 cerebral palsy, 18 Duchenne muscular dystrophy, 8 spinal muscular atrophy and 6 others) were divided in two groups according to severity of curves; group I (< 90°) and group II (> 90°). All underwent PSF and SSI with pedicle screw fixation. There were no anterior procedures. Perioperative (within three months of surgery) and postoperative (after three months of surgery) complications were retrospectively reviewed.</p> <p>Results</p> <p>There were fifty (37 perioperative, 13 postoperative) complications. Hemo/pneumothorax, pleural effusion, pulmonary edema requiring ICU care, complete spinal cord injury, deep wound infection and death were major complications; while atelectesis, pneumonia, mild pleural effusion, UTI, ileus, vomiting, gastritis, tingling sensation or radiating pain in lower limb, superficial infection and wound dehiscence were minor complications. Regarding perioperative complications, 34(68%) patients had at least one major or one minor complication. There were 16 patients with pulmonary, 14 with abdominal, 3 with wound related, 2 with neurological and 1 cardiovascular complications, respectively. There were two deaths, one due to cardiac arrest and other due to hypovolemic shock. Regarding postoperative complications 7 patients had coccygodynia, 3 had screw head prominence, 2 had bed sore and 1 had implant loosening, respectively. There was a significant relationship between age and increased intraoperative blood loss (p = 0.024). However it did not increased complications or need for ICU care. Similarly intraoperative blood loss > 3500 ml, severity of curve or need of pelvic fixation did not increase the complication rate or need for ICU. DMD patients had higher chances of coccygodynia postoperatively.</p> <p>Conclusion</p> <p>Although posterior-only approach using pedicle screw fixation had good correction rate, complications were similar to previous reports. There were few unusual complications like coccygodynia.</p

The Human Phenotype Ontology in 2024: phenotypes around the world

\ua9 The Author(s) 2023. Published by Oxford University Press on behalf of Nucleic Acids Research. The Human Phenotype Ontology (HPO) is a widely used resource that comprehensively organizes and defines the phenotypic features of human disease, enabling computational inference and supporting genomic and phenotypic analyses through semantic similarity and machine learning algorithms. The HPO has widespread applications in clinical diagnostics and translational research, including genomic diagnostics, gene-disease discovery, and cohort analytics. In recent years, groups around the world have developed translations of the HPO from English to other languages, and the HPO browser has been internationalized, allowing users to view HPO term labels and in many cases synonyms and definitions in ten languages in addition to English. Since our last report, a total of 2239 new HPO terms and 49235 new HPO annotations were developed, many in collaboration with external groups in the fields of psychiatry, arthrogryposis, immunology and cardiology. The Medical Action Ontology (MAxO) is a new effort to model treatments and other measures taken for clinical management. Finally, the HPO consortium is contributing to efforts to integrate the HPO and the GA4GH Phenopacket Schema into electronic health records (EHRs) with the goal of more standardized and computable integration of rare disease data in EHRs