Replay across Experiments: A Natural Extension of Off-Policy RL

Replaying data is a principal mechanism underlying the stability and data efficiency of off-policy reinforcement learning (RL). We present an effective yet simple framework to extend the use of replays across multiple experiments, minimally adapting the RL workflow for sizeable improvements in controller performance and research iteration times. At its core, Replay Across Experiments (RaE) involves reusing experience from previous experiments to improve exploration and bootstrap learning while reducing required changes to a minimum in comparison to prior work. We empirically show benefits across a number of RL algorithms and challenging control domains spanning both locomotion and manipulation, including hard exploration tasks from egocentric vision. Through comprehensive ablations, we demonstrate robustness to the quality and amount of data available and various hyperparameter choices. Finally, we discuss how our approach can be applied more broadly across research life cycles and can increase resilience by reloading data across random seeds or hyperparameter variations

Reducing the environmental impact of surgery on a global scale: systematic review and co-prioritization with healthcare workers in 132 countries

Abstract Background Healthcare cannot achieve net-zero carbon without addressing operating theatres. The aim of this study was to prioritize feasible interventions to reduce the environmental impact of operating theatres. Methods This study adopted a four-phase Delphi consensus co-prioritization methodology. In phase 1, a systematic review of published interventions and global consultation of perioperative healthcare professionals were used to longlist interventions. In phase 2, iterative thematic analysis consolidated comparable interventions into a shortlist. In phase 3, the shortlist was co-prioritized based on patient and clinician views on acceptability, feasibility, and safety. In phase 4, ranked lists of interventions were presented by their relevance to high-income countries and low–middle-income countries. Results In phase 1, 43 interventions were identified, which had low uptake in practice according to 3042 professionals globally. In phase 2, a shortlist of 15 intervention domains was generated. In phase 3, interventions were deemed acceptable for more than 90 per cent of patients except for reducing general anaesthesia (84 per cent) and re-sterilization of ‘single-use’ consumables (86 per cent). In phase 4, the top three shortlisted interventions for high-income countries were: introducing recycling; reducing use of anaesthetic gases; and appropriate clinical waste processing. In phase 4, the top three shortlisted interventions for low–middle-income countries were: introducing reusable surgical devices; reducing use of consumables; and reducing the use of general anaesthesia. Conclusion This is a step toward environmentally sustainable operating environments with actionable interventions applicable to both high– and low–middle–income countries

AMEP students online : the view from morning self-access

A spot survey of computer use in open self-access was conducted at the Bankstown Adult Migrant English Program (AMEP) Centre as a way of exploring the changing information and technology environment of AMEP teaching and learning. The survey documents, from a local centre perspective, the growing role of the Internet in meeting technology and information needs among AMEP clients. It confirms that the Internet has become the primary focus of computer use among clients and that Internet skills have become a key skill need. The paper illustrates the forces behind the Internet's growing impact through the case of a particular Web-based resource, the NSW online Driver Knowledge Test. The paper builds upon the broader investigation of AMEP Internet use conducted by Corbel and Taylor (2003) and critically examines their recommendation for the teaching of Internet skills to focus on particular high-value websites.17 page(s

Stepping through the orientation looking glass : a staged approach for postgraduate students

Postgraduate coursework is now delivered to a largely mature age study population, in what may be an unfamiliar mix of online and distance learning to many students. This paper reports on a novel approach to student orientation in this new environment. Orientation is conceptualised as a process of transition between the domain of everyday life and the domain of academic study over a period of time commencing prior to enrolment and continuing into formal studies. A schema addressing three dimensions (interpersonal, technical and reflective) was constructed and operationalised as a staged orientation plan (GettingOnTrack). Students are able to move through the three stages participating in activities which align with their needs before, during and after enrolment. This builds on critical concerns reported in earlier literature, highlighting the need for an extended time line and authentic learning tasks in a risk free environment

Reconfiguration of genomic anchors upon transcriptional activation of the human major histocompatibility complex

The folding of chromatin into topologically constrained loop domains is essential for genomic function. We have identified genomic anchors that define the organization of chromatin loop domains across the human major histocompatibility complex (MHC). This locus contains critical genes for immunity and is associated with more diseases than any other region of the genome. Classical MHC genes are expressed in a cell type-specific pattern and can be induced by cytokines such as interferon-gamma (IFNG). Transcriptional activation of the MHC was associated with a reconfiguration of chromatin architecture resulting from the formation of additional genomic anchors. These findings suggest that the dynamic arrangement of genomic anchors and loops plays a role in transcriptional regulation