Adaptive patch foraging in deep reinforcement learning agents

Patch foraging is one of the most heavily studied behavioral optimization challenges in biology. However, despite its importance to biological intelligence, this behavioral optimization problem is understudied in artificial intelligence research. Patch foraging is especially amenable to study given that it has a known optimal solution, which may be difficult to discover given current techniques in deep reinforcement learning. Here, we investigate deep reinforcement learning agents in an ecological patch foraging task. For the first time, we show that machine learning agents can learn to patch forage adaptively in patterns similar to biological foragers, and approach optimal patch foraging behavior when accounting for temporal discounting. Finally, we show emergent internal dynamics in these agents that resemble single-cell recordings from foraging non-human primates, which complements experimental and theoretical work on the neural mechanisms of biological foraging. This work suggests that agents interacting in complex environments with ecologically valid pressures arrive at common solutions, suggesting the emergence of foundational computations behind adaptive, intelligent behavior in both biological and artificial agents.Comment: Published in Transactions on Machine Learning Research (TMLR). See: https://openreview.net/pdf?id=a0T3nOP9s

Does the extended Glasgow Outcome Scale add value to the conventional Glasgow Outcome Scale?

The Glasgow Outcome Scale (GOS) is firmly established as the primary outcome measure for use in Phase III trials of interventions in traumatic brain injury (TBI). However, the GOS has been criticized for its lack of sensitivity to detect small but clinically relevant changes in outcome. The Glasgow Outcome Scale-Extended (GOSE) potentially addresses this criticism, and in this study we estimate the efficiency gain associated with using the GOSE in place of the GOS in ordinal analysis of 6-month outcome. The study uses both simulation and the reanalysis of existing data from two completed TBI studies, one an observational cohort study and the other a randomized controlled trial. As expected, the results show that using an ordinal technique to analyze the GOS gives a substantial gain in efficiency relative to the conventional analysis, which collapses the GOS onto a binary scale (favorable versus unfavorable outcome). We also found that using the GOSE gave a modest but consistent increase in efficiency relative to the GOS in both studies, corresponding to a reduction in the required sample size of the order of 3–5%. We recommend that the GOSE be used in place of the GOS as the primary outcome measure in trials of TBI, with an appropriate ordinal approach being taken to the statistical analysis

Contemporary Review of Hemodynamic Monitoring in the Critical Care Setting

Hemodynamic assessment remains the most valuable adjunct to physical examination and laboratory assessment in the diagnosis and management of shock. Through the years, multiple modalities to measure and trend hemodynamic indices have evolved with varying degrees of invasiveness. Pulmonary artery catheter (PAC) has long been considered the gold standard of hemodynamic assessment in critically ill patients and in recent years has been shown to improve clinical outcomes among patients in cardiogenic shock. The invasive nature of PAC is often cited as its major limitation and has encouraged development of less invasive technologies. In this review, the authors summarize the literature on the mechanism and validation of several minimally invasive and noninvasive modalities available in the contemporary intensive care unit. They also provide an update on the use of focused bedside echocardiography

Infiltration efficiency and subsurface water processes of a sustainable drainage system and consequences to flood management

With increased intensity rainfall events globally and urban expansion decreasing permeable surfaces, there is an increasing problem of urban flooding. This study aims to better understand rainfall infiltration into a Sustainable Drainage System (SuDS) permeable pavement, compared with an adjacent Green Area of made ground, in relationship to groundwater levels below both areas. Both areas were instrumented with soil water content and matric potential sensors and four shallow boreholes were instrumented with groundwater level sensors. Surface infiltration rates were measured using a double‐ring infiltrometer. Results showed that average infiltration rates of the SuDS (1,925 mm/hr) were significantly higher than the Green Area (56 mm/hr). The SuDS was well designed to transfer rainfall rapidly to the aquifer below, where groundwater levels rapidly rose within 1 hr of a 1 in 30 year event (32.8 mm/hr). In comparison, soil compaction of the made ground Green Area decreased infiltration rates, but still enabled the majority of rainfall events to infiltrate. The aquifer below the Green Area responded more slowly, as lower matrix potentials facilitated water retention in the soil profile, slowing water draining to the aquifer. This work reiterates the importance of ensuring a 1 m separation depth between the base of the SuDS infiltration zone and aquifer depth

The α-dystroglycan N-terminus is a broad-spectrum antiviral agent against SARS-CoV-2 and enveloped viruses

The COVID-19 pandemic has shown the need to develop effective therapeutics in preparedness for further epidemics of virus infections that pose a significant threat to human health. As a natural compound antiviral candidate, we focused on α-dystroglycan, a highly glycosylated basement membrane protein that links the extracellular matrix to the intracellular cytoskeleton. Here we show that the N-terminal fragment of α-dystroglycan (α-DGN), as produced in E. coli in the absence of post-translational modifications, blocks infection of SARS-CoV-2 in cell culture, human primary gut organoids and the lungs of transgenic mice expressing the human receptor angiotensin I-converting enzyme 2 (hACE2). Prophylactic and therapeutic administration of α-DGN reduced SARS-CoV-2 lung titres and protected the mice from respiratory symptoms and death. Recombinant α-DGN also blocked infection of a wide range of enveloped viruses including the four Dengue virus serotypes, influenza A virus, respiratory syncytial virus, tick-borne encephalitis virus, but not human adenovirus, a non-enveloped virus in vitro. This study establishes soluble recombinant α-DGN as a broad-band, natural compound candidate therapeutic against enveloped viruses.</p

Thrombolytic removal of intraventricular haemorrhage in treatment of severe stroke: results of the randomised, multicentre, multiregion, placebo-controlled CLEAR III trial

Background: Intraventricular haemorrhage is a subtype of intracerebral haemorrhage, with 50% mortality and serious disability for survivors. We aimed to test whether attempting to remove intraventricular haemorrhage with alteplase versus saline irrigation improved functional outcome. Methods: In this randomised, double-blinded, placebo-controlled, multiregional trial (CLEAR III), participants with a routinely placed extraventricular drain, in the intensive care unit with stable, non-traumatic intracerebral haemorrhage volume less than 30 mL, intraventricular haemorrhage obstructing the 3rd or 4th ventricles, and no underlying pathology were adaptively randomly assigned (1:1), via a web-based system to receive up to 12 doses, 8 h apart of 1 mg of alteplase or 0·9% saline via the extraventricular drain. The treating physician, clinical research staff, and participants were masked to treatment assignment. CT scans were obtained every 24 h throughout dosing. The primary efficacy outcome was good functional outcome, defined as a modified Rankin Scale score (mRS) of 3 or less at 180 days per central adjudication by blinded evaluators. This study is registered with ClinicalTrials.gov, NCT00784134. Findings: Between Sept 18, 2009, and Jan 13, 2015, 500 patients were randomised: 249 to the alteplase group and 251 to the saline group. 180-day follow-up data were available for analysis from 246 of 249 participants in the alteplase group and 245 of 251 participants in the placebo group. The primary efficacy outcome was similar in each group (good outcome in alteplase group 48% vs saline 45%; risk ratio [RR] 1·06 [95% CI 0·88–1·28; p=0·554]). A difference of 3·5% (RR 1·08 [95% CI 0·90–1·29], p=0·420) was found after adjustment for intraventricular haemorrhage size and thalamic intracerebral haemorrhage. At 180 days, the treatment group had lower case fatality (46 [18%] vs saline 73 [29%], hazard ratio 0·60 [95% CI 0·41–0·86], p=0·006), but a greater proportion with mRS 5 (42 [17%] vs 21 [9%]; RR 1·99 [95% CI 1·22–3·26], p=0·007). Ventriculitis (17 [7%] alteplase vs 31 [12%] saline; RR 0·55 [95% CI 0·31–0·97], p=0·048) and serious adverse events (114 [46%] alteplase vs 151 [60%] saline; RR 0·76 [95% CI 0·64–0·90], p=0·002) were less frequent with alteplase treatment. Symptomatic bleeding (six [2%] in the alteplase group vs five [2%] in the saline group; RR 1·21 [95% CI 0·37–3·91], p=0·771) was similar. Interpretation: In patients with intraventricular haemorrhage and a routine extraventricular drain, irrigation with alteplase did not substantially improve functional outcomes at the mRS 3 cutoff compared with irrigation with saline. Protocol-based use of alteplase with extraventricular drain seems safe. Future investigation is needed to determine whether a greater frequency of complete intraventricular haemorrhage removal via alteplase produces gains in functional status

Marimo machines: Oscillators, biosensors and actuators

BackgroundThe green algae balls (Aegagropila linnaei), known as Marimo, are large spherical colonies of live photosynthetic filaments, formed by rolling water currents in freshwater lakes. Photosynthesis therein produces gas bubbles that can attach to the Marimo, consequently changing its buoyancy. This property allows them to float in the presence of light and sink in its absence.ResultsWe demonstrate that this ability can be harnessed to make actuators, biosensors and bioprocessors (oscillator, logic gates). Factors affecting Marimo movement have been studied to enable the design, construction and testing of working prototypes.ConclusionsA novel actuator design is reported, incorporating an enhanced bubble retention system and the design and optimisation of a bio-oscillator is demonstrated. A range of logic gates (or, and, nor, nand, xor) implementable with Marimo have been proposed