Probabilistic Guarantees for Safe Deep Reinforcement Learning

Deep reinforcement learning has been successfully applied to many control tasks, but the application of such agents in safety-critical scenarios has been limited due to safety concerns. Rigorous testing of these controllers is challenging, particularly when they operate in probabilistic environments due to, for example, hardware faults or noisy sensors. We propose MOSAIC, an algorithm for measuring the safety of deep reinforcement learning agents in stochastic settings. Our approach is based on the iterative construction of a formal abstraction of a controller's execution in an environment, and leverages probabilistic model checking of Markov decision processes to produce probabilistic guarantees on safe behaviour over a finite time horizon. It produces bounds on the probability of safe operation of the controller for different initial configurations and identifies regions where correct behaviour can be guaranteed. We implement and evaluate our approach on agents trained for several benchmark control problems

Swimming using surface acoustic waves

Microactuation of free standing objects in fluids is currently dominated by the rotary propeller, giving rise to a range of potential applications in the military, aeronautic and biomedical fields. Previously, surface acoustic waves (SAWs) have been shown to be of increasing interest in the field of microfluidics, where the refraction of a SAW into a drop of fluid creates a convective flow, a phenomenon generally known as SAW streaming. We now show how SAWs, generated at microelectronic devices, can be used as an efficient method of propulsion actuated by localised fluid streaming. The direction of the force arising from such streaming is optimal when the devices are maintained at the Rayleigh angle. The technique provides propulsion without any moving parts, and, due to the inherent design of the SAW transducer, enables simple control of the direction of travel

Temporal Stream Logic: Synthesis beyond the Bools

Reactive systems that operate in environments with complex data, such as mobile apps or embedded controllers with many sensors, are difficult to synthesize. Synthesis tools usually fail for such systems because the state space resulting from the discretization of the data is too large. We introduce TSL, a new temporal logic that separates control and data. We provide a CEGAR-based synthesis approach for the construction of implementations that are guaranteed to satisfy a TSL specification for all possible instantiations of the data processing functions. TSL provides an attractive trade-off for synthesis. On the one hand, synthesis from TSL, unlike synthesis from standard temporal logics, is undecidable in general. On the other hand, however, synthesis from TSL is scalable, because it is independent of the complexity of the handled data. Among other benchmarks, we have successfully synthesized a music player Android app and a controller for an autonomous vehicle in the Open Race Car Simulator (TORCS.

High Abundances of Microplastic Pollution in Deep-Sea Sediments: Evidence from Antarctica and the Southern Ocean.

Plastic pollution in Antarctica and the Southern Ocean has been recorded in scientific literature since the 1980s; however, the presence of microplastic particles (<5 mm) is less understood. Here, we aimed to determine whether microplastic accumulation would vary among Antarctic and Southern Ocean regions through studying 30 deep-sea sediment cores. Additionally, we aimed to highlight whether microplastic accumulation was related to sample depth or the sediment characteristics within each core. Sediment cores were digested and separated using a high-density sodium polytungstate solution (SPT) and microplastic particles were identified using micro-Fourier-transform infrared spectroscopy (μFTIR). Microplastic pollution was found in 93% of the sediment cores (28/30). The mean (±SE) microplastics per gram of sediment was 1.30 ± 0.51, 1.09 ± 0.22, and 1.04 ± 0.39 MP/g, for the Antarctic Peninsula, South Sandwich Islands, and South Georgia, respectively. Microplastic fragment accumulation correlated significantly with the percentage of clay within cores, suggesting that microplastics have similar dispersion behavior to low density sediments. Although no difference in microplastic abundance was found among regions, the values were much higher in comparison to less remote ecosystems, suggesting that the Antarctic and Southern Ocean deep-sea accumulates higher numbers of microplastic pollution than previously expected

The accumulation of microplastic pollution in a commercially important fishing ground

The Irish Sea is an important area for Norway Lobster Nephrops norvegicus fisheries, which are the most valuable fishing resource in the UK. Norway lobster are known to ingest microplastic pollution present in the sediment and have displayed reduced body mass when exposed to microplastic pollution. Here, we identified microplastic pollution in the Irish Sea fishing grounds through analysis of 24 sediment samples from four sites of differing proximity to the Western Irish Sea Gyre in both 2016 and 2019. We used µFTIR spectroscopy to identify seven polymer types, and a total of 77 microplastics consisting of fibres and fragments. The mean microplastics per gram of sediment ranged from 0.13 to 0.49 and 0 to 1.17 MP/g in 2016 and 2019, respectively. There were no differences in the microplastic counts across years, and there was no correlation of microplastic counts with proximity to the Western Irish Sea Gyre. Considering the consistently high microplastic abundance found in the Irish Sea, and the propensity of N. norvegicus to ingest and be negatively impacted by them, we suggest microplastic pollution levels in the Irish Sea may have adverse impacts on N. norvegicus and negative implications for fishery sustainability in the future

Tendinopathy—from basic science to treatment

Chronic tendon pathology (tendinopathy), although common, is difficult to treat. Tendons possess a highly organized fibrillar matrix, consisting of type I collagen and various 'minor' collagens, proteoglycans and glycoproteins. The tendon matrix is maintained by the resident tenocytes, and there is evidence of a continuous process of matrix remodeling, although the rate of turnover varies at different sites. A change in remodeling activity is associated with the onset of tendinopathy. Major molecular changes include increased expression of type III collagen, fibronectin, tenascin C, aggrecan and biglycan. These changes are consistent with repair, but they might also be an adaptive response to changes in mechanical loading. Repeated minor strain is thought to be the major precipitating factor in tendinopathy, although further work is required to determine whether it is mechanical overstimulation or understimulation that leads to the change in tenocyte activity. Metalloproteinase enzymes have an important role in the tendon matrix, being responsible for the degradation of collagen and proteoglycan in both healthy patients and those with disease. Metalloproteinases that show increased expression in painful tendinopathy include ADAM (a disintegrin and metalloproteinase)-12 and MMP (matrix metalloproteinase)-23. The role of these enzymes in tendon pathology is unknown, and further work is required to identify novel and specific molecular targets for therapy

Genetic identification of cytomegaloviruses in a rural population of Côte d'Ivoire.

BACKGROUND: Cytomegaloviruses (CMVs) are herpesviruses that infect many mammalian species, including humans. Infection generally passes undetected, but the virus can cause serious disease in individuals with impaired immune function. Human CMV (HCMV) is circulating with high seroprevalence (60-100 %) on all continents. However, little information is available on HCMV genoprevalence and genetic diversity in subsaharan Africa, especially in rural areas of West Africa that are at high risk of human-to-human HCMV transmission. In addition, there is a potential for zoonotic spillover of pathogens through bushmeat hunting and handling in these areas as shown for various retroviruses. Although HCMV and nonhuman CMVs are regarded as species-specific, potential human infection with CMVs of non-human primate (NHP) origin, shown to circulate in the local NHP population, has not been studied. FINDINGS: Analysis of 657 human oral swabs and fecal samples collected from 518 individuals living in 8 villages of Côte d'Ivoire with generic PCR for identification of human and NHP CMVs revealed shedding of HCMV in 2.5 % of the individuals. Determination of glycoprotein B sequences showed identity with strains Towne, AD169 and Toledo, respectively. NHP CMV sequences were not detected. CONCLUSIONS: HCMV is actively circulating in a proportion of the rural Côte d'Ivoire human population with circulating strains being closely related to those previously identified in non-African countries. The lack of NHP CMVs in human populations in an environment conducive to cross-species infection supports zoonotic transmission of CMVs to humans being at most a rare event

Parental experiences of supporting children with clinically significant post-traumatic distress: a qualitative study of families accessing psychological services

The aim of this study was to investigate the experiences of parents in providing support to their child following trauma exposure in cases where children are experiencing clinically significant levels of post-traumatic distress. Qualitative interviews were conducted with parents whose child was exposed to a trauma and referred for psychological treatment. Parents reported considerable anxiety in coping with their child’s post-traumatic distress. Avoidance of trauma-related discussions was encouraged due to concerns that non-avoidant approaches may worsen children’s post-trauma difficulties. Nonetheless, parents were often sensitive to their child’s distress and offered reassurance and other forms of support. Many barriers existed to accessing psychological treatment, and perceptions of inadequate guidance from therapists on supporting child adjustment contributed to parental distress. The results illustrate the strategies used by parents in supporting their child post-trauma and may assist mental health professionals in providing acceptable guidance to parents following child trauma

Identification of a Novel Signaling Pathway and Its Relevance for GluA1 Recycling

We previously showed that the serum- and glucocorticoid-inducible kinase 3 (SGK3) increases the AMPA-type glutamate receptor GluA1 protein in the plasma membrane. The activation of AMPA receptors by NMDA-type glutamate receptors eventually leads to postsynaptic neuronal plasticity. Here, we show that SGK3 mRNA is upregulated in the hippocampus of new-born wild type Wistar rats after NMDA receptor activation. We further demonstrate in the Xenopus oocyte expression system that delivery of GluA1 protein to the plasma membrane depends on the small GTPase RAB11. This RAB-dependent GluA1 trafficking requires phosphorylation and activation of phosphoinositol-3-phosphate-5-kinase (PIKfyve) and the generation of PI(3,5)P2. In line with this mechanism we could show PIKfyve mRNA expression in the hippocampus of wild type C57/BL6 mice and phosphorylation of PIKfyve by SGK3. Incubation of hippocampal slices with the PIKfyve inhibitor YM201636 revealed reduced CA1 basal synaptic activity. Furthermore, treatment of primary hippocampal neurons with YM201636 altered the GluA1 expression pattern towards reduced synaptic expression of GluA1. Our findings demonstrate for the first time an involvement of PIKfyve and PI(3,5)P2 in NMDA receptor-triggered synaptic GluA1 trafficking. This new regulatory pathway of GluA1 may contribute to synaptic plasticity and memory