Learning to Run challenge solutions: Adapting reinforcement learning methods for neuromusculoskeletal environments

In the NIPS 2017 Learning to Run challenge, participants were tasked with building a controller for a musculoskeletal model to make it run as fast as possible through an obstacle course. Top participants were invited to describe their algorithms. In this work, we present eight solutions that used deep reinforcement learning approaches, based on algorithms such as Deep Deterministic Policy Gradient, Proximal Policy Optimization, and Trust Region Policy Optimization. Many solutions use similar relaxations and heuristics, such as reward shaping, frame skipping, discretization of the action space, symmetry, and policy blending. However, each of the eight teams implemented different modifications of the known algorithms.Comment: 27 pages, 17 figure

Backaction of a driven nonlinear resonator on a superconducting qubit

We study the backaction of a driven nonlinear resonator on a multi-level superconducting qubit. Using unitary transformations on the multi-level Jaynes-Cummings Hamiltonian and quantum optics master equation, we derive an analytical model that goes beyond linear response theory. Within the limits of validity of the model, we obtain quantitative agreement with experimental and numerical data, both in the bifurcation and in the parametric amplification regimes of the nonlinear resonator. We show in particular that the measurement-induced dephasing rate of the qubit can be rather small at high drive power. This is in contrast to measurement with a linear resonator where this rate increases with the drive power. Finally, we show that, for typical parameters of circuit quantum electrodynamics, correctly describing measurement-induced dephasing requires a model going beyond linear response theory, such as the one presented here.Comment: 17 pages, 7 figure

Potential determinants of obesity among children and adolescents in Germany: results from the cross-sectional KiGGS study

<p>Abstract</p> <p>Background</p> <p>Obesity among children and adolescents is a growing public health problem. The aim of the present paper is to identify potential determinants of obesity and risk groups among 3- to 17-year old children and adolescents to provide a basis for effective prevention strategies.</p> <p>Methods</p> <p>Data were collected in the German Health Interview and Examination Survey for Children and Adolescents (KiGGS), a nationally representative and comprehensive data set on health behaviour and health status of German children and adolescents. Body height and weight were measured and body mass index (BMI) was classified according to IOTF cut-off points. Statistical analyses were conducted on 13,450 non-underweight children and adolescents aged 3 to 17 years. The association between overweight, obesity and several potential determinants was analysed for this group as well as for three socio-economic status (SES) groups. A multiple logistic regression model with obesity as the dependent variable was also calculated.</p> <p>Results</p> <p>The strongest association with obesity was observed for parental overweight and for low SES. Furthermore, a positive association with both overweight (including obesity) and obesity was seen for maternal smoking during pregnancy, high weight gain during pregnancy (only for mothers of normal weight), high birth weight, and high media consumption. In addition, high intakes of meat and sausages, total beverages, water and tea, total food and beverages, as well as energy-providing food and beverages were significantly associated with overweight as well as with obesity. Long sleep time was negatively associated with obesity among 3- to 10-year olds. Determinants of obesity occurred more often among children and adolescents with low SES.</p> <p>Conclusion</p> <p>Parental overweight and a low SES are major potential determinants of obesity. Families with these characteristics should be focused on in obesity prevention.</p

Territorial (In) Coherence: Labour and Special Economic Zones in Laos's Border Manufacturing

© 2018 The Author. Antipode © 2018 Antipode Foundation Ltd. This article engages literature on special economic zones and territory in global development. I suggest a focus on labour's spatial class composition as constitutive of territorial coherence provides insights into how the Savan-Seno Special Economic Zone in Lao PDR operates as an economic border territory bridging Laos to the regional and global economies. The distanciated global connections which special economic zones aim to create are predicated on zones gaining internal coherence for capital accumulation. I suggest zones’ internal coherence depends on zone firms reworking the local class composition of labour, itself constituted by workers’ spatial practices. In the Savan-Seno zone this occurred through immobilising a mobile labour force and taking advantage of its continuing embeddedness within a subsistence rice-producing village economy. The argument aims to illustrate how zones producing for global markets act as territories of complex spatiality which span and connect multiple spaces of production and workers’ social reproduction

Environmental effects of ozone depletion, UV radiation and interactions with climate change : UNEP Environmental Effects Assessment Panel, update 2017

Peer reviewe

Comprehensive Cancer-Predisposition Gene Testing in an Adult Multiple Primary Tumor Series Shows a Broad Range of Deleterious Variants and Atypical Tumor Phenotypes.

Multiple primary tumors (MPTs) affect a substantial proportion of cancer survivors and can result from various causes, including inherited predisposition. Currently, germline genetic testing of MPT-affected individuals for variants in cancer-predisposition genes (CPGs) is mostly targeted by tumor type. We ascertained pre-assessed MPT individuals (with at least two primary tumors by age 60 years or at least three by 70 years) from genetics centers and performed whole-genome sequencing (WGS) on 460 individuals from 440 families. Despite previous negative genetic assessment and molecular investigations, pathogenic variants in moderate- and high-risk CPGs were detected in 67/440 (15.2%) probands. WGS detected variants that would not be (or were not) detected by targeted resequencing strategies, including low-frequency structural variants (6/440 [1.4%] probands). In most individuals with a germline variant assessed as pathogenic or likely pathogenic (P/LP), at least one of their tumor types was characteristic of variants in the relevant CPG. However, in 29 probands (42.2% of those with a P/LP variant), the tumor phenotype appeared discordant. The frequency of individuals with truncating or splice-site CPG variants and at least one discordant tumor type was significantly higher than in a control population (χ2 = 43.642; p ≤ 0.0001). 2/67 (3%) probands with P/LP variants had evidence of multiple inherited neoplasia allele syndrome (MINAS) with deleterious variants in two CPGs. Together with variant detection rates from a previous series of similarly ascertained MPT-affected individuals, the present results suggest that first-line comprehensive CPG analysis in an MPT cohort referred to clinical genetics services would detect a deleterious variant in about a third of individuals.JW is supported by a Cancer Research UK Cambridge Cancer Centre Clinical Research Training Fellowship. Funding for the NIHR BioResource – Rare diseases project was provided by the National Institute for Health Research (NIHR, grant number RG65966). ERM acknowledges support from the European Research Council (Advanced Researcher Award), NIHR (Senior Investigator Award and Cambridge NIHR Biomedical Research Centre), Cancer Research UK Cambridge Cancer Centre and Medical Research Council Infrastructure Award. The University of Cambridge has received salary support in respect of EM from the NHS in the East of England through the Clinical Academic Reserve. The views expressed are those of the authors and not necessarily those of the NHS or Department of Health. DGE is an NIHR Senior Investigator and is supported by the all Manchester NIHR Biomedical Research Centre

Intraperitoneal drain placement and outcomes after elective colorectal surgery: international matched, prospective, cohort study

Despite current guidelines, intraperitoneal drain placement after elective colorectal surgery remains widespread. Drains were not associated with earlier detection of intraperitoneal collections, but were associated with prolonged hospital stay and increased risk of surgical-site infections.Background Many surgeons routinely place intraperitoneal drains after elective colorectal surgery. However, enhanced recovery after surgery guidelines recommend against their routine use owing to a lack of clear clinical benefit. This study aimed to describe international variation in intraperitoneal drain placement and the safety of this practice. Methods COMPASS (COMPlicAted intra-abdominal collectionS after colorectal Surgery) was a prospective, international, cohort study which enrolled consecutive adults undergoing elective colorectal surgery (February to March 2020). The primary outcome was the rate of intraperitoneal drain placement. Secondary outcomes included: rate and time to diagnosis of postoperative intraperitoneal collections; rate of surgical site infections (SSIs); time to discharge; and 30-day major postoperative complications (Clavien-Dindo grade at least III). After propensity score matching, multivariable logistic regression and Cox proportional hazards regression were used to estimate the independent association of the secondary outcomes with drain placement. Results Overall, 1805 patients from 22 countries were included (798 women, 44.2 per cent; median age 67.0 years). The drain insertion rate was 51.9 per cent (937 patients). After matching, drains were not associated with reduced rates (odds ratio (OR) 1.33, 95 per cent c.i. 0.79 to 2.23; P = 0.287) or earlier detection (hazard ratio (HR) 0.87, 0.33 to 2.31; P = 0.780) of collections. Although not associated with worse major postoperative complications (OR 1.09, 0.68 to 1.75; P = 0.709), drains were associated with delayed hospital discharge (HR 0.58, 0.52 to 0.66; P &lt; 0.001) and an increased risk of SSIs (OR 2.47, 1.50 to 4.05; P &lt; 0.001). Conclusion Intraperitoneal drain placement after elective colorectal surgery is not associated with earlier detection of postoperative collections, but prolongs hospital stay and increases SSI risk

Many Labs 2: Investigating Variation in Replicability Across Samples and Settings

We conducted preregistered replications of 28 classic and contemporary published findings, with protocols that were peer reviewed in advance, to examine variation in effect magnitudes across samples and settings. Each protocol was administered to approximately half of 125 samples that comprised 15,305 participants from 36 countries and territories. Using the conventional criterion of statistical significance (p < .05), we found that 15 (54%) of the replications provided evidence of a statistically significant effect in the same direction as the original finding. With a strict significance criterion (p < .0001), 14 (50%) of the replications still provided such evidence, a reflection of the extremely highpowered design. Seven (25%) of the replications yielded effect sizes larger than the original ones, and 21 (75%) yielded effect sizes smaller than the original ones. The median comparable Cohen’s ds were 0.60 for the original findings and 0.15 for the replications. The effect sizes were small (< 0.20) in 16 of the replications (57%), and 9 effects (32%) were in the direction opposite the direction of the original effect. Across settings, the Q statistic indicated significant heterogeneity in 11 (39%) of the replication effects, and most of those were among the findings with the largest overall effect sizes; only 1 effect that was near zero in the aggregate showed significant heterogeneity according to this measure. Only 1 effect had a tau value greater than .20, an indication of moderate heterogeneity. Eight others had tau values near or slightly above .10, an indication of slight heterogeneity. Moderation tests indicated that very little heterogeneity was attributable to the order in which the tasks were performed or whether the tasks were administered in lab versus online. Exploratory comparisons revealed little heterogeneity between Western, educated, industrialized, rich, and democratic (WEIRD) cultures and less WEIRD cultures (i.e., cultures with relatively high and low WEIRDness scores, respectively). Cumulatively, variability in the observed effect sizes was attributable more to the effect being studied than to the sample or setting in which it was studied.UCR::Vicerrectoría de Investigación::Unidades de Investigación::Ciencias Sociales::Instituto de Investigaciones Psicológicas (IIP