Sampled Policy Gradient for Learning to Play the Game Agar.io

In this paper, a new offline actor-critic learning algorithm is introduced: Sampled Policy Gradient (SPG). SPG samples in the action space to calculate an approximated policy gradient by using the critic to evaluate the samples. This sampling allows SPG to search the action-Q-value space more globally than deterministic policy gradient (DPG), enabling it to theoretically avoid more local optima. SPG is compared to Q-learning and the actor-critic algorithms CACLA and DPG in a pellet collection task and a self play environment in the game Agar.io. The online game Agar.io has become massively popular on the internet due to intuitive game design and the ability to instantly compete against players around the world. From the point of view of artificial intelligence this game is also very intriguing: The game has a continuous input and action space and allows to have diverse agents with complex strategies compete against each other. The experimental results show that Q-Learning and CACLA outperform a pre-programmed greedy bot in the pellet collection task, but all algorithms fail to outperform this bot in a fighting scenario. The SPG algorithm is analyzed to have great extendability through offline exploration and it matches DPG in performance even in its basic form without extensive sampling

P-182: 24-hour ambulatory blood-pressure effects of valsartan + hydrochlorothiazide combinations compared with amlodipine in hypertensive patients at increased cardiovascular risk

In a randomised, double-blind trial, the effects on 24-hr ABP of the combination valsartan 160 mg od and hydrochlorothiazide (HCTZ) 25 or 12.5 mg during 24 weeks of therapy were compared with the effects of amlodipine 10 mg monotherapy (group A10) in 474 stage-II hypertensive patients with additional cardiovascular risk factors. After a two-week single-blind placebo run-in period, patients were randomised to receive valsartan 160 mg od or amlodipine 5 mg od. At Week 4, HCTZ 12.5 mg (group V160/HCTZ12.5) and 25 mg (group V160/HCTZ25) were added to the valsartan groups and in the A10 patients the amlodipine dose was force-titrated to 10 mg od. All treatments reduced BP as well as night-time and daytime BP levels from baseline. 24-hr SBP was reduced by 15.9 ±1.0 mmHg (least-squares mean change ±SE), 19.3 ±1.0 mmHg and 16.1 ±1.1 mmHg in the V160/HCTZ12.5, V160/HCTZ25 and A10 groups, respectively and 24-hr DBP was reduced by 9.3 ±0.6 mmHg, 11.4 ±0.6 mmHg and 9.6 ±0.7 mmHg in the three groups. The differences between the V160/HCTZ25 group and the A10 group were significant (p<0.05) for the changes in 24-hr systolic BP as well as for changes in daytime systolic BP and night-time diastolic BP. Control rates defined as ABPM ≤130/80 mmHg were: 48.4%, 60.8% and 50.9% in the V160/HCTZ12.5, V160/25 and A10 groups, respectively; the differences between the V160/HCTZ25 group and the other two treatment groups were significant at p<0.05. (See Figure) In conclusion, the fixed-dose combination of valsartan 160 mg + HCTZ 25 mg od is an attractive therapeutic option measured on the effects on 24-hr ABPM, night-time and daytime BP reduction and control rates in hypertensive patients at additional cardiovascular ris

A Lifestyle Modification Program for Community Dwelling Adults with Obesity

Obesity is significantly rising among adults in the United States. The Center for Disease Control (CDC, 2009e), estimates that obesity increased by 15% to 32.9% within a 20 year span (1985 – 2008). Clinical obesity is defined as having a BMI 30 and over; it is correlated with secondary complications that include hypertension, type II diabetes, osteoarthritis, cardiovascular diseases, cancers, cerebral vascular accidents, sleep apnea, and respiratory illnesses (CDC, 2009d; World Health Organization [WHO], 2009). Beyond the many health consequences caused by obesity, there are also psychosocial, genetic, and discriminatory aspects of this disease that negatively impact the quality of life and participation in occupations (Clark, Reingold, & Salles-Jordan, 2006). Occupational therapists can provide education and intervention focusing on lifestyle modification to increase participation in occupations, and improve quality of life (Blanchard, 2006; Clark, et al. 2006). The CDC (2009g) describes that 10-minute bouts of moderate to vigorous intensity in the form of meaningful activities such as lawn mowing, dancing, or biking to the store is adequate for raising heart rates and starting the path to physical fitness. This approach fits well with the role of occupational therapy. A comprehensive literature review was conducted on obesity and the impact it has on activities of daily living. Key areas explored include medications, genetics, psychological impacts and discrimination, impact on activities of daily living, sedentary lifestyles, impact of socio-economic status on health, dietary modifications, as well as effective holistic intervention strategies. The literature indicated a need for a lifestyle modification program for community dwelling adults who are overweight or obese. The Step It Up to A Better You is a lifestyle modification program consisting of one-hour educational sessions for 12-weeks. The overall goal is to gain a healthy lifestyle with enhanced quality of life and ability to participate in one’s meaningful daily activities. The sessions include educational resources on motivation, nutrition, physical activity, exploring community resources, psychosocial well-being, and a lifestyle maintenance plan

Longer wings for faster springs – wing length relates tospring phenology in a long-distanc e migrant across its range

In migratory birds, morphological adaptations for efficient migratory flight often oppose morphological adaptations for efficient behavior during resident periods. This includes adaptations in wing shape for either flying long distances or foraging in the vegetation and in climate-driven variation of body size. In addition, the timing of migratory flights and particularly the timely arrival at local breeding sites is crucial because fitness prospects depend on site-specific phenology. Thus, adaptations for efficient long-distance flights might be also related to conditions at destination areas. For an obligatory long-distance migrant, the common nightingale, we verified that wing length as the aerodynamically important trait, but not structural body size increased from the western to the eastern parts of the species range. In contrast with expectation from aerodynamic theory, however, wing length did not increase with increasing migration distances. Instead, wing length was associated with the phenology at breeding destinations, namely the speed of local spring green-up. We argue that longer wings are beneficial for adjusting migration speed to local conditions for birds breeding in habitats with fast spring green-up and thus short optimal arrival periods. We suggest that the speed of spring green-up at breeding sites is a fundamental variable determining the timing of migration that fine tune phenotypes in migrants across their range

Polynomial super-gl(n) algebras

We introduce a class of finite dimensional nonlinear superalgebras $L = L_{\bar{0}} + L_{\bar{1}}$ providing gradings of $L_{\bar{0}} = gl(n) \simeq sl(n) + gl(1)$. Odd generators close by anticommutation on polynomials (of degree $>1$) in the $gl(n)$ generators. Specifically, we investigate `type I' super-$gl(n)$ algebras, having odd generators transforming in a single irreducible representation of $gl(n)$ together with its contragredient. Admissible structure constants are discussed in terms of available $gl(n)$ couplings, and various special cases and candidate superalgebras are identified and exemplified via concrete oscillator constructions. For the case of the $n$-dimensional defining representation, with odd generators $Q_{a}, \bar{Q}{}^{b}$, and even generators ${E^{a}}_{b}$, $a,b = 1,...,n$, a three parameter family of quadratic super-$gl(n)$ algebras (deformations of $sl(n/1)$) is defined. In general, additional covariant Serre-type conditions are imposed, in order that the Jacobi identities be fulfilled. For these quadratic super-$gl(n)$ algebras, the construction of Kac modules, and conditions for atypicality, are briefly considered. Applications in quantum field theory, including Hamiltonian lattice QCD and space-time supersymmetry, are discussed.Comment: 31 pages, LaTeX, including minor corrections to equation (3) and reference [60

PIP5KIβ Selectively Modulates Apical Endocytosis in Polarized Renal Epithelial Cells

Localized synthesis of phosphatidylinositol 4,5-bisphosphate [PtdIns(4,5)P2] at clathrin coated pits (CCPs) is crucial for the recruitment of adaptors and other components of the internalization machinery, as well as for regulating actin dynamics during endocytosis. PtdIns(4,5)P2 is synthesized from phosphatidylinositol 4-phosphate by any of three phosphatidylinositol 5-kinase type I (PIP5KI) isoforms (α, β or γ). PIP5KIβ localizes almost exclusively to the apical surface in polarized mouse cortical collecting duct cells, whereas the other isoforms have a less polarized membrane distribution. We therefore investigated the role of PIP5KI isoforms in endocytosis at the apical and basolateral domains. Endocytosis at the apical surface is known to occur more slowly than at the basolateral surface. Apical endocytosis was selectively stimulated by overexpression of PIP5KIβ whereas the other isoforms had no effect on either apical or basolateral internalization. We found no difference in the affinity for PtdIns(4,5)P2-containing liposomes of the PtdIns(4,5)P2 binding domains of epsin and Dab2, consistent with a generic effect of elevated PtdIns(4,5)P2 on apical endocytosis. Additionally, using apical total internal reflection fluorescence imaging and electron microscopy we found that cells overexpressing PIP5KIβ have fewer apical CCPs but more internalized coated structures than control cells, consistent with enhanced maturation of apical CCPs. Together, our results suggest that synthesis of PtdIns(4,5)P2 mediated by PIP5KIβ is rate limiting for apical but not basolateral endocytosis in polarized kidney cells. PtdIns(4,5)P2 may be required to overcome specific structural constraints that limit the efficiency of apical endocytosis. © 2013 Szalinski et al

Viruses in extreme environments

The original publication is available at www.springerlink.comInternational audienceThe tolerance limits of extremophiles in term of temperature, pH, salinity, desiccation, hydrostatic pressure, radiation, anaerobiosis far exceed what can support non-extremophilic organisms. Like all other organisms, extremophiles serve as hosts for viral replication. Many lines of evidence suggest that viruses could no more be regarded as simple infectious ‘‘fragments of life'' but on the contrary as one of the major components of the biosphere. The exploration of niches with seemingly harsh life conditions as hypersaline and soda lakes, Sahara desert, polar environments or hot acid springs and deep sea hydrothermal vents, permitted to track successfully the presence of viruses. Substantial populations of double-stranded DNA virus that can reach 109 particles per milliliter were recorded. All these viral communities, with genome size ranging from 14 kb to 80 kb, seem to be genetically distinct, suggesting specific niche adaptation. Nevertheless, at this stage of the knowledge, very little is known of their origin, activity, or importance to the in situ microbial dynamics. The continuous attempts to isolate and to study viruses that thrive in extreme environments will be needed to address such questions. However, this topic appears to open a new window on an unexplored part of the viral world

Morphotectonics of the central Muertos thrust belt and Muertos Trough (northeastern Caribbean)

Multibeam bathymetry data acquired during the 2005 Spanish R/V Hespérides cruise and reprocessed multichannel seismic profiles provide the basis for the analysis of the morphology and deformation in the central Muertos Trough and Muertos thrust belt. The Muertos Trough is an elongated basin developed where the Venezuelan Basin crust is thrusted under the Muertos fold-and-thrust belt. Structural variations along the Muertos Trough are suggested to be a consequence of the overburden of the asymmetrical thrust belt and by the variable nature of the Venezuelan Basin crust along the margin. The insular slope can be divided into three east–west trending slope provinces with high lateral variability which correspond to different accretion stages: 1) The lower slope is composed of an active sequence of imbricate thrust slices and closed fold axes, which form short and narrow accretionary ridges and elongated slope basins; 2) The middle slope shows a less active imbricate structure resulting in lower superficial deformation and bigger slope basins; 3) The upper slope comprises the talus region and extended terraces burying an island arc basement and an inactive imbricate structure. The talus region is characterized by a dense drainage network that transports turbidite flows from the islands and their surrounding carbonate platform areas to the slope basins and sometimes to the trough. In the survey area the accommodation of the ongoing east–west differential motion between the Hispaniola and the Puerto Rico–Virgin Islands blocks takes place by means of diffuse deformation. The asymmetrical development of the thrust belt is not related to the geological conditions in the foreland, but rather may be caused by variations in the geometry and movement of the backstop. The map-view curves of the thrust belt and the symmetry of the recesses suggest a main north–south convergence along the Muertos margin. The western end of the Investigator Fault Zone comprises a broad band of active normal faults which result in high instability of the upper insular slope

School Nurses' Experiences of Health Promotion for School-Age Asylum Seekers

The number of school-age asylum seekers and refugees worldwide is increasing. Health promotion provided by school nurses can be crucial for the well-being of young asylum seekers, yet research on these nurses' experiences is limited. This qualitative study aims to describe school nurses' experiences of providing health promotion to school-age asylum seekers. Semistructured interviews were conducted with 12 school nurses, and inductive content analysis was then used. The results were grouped under the following themes: (1) difficulties in providing health services to school-age asylum seekers, (2) considering the vulnerable circumstances of asylum seekers, (3) the importance of family-centered health promotion, and (4) the importance of time management. School nurses face challenges that stem from individual asylum seekers' unique circumstances, nursing competency, and the school health care system. To deepen the existing knowledge, further research is needed from the perspective of asylum seekers.</p

The transcription factor Sox5 modulates Sox10 function during melanocyte development

The transcription factor Sox5 has previously been shown in chicken to be expressed in early neural crest cells and neural crest-derived peripheral glia. Here, we show in mouse that Sox5 expression also continues after neural crest specification in the melanocyte lineage. Despite its continued expression, Sox5 has little impact on melanocyte development on its own as generation of melanoblasts and melanocytes is unaltered in Sox5-deficient mice. Loss of Sox5, however, partially rescued the strongly reduced melanoblast generation and marker gene expression in Sox10 heterozygous mice arguing that Sox5 functions in the melanocyte lineage by modulating Sox10 activity. This modulatory activity involved Sox5 binding and recruitment of CtBP2 and HDAC1 to the regulatory regions of melanocytic Sox10 target genes and direct inhibition of Sox10-dependent promoter activation. Both binding site competition and recruitment of corepressors thus help Sox5 to modulate the activity of Sox10 in the melanocyte lineage