Planning with Information-Processing Constraints and Model Uncertainty in Markov Decision Processes

Information-theoretic principles for learning and acting have been proposed to solve particular classes of Markov Decision Problems. Mathematically, such approaches are governed by a variational free energy principle and allow solving MDP planning problems with information-processing constraints expressed in terms of a Kullback-Leibler divergence with respect to a reference distribution. Here we consider a generalization of such MDP planners by taking model uncertainty into account. As model uncertainty can also be formalized as an information-processing constraint, we can derive a unified solution from a single generalized variational principle. We provide a generalized value iteration scheme together with a convergence proof. As limit cases, this generalized scheme includes standard value iteration with a known model, Bayesian MDP planning, and robust planning. We demonstrate the benefits of this approach in a grid world simulation.Comment: 16 pages, 3 figure

Available data sources for monitoring non-communicable diseases and their risk factors in South Africa.

BACKGROUND: Health information systems for monitoring chronic non-communicable diseases (NCDs) in South Africa (SA) are relatively less advanced than those for infectious diseases (particularly tuberculosis and HIV) and for maternal and child health. NCDs are now the largest cause of premature mortality owing to exposure to risk factors arising from obesity that include physical inactivity and accessible, cheap but unhealthy diets. The National Strategic Plan for the Prevention and Control of Non-Communicable Diseases 2013 - 17 developed by the SA National Department of Health outlines targets and monitoring priorities. OBJECTIVES: To assess data sources relevant for monitoring NCDs and their risk factors by identifying the strengths and weaknesses, including usability and availability, of surveys and routine systems focusing at national and certain sub-national levels. METHODS: Publicly available survey and routine data sources were assessed for variables collected, their characteristics, frequency of data collection, geographical coverage and data availability. RESULTS: Survey data sources were found to be quite different in the way data variables are collected, their geographical coverage and also availability, while the main weakness of routine data sources was poor quality of data. CONCLUSIONS: To provide a sound basis for monitoring progress of NCDs and related risk factors, we recommend harmonising and strengthening available SA data sources in terms of data quality, definitions, categories used, timeliness, disease coverage and biomarker measurement

Binaries and Globular Cluster Dynamics

We summarize the results of recent theoretical work on the dynamical evolution of globular clusters containing primordial binaries. Even a very small initial binary fraction (e.g., 10%) can play a key role in supporting a cluster against gravothermal collapse for many relaxation times. Inelastic encounters between binaries and single stars or other binaries provide a very significant energy source for the cluster. These dynamical interactions also lead to the production of large numbers of exotic systems such as ultracompact X-ray binaries, recycled radio pulsars, double degenerate systems, and blue stragglers. Our work is based on a new parallel supercomputer code implementing Henon's Monte Carlo method for simulating the dynamical evolution of dense stellar systems in the Fokker-Planck approximation. This new code allows us to calculate very accurately the evolution of a cluster containing a realistic number of stars (N ~ 10^5 - 10^6) in typically a few hours to a few days of computing time. The discrete, star-by-star representation of the cluster in the simulation makes it possible to treat naturally a number of important processes, including single and binary star evolution, all dynamical interactions of single stars and binaries, and tidal interactions with the Galaxy.Comment: 15 pages, to appear in `The Influence of Binaries on Stellar Population Studies', ed. D. Vanbeveren (Kluwer

Gingival crevicular fluid MMP-8-concentrations in patients after acute myocardial infarction

<p>Abstract</p> <p>Background</p> <p>The aim of this study was to determine the presence of matrix metalloproteinase-8 in the gingival crevicular fluid (GCF) of patients after acute myocardial infarction (AMI).</p> <p>Methods</p> <p>A total of 48 GCF samples from 20 AMI patients, hospitalized at the Department of Cardiology and Angiology of the Johannes Gutenberg University Mainz, were investigated. Besides the myocardial infarction all patients suffered from chronic periodontal disease. Fifty-one GCF samples from 20 healthy age matched individuals with similar periodontal conditions served as controls. The dental examination included the assessment of oral hygiene, gingival inflammation, probing pocket depth, clinical attachment level and X-ray examination. The study was only carried out after the positive consent of the regional ethic commission. A quantitative assessment of aMMP-8 levels in the gingival crevicular fluid was performed with the help of the DentoAnalyzer (Dentognostics GmbH, Jena, Germany), utilising an immunological procedure.</p> <p>Results</p> <p>The aMMP-8 concentrations found in the gingival crevicular fluid of the AMI patients significantly differed (p = 0.001; mean value 30.33 ± 41.99 ng/ml aMMP-8) from the control group (mean value 10.0 ± 10.7 ng/ml aMMP-8). These findings suggest that periodontal inflammation in AMI patients might be associated with higher MMP-8-values compared to the healthy controls.</p> <p>Conclusions</p> <p>The acute myocardial infarction seems to influence the degree of periodontal inflammation, thus the measurement of the gingival crevicular fluid MMP8 levels seems to be a helpful biochemical test to obtain information about the severity of the periodontal disease.</p

Improving the performance of cryogenic calorimeters with nonlinear multivariate noise cancellation algorithms

State-of-the-art physics experiments require high-resolution, low-noise, and low-threshold detectors to achieve competitive scientific results. However, experimental environments invariably introduce sources of noise, such as electrical interference or microphonics. The sources of this environmental noise can often be monitored by adding specially designed “auxiliary devices” (e.g. microphones, accelerometers, seismometers, magnetometers, and antennae). A model can then be constructed to predict the detector noise based on the auxiliary device information, which can then be subtracted from the true detector signal. Here, we present a multivariate noise cancellation algorithm which can be used in a variety of settings to improve the performance of detectors using multiple auxiliary devices. To validate this approach, we apply it to simulated data to remove noise due to electromagnetic interference and microphonic vibrations. We then employ the algorithm to a cryogenic light detector in the laboratory and show an improvement in the detector performance. Finally, we motivate the use of nonlinear terms to better model vibrational contributions to the noise in thermal detectors. We show a further improvement in the performance of a particular channel of the CUORE detector when using the nonlinear algorithm in combination with optimal filtering techniques

Studies of the Association of Arg72Pro of Tumor Suppressor Protein p53 with Type 2 Diabetes in a Combined Analysis of 55,521 Europeans

A study of 222 candidate genes in type 2 diabetes reported association of variants in RAPGEF1, ENPP1, TP53, NRF1, SLC2A2, SLC2A4 and FOXC2 with type 2 diabetes in 4,805 Finnish individuals. We aimed to replicate these associations in a Danish case-control study and to substantiate any replicated associations in meta-analyses. Furthermore, we evaluated the impact on diabetes-related intermediate traits in a population-based sample of middle-aged Danes.We genotyped nine lead variants in the seven genes in 4,973 glucose-tolerant and 3,612 type 2 diabetes Danish individuals. In meta-analyses we combined case-control data from the DIAGRAM+ Consortium (n = 47,117) and the present genotyping results. The quantitative trait studies involved 5,882 treatment-naive individuals from the Danish Inter99 study.None of the nine investigated variants were significantly associated with type 2 diabetes in the Danish samples. However, for all nine variants the estimate of increase in type 2 diabetes risk was observed for the same allele as previously reported. In a meta-analysis of published and online data including 55,521 Europeans the G-allele of rs1042522 in TP53 showed significant association with type 2 diabetes (OR = 1.06 95% CI 1.02-1.11, p = 0.0032). No substantial associations with diabetes-related intermediary phenotypes were found.The G-allele of TP53 rs1042522 is associated with an increased prevalence of type 2 diabetes in a combined analysis of 55,521 Europeans

Chromatic Illumination Discrimination Ability Reveals that Human Colour Constancy Is Optimised for Blue Daylight Illuminations

The phenomenon of colour constancy in human visual perception keeps surface colours constant, despite changes in their reflected light due to changing illumination. Although colour constancy has evolved under a constrained subset of illuminations, it is unknown whether its underlying mechanisms, thought to involve multiple components from retina to cortex, are optimised for particular environmental variations. Here we demonstrate a new method for investigating colour constancy using illumination matching in real scenes which, unlike previous methods using surface matching and simulated scenes, allows testing of multiple, real illuminations. We use real scenes consisting of solid familiar or unfamiliar objects against uniform or variegated backgrounds and compare discrimination performance for typical illuminations from the daylight chromaticity locus (approximately blue-yellow) and atypical spectra from an orthogonal locus (approximately red-green, at correlated colour temperature 6700 K), all produced in real time by a 10-channel LED illuminator. We find that discrimination of illumination changes is poorer along the daylight locus than the atypical locus, and is poorest particularly for bluer illumination changes, demonstrating conversely that surface colour constancy is best for blue daylight illuminations. Illumination discrimination is also enhanced, and therefore colour constancy diminished, for uniform backgrounds, irrespective of the object type. These results are not explained by statistical properties of the scene signal changes at the retinal level. We conclude that high-level mechanisms of colour constancy are biased for the blue daylight illuminations and variegated backgrounds to which the human visual system has typically been exposed

Timing of embryonic quiescence determines viability of embryos from the calanoid copepod, Acartia tonsa (Dana)

<div><p>Like 41 other calanoid copepods, <i>Acartia tonsa</i>, are capable of inducing embryonic quiescence when experiencing unfavorable environmental conditions. The ecdysone-signaling cascade is known to have a key function in developmental processes like embryogenesis and molting of arthropods, including copepods. We examined the role of <i>ecdysteroid-phosphate phosphatase</i> (<i>EPPase</i>), <i>ecdysone receptor</i> (<i>EcR</i>), <i>ß fushi tarazu transcription factor 1</i> (<i>ßFTZ-F1</i>), and the <i>ecdysteroid-regulated early gene E74</i> (<i>E74</i>), which represent different levels of the ecdysone-signaling cascade in our calanoid model organism. Progression of embryogenesis was monitored and hatching success determined to evaluate viability. Embryos that were induced quiescence before the gastrulation stage would stay in gastrulation during the rest of quiescence and exhibited a slower pace of hatching as compared to subitaneous embryos. In contrast, embryos developed further than gastrulation would stay in gastrulation or later stages during quiescence and showed a rapid pace in hatching after quiescence termination. Expression patterns suggested two peaks of the biological active ecdysteroids, 20-hydroxyecdysone (20E). The first peak of 20E was expressed in concert with the beginning of embryogenesis originating from yolk-conjugated ecdysteroids, based on <i>EPPase</i> expression. The second peak is suggested to originate from <i>de novo</i> synthesized 20E around the limb bud stage. During quiescence, the expression patterns of <i>EPPase</i>, <i>EcR</i>, <i>ßFTZ-F1</i>, and <i>E74</i> were either decreasing or not changing over time. This suggests that the ecdysone-signaling pathway play a key role in the subitaneous development of <i>A</i>. <i>tonsa</i> embryogenesis, but not during quiescence. The observation is of profound ecological and practical relevance for the dynamics of egg banks.</p></div