Planning with Information-Processing Constraints and Model Uncertainty in Markov Decision Processes

Information-theoretic principles for learning and acting have been proposed to solve particular classes of Markov Decision Problems. Mathematically, such approaches are governed by a variational free energy principle and allow solving MDP planning problems with information-processing constraints expressed in terms of a Kullback-Leibler divergence with respect to a reference distribution. Here we consider a generalization of such MDP planners by taking model uncertainty into account. As model uncertainty can also be formalized as an information-processing constraint, we can derive a unified solution from a single generalized variational principle. We provide a generalized value iteration scheme together with a convergence proof. As limit cases, this generalized scheme includes standard value iteration with a known model, Bayesian MDP planning, and robust planning. We demonstrate the benefits of this approach in a grid world simulation.Comment: 16 pages, 3 figure

HLA Class-II Associated HIV Polymorphisms Predict Escape from CD4+ T Cell Responses.

Antiretroviral therapy, antibody and CD8+ T cell-mediated responses targeting human immunodeficiency virus-1 (HIV-1) exert selection pressure on the virus necessitating escape; however, the ability of CD4+ T cells to exert selective pressure remains unclear. Using a computational approach on HIV gag/pol/nef sequences and HLA-II allelic data, we identified 29 HLA-II associated HIV sequence polymorphisms or adaptations (HLA-AP) in an African cohort of chronically HIV-infected individuals. Epitopes encompassing the predicted adaptation (AE) or its non-adapted (NAE) version were evaluated for immunogenicity. Using a CD8-depleted IFN-γ ELISpot assay, we determined that the magnitude of CD4+ T cell responses to the predicted epitopes in controllers was higher compared to non-controllers (p<0.0001). However, regardless of the group, the magnitude of responses to AE was lower as compared to NAE (p<0.0001). CD4+ T cell responses in patients with acute HIV infection (AHI) demonstrated poor immunogenicity towards AE as compared to NAE encoded by their transmitted founder virus. Longitudinal data in AHI off antiretroviral therapy demonstrated sequence changes that were biologically confirmed to represent CD4+ escape mutations. These data demonstrate an innovative application of HLA-associated polymorphisms to identify biologically relevant CD4+ epitopes and suggests CD4+ T cells are active participants in driving HIV evolution

An optical supernova associated with the X-ray flash XRF 060218

Long-duration gamma-ray bursts (GRBs) are associated with type Ic supernovae that are more luminous than average and that eject material at very high velocities. Less-luminous supernovae were not hitherto known to be associated with GRBs, and therefore GRB-supernovae were thought to be rare events. Whether X-ray flashes - analogues of GRBs, but with lower luminosities and fewer gamma-rays - can also be associated with supernovae, and whether they are intrinsically 'weak' events or typical GRBs viewed off the axis of the burst, is unclear. Here we report the optical discovery and follow-up observations of the type Ic supernova SN 2006aj associated with X-ray flash XRF 060218. Supernova 2006aj is intrinsically less luminous than the GRB-supernovae, but more luminous than many supernovae not accompanied by a GRB. The ejecta velocities derived from our spectra are intermediate between these two groups, which is consistent with the weakness of both the GRB output and the supernova radio flux. Our data, combined with radio and X-ray observations, suggest that XRF 060218 is an intrinsically weak and soft event, rather than a classical GRB observed off-axis. This extends the GRB-supernova connection to X-ray flashes and fainter supernovae, implying a common origin. Events such as XRF 060218 are probably more numerous than GRB-supernovae.Comment: Final published versio

Buckling Instabilities of a Confined Colloid Crystal Layer

A model predicting the structure of repulsive, spherically symmetric, monodisperse particles confined between two walls is presented. We study the buckling transition of a single flat layer as the double layer state develops. Experimental realizations of this model are suspensions of stabilized colloidal particles squeezed between glass plates. By expanding the thermodynamic potential about a flat state of $N$ confined colloidal particles, we derive a free energy as a functional of in-plane and out-of-plane displacements. The wavevectors of these first buckling instabilities correspond to three different ordered structures. Landau theory predicts that the symmetry of these phases allows for second order phase transitions. This possibility exists even in the presence of gravity or plate asymmetry. These transitions lead to critical behavior and phases with the symmetry of the three-state and four-state Potts models, the X-Y model with 6-fold anisotropy, and the Heisenberg model with cubic interactions. Experimental detection of these structures is discussed.Comment: 24 pages, 8 figures on request. EF508

Re-evaluating diabetic papillopathy using optical coherence tomography and inner retinal sublayer analysis.

BACKGROUND/OBJECTIVES: To re-evaluate diabetic papillopathy using optical coherence tomography (OCT) for quantitative analysis of the peripapillary retinal nerve fibre layer (pRNFL), macular ganglion cell layer (mGCL) and inner nuclear layer (mINL) thickness. SUBJECTS/METHODS: In this retrospective observational case series between June 2008 and July 2019 at Moorfields Eye hospital, 24 eyes of 22 patients with diabetes and optic disc swelling with confirmed diagnosis of NAION or diabetic papillopathy by neuro-ophthalmological assessment were included for evaluation of the pRNFL, mGCL and mINL thicknesses after resolution of optic disc swelling. RESULTS: The mean age of included patients was 56.5 (standard deviation (SD) ± 14.85) years with a mean follow-up duration of 216 days. Thinning of pRNFL (mean: 66.26, SD ± 31.80 µm) and mGCL (mean volume: 0.27 mm3, SD ± 0.09) were observed in either group during follow-up, the mINL volume showed no thinning with 0.39 ± 0.05 mm3. The mean decrease in visual acuity was 4.13 (SD ± 14.27) ETDRS letters with a strong correlation between mGCL thickness and visual acuity (rho 0.74, p < 0.001). CONCLUSION: After resolution of acute optic disc swelling, atrophy of pRNFL and mGCL became apparent in all cases of diabetic papillopathy and diabetic NAION, with preservation of mINL volumes. Analysis of OCT did not provide a clear diagnostic distinction between both entities. We suggest a diagnostic overlay with the degree of pRNFL and mGCL atrophy of prognostic relevance for poor visual acuity independent of the semantics of terminology

Formative peer assessment in a CSCL environment

In this case study our aim was to gain more insight in the possibilities of qualitative formative peer assessment in a computer supported collaborative learning (CSCL) environment. An approach was chosen in which peer assessment was operationalised in assessment assignments and assessment tools that were embedded in the course material. The course concerned a higher education case-based virtual seminar, in which students were asked to conduct research and write a report in small multidisciplinary teams. The assessment assignments contained the discussion of assessment criteria, the assessment of a group report of a fellow group, and writing an assessment report. A list of feedback rules was one of the assessment tools. A qualitative oriented study was conducted, focussing on the attitude of students towards peer assessment and practical use of peer assessment assignments and tools. Results showed that students’ attitude towards peer assessment was positive and that assessment assignments had added value. However, not all students fulfilled all assessment assignments. Recommendations for implementation of peer assessment in CSCL environments as well as suggestions for future research are discussed

Ego-Splitting and the Transcendental Subject. Kant’s Original Insight and Husserl’s Reappraisal

In this paper, I contend that there are at least two essential traits that commonly define being an I: self-identity and self-consciousness. I argue that they bear quite an odd relation to each other in the sense that self-consciousness seems to jeopardize self-identity. My main concern is to elucidate this issue within the range of the transcendental philosophies of Immanuel Kant and Edmund Husserl. In the first section, I shall briefly consider Kant’s own rendition of the problem of the Egosplitting. My reading of the Kantian texts reveals that Kant himself was aware of this phenomenon but eventually deems it an unexplainable fact. The second part of the paper tackles the same problematic from the standpoint of Husserlian phenomenology. What Husserl’s extensive analyses on this topic bring to light is that the phenomenon of the Ego-splitting constitutes the bedrock not only of his thought but also of every philosophy that works within the framework of transcendental thinking

Comparative study of nonlinear properties of EEG signals of a normal person and an epileptic patient

Background: Investigation of the functioning of the brain in living systems has been a major effort amongst scientists and medical practitioners. Amongst the various disorder of the brain, epilepsy has drawn the most attention because this disorder can affect the quality of life of a person. In this paper we have reinvestigated the EEGs for normal and epileptic patients using surrogate analysis, probability distribution function and Hurst exponent. Results: Using random shuffled surrogate analysis, we have obtained some of the nonlinear features that was obtained by Andrzejak \textit{et al.} [Phys Rev E 2001, 64:061907], for the epileptic patients during seizure. Probability distribution function shows that the activity of an epileptic brain is nongaussian in nature. Hurst exponent has been shown to be useful to characterize a normal and an epileptic brain and it shows that the epileptic brain is long term anticorrelated whereas, the normal brain is more or less stochastic. Among all the techniques, used here, Hurst exponent is found very useful for characterization different cases. Conclusions: In this article, differences in characteristics for normal subjects with eyes open and closed, epileptic subjects during seizure and seizure free intervals have been shown mainly using Hurst exponent. The H shows that the brain activity of a normal man is uncorrelated in nature whereas, epileptic brain activity shows long range anticorrelation.Comment: Keywords:EEG, epilepsy, Correlation dimension, Surrogate analysis, Hurst exponent. 9 page

Light-like polygonal Wilson loops in 3d Chern-Simons and ABJM theory

We study light-like polygonal Wilson loops in three-dimensional Chern-Simons and ABJM theory to two-loop order. For both theories we demonstrate that the one-loop contribution to these correlators cancels. For pure Chern-Simons, we find that specific UV divergences arise from diagrams involving two cusps, implying the loss of finiteness and topological invariance at two-loop order. Studying those UV divergences we derive anomalous conformal Ward identities for n-cusped Wilson loops which restrict the finite part of the latter to conformally invariant functions. We also compute the four-cusp Wilson loop in ABJM theory to two-loop order and find that the result is remarkably similar to that of the corresponding Wilson loop in N=4 SYM. Finally, we speculate about the existence of a Wilson loop/scattering amplitude relation in ABJM theory.Comment: 37 pages, many figures; v2: references added, minor changes; v3: references added, sign error fixed and note adde