Geometry of Policy Improvement

We investigate the geometry of optimal memoryless time independent decision making in relation to the amount of information that the acting agent has about the state of the system. We show that the expected long term reward, discounted or per time step, is maximized by policies that randomize among at most $k$ actions whenever at most $k$ world states are consistent with the agent's observation. Moreover, we show that the expected reward per time step can be studied in terms of the expected discounted reward. Our main tool is a geometric version of the policy improvement lemma, which identifies a polyhedral cone of policy changes in which the state value function increases for all states.Comment: 8 page

Operative strategy for fistula-in-ano without division of the anal sphincter

We would like to thank Mr ER MacDonald for his contribution in data collection during the early years of the study. The material in this paper was presented as a poster at the annual meeting of the American Society of Colon and Rectal Surgeons held in Vancouver, Canada, May 2011.Peer reviewedPublisher PD

Time-dependent appearance of myofibroblasts in granulation tissue of human skin wounds

Human skin wounds (66) inflicted between 20 h and 7 months prior to biopsy were studied. In order to identify the type of cellular differentiation of the fibroblastic cells in the granulation tissue, alpha-smooth muscle actin and desmin were immunohistochemically localized. The value of any presumed time-dependent appearance and/or disappearance of positively stained cells was tested for the estimation of wound age. In skin specimens with a wound age less than 5 days (n =15) no typical granulation tissue had developed and no alpha-actin-positive myofibroblasts could be detected. The first appearance of positively reacting myofibroblasts was noted in a 5-day-old wound. In 57% of the lesions with a wound age between 5 and 31 days (25 out of 44 cases) typical granulation tissue formation was present and myofibroblasts with positive reaction for alpha-smooth muscle actin could be identified. Numerous positively reacting cells could generally be found in wounds aged between 16 and 31 days, but also in wounds less than 16 days old. In 29% of the cases with a wound age of more than 31 days (2 out of 7 cases) alpha-sma-positive myofibroblasts also occured. Fibroblastic cells positive for desmin could not be seen at all in our series. Our results demonstrate the appearance of alpha-sma-positive myofibroblasts with the initial formation of typical granulation tissue in human skin lesions as early as approximately 5 days after wounding. In contrast to recent experimental results these cells remained detectable in wounds aged more than 2 months in some cases. The immunohistochemical detection of actin-positive cells, therefore, demonstrates whether an unknown skin wound is aged approximately 5 days or more. Even though a time-dependent decrease of myofibroblasts in human granulation tissue after 31 days in human wounds seems probable, the extended presence (up to about 2 months) of these cells allows no further exact age determination of older wounds

Probabilistic Analysis of Optimization Problems on Generalized Random Shortest Path Metrics

Simple heuristics often show a remarkable performance in practice for optimization problems. Worst-case analysis often falls short of explaining this performance. Because of this, "beyond worst-case analysis" of algorithms has recently gained a lot of attention, including probabilistic analysis of algorithms. The instances of many optimization problems are essentially a discrete metric space. Probabilistic analysis for such metric optimization problems has nevertheless mostly been conducted on instances drawn from Euclidean space, which provides a structure that is usually heavily exploited in the analysis. However, most instances from practice are not Euclidean. Little work has been done on metric instances drawn from other, more realistic, distributions. Some initial results have been obtained by Bringmann et al. (Algorithmica, 2013), who have used random shortest path metrics on complete graphs to analyze heuristics. The goal of this paper is to generalize these findings to non-complete graphs, especially Erd\H{o}s-R\'enyi random graphs. A random shortest path metric is constructed by drawing independent random edge weights for each edge in the graph and setting the distance between every pair of vertices to the length of a shortest path between them with respect to the drawn weights. For such instances, we prove that the greedy heuristic for the minimum distance maximum matching problem, the nearest neighbor and insertion heuristics for the traveling salesman problem, and a trivial heuristic for the $k$-median problem all achieve a constant expected approximation ratio. Additionally, we show a polynomial upper bound for the expected number of iterations of the 2-opt heuristic for the traveling salesman problem.Comment: An extended abstract appeared in the proceedings of WALCOM 201

Probabilistic Analysis of Facility Location on Random Shortest Path Metrics

The facility location problem is an NP-hard optimization problem. Therefore, approximation algorithms are often used to solve large instances. Such algorithms often perform much better than worst-case analysis suggests. Therefore, probabilistic analysis is a widely used tool to analyze such algorithms. Most research on probabilistic analysis of NP-hard optimization problems involving metric spaces, such as the facility location problem, has been focused on Euclidean instances, and also instances with independent (random) edge lengths, which are non-metric, have been researched. We would like to extend this knowledge to other, more general, metrics. We investigate the facility location problem using random shortest path metrics. We analyze some probabilistic properties for a simple greedy heuristic which gives a solution to the facility location problem: opening the $\kappa$ cheapest facilities (with $\kappa$ only depending on the facility opening costs). If the facility opening costs are such that $\kappa$ is not too large, then we show that this heuristic is asymptotically optimal. On the other hand, for large values of $\kappa$, the analysis becomes more difficult, and we provide a closed-form expression as upper bound for the expected approximation ratio. In the special case where all facility opening costs are equal this closed-form expression reduces to $O(\sqrt[4]{\ln(n)})$ or $O(1)$ or even $1+o(1)$ if the opening costs are sufficiently small.Comment: A preliminary version accepted to CiE 201

Electrically controlled long-distance spin transport through an antiferromagnetic insulator

Spintronics uses spins, the intrinsic angular momentum of electrons, as an alternative for the electron charge. Its long-term goal is in the development of beyond-Moore low dissipation technology devices. Recent progress demonstrated the long-distance transport of spin signals across ferromagnetic insulators. Antiferromagnetically ordered materials are however the most common class of magnetic materials with several crucial advantages over ferromagnetic systems. In contrast to the latter, antiferromagnets exhibit no net magnetic moment, which renders them stable and impervious to external fields. In addition, they can be operated at THz frequencies. While fundamentally their properties bode well for spin transport, previous indirect observations indicate that spin transmission through antiferromagnets is limited to short distances of a few nanometers. Here we demonstrate the long-distance, over tens of micrometers, propagation of spin currents through hematite (\alpha-Fe2O3), the most common antiferromagnetic iron oxide, exploiting the spin Hall effect for spin injection. We control the spin current flow by the interfacial spin-bias and by tuning the antiferromagnetic resonance frequency with an external magnetic field. This simple antiferromagnetic insulator is shown to convey spin information parallel to the compensated moment (N\'eel order) over distances exceeding tens of micrometers. This newly-discovered mechanism transports spin as efficiently as the net magnetic moments in the best-suited complex ferromagnets. Our results pave the way to ultra-fast, low-power antiferromagnet-insulator-based spin-logic devices that operate at room temperature and in the absence of magnetic fields

Characterising the shape, size, and orientation of cloud‐feeding coherent boundary‐layer structures

Two techniques are presented for characterisation of cloud-feeding coherent boundary-layer structures through analysis of large-eddy simulations of shallow cumulus clouds, contrasting conditions with and without ambient shear. The first technique is a generalisation of the two-point correlation function, where the correlation length-scale as well as the orientation can be extracted. The second technique identifies individual coherent structures and decomposes their vertical transport by the shape, size, and orientation of these objects. The bulk-correlation technique is shown to capture the elongation and orientation of coherence by ambient wind, but is unable to characterise individual coherent structures. Using the object-based approach, it is found that the individual structures dominating the vertical flux are plume-like in character (extending from the surface into cloud) rather than thermal-like, show small width/thickness asymmetry, and rise near-vertically in the absence of ambient wind. The planar stretching and tilting of boundary-layer structures caused by the introduction of ambient shear is also quantified, demonstrating the general applicability of the techniques for future study of other boundary-layer patterns

Managing Incidental Genomic Findings in Clinical Trials: Fulfillment of the Principle of Justice

<p>Managing Incidental Genomic Findings in Clinical Trials: Fulfillment of the Principle of Justice</p

The need to promote behaviour change at the cultural level: one factor explaining the limited impact of the MEMA kwa Vijana adolescent sexual health intervention in rural Tanzania. A process evaluation

Background - Few of the many behavioral sexual health interventions in Africa have been rigorously evaluated. Where biological outcomes have been measured, improvements have rarely been found. One of the most rigorous trials was of the multi-component MEMA kwa Vijana adolescent sexual health programme, which showed improvements in knowledge and reported attitudes and behaviour, but none in biological outcomes. This paper attempts to explain these outcomes by reviewing the process evaluation findings, particularly in terms of contextual factors. Methods - A large-scale, primarily qualitative process evaluation based mainly on participant observation identified the principal contextual barriers and facilitators of behavioural change. Results - The contextual barriers involved four interrelated socio-structural factors: culture (i.e. shared practices and systems of belief), economic circumstances, social status, and gender. At an individual level they appeared to operate through the constructs of the theories underlying MEMA kwa Vijana - Social Cognitive Theory and the Theory of Reasoned Action – but the intervention was unable to substantially modify these individual-level constructs, apart from knowledge. Conclusion - The process evaluation suggests that one important reason for this failure is that the intervention did not operate sufficiently at a structural level, particularly in regard to culture. Recently most structural interventions have focused on gender or/and economics. Complementing these with a cultural approach could address the belief systems that justify and perpetuate gender and economic inequalities, as well as other barriers to behaviour change