Value Iteration for Long-run Average Reward in Markov Decision Processes

Markov decision processes (MDPs) are standard models for probabilistic systems with non-deterministic behaviours. Long-run average rewards provide a mathematically elegant formalism for expressing long term performance. Value iteration (VI) is one of the simplest and most efficient algorithmic approaches to MDPs with other properties, such as reachability objectives. Unfortunately, a naive extension of VI does not work for MDPs with long-run average rewards, as there is no known stopping criterion. In this work our contributions are threefold. (1) We refute a conjecture related to stopping criteria for MDPs with long-run average rewards. (2) We present two practical algorithms for MDPs with long-run average rewards based on VI. First, we show that a combination of applying VI locally for each maximal end-component (MEC) and VI for reachability objectives can provide approximation guarantees. Second, extending the above approach with a simulation-guided on-demand variant of VI, we present an anytime algorithm that is able to deal with very large models. (3) Finally, we present experimental results showing that our methods significantly outperform the standard approaches on several benchmarks

Predicting the Use of Campus Counseling Services for Asian/Pacific Islander, Latino/Hispanic, and White Students: Problem Severity, Gender, and Generational Status

The purpose of the current study was to identify predictors of counseling center use among Asian, Latino/a, and White college students. Findings indicated that females and second generation students report the most severe difficulties. Problem severity and gender predicted counseling center use for White and Asian students, whereas only problem severity predicted use for Latino students. Generational status was not a significant predictor of use for any group

Measuring patient-perceived quality of care in US hospitals using Twitter

BACKGROUND: Patients routinely use Twitter to share feedback about their experience receiving healthcare. Identifying and analysing the content of posts sent to hospitals may provide a novel real-time measure of quality, supplementing traditional, survey-based approaches. OBJECTIVE: To assess the use of Twitter as a supplemental data stream for measuring patient-perceived quality of care in US hospitals and compare patient sentiments about hospitals with established quality measures. DESIGN: 404 065 tweets directed to 2349 US hospitals over a 1-year period were classified as having to do with patient experience using a machine learning approach. Sentiment was calculated for these tweets using natural language processing. 11 602 tweets were manually categorised into patient experience topics. Finally, hospitals with ≥50 patient experience tweets were surveyed to understand how they use Twitter to interact with patients. KEY RESULTS: Roughly half of the hospitals in the US have a presence on Twitter. Of the tweets directed toward these hospitals, 34 725 (9.4%) were related to patient experience and covered diverse topics. Analyses limited to hospitals with ≥50 patient experience tweets revealed that they were more active on Twitter, more likely to be below the national median of Medicare patients (p<0.001) and above the national median for nurse/patient ratio (p=0.006), and to be a non-profit hospital (p<0.001). After adjusting for hospital characteristics, we found that Twitter sentiment was not associated with Hospital Consumer Assessment of Healthcare Providers and Systems (HCAHPS) ratings (but having a Twitter account was), although there was a weak association with 30-day hospital readmission rates (p=0.003). CONCLUSIONS: Tweets describing patient experiences in hospitals cover a wide range of patient care aspects and can be identified using automated approaches. These tweets represent a potentially untapped indicator of quality and may be valuable to patients, researchers, policy makers and hospital administrators

An Event Structure Model for Probabilistic Concurrent Kleene Algebra

We give a new true-concurrent model for probabilistic concurrent Kleene algebra. The model is based on probabilistic event structures, which combines ideas from Katoen's work on probabilistic concurrency and Varacca's probabilistic prime event structures. The event structures are compared with a true-concurrent version of Segala's probabilistic simulation. Finally, the algebraic properties of the model are summarised to the extent that they can be used to derive techniques such as probabilistic rely/guarantee inference rules.Comment: Submitted and accepted for LPAR19 (2013

All-optical generation of antiferromagnetic magnon currents via the magnon circular photogalvanic effect

We introduce the magnon circular photogalvanic effect enabled by two-magnon Raman scattering. This provides an all-optical pathway to the generation of directed magnon currents with circularly polarized light in honeycomb antiferromagnetic insulators. The effect is the leading order contribution to magnon photocurrent generation via optical fields. Control of the magnon current by the polarization and angle of incidence of the laser is demonstrated. Experimental detection by sizable inverse spin Hall voltages in platinum contacts is proposed

Direct optical probe of magnon topology in two-dimensional quantum magnets

Controlling edge states of topological magnon insulators is a promising route to stable spintronics devices. However, to experimentally ascertain the topology of magnon bands is a challenging task. Here we derive a fundamental relation between the light-matter coupling and the quantum geometry of magnon states. This allows to establish the two-magnon Raman circular dichroism as an optical probe of magnon topology in honeycomb magnets, in particular of the Chern number and the topological gap. Our results pave the way for interfacing light and topological magnons in functional quantum devices

MTOR signaling and ubiquitin-proteosome gene expression in the preservation of fat free mass following high protein, calorie restricted weight loss

Extent: 8p.Caloric restriction is one of the most efficient ways to promote weight loss and is known to activate protective metabolic pathways. Frequently reported with weight loss is the undesirable consequence of fat free (lean muscle) mass loss. Weight loss diets with increased dietary protein intake are popular and may provide additional benefits through preservation of fat free mass compared to a standard protein, high carbohydrate diet. However, the precise mechanism by which a high protein diet may mitigate dietary weight loss induced reductions in fat free mass has not been fully elucidated. Maintenance of fat free mass is dependent upon nutrient stimulation of protein synthesis via the mTOR complex, although during caloric restriction a decrease (atrophy) in skeletal muscle may be driven by a homeostatic shift favouring protein catabolism. This review evaluates the relationship between the macronutrient composition of calorie restricted diets and weight loss using metabolic indicators. Specifically we evaluate the effect of increased dietary protein intake and caloric restricted diets on gene expression in skeletal muscle, particularly focusing on biosynthesis, degradation and the expression of genes in the ubiquitin-proteosome (UPP) and mTOR signaling pathways, including MuRF-1, MAFbx/atrogin-1, mTORC1, and S6K1.Cassandra M McIver, Thomas P Wycherley and Peter M Clifto

Gliotransmission modulates baseline mechanical nociception

Pain is a physiological and adaptive process which occurs to protect organisms from tissue damage and extended injury. Pain sensation beyond injury, however, is a pathological process which is poorly understood. Experimental models of neuropathic pain demonstrate that reactive astrocytes contribute to reduced nociceptive thresholds. Astrocytes release "gliotransmitters" such as D-serine, glutamate, and ATP, which is extracellularly hydrolyzed to adenosine. Adenosine 1 receptor activation in the spinal cord has anti-nociceptive effects on baseline pain threshold, but the source of the endogenous ligand (adenosine) in the spinal cord is unknown. In this study we used a transgenic mouse model in which SNARE-mediated gliotransmission was selectively attenuated (called dnSNARE mice) to investigate the role of astrocytes in mediating baseline nociception and the development of neuropathic pain. Under baseline conditions, immunostaining in the dorsal horn of the spinal cord showed astrocyte-specific transgene expression in dnSNARE mice, and no difference in expression levels of the astrocyte marker GFAP and the microglia marker Iba1 relative to wild-type mice. The Von Frey filament test was used to probe sensitivity to baseline mechanical pain thresholds and allodynia following the spared nerve injury model of neuropathic pain. DnSNARE mice exhibit a reduced nociceptive threshold in response to mechanical stimulation compared to wild-type mice under baseline conditions, but nociceptive thresholds following spared nerve injury were similar between dnSNARE and wild-types. This study is the first to provide evidence that gliotransmission contributes to basal mechanical nociception

Bolus ingestion of whey protein immediately post-exercise does not influence rehydration compared to energy-matched carbohydrate ingestion

Whey protein is a commonly ingested nutritional supplement amongst athletes and regular exercisers; however, its role in post-exercise rehydration remains unclear. Eight healthy male and female participants completed two experimental trials involving the ingestion of 35 g of whey protein (WP) or maltodextrin (MD) at the onset of a rehydration period, followed by ingestion of water to a volume equivalent to 150% of the amount of body mass lost during exercise in the heat. The gastric emptying rates of the solutions were measured using 13C breath tests. Recovery was monitored for a further 3 h by the collection of blood and urine samples. The time taken to empty half of the initial solution (T1/2) was different between the trials (WP = 65.5 ± 11.4 min; MD = 56.7 ± 6.3 min; p = 0.05); however, there was no difference in cumulative urine volume throughout the recovery period (WP = 1306 ± 306 mL; MD = 1428 ± 443 mL; p = 0.314). Participants returned to net negative fluid balance 2 h after the recovery period with MD and 3 h with WP. The results of this study suggest that whey protein empties from the stomach at a slower rate than MD; however, this does not seem to exert any positive or negative effects on the maintenance of fluid balance in the post-exercise period