Value Iteration for Long-run Average Reward in Markov Decision Processes

Markov decision processes (MDPs) are standard models for probabilistic systems with non-deterministic behaviours. Long-run average rewards provide a mathematically elegant formalism for expressing long term performance. Value iteration (VI) is one of the simplest and most efficient algorithmic approaches to MDPs with other properties, such as reachability objectives. Unfortunately, a naive extension of VI does not work for MDPs with long-run average rewards, as there is no known stopping criterion. In this work our contributions are threefold. (1) We refute a conjecture related to stopping criteria for MDPs with long-run average rewards. (2) We present two practical algorithms for MDPs with long-run average rewards based on VI. First, we show that a combination of applying VI locally for each maximal end-component (MEC) and VI for reachability objectives can provide approximation guarantees. Second, extending the above approach with a simulation-guided on-demand variant of VI, we present an anytime algorithm that is able to deal with very large models. (3) Finally, we present experimental results showing that our methods significantly outperform the standard approaches on several benchmarks

The attitudes and beliefs of Pakistani medical practitioners about depression: a cross-sectional study in Lahore using the Revised Depression Attitude Questionnaire (R-DAQ)

BACKGROUND: Mental disorders such as depression are common and rank as major contributors to the global burden of disease. Condition recognition and subsequent management of depression is variable and influenced by the attitudes and beliefs of clinicians as well as those of patients. Most studies examining health professionals' attitudes have been conducted in Western nations; this study explores beliefs and attitudes about depression among doctors working in Lahore, Pakistan. METHODS: A cross-sectional survey conducted in 2015 used a questionnaire concerning demographics, education in psychiatry, beliefs about depression causes, and attitudes about depression using the Revised Depression Attitude Questionnaire (R-DAQ). A convenience sample of 700 non-psychiatrist medical practitioners based in six hospitals in Lahore was approached to participate in the survey. RESULTS: Six hundred and one (86 %) of the doctors approached consented to participate; almost all respondents (99 %) endorsed one of various biopsychosocial causes of depression (38 to 79 % for particular causes), and 37 % (between 13 and 19 % for particular causes) noted that supernatural forces could be responsible. Supernatural causes were more commonly held by female doctors, those working in rural settings, and those with greater psychiatry specialist education. Attitudes to depression were mostly less confident or optimistic and less inclined to a generalist perspective than those of clinicians in the UK or European nations, and deterministic perspectives that depression is a natural part of aging or due to personal failings were particularly common. However, there was substantial confidence in the efficacy of antidepressants and psychological therapy. More confident and therapeutically optimistic views and a more generalist perspective about depression management were associated with a rejection of supernatural explanations of the origin of depression. CONCLUSIONS: Non-psychiatrist medical practitioners in Pakistan hold a range of views about the causes of depression, with supernatural explanations held by more than a third. Depression attitudes appear less positive than among UK and European clinicians, with the notions that depression is due to a lack of stamina and will-power and a natural part of growing old being especially commonly held; more positive attitudes appear to be associated with a rejection of supernatural explanatory models of depression

Causes and risk factors for common mental illnesses : the beliefs of paediatric hospital staff in the United Arab Emirates

Background Children and adolescents with chronic physical health conditions are vulnerable to poor mental health outcomes. The measurement of mental health literacy of health professionals working with such populations is important because of their role in promoting early and appropriate help-seeking. This study sought to determine the beliefs regarding the causes of and risks factors for three types of mental illnesses amongst health professionals in United Arab Emirates. Method A culturally validated mental health literacy survey presenting three vignettes of fictional characters meeting diagnostic criteria for posttraumatic stress disorder, depression with suicidal thoughts and psychosis was distributed. The survey measured health care professionals’ beliefs regarding the causes of and risk factors for these disorders. Results A total of 317 health care professional (> 90% nurses) were surveyed from across the UAE. Although 43.8% correctly endorsed exposure to a ‘traumatic event’ as the most likely cause for developing posttraumatic stress disorder, there was a more limited understanding of the contribution of biopsychosocial factors to the development of the mental illness, particularly for psychosis. Participant socio-demographic variables were associated with attributions of religious or spiritual beliefs and personal weakness as causal and/or vulnerability factors in the development of depression with suicidal thoughts and psychosis. Conclusions Efforts to improve mental health systems and health care providers in UAE and other similar Middle Eastern countries requires targeted mental health literacy programs that seek to integrate biopsychosocial models of mental illness and their treatment with the positive aspects of religious and cultural beliefs that are dominant in this region

Acute pressure overload of the right ventricle. Comparison of two models of right-left shunt. Pulmonary artery to left atrium and right atrium to left atrium: experimental study

<p>Abtract</p> <p>Background</p> <p>In right ventricular failure (RVF), an interatrial shunt can relieve symptoms of severe pulmonary hypertension by reducing right ventricular preload and increasing systemic flow. Using a pig model to determine if a pulmonary artery - left atrium shunt (PA-LA) is better than a right atrial - left atrial shunt (RA-LA), we compared the hemodynamic effects and blood gases between the two shunts.</p> <p>Methods</p> <p>Thirty, male Large White pigs weighting in average 21.3 kg ± 0.7 (SEM) were divided into two groups (15 pigs per group): In group 1, banding of the pulmonary artery and a pulmonary artery to left atrium shunt with an 8 mm graft (PA-LA) was performed and in group 2 banding of the pulmonary artery and right atrial to left atrial shunt (RA-LA) with a similar graft was performed. Hemodynamic parameters and blood gases were measured from all cardiac chambers in 10 and 20 minutes, half and one hour interval from the baseline (30 min from the banding). Cardiac output and flow of at the left anterior descending artery was also monitored.</p> <p>Results</p> <p>In both groups, a stable RVF was generated. The PA-LA shunt compared to the RA-LA shunt has better hemodynamic performance concerning the decreased right ventricle afterload, the 4 fold higher mean pressure of the shunt, the better flow in left anterior descending artery and the decreased systemic vascular resistance. Favorable to the PA-LA shunt is also the tendency - although not statistically significant - in relation to central venous pressure, left atrial filling and cardiac output.</p> <p>Conclusion</p> <p>The PA-LA shunt can effectively reverse the catastrophic effects of acute RVF offering better hemodynamic characteristics than an interatrial shunt.</p

Onset of efficacy and tolerability following the initiation dosing of long-acting paliperidone palmitate: post-hoc analyses of a randomized, double-blind clinical trial

<p>Abstract</p> <p>Background</p> <p>Paliperidone palmitate is a long-acting injectable atypical antipsychotic for the acute and maintenance treatment of adults with schizophrenia. The recommended initiation dosing regimen is 234 mg on Day 1 and 156 mg on Day 8 via intramuscular (deltoid) injection; followed by 39 to 234 mg once-monthly thereafter (deltoid or gluteal). These post-hoc analyses addressed two commonly encountered clinical issues regarding the initiation dosing: the time to onset of efficacy and the associated tolerability.</p> <p>Methods</p> <p>In a 13-week double-blind trial, 652 subjects with schizophrenia were randomized to paliperidone palmitate 39, 156, or 234 mg (corresponding to 25, 100, or 150 mg equivalents of paliperidone, respectively) or placebo (NCT#00590577). Subjects randomized to paliperidone palmitate received 234 mg on Day 1, followed by their randomized fixed dose on Day 8, and monthly thereafter, with no oral antipsychotic supplementation. The onset of efficacy was defined as the first timepoint where the paliperidone palmitate group showed significant improvement in the Positive and Negative Syndrome Scale (PANSS) score compared to placebo (Analysis of Covariance [ANCOVA] models and Last Observation Carried Forward [LOCF] methodology without adjusting for multiplicity) using data from the Days 4, 8, 22, and 36 assessments. Adverse event (AE) rates and relative risks (RR) with 95% confidence intervals (CI) versus placebo were determined.</p> <p>Results</p> <p>Paliperidone palmitate 234 mg on Day 1 was associated with greater improvement than placebo on Least Squares (LS) mean PANSS total score at Day 8 (p = 0.037). After the Day 8 injection of 156 mg, there was continued PANSS improvement at Day 22 (p ≤ 0.007 vs. placebo) and Day 36 (p < 0.001). Taken together with results in the 39 mg and 234 mg Day 8 arms, these findings suggest a trend towards a dose-dependent response. During Days 1 to 7, AEs reported in ≥2% of paliperidone palmitate subjects (234 mg) and a greater proportion of paliperidone palmitate than placebo subjects were: agitation (3.2% vs. 1.3%; RR 2.52 [95% CI 0.583, 10.904]), headache (4.0% vs. 3.8%; RR 1.06 [95% CI 0.433, 2.619]), and injection site pain (6.7% vs. 3.8%; RR 1.79 [95% CI 0.764, 4.208]). Days 8 to 36 AEs meeting the same criteria in the 156 mg Day 8 arm were: anxiety (3.1% vs. 2.5%; RR 1.24 [95% CI 0.340, 4.542]), psychotic disorder (2.5% vs. 1.3%; RR 1.99 [95% CI 0.369, 10.699]), dizziness (2.5% vs. 1.3%; RR 1.99 [95% CI 0.369, 10.699]), and injection site pain (2.5% vs. 1.3%; RR 1.99 [95% CI 0.369, 10.699]). Corresponding Days 8 to 36 AEs in the 39 mg Day 8 group were: agitation (4.5% vs. 4.4%; RR 1.03 [95% CI 0.371, 2.874]), anxiety (3.9% vs. 2.5%; RR 1.55 [95% CI 0.446, 5.381]), and psychotic disorder (2.6% vs. 1.3%; RR 2.07 [95% CI 0.384, 11.110]) while in the 234 mg Day 8 group it was anxiety (3.1% vs. 2.5%, RR 1.25 [95% CI 0.342, 4.570]).</p> <p>Conclusions</p> <p>Significantly greater symptom improvement was observed by Day 8 with paliperidone palmitate (234 mg on Day 1) compared to placebo; this effect was maintained after the 156 mg Day 8 injection, with a trend towards a dose-dependent response. No unexpected tolerability findings were noted in the first week or month after the initiation dosing.</p> <p>Trial registration</p> <p>ClinicalTrials.gov: <a href="http://www.clinicaltrials.gov/ct2/show/NCT#00590577">NCT#00590577</a></p

Solitary waves in the Nonlinear Dirac Equation

In the present work, we consider the existence, stability, and dynamics of solitary waves in the nonlinear Dirac equation. We start by introducing the Soler model of self-interacting spinors, and discuss its localized waveforms in one, two, and three spatial dimensions and the equations they satisfy. We present the associated explicit solutions in one dimension and numerically obtain their analogues in higher dimensions. The stability is subsequently discussed from a theoretical perspective and then complemented with numerical computations. Finally, the dynamics of the solutions is explored and compared to its non-relativistic analogue, which is the nonlinear Schr{\"o}dinger equation. A few special topics are also explored, including the discrete variant of the nonlinear Dirac equation and its solitary wave properties, as well as the PT-symmetric variant of the model

Surgical management and outcome of newly diagnosed glioblastoma without contrast enhancement (<i>low-grade appearance</i>):a report of the RANO <i>resect </i>group

BackgroundResection of the contrast-enhancing (CE) tumor represents the standard of care in newly diagnosed glioblastoma. However, some tumors ultimately diagnosed as glioblastoma lack contrast enhancement and have a ‘low-grade appearance’ on imaging (non-CE glioblastoma). We aimed to (a) volumetrically define the value of non-CE tumor resection in the absence of contrast enhancement, and to (b) delineate outcome differences between glioblastoma patients with and without contrast enhancement.MethodsThe RANO resect group retrospectively compiled a global, eight-center cohort of patients with newly diagnosed glioblastoma per WHO 2021 classification. The associations between postoperative tumor volumes and outcome were analyzed. Propensity score-matched analyses were constructed to compare glioblastomas with and without contrast enhancement.ResultsAmong 1323 newly diagnosed IDH-wildtype glioblastomas, we identified 98 patients (7.4%) without contrast enhancement. In such patients, smaller postoperative tumor volumes were associated with more favorable outcome. There was an exponential increase in risk for death with larger residual non-CE tumor. Accordingly, extensive resection was associated with improved survival compared to lesion biopsy. These findings were retained on a multivariable analysis adjusting for demographic and clinical markers. Compared to CE glioblastoma, patients with non-CE glioblastoma had a more favorable clinical profile and superior outcome as confirmed in propensity score analyses by matching the patients with non-CE glioblastoma to patients with CE glioblastoma using a large set of clinical variables.ConclusionsThe absence of contrast enhancement characterizes a less aggressive clinical phenotype of IDH-wildtype glioblastomas. Maximal resection of non-CE tumors has prognostic implications and translates into favorable outcome

Visualization of Abscess Formation in a Murine Thigh Infection Model of Staphylococcus aureus by 19F-Magnetic Resonance Imaging (MRI)

Background: During the last years, 19 F-MRI and perfluorocarbon nanoemulsion (PFC) emerged as a powerful contrast agent based MRI methodology to track cells and to visualize inflammation. We applied this new modality to visualize deep tissue abscesses during acute and chronic phase of inflammation caused by Staphylococcus aureus infection. Methodology and Principal Findings: In this study, a murine thigh infection model was used to induce abscess formation and PFC or CLIO (cross linked ironoxides) was administered during acute or chronic phase of inflammation. 24 h after inoculation, the contrast agent accumulation was imaged at the site of infection by MRI. Measurements revealed a strong accumulation of PFC at the abscess rim at acute and chronic phase of infection. The pattern was similar to CLIO accumulation at chronic phase and formed a hollow sphere around the edema area. Histology revealed strong influx of neutrophils at the site of infection and to a smaller extend macrophages during acute phase and strong influx of macrophages at chronic phase of inflammation. Conclusion and Significance: We introduce 19 F-MRI in combination with PFC nanoemulsions as a new platform to visualize abscess formation in a murine thigh infection model of S. aureus. The possibility to track immune cells in vivo by this modality offers new opportunities to investigate host immune response, the efficacy of antibacterial therapies and th

Thresholds of riparian forest use by terrestrial mammals in a fragmented Amazonian deforestation frontier

Species persistence in fragmented landscapes is intimately related to the quality, structure, and context of remaining habitat remnants. Riparian vegetation is legally protected within private landholdings in Brazil, so we quantitatively assessed occupancy patterns of terrestrial mammals in these remnants, examining under which circumstances different species effectively use them. We selected 38 riparian forest patches and five comparable riparian sites within continuous forest, at which we installed four to five camera-traps per site (199 camera-trap stations). Terrestrial mammal assemblages were sampled for 60 days per station during the dry seasons of 2013 and 2014. We modelled species occupancy and detection probabilities within riparian forest remnants, and examined the effects of patch size, habitat quality, and landscape structure on occupancy probabilities. We then scaled-up modelled occupancies to all 1915 riparian patches throughout the study region to identify which remnants retain the greatest potential to work as habitat for terrestrial vertebrates. Of the ten species for which occupancy was modelled, six responded to forest quality (remnant degradation, cattle intrusion, palm aggregations, and understorey density) or structure (remnant width, isolation, length, and area of the patch from which it originates). Patch suitability was lower considering habitat quality than landscape structure, and virtually all riparian remnants were unsuitable to maintain a high occupancy probability for all species that responded to forest patch quality or structure. Beyond safeguarding legal compliance concerning riparian remnant amount, ensuring terrestrial vertebrate persistence in fragmented landscapes will require curbing the drivers of forest degradation within private landholdings