Probabilistic inference for determining options in reinforcement learning

Tasks that require many sequential decisions or complex solutions are hard to solve using conventional reinforcement learning algorithms. Based on the semi Markov decision process setting (SMDP) and the option framework, we propose a model which aims to alleviate these concerns. Instead of learning a single monolithic policy, the agent learns a set of simpler sub-policies as well as the initiation and termination probabilities for each of those sub-policies. While existing option learning algorithms frequently require manual specification of components such as the sub-policies, we present an algorithm which infers all relevant components of the option framework from data. Furthermore, the proposed approach is based on parametric option representations and works well in combination with current policy search methods, which are particularly well suited for continuous real-world tasks. We present results on SMDPs with discrete as well as continuous state-action spaces. The results show that the presented algorithm can combine simple sub-policies to solve complex tasks and can improve learning performance on simpler tasks

New mutations at the imprinted Gnas cluster show gene dosage effects of Gsα in postnatal growth and implicate XLαs in bone and fat metabolism, but not in suckling

The imprinted Gnas cluster is involved in obesity, energy metabolism, feeding behavior, and viability. Relative contribution of paternally expressed proteins XLαs, XLN1, and ALEX or a double dose of maternally expressed Gsα to phenotype has not been established. In this study, we have generated two new mutants (Ex1A-T-CON and Ex1A-T) at the Gnas cluster. Paternal inheritance of Ex1A-T-CON leads to loss of imprinting of Gsα, resulting in preweaning growth retardation followed by catch-up growth. Paternal inheritance of Ex1A-T leads to loss of imprinting of Gsα and loss of expression of XLαs and XLN1. These mice have severe preweaning growth retardation and incomplete catch-up growth. They are fully viable probably because suckling is unimpaired, unlike mutants in which the expression of all the known paternally expressed Gnasxl proteins (XLαs, XLN1 and ALEX) is compromised. We suggest that loss of ALEX is most likely responsible for the suckling defects previously observed. In adults, paternal inheritance of Ex1A-T results in an increased metabolic rate and reductions in fat mass, leptin, and bone mineral density attributable to loss of XLαs. This is, to our knowledge, the first report describing a role for XLαs in bone metabolism. We propose that XLαs is involved in the regulation of bone and adipocyte metabolism

Comparing the immune response to a novel intranasal nanoparticle PLGA vaccine and a commercial BPI3V vaccine in dairy calves

peer-reviewedBackground There is a need to improve vaccination against respiratory pathogens in calves by stimulation of local immunity at the site of pathogen entry at an early stage in life. Ideally such a vaccine preparation would not be inhibited by the maternally derived antibodies. Additionally, localized immune response at the site of infection is also crucial to control infection at the site of entry of virus. The present study investigated the response to an intranasal bovine parainfluenza 3 virus (BPI3V) antigen preparation encapsulated in PLGA (poly dl-lactic-co-glycolide) nanoparticles in the presence of pre-existing anti-BPI3V antibodies in young calves and comparing it to a commercially available BPI3V respiratory vaccine. Results There was a significant (P < 0.05) increase in BPI3V-specific IgA in the nasal mucus of the BPI3V nanoparticle vaccine group alone. Following administration of the nanoparticle vaccine an early immune response was induced that continued to grow until the end of study and was not observed in the other treatment groups. Virus specific serum IgG response to both the nanoparticle vaccine and commercial live attenuated vaccine showed a significant (P < 0.05) rise over the period of study. However, the cell mediated immune response observed didn’t show any significant rise in any of the treatment groups. Conclusion Calves administered the intranasal nanoparticle vaccine induced significantly greater mucosal IgA responses, compared to the other treatment groups. This suggests an enhanced, sustained mucosal-based immunological response to the BPI3V nanoparticle vaccine in the face of pre-existing antibodies to BPI3V, which are encouraging and potentially useful characteristics of a candidate vaccine. However, ability of nanoparticle vaccine in eliciting cell mediated immune response needs further investigation. More sustained local mucosal immunity induced by nanoparticle vaccine has obvious potential if it translates into enhanced protective immunity in the face of virus outbreak

Gentrifying the Peri-urban: Land use Conflicts and institutional dynamics at the Frontier of an Indonesian Metropolis

This paper aims to specify the meaning of gentrification in rapidly peri-urbanising metropolitan regions in the context of Indonesia’s rapid transition to decentralisation and democracy. It discusses a case study of conflict over an environmental revitalisation project in a peri-urban area of Bandung City. The analysis focuses on the political processes, tactics and strategies supporting and opposing peri-urban gentrification and their consequences. The analysis illustrates how these political dynamics mediate the interaction between the movement of capital and the spatial reorganisation of social classes. It is argued that in the context of a peri-urbanising metropolis, gentrification needs to be narrated less in terms of class-based neighbourhood succession and more in terms of competing cross-class coalitions emerging at local and regional levels

Thymidylate synthetase mRNA levels are increased in liver metastases of colorectal cancer patients resistant to fluoropyrimidine-based chemotherapy

BACKGROUND: Fluoropyrimidines such as 5-fluorouracil (5-FU) and 5-fluoro-2'deoxyuridine (FUDR) are among the most effective chemotherapeutic agents for treatment of metastatic colorectal cancer (CRC). Increased expression of thymidylate synthetase (TS) in CRC metastases has been proposed to be an important mechanism of resistance to fluoropyrimidine-based chemotherapy. METHODS: The present study investigated whether TS mRNA levels in liver metastases of 20 CRC patients before treatment with FUDR by hepatic arterial infusion (HAI) correlated with frequency of clinical response or survival duration. RESULTS: Median survival duration of patients with TS mRNA levels above and below the median was 15 and 18 months, respectively (p > 0.05). Clinical response was achieved in 40% of patients with low TS mRNA levels, but in only 20% of patients with high TS mRNA levels (p = 0.01). TS mRNA levels were also measured for liver metastases of 7 of the patients that did not achieve a clinical response. A statistically significant increase in expression of TS mRNA was observed for liver metastases resistant to chemotherapy (21 ± 14) in comparison to liver metastases of the same patients before chemotherapy (8 ± 4) (p = 0.03). CONCLUSION: This is the first report to demonstrate increased TS expression in liver metastases from CRC patients resistant to fluoropyrimidine based chemotherapy. These findings are consistent with previous studies indicating that increased TS expression is associated with resistance to fluoropyrimidine-based chemotherapy

Roaring high and low: composition and possible functions of the Iberian stag's vocal repertoire

We provide a detailed description of the rutting vocalisations of free-ranging male Iberian deer (Cervus elaphus hispanicus, Hilzheimer 1909), a geographically isolated and morphologically differentiated subspecies of red deer Cervus elaphus. We combine spectrographic examinations, spectral analyses and automated classifications to identify different call types, and compare the composition of the vocal repertoire with that of other red deer subspecies. Iberian stags give bouts of roars (and more rarely, short series of barks) that are typically composed of two different types of calls. Long Common Roars are mostly given at the beginning or at the end of the bout, and are characterised by a high fundamental frequency (F0) resulting in poorly defined formant frequencies but a relatively high amplitude. In contrast, Short Common Roars are typically given in the middle or at the end of the bout, and are characterised by a lower F0 resulting in relatively well defined vocal tract resonances, but low amplitude. While we did not identify entirely Harsh Roars (as described in the Scottish red deer subspecies (Cervus elaphus scoticus), a small percentage of Long Common Roars contained segments of deterministic chaos. We suggest that the evolution of two clearly distinct types of Common Roars may reflect divergent selection pressures favouring either vocal efficiency in high pitched roars or the communication of body size in low-pitched, high spectral density roars highlighting vocal tract resonances. The clear divergence of the Iberian red deer vocal repertoire from those of other documented European red deer populations reinforces the status of this geographical variant as a distinct subspecies

Incidence and Risk Factors of Recurrence after Surgery for Pathology-proven Diverticular Disease

Contains fulltext : 69776.pdf (publisher's version ) (Closed access)BACKGROUND: Diverticular disease is a common problem in Western countries. Rationale for elective surgery is to prevent recurrent complicated diverticulitis and to reduce emergency procedures. Recurrent diverticulitis occurs in about 10% after resection. The pathogenesis for recurrence is not completely understood. We studied the incidence and risk factors for recurrence and the overall morbidity and mortality of surgical therapy for diverticular disease. METHODS: Medical records of 183 consecutive patients with pathology-proven diverticulitis were eligible for evaluation. Mean duration of follow-up was 7.2 years. Number of preoperative episodes, emergency or elective surgeries, type of operation, level of anastomosis, postoperative complications, persistent postoperative pain, complications associated with colostomy reversal, and recurrent diverticulitis were noted. The Kaplan-Meier method was used to calculate the cumulative probability of recurrence. Cox regression was used to identify possible risk factors for recurrence. RESULTS: The incidence of recurrence was 8.7%, with an estimated risk of recurrence over a 15-year period of 16%. Risk factors associated with recurrence were (younger) age (p < 0.02) and the persistence of postoperative pain (p < 0.005). Persistent abdominal pain after surgery was present in 22%. Eighty percent of patients who needed emergency surgery for acute diverticulitis had no manifestation of diverticular disease prior to surgery. In addition, recurrent diverticulitis was not associated with a higher percentage of emergency procedures. CONCLUSION: Estimated risk of recurrence is high and abdominal complaints after surgical therapy for diverticulitis are frequent. Younger age and persistence of postoperative symptoms predict recurrent diverticulitis after resection. The clinical implication of these findings needs further investigation. The results of this study support the careful selection of patients for surgery for diverticulitis

Gastrointestinal complaints in runners are not due to small intestinal bacterial overgrowth

<p>Abstract</p> <p>Background</p> <p>Gastrointestinal complaints are common among long distance runners. We hypothesised that small intestinal bacterial overgrowth (SIBO) is present in long distance runners frequently afflicted with gastrointestinal complaints.</p> <p>Findings</p> <p>Seven long distance runners (5 female, mean age 29.1 years) with gastrointestinal complaints during and immediately after exercise without known gastrointestinal diseases performed Glucose hydrogen breath tests for detection of SIBO one week after a lactose hydrogen breath test checking for lactose intolerance. The most frequent symptoms were diarrhea (5/7, 71%) and flatulence (6/7, 86%). The study was conducted at a laboratory.</p> <p>In none of the subjects a pathological hydrogen production was observed after the intake of glucose. Only in one athlete a pathological hydrogen production was measured after the intake of lactose suggesting lactose intolerance.</p> <p>Conclusions</p> <p>Gastrointestinal disorders in the examined long distance runners were not associated with small intestinal bacterial overgrowth.</p

Is IP-10 a Better Biomarker for Active and Latent Tuberculosis in Children than IFNγ?

Background: The blood based interferon-gamma release assays (IGRA) for the diagnosis of tuberculosis do not discriminate between active TB disease and latent TB infection (LTBI). The search for distinguishing biomarkers therefore continues, as the accurate diagnosis of tuberculosis is particularly challenging in children. IFN-c-inducible protein 10 (IP-10/CXCL10) has recently been evaluated as a marker for active TB in adults with promising results. Aim: To investigate this new biomarker for active TB and LTBI in paediatrics. Method: We measured IP-10 levels using ELISA in supernatants of whole blood samples stimulated with TB-specificantigens and negative control antigen. Results: IP-10 is produced in high levels following mycobacterial antigen stimulation in active TB (n = 17) and LTBI (n = 16) compared to controls (n = 16) and to IFN-c. The baseline levels of IP-10 are increased in active TB and in LTBI, but there is no significant difference of stimulated levels of IP-10 between active TB and LTBI. Conclusions: IP-10 is a biomarker for tuberculosis in children. However like IFNc, IP-10 also does not distinguish between active TB and LTBI