Sequence tutor: Conservative fine-tuning of sequence generation models with KL-control

This paper proposes a general method for improving the structure and quality of sequences generated by a recurrent neural network (RNN), while maintaining information originally learned from data, as well as sample diversity. An RNN is first pre-trained on data using maximum likelihood estimation (MLE), and the probability distribution over the next token in the sequence learned by this model is treated as a prior policy. Another RNN is then trained using reinforcement learning (RL) to generate higher-quality outputs that account for domain-specific incentives while retaining proximity to the prior policy of the MLE RNN. To formalize this objective, we derive novel off-policy RL methods for RNNs from KL-control. The effectiveness of the approach is demonstrated on two applications; 1) generating novel musical melodies, and 2) computational molecular generation. For both problems, we show that the proposed method improves the desired properties and structure of the generated sequences, while maintaining information learned from data

Rewiring strategies for changing environments

A typical pervasive application executes in a changing environment: people, computing resources, software services and network connections come and go continuously. A robust pervasive application needs adapt to this changing context as long as there is an appropriate rewiring strategy that guarantees correct behavior. We combine the MERODE modeling methodology with the ReWiRe framework for creating interactive pervasive applications that can cope with changing environments. The core of our approach is a consistent environment model, which is essential to create (re)configurable context-aware pervasive applications. We aggregate different ontologies that provide the required semantics to describe almost any target environment. We present a case study that shows a interactive pervasive application for media access that incorporates parental control on media content and can migrate between devices. The application builds upon models of the run-time environment represented as system states for dedicated rewiring strategies

SWITCHING RATES AND THE ASYMPTOTIC BEHAVIOR OF HERDING MODELS

Markov chains have experienced a surge of economic interest in the form of behavioral agent-based models that aim at explaining the statistical regularities of financial returns. We review some of the relevant mathematical facts and show how they apply to agent-based herding models, with the particular goal of establishing their asymptotic behavior because several studies have pointed out that the ability of such models to reproduce the stylized facts hinges crucially on the size of the agent population (typically denoted by n), a phenomenon that is also known as n-dependence. Our main finding is that n-(in)dependence traces back to both the topology and the velocity of information transmission among heterogeneous financial agents

Upregulation of ERK1/2-eNOS via AT2 Receptors Decreases the Contractile Response to Angiotensin II in Resistance Mesenteric Arteries from Obese Rats

It has been clearly established that mitogen-activated protein kinases (MAPKS) are important mediators of angiotensin II (Ang II) signaling via AT1 receptors in the vasculature. However, evidence for a role of these kinases in changes of Ang II-induced vasoconstriction in obesity is still lacking. Here we sought to determine whether vascular MAPKs are differentially activated by Ang II in obese animals. the role of AT2 receptors was also evaluated. Male monosodium glutamate-induced obese (obese) and non-obese Wistar rats (control) were used. the circulating concentrations of Ang I and Ang II, determined by HPLC, were increased in obese rats. Ang II-induced isometric contraction was decreased in endothelium-intact resistance mesenteric arteries from obese compared with control rats and exhibited a retarded AT1 receptor antagonist response. Blocking of AT2 receptors and inhibition of either endothelial nitric oxide synthase (eNOS) or extracellular signal-regulated protein kinases 1 and 2 (ERK1/2) restored Ang II-induced contraction in obese rats. Western blot analysis revealed increased protein expression of AT2 receptors in arteries from obese rats. Basal and Ang II-induced ERK1/2 phosphorylation was also increased in obese rats. Blockade of either AT1 or AT2 receptors corrected the increased ERK1/2 phosphorylation in arteries from obese rats to levels observed in control preparations. Phosphorylation of eNOS was increased in obese rats. Incubation with the ERK1/2 inhibitor before Ang II stimulation did not affect eNOS phosphorylation in control rats; however, it corrected the increased phosphorylation of eNOS in obese rats. These results clearly demonstrate that enhanced AT2 receptor and ERK1/2-induced, NO-mediated vasodilation reduces Ang II-induced contraction in an endothelium-dependent manner in obese rats.Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq)Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES)Univ São Paulo, Inst Biomed Sci, Dept Pharmacol, São Paulo, BrazilUniv Fed Goias, Div Cardiovasc Physiol, Dept Biol Sci, Jatai, BrazilUniversidade Federal de São Paulo, Div Nephrol, Dept Med, Escola Paulista Med, São Paulo, BrazilUniversidade Federal de São Paulo, Div Nephrol, Dept Med, Escola Paulista Med, São Paulo, BrazilFAPESP: 2007/58311-0FAPESP: 2008/51622-3FAPESP: 2010/03642-5Web of Scienc

Interpretação hidrogeoquímica das águas subterrâneas da ilha de Marajó.

Information obtained in a research survey carried oat by IDESP was used to investigate, groundwater hydrogeochemistry on Marajó island. The samples were collected in both dug and drilled wells. The results of physico-chemistry analyses indicated a wide range of concentrations in the water quality parameters which reflects the hydrogeologic complexity on the area. The largest total dissolved solids concentrations ocuured in the central and northern part of the area while the lowest levels were found in the south, southeast and northwest. The waters were predominantly of the sodium-chloride type followed by the mixed-chloride and mixed-bicarbonate types. The Schöeller semi-logarithmic diagram was used to identify waters with similar chemical characteristics. The variation in groundwater composition along the subsurficial flow path indicated a dissolution phenomenon with the dissolved ions increasing from the active groundwater flushing zone to the zone of very sluggish flow. This resulted in a variable mixture of fresh and brackish groundwater. The reduction of sulfate by oxidation of organic matter,the base exchange and adsorption are phenomena that exert an important control on the water chemistry.As pesquisas desenvolvidas pelo IDESP na Ilha de Marajó possibilitaram estudos de hidrogeoquímica das águas subterrâneas. As amostras foram coletadas em poços escavados e em poços tubulares. Os resultados das análises físico-químicas evidenciaram significativas variações nas concentrações dos parâmetros de qualidade de água, refletindo a complexidade hidrogeológica da área. As maiores concentrações de sólidos totais dissolvidos ocorrem na parte central e norte da área, sendo pequena na parte sul, sudeste e noroeste. As águas são predominantemente do tipo sódio-cloretada, seguidas pelos tipos mista-cloretada e mista-bicarbonatada. A utilização de diagramas semi-logarítimicos de Schoeller possibilitou o agrupamento das águas subterrâneas com características químicas similares. A evolução da composição das águas subterrâneas evidencia o aumento da concentração dos íons dissolvidos das zonas de fluxo ativo em áreas de recarga para as zonas de fluxo muito lento. Misturas de águas doces com águas salobras conatas ocorrem em proporções variadas. A redução de sulfatos pela matéria orgânica e a troca de bases e adsorção são fenômenos que atuam na concentração dos íons dissolvidos

Uso da cianamida na superação de dormência de sementes do híbrido interespecífico BRS Manicoré.

O objetivo desse estudo foi avaliar o efeito da cianamida hidrogenada (CH2N2) na germinação das sementes híbridas OxG. O experimento foi realizado na Embrapa Amazônia Ocidental, no delineamento blocos casualizados com seis tratamentos e quatro repetições de 500 sementes