Reinforcement learning or active inference?

This paper questions the need for reinforcement learning or control theory when optimising behaviour. We show that it is fairly simple to teach an agent complicated and adaptive behaviours using a free-energy formulation of perception. In this formulation, agents adjust their internal states and sampling of the environment to minimize their free-energy. Such agents learn causal structure in the environment and sample it in an adaptive and self-supervised fashion. This results in behavioural policies that reproduce those optimised by reinforcement learning and dynamic programming. Critically, we do not need to invoke the notion of reward, value or utility. We illustrate these points by solving a benchmark problem in dynamic programming; namely the mountain-car problem, using active perception or inference under the free-energy principle. The ensuing proof-of-concept may be important because the free-energy formulation furnishes a unified account of both action and perception and may speak to a reappraisal of the role of dopamine in the brain

Use of a nested PCR-enzyme immunoassay with an internal control to detect Chlamydophila psittaci in turkeys

BACKGROUND: Laboratory diagnosis of Chlamydophila psittaci, an important turkey respiratory pathogen, is difficult. To facilitate the diagnosis, a nested PCR-enzyme immunoassay (PCR-EIA) was developed to detect the Cp. psittaci outer membrane protein A (ompA) gene in pharyngeal swabs. METHODS: The fluorescein-biotin labelled PCR products were immobilized on streptavidin-coated microtiter plates and detected with anti-fluorescein peroxidase conjugate and a colorimetric substrate. An internal inhibition control was included to rule out the presence of inhibitors of DNA amplification. The diagnostic value of the ompA nested PCR-EIA in comparison to cell culture and a 16S-rRNA based nested PCR was assessed in pharyngeal turkey swabs from 10 different farms experiencing respiratory disease. RESULTS: The sensitivity of the nested PCR-EIA was established at 0.1 infection forming units (IFU). Specificity was 100%. The ompA nested PCR-EIA was more sensitive than the 16S-rRNA based nested PCR and isolation, revealing 105 out of 200 (52.5%) positives against 13 and 74 for the latter two tests, respectively. Twenty-nine (23.8%) out of 122 ompA PCR-EIA negatives showed the presence of inhibitors of DNA amplification, although 27 of them became positive after diluting (1/10) the specimens in PCR buffer or after phenol-chloroform extraction and subsequent ethanol precipitation. CONCLUSION: The present study stresses the need for an internal control to confirm PCR true-negatives and demonstrates the high prevalence of chlamydiosis in Belgian turkeys and its potential zoonotic risk. The ompA nested PCR-EIA described here is a rapid, highly sensitive and specific diagnostic assay and will help to facilitate the diagnosis of Cp. psittaci infections in both poultry and man

Mechanism of RPE Cell Death in α-Crystallin Deficient Mice: A Novel and Critical Role for MRP1-Mediated GSH Efflux

Absence of α-crystallins (αA and αB) in retinal pigment epithelial (RPE) cells renders them susceptible to oxidant-induced cell death. We tested the hypothesis that the protective effect of α-crystallin is mediated by changes in cellular glutathione (GSH) and elucidated the mechanism of GSH efflux. In α-crystallin overexpressing cells resistant to cell death, cellular GSH was >2 fold higher than vector control cells and this increase was seen particularly in mitochondria. The high GSH levels associated with α-crystallin overexpression were due to increased GSH biosynthesis. On the other hand, cellular GSH was decreased by 50% in murine retina lacking αA or αB crystallin. Multiple multidrug resistance protein (MRP) family isoforms were expressed in RPE, among which MRP1 was the most abundant. MRP1 was localized to the plasma membrane and inhibition of MRP1 markedly decreased GSH efflux. MRP1-suppressed cells were resistant to cell death and contained elevated intracellular GSH and GSSG. Increased GSH in MRP1-supressed cells resulted from a higher conversion of GSSG to GSH by glutathione reductase. In contrast, GSH efflux was significantly higher in MRP1 overexpressing RPE cells which also contained lower levels of cellular GSH and GSSG. Oxidative stress further increased GSH efflux with a decrease in cellular GSH and rendered cells apoptosis-prone. In conclusion, our data reveal for the first time that 1) MRP1 mediates GSH and GSSG efflux in RPE cells; 2) MRP1 inhibition renders RPE cells resistant to oxidative stress-induced cell death while MRP1 overexpression makes them susceptible and 3) the antiapoptotic function of α-crystallin in oxidatively stressed cells is mediated in part by GSH and MRP1. Our findings suggest that MRP1 and α crystallin are potential therapeutic targets in pathological retinal degenerative disorders linked to oxidative stress

Decadal to monthly timescales of magma transfer and reservoir growth at a caldera volcano

International audienceCaldera-forming volcanic eruptions are low-frequency, highimpact events capable of discharging tens to thousands of cubic kilometres of magma explosively on timescales of hours to days, with devastating effects on local and global scales1. Because no such eruption has been monitored during its long build-up phase, the precursor phenomena are not well understood. Geophysical signals obtained during recent episodes of unrest at calderas such as Yellowstone, USA, and Campi Flegrei, Italy, are difficult to interpret, and the conditions necessary for large eruptions are poorly constrained2,3. Here we present a study of pre-eruptive magmatic processes and their timescales using chemically zoned crystals from the 'Minoan' caldera-formingeruption of Santorini volcano,Greece4, which occurred in the late 1600s BC. The results provide insights into how rapidly large silicic systems may pass from a quiescent state to one on the edge of eruption5,6. Despite the large volume of erupted magma4 (40-60 cubic kilometres), and the 18,000-year gestation period between the Minoan eruption and the previous major eruption, most crystals in the Minoan magma record processes that occurred less than about 100 years before the eruption. Recharge of the magma reservoir by large volumes of silicic magma (and some mafic magma) occurred during the century before eruption, and mixing between different silicicmagmabatches was still taking place during the final months. Final assembly of large silicic magma reservoirs may occur on timescales that are geologically very short by comparison with the preceding repose period, with major growth phases immediately before eruption. These observations have implications for the monitoring of long-dormant, but potentially active, caldera systems

An Epididymis-Specific Secretory Protein HongrES1 Critically Regulates Sperm Capacitation and Male Fertility

Mammalian sperm capacitation is an essential prerequisite to fertilizion. Although progress had been made in understanding the physiology and biochemistry of capacitation, little is known about the potential roles of epididymal proteins during this process. Here we report that HongrES1, a new member of the SERPIN (serine proteinase inhibitor) family exclusively expressed in the rat cauda epididymis and up-regulated by androgen, is secreted into the lumen and covers the sperm head. Co-culture of caudal sperms with HongrES1 antibody in vitro resulted in a significant increase in the percentage of capacitated spermatozoa. Furthermore, the percentage of capacitated spermatozoa clearly increased in rats when HongrES1 was down-regulated by RNAi in vivo. Remarkably, knockdown of HongrES1 in vivo led to reduced fertility accompanied with deformed appearance of fetuses and pups. These results identify HongrES1 as a novel and critical molecule in the regulation of sperm capacitation and male fertility

Arginine Metabolism by Macrophages Promotes Cardiac and Muscle Fibrosis in mdx Muscular Dystrophy

Duchenne muscular dystrophy (DMD) is the most common, lethal disease of childhood. One of 3500 new-born males suffers from this universally-lethal disease. Other than the use of corticosteroids, little is available to affect the relentless progress of the disease, leading many families to use dietary supplements in hopes of reducing the progression or severity of muscle wasting. Arginine is commonly used as a dietary supplement and its use has been reported to have beneficial effects following short-term administration to mdx mice, a genetic model of DMD. However, the long-term effects of arginine supplementation are unknown. This lack of knowledge about the long-term effects of increased arginine metabolism is important because elevated arginine metabolism can increase tissue fibrosis, and increased fibrosis of skeletal muscles and the heart is an important and potentially life-threatening feature of DMD.We use both genetic and nutritional manipulations to test whether changes in arginase metabolism promote fibrosis and increase pathology in mdx mice. Our findings show that fibrotic lesions in mdx muscle are enriched with arginase-2-expressing macrophages and that muscle macrophages stimulated with cytokines that activate the M2 phenotype show elevated arginase activity and expression. We generated a line of arginase-2-null mutant mdx mice and found that the mutation reduced fibrosis in muscles of 18-month-old mdx mice, and reduced kyphosis that is attributable to muscle fibrosis. We also observed that dietary supplementation with arginine for 17-months increased mdx muscle fibrosis. In contrast, arginine-2 mutation did not reduce cardiac fibrosis or affect cardiac function assessed by echocardiography, although 17-months of dietary supplementation with arginine increased cardiac fibrosis. Long-term arginine treatments did not decrease matrix metalloproteinase-2 or -9 or increase the expression of utrophin, which have been reported as beneficial effects of short-term treatments.Our findings demonstrate that arginine metabolism by arginase promotes fibrosis of muscle in muscular dystrophy and contributes to kyphosis. Our findings also show that long-term, dietary supplementation with arginine exacerbates fibrosis of dystrophic heart and muscles. Thus, commonly-practiced dietary supplementation with arginine by DMD patients has potential risk for increasing pathology when performed for long periods, despite reports of benefits acquired with short-term supplementation

The Water Bugs (Heteroptera: Nepomorpha) of the Guyana Region

NEPOMORPHA OF THE GUYANA REGION The Nepomorpha of the Guyana Region are keyed out and described. In addition distributional, faunistical and comparative notes on the species are given. New species and subspecies: Ochterus aeneifrons surinamensis, O. tenebrosus; Limnocoris fittkaui surinamensis; Ranatra adelomorpha; Neoplea globoidea; Buenoa amnigenopsis; Tenagobia pseudoromani from Suriname and Ranatra ornitheia from Guyana. New synonyms (junior ones between parenthesis): Gelaslocorus flavus flavus Guér. (G. nebulosus nebulosus Guér.); Pelocoris impicticollis Stål (P. horváthi Mont.), P. poeyi (Guér.) not identical with P. femoratus (P.-B.) (P. convexus Nieser), P. procurrens White (P. minutus Mont.); Belostoma bicavum Lauck ( B. parvoculum Lauck); Ranatra doesburgi De Carlo (R. usingeri De C.), R. macrophthalma H.-S. (R. surinamensis De C.), R. mediana Mont. (R. williamsi Kuitert), R. obscura Mont. (R. annulipes White 1879 not Stål), R. sarmentoi De C. (R. ameghinoi De C.); Buenoa amnigenopsis n. sp. ( B. amnigenus Nieser 1968, 1970 not White), B. amnigenus (White) (B. amnigenoidea Nieser 1970), B. nitida Truxal (B. doesburgi Nieser); Heterocorixa surinamensis Nieser ( H. boliviensis Nieser 1970 not Hungerford); Tenagobia incerta Lundbl. ( T. signata and T. serrata in part, Nieser 1970 not White and Deay respectively), T. socialis (White) (T. serrata in part, Nieser 1970 not Deay)