Reinforcement learning or active inference?

This paper questions the need for reinforcement learning or control theory when optimising behaviour. We show that it is fairly simple to teach an agent complicated and adaptive behaviours using a free-energy formulation of perception. In this formulation, agents adjust their internal states and sampling of the environment to minimize their free-energy. Such agents learn causal structure in the environment and sample it in an adaptive and self-supervised fashion. This results in behavioural policies that reproduce those optimised by reinforcement learning and dynamic programming. Critically, we do not need to invoke the notion of reward, value or utility. We illustrate these points by solving a benchmark problem in dynamic programming; namely the mountain-car problem, using active perception or inference under the free-energy principle. The ensuing proof-of-concept may be important because the free-energy formulation furnishes a unified account of both action and perception and may speak to a reappraisal of the role of dopamine in the brain

Evaluations of Tactics for Automated Negotiations

[[abstract]]Automated negotiation under the infrastructure of e-commerce is becoming an important issue. However, although the communication protocols and frameworks of automated negotiation have been extensively investigated, the corresponding tactics and strategies are still underdeveloped and need to be evaluated further. Based on the negotiation model proposed by Faratin et al., this paper examines the performance of automated negotiation tactics and intends to provide concise suggestions for the users of automated negotiation. First, theoretical analysis is used to evaluate the behavior-dependent tactics. Constructive conclusions are obtained when single-issue negotiations are considered. Next, a new framework for applying single-issue tactics to multi-issue negotiation is proposed. Based on this framework, theoretical analysis is then extended to multi-issue cases. Finally, different from the previous work, exhaustive simulations based on two-issue negotiations are performed to evaluate the effectiveness of behavior-dependent and time-dependent tactics. The experimental results provide several important insights into negotiation tactics.[[booktype]]紙本[[booktype]]電子

VLDL Hydrolysis by Hepatic Lipase Regulates PPARδ Transcriptional Responses

PPARs (α,γ,δ) are a family of ligand-activated transcription factors that regulate energy balance, including lipid metabolism. Despite these critical functions, the integration between specific pathways of lipid metabolism and distinct PPAR responses remains obscure. Previous work has revealed that lipolytic pathways can activate PPARs. Whether hepatic lipase (HL), an enzyme that regulates VLDL and HDL catabolism, participates in PPAR responses is unknown.Using PPAR ligand binding domain transactivation assays, we found that HL interacted with triglyceride-rich VLDL (>HDL≫LDL, IDL) to activate PPARδ preferentially over PPARα or PPARγ, an effect dependent on HL catalytic activity. In cell free ligand displacement assays, VLDL hydrolysis by HL activated PPARδ in a VLDL-concentration dependent manner. Extended further, VLDL stimulation of HL-expressing HUVECs and FAO hepatoma cells increased mRNA expression of canonical PPARδ target genes, including adipocyte differentiation related protein (ADRP), angiopoietin like protein 4 and pyruvate dehydrogenase kinase-4. HL/VLDL regulated ADRP through a PPRE in the promoter region of this gene. In vivo, adenoviral-mediated hepatic HL expression in C57BL/6 mice increased hepatic ADRP mRNA levels by 30%. In ob/ob mice, a model with higher triglycerides than C57BL/6 mice, HL overexpression increased ADRP expression by 70%, demonstrating the importance of triglyceride substrate for HL-mediated PPARδ activation. Global metabolite profiling identified HL/VLDL released fatty acids including oleic acid and palmitoleic acid that were capable of recapitulating PPARδ activation and ADRP gene regulation in vitro.These data define a novel pathway involving HL hydrolysis of VLDL that activates PPARδ through generation of specific monounsaturated fatty acids. These data also demonstrate how integrating cell biology with metabolomic approaches provides insight into specific lipid mediators and pathways of lipid metabolism that regulate transcription

ANGPTL4 variants E40K and T266M are associated with lower fasting triglyceride levels in Non-Hispanic White Americans from the Look AHEAD Clinical Trial

<p>Abstract</p> <p>Background</p> <p>Elevated triglyceride levels are a risk factor for cardiovascular disease. Angiopoietin-like protein 4 (Angptl4) is a metabolic factor that raises plasma triglyceride levels by inhibiting lipoprotein lipase (LPL). In non-diabetic individuals, the <it>ANGPTL4 </it>coding variant E40K has been associated with lower plasma triglyceride levels while the T266M variant has been associated with more modest effects on triglyceride metabolism. The objective of this study was to determine whether ANGPTL4 E40K and T266M are associated with triglyceride levels in the setting of obesity and T2D, and whether modification of triglyceride levels by these genetic variants is altered by a lifestyle intervention designed to treat T2D.</p> <p>Methods</p> <p>The association of <it>ANGPTL4 </it>E40K and T266M with fasting triglyceride levels was investigated in 2,601 participants from the Look AHEAD Clinical Trial, all of whom had T2D and were at least overweight. Further, we tested for an interaction between genotype and treatment effects on triglyceride levels.</p> <p>Results</p> <p>Among non-Hispanic White Look AHEAD participants, <it>ANGPTL4 </it>K40 carriers had mean triglyceride levels of 1.61 ± 0.62 mmol/L, 0.33 mmol/L lower than E40 homozygotes (p = 0.001). Individuals homozygous for the minor M266 allele (MAF 30%) had triglyceride levels of 1.75 ± 0.58 mmol/L, 0.24 mmol/L lower than T266 homozygotes (p = 0.002). The association of the M266 with triglycerides remained significant even after removing K40 carriers from the analysis (p = 0.002). There was no interaction between the weight loss intervention and genotype on triglyceride levels.</p> <p>Conclusions</p> <p>This is the first study to demonstrate that the <it>ANGPTL4 </it>E40K and T266M variants are associated with lower triglyceride levels in the setting of T2D. In addition, our findings demonstrate that <it>ANGPTL4 </it>genotype status does not alter triglyceride response to a lifestyle intervention in the Look AHEAD study.</p

Role of potassium and calcium channels in sevoflurane-mediated vasodilation in the foeto-placental circulation

<p>Abstract</p> <p>Background</p> <p>Sevoflurane has been demonstrated to vasodilate the foeto-placental vasculature. We aimed to determine the contribution of modulation of potassium and calcium channel function to the vasodilatory effect of sevoflurane in isolated human chorionic plate arterial rings.</p> <p>Methods</p> <p>Quadruplicate <it>ex vivo </it>human chorionic plate arterial rings were used in all studies. <b><it>Series 1 and 2 </it></b>examined the role of the K⁺channel in sevoflurane-mediated vasodilation. Separate experiments examined whether tetraethylammonium, which blocks large conductance calcium activated K⁺(K_Ca++) channels (<b><it>Series 1A+B</it></b>) or glibenclamide, which blocks the ATP sensitive K⁺(K_ATP) channel (<b><it>Series 2</it></b>), modulated sevoflurane-mediated vasodilation. <b><it>Series 3 – 5 </it></b>examined the role of the Ca⁺⁺channel in sevoflurane induced vasodilation. Separate experiments examined whether verapamil, which blocks the sarcolemmal voltage-operated Ca⁺⁺channel (<b><it>Series 3</it></b>), SK&F 96365 an inhibitor of sarcolemmal voltage-independent Ca⁺⁺channels (<b><it>Series 4A+B</it></b>), or ryanodine an inhibitor of the sarcoplasmic reticulum Ca⁺⁺channel (<b><it>Series 5A+B</it></b>), modulated sevoflurane-mediated vasodilation.</p> <p>Results</p> <p>Sevoflurane produced dose dependent vasodilatation of chorionic plate arterial rings in all studies. Prior blockade of the K_Ca++and K_ATPchannels augmented the vasodilator effects of sevoflurane. Furthermore, exposure of rings to sevoflurane in advance of TEA occluded the effects of TEA. Taken together, these findings suggest that sevoflurane blocks K⁺channels. Blockade of the voltage-operated Ca⁺⁺channels inhibited the vasodilator effects of sevoflurane. In contrast, blockade of the voltage-independent and sarcoplasmic reticulum Ca⁺⁺channels did not alter sevoflurane vasodilation.</p> <p>Conclusion</p> <p>Sevoflurane appears to block chorionic arterial K_Ca++and K_ATPchannels. Sevoflurane also blocks voltage-operated calcium channels, and exerts a net vasodilatory effect in the <it>in vitro </it>foeto-placental circulation.</p

Measurement of the inclusive and dijet cross-sections of b-jets in pp collisions at sqrt(s) = 7 TeV with the ATLAS detector

The inclusive and dijet production cross-sections have been measured for jets containing b-hadrons (b-jets) in proton-proton collisions at a centre-of-mass energy of sqrt(s) = 7 TeV, using the ATLAS detector at the LHC. The measurements use data corresponding to an integrated luminosity of 34 pb^-1. The b-jets are identified using either a lifetime-based method, where secondary decay vertices of b-hadrons in jets are reconstructed using information from the tracking detectors, or a muon-based method where the presence of a muon is used to identify semileptonic decays of b-hadrons inside jets. The inclusive b-jet cross-section is measured as a function of transverse momentum in the range 20 < pT < 400 GeV and rapidity in the range |y| < 2.1. The bbbar-dijet cross-section is measured as a function of the dijet invariant mass in the range 110 < m_jj < 760 GeV, the azimuthal angle difference between the two jets and the angular variable chi in two dijet mass regions. The results are compared with next-to-leading-order QCD predictions. Good agreement is observed between the measured cross-sections and the predictions obtained using POWHEG + Pythia. MC@NLO + Herwig shows good agreement with the measured bbbar-dijet cross-section. However, it does not reproduce the measured inclusive cross-section well, particularly for central b-jets with large transverse momenta.Comment: 10 pages plus author list (21 pages total), 8 figures, 1 table, final version published in European Physical Journal

Measurement of the cross-section of high transverse momentum vector bosons reconstructed as single jets and studies of jet substructure in pp collisions at √s = 7 TeV with the ATLAS detector

This paper presents a measurement of the cross-section for high transverse momentum W and Z bosons produced in pp collisions and decaying to all-hadronic final states. The data used in the analysis were recorded by the ATLAS detector at the CERN Large Hadron Collider at a centre-of-mass energy of √s = 7 TeV;{\rm Te}{\rm V}$and correspond to an integrated luminosity of$4.6\;{\rm f}{{{\rm b}}^{-1}}$. The measurement is performed by reconstructing the boosted W or Z bosons in single jets. The reconstructed jet mass is used to identify the W and Z bosons, and a jet substructure method based on energy cluster information in the jet centre-of-mass frame is used to suppress the large multi-jet background. The cross-section for events with a hadronically decaying W or Z boson, with transverse momentum${{p}_{{\rm T}}}\gt 320\;{\rm Ge}{\rm V}$and pseudorapidity$|\eta |\lt 1.9$, is measured to be${{\sigma }_{W+Z}}=8.5\pm 1.7$ pb and is compared to next-to-leading-order calculations. The selected events are further used to study jet grooming techniques

Observation of associated near-side and away-side long-range correlations in √sNN=5.02 TeV proton-lead collisions with the ATLAS detector

Two-particle correlations in relative azimuthal angle (Δϕ) and pseudorapidity (Δη) are measured in √sNN=5.02  TeV p+Pb collisions using the ATLAS detector at the LHC. The measurements are performed using approximately 1  μb-1 of data as a function of transverse momentum (pT) and the transverse energy (ΣETPb) summed over 3.1<η<4.9 in the direction of the Pb beam. The correlation function, constructed from charged particles, exhibits a long-range (2<|Δη|<5) “near-side” (Δϕ∼0) correlation that grows rapidly with increasing ΣETPb. A long-range “away-side” (Δϕ∼π) correlation, obtained by subtracting the expected contributions from recoiling dijets and other sources estimated using events with small ΣETPb, is found to match the near-side correlation in magnitude, shape (in Δη and Δϕ) and ΣETPb dependence. The resultant Δϕ correlation is approximately symmetric about π/2, and is consistent with a dominant cos⁡2Δϕ modulation for all ΣETPb ranges and particle pT