Replicating DeepMind StarCraft II reinforcement learning benchmark with actor-critic methods

Reinforcement Learning (RL) is a subfield of Artificial Intelligence (AI) that deals with agents navigating in an environment with the goal of maximizing total reward. Games are good environments to test RL algorithms as they have simple rules and clear reward signals. Theoretical part of this thesis explores some of the popular classical and modern RL approaches, which include the use of Artificial Neural Network (ANN) as a function approximator inside AI agent. In practical part of the thesis we implement Advantage Actor-Critic RL algorithm and replicate ANN based agent described in [Vinyals et al., 2017]. We reproduce the state-of-the-art results in a modern video game StarCraft II, a game that is considered the next milestone in AI after the fall of chess and Go

Pairing in 4-component fermion systems: the bulk limit of SU(4)-symmetric Hamiltonians

Fermion systems with more than two components can exhibit pairing condensates of much more complex structure than the well-known single BCS condensate of spin-up and spin-down fermions. In the framework of the exactly solvable SO(8) Richardson-Gaudin model with SU(4)-symmetric Hamiltonians, we show that the BCS approximation remains valid in the thermodynamic limit of large systems for describing the ground state energy and the canonical and quasiparticle excitation gaps. Correlations beyond BCS pairing give rise to a spectrum of collective excitations, but these do not affect the bulk energy and quasiparticle gaps.Comment: 13 pages; 2 figures; 1 tabl

Flt1 produced by lung endothelial cells impairs ATII cell transdifferentiation and repair in pulmonary fibrosis

Pulmonary fibrosis is a devastating disease, in which fibrotic tissue progressively replaces lung alveolar structure, resulting in chronic respiratory failure. Alveolar type II cells act as epithelial stem cells, being able to transdifferentiate into alveolar type I cells, which mediate gas exchange, thus contributing to lung homeostasis and repair after damage. Impaired epithelial transdifferentiation is emerging as a major pathogenetic mechanism driving both onset and progression of fibrosis in the lung. Here, we show that lung endothelial cells secrete angiocrine factors that regulate alveolar cell differentiation. Specifically, we build on our previous data on the anti-fibrotic microRNA-200c and identify the Vascular Endothelial Growth Factor receptor 1, also named Flt1, as its main functional target in endothelial cells. Endothelial-specific knockout of Flt1 reproduces the anti-fibrotic effect of microRNA-200c against pulmonary fibrosis and results in the secretion of a pool of soluble factors and matrix components able to promote epithelial transdifferentiation in a paracrine manner. Collectively, these data indicate the existence of a complex endothelial-epithelial paracrine crosstalk in vitro and in vivo and position lung endothelial cells as a relevant therapeutic target in the fight against pulmonary fibrosis

Linear-response time-dependent density-functional theory with pairing fields

A

Flamingo: a visual language model for few-shot learning

Building models that can be rapidly adapted to novel tasks using only a handful of annotated examples is an open challenge for multimodal machine learning research. We introduce Flamingo, a family of Visual Language Models (VLM) with this ability. We propose key architectural innovations to: (i) bridge powerful pretrained vision-only and language-only models, (ii) handle sequences of arbitrarily interleaved visual and textual data, and (iii) seamlessly ingest images or videos as inputs. Thanks to their flexibility, Flamingo models can be trained on large-scale multimodal web corpora containing arbitrarily interleaved text and images, which is key to endow them with in-context few-shot learning capabilities. We perform a thorough evaluation of our models, exploring and measuring their ability to rapidly adapt to a variety of image and video tasks. These include open-ended tasks such as visual question-answering, where the model is prompted with a question which it has to answer, captioning tasks, which evaluate the ability to describe a scene or an event, and close-ended tasks such as multiple-choice visual question-answering. For tasks lying anywhere on this spectrum, a single Flamingo model can achieve a new state of the art with few-shot learning, simply by prompting the model with task-specific examples. On numerous benchmarks, Flamingo outperforms models fine-tuned on thousands of times more task-specific data

Ischemic wound revascularization by the stromal vascular fraction relies on host-donor hybrid vessels

Nonhealing wounds place a significant burden on both quality of life of affected patients and health systems. Skin substitutes are applied to promote the closure of nonhealing wounds, although their efficacy is limited by inadequate vascularization. The stromal vascular fraction (SVF) from the adipose tissue is a promising therapy to overcome this limitation. Despite a few successful clinical trials, its incorporation in the clinical routine has been hampered by their inconsistent results. All these studies concluded by warranting pre-clinical work aimed at both characterizing the cell types composing the SVF and shedding light on their mechanism of action. Here, we established a model of nonhealing wound, in which we applied the SVF in combination with a clinical-grade skin substitute. We purified the SVF cells from transgenic animals to trace their fate after transplantation and observed that it gave rise to a mature vascular network composed of arteries, capillaries, veins, as well as lymphatics, structurally and functionally connected with the host circulation. Then we moved to a human-in-mouse model and confirmed that SVF-derived endothelial cells formed hybrid human-mouse vessels, that were stabilized by perivascular cells. Mechanistically, SVF-derived endothelial cells engrafted and expanded, directly contributing to the formation of new vessels, while a population of fibro-adipogenic progenitors stimulated the expansion of the host vasculature in a paracrine manner. These data have important clinical implications, as they provide a steppingstone toward the reproducible and effective adoption of the SVF as a standard care for nonhealing wounds

Influence of the central-to-peripheral arterial stiffness gradient on the timing and amplitude of wave reflections

In individuals with compliant aortas, peripheral muscular artery stiffness exceeds central elastic artery stiffness. With ageing, central stiffness increases, with little change in peripheral stiffness, resulting in a reversal of the normal stiffness gradient. This reversal may reduce wave reflection amplitude, due to movement of the major “effective” reflection site further from the heart. To test this, we investigated the relationship among arterial stiffness gradients (normal and reversed), wave reflection amplitude and reflection site distance. Subjects aged ≥50years were recruited from the Anglo-Cardiff Collaborative Trial. Central stiffness was assessed by carotid-femoral pulse wave velocity (cfPWV). In study 1, peripheral PWV was also measured in the arm (carotid-radial, crPWV), and in study 2 in the leg (femoral- dorsalis pedis, fpPWV). Reflection site distance was calculated from cfPWV and reflected wave travel time. Subjects were dichotomized into those with a normal stiffness gradient (peripheral>central PWV), or a reversed gradient (peripheral<central PWV). In study 1, reflection site distance was greater in subjects with a reversed gradient (P<0.01), whereas time to reflection was lower (P<0.001). Both augmentation pressure (P<0.001) and augmentation index (P<0.05) were greater in subjects with a reversed gradient. In study 2, augmentation pressure, augmentation index and reflection site distance were greater in subjects with a reversed stiffness gradient (P<0.01, P<0.05 and P<0.01, respectively), and time to reflection was not different between groups. A reversed arterial stiffness gradient is associated with increased reflection site distance and a paradoxical increase in reflected wave amplitude, and augmentation index

Risk governance in organizations

Dieses Buch dokumentiert 10 Jahre Risk-Governance-Forschung an der Universität Siegen. In 50 Beiträgen reflektieren Forscher und Praktiker Risk Governance vor dem Hintergrund ihrer eigenen Forschungen und/oder Erfahrungen und geben jeweils einen Entwicklungsimpuls für die Zukunft der Risk Governance. Das Buch zeigt die große Bandbreite und Tiefe des Forschungsgebietes auf und diskutiert Grundannahmen, Implementierungsfragen, die Rolle der Risk Governance als Transformationsmotor, ihre Wirkung in den verschiedenen betrieblichen Funktionen, Entwicklungsperspektiven und den Beitrag der Risk Governance zu einer nachhaltigen Ausrichtung von Unternehmen.This book documents 10 years of risk governance research at the University of Siegen. In 50 contributions, researchers and practitioners reflect on risk governance against the background of their own research and/or experience and provide a development impetus for the future of risk governance. The book shows the wide range and depth of the research field and discusses basic assumptions, implementation issues, the role of risk governance as transformation engine, its impact in the various operational functions, development perspectives, and the contribution of risk governance to a sustainable orientation of companies

New genetic loci link adipose and insulin biology to body fat distribution.

Body fat distribution is a heritable trait and a well-established predictor of adverse metabolic outcomes, independent of overall adiposity. To increase our understanding of the genetic basis of body fat distribution and its molecular links to cardiometabolic traits, here we conduct genome-wide association meta-analyses of traits related to waist and hip circumferences in up to 224,459 individuals. We identify 49 loci (33 new) associated with waist-to-hip ratio adjusted for body mass index (BMI), and an additional 19 loci newly associated with related waist and hip circumference measures (P < 5 × 10(-8)). In total, 20 of the 49 waist-to-hip ratio adjusted for BMI loci show significant sexual dimorphism, 19 of which display a stronger effect in women. The identified loci were enriched for genes expressed in adipose tissue and for putative regulatory elements in adipocytes. Pathway analyses implicated adipogenesis, angiogenesis, transcriptional regulation and insulin resistance as processes affecting fat distribution, providing insight into potential pathophysiological mechanisms