Atari games and Intel processors

The asynchronous nature of the state-of-the-art reinforcement learning algorithms such as the Asynchronous Advantage Actor-Critic algorithm, makes them exceptionally suitable for CPU computations. However, given the fact that deep reinforcement learning often deals with interpreting visual information, a large part of the train and inference time is spent performing convolutions. In this work we present our results on learning strategies in Atari games using a Convolutional Neural Network, the Math Kernel Library and TensorFlow 0.11rc0 machine learning framework. We also analyze effects of asynchronous computations on the convergence of reinforcement learning algorithms

Distributed Deep Reinforcement Learning: Learn how to play Atari games in 21 minutes

We present a study in Distributed Deep Reinforcement Learning (DDRL) focused on scalability of a state-of-the-art Deep Reinforcement Learning algorithm known as Batch Asynchronous Advantage ActorCritic (BA3C). We show that using the Adam optimization algorithm with a batch size of up to 2048 is a viable choice for carrying out large scale machine learning computations. This, combined with careful reexamination of the optimizer's hyperparameters, using synchronous training on the node level (while keeping the local, single node part of the algorithm asynchronous) and minimizing the memory footprint of the model, allowed us to achieve linear scaling for up to 64 CPU nodes. This corresponds to a training time of 21 minutes on 768 CPU cores, as opposed to 10 hours when using a single node with 24 cores achieved by a baseline single-node implementation

Integrated navigation – flight control system of guided projectiles and bombs

Integrated navigation and flight control systems have found a widespread use in projectiles.Currently, due to their advantages, they begin to be used more frequently in airplanes and helicopters. The paper presents one of the most advanced solutions of the integrated navigation – the flight control system designed for guidance of projectiles and aerial bombs

Entrapment of Bacteria in Fluid Inclusions in Laboratory-Grown Halite

This is the publisher's version, also available electronically from "http://online.liebertpub.com".Cells of the bacterium Pseudomonas aeruginosa, which were genetically modified to produce green fluorescent protein, were entrapped in fluid inclusions in laboratory-grown halite. The bacteria were used to inoculate NaCl-saturated aqueous solutions, which were allowed to evaporate and precipitate halite. The number, size, and distribution of fluid inclusions were highly variable, but did not appear to be affected by the presence of the bacteria. Many of the inclusions in crystals from inoculated solutions contained cells in populations ranging from two to 20. Microbial attachment to crystal surfaces was neither evident nor necessary for entrapment. Cells occurred exclusively within fluid inclusions and were not present in the crystal matrix. In both the inclusions and the hypersaline solution, the cells fluoresced and twitched, which indicates that the bacteria might have remained viable after entrapment. The fluorescence continued up to 13 months after entrapment, which indicates that little degradation of the bacteria occurred over that time interval. The entrapment, fluorescence, and preservation of cells were independent of the volume of hypersaline solution used or whether the solutions were completely evaporated prior to crystal extraction. The results of this study have a wide range of implications for the long-term survival of microorganisms in fluid inclusions and their detection through petrography. The results also demonstrate the preservation potential for microbes in hypersaline fluid inclusions, which could allow cells to survive harsh conditions of space, the deep geologic past, or burial in sedimentary basins

Pathfinder VI Experimental Payload: Desna

The objective of this project is to design, fabricate and test a fixed wing unmanned aerial vehicle (UAV) that is to be carried in, and deployed from the Pathfinder VI rocket. The UAV, known as Desna, is tasked with being able to carry a Tamarisk 640 75mm thermal imaging camera, and transmit live video footage to a ground station from 8500 feet AGL. Desna must also fit inside Pathfinder VI’s 7.5” diameter, 35” long cargo bay. To accomplish this, Desna’s wing configuration, determined through description matrices and light prototype testing, will consist of a 35” wing that rotates about its center with 11” folding winglets to increase lift and stability. Desna will be constructed from blue high-density foam to allow for cheap, rapid prototyping as well as being light as possible while still being able to survive the G loadings during assent. Desna will fly in Pathfinder VI this June in the Intercollegiate Rocket Engineering Competition as an experimental payload

Identification of moisture transport mechanism in gypsum during convective drying

[EN] Gypsum is a popular building material. Drying and rewetting of gypsum is a process of practical importance. This work presents the experimental results of kinetic of drying, heating and internal pressure development in rewetted gypsum cylinders. Analysis of the observed changes is presented. Additionally sorption isotherms, permeability and dependence of Young’s modulus on moisture content were measured. These data will be used in the model of the process under development.Adamski, R.; Adamska, A.; Pakowski, Z. (2018). Identification of moisture transport mechanism in gypsum during convective drying. En IDS 2018. 21st International Drying Symposium Proceedings. Editorial Universitat Politècnica de València. 379-386. https://doi.org/10.4995/IDS2018.2018.7527OCS37938

The investigation of internal pressure development in convective drying of shrinking and non-shrinking materials using green and fired clay as an example

[EN] The aim of present research was to measure and analyze the dynamic changes of internal pressure in shrinking vs. non-shrinking materials during convective drying for the use as a possible process control method. Drying experiments were carried out on wet and fired clay at 50°C and 60°C. In addition, the shrinkage curve was investigated. Experimental measurements show the existence of 4 stages of the process. The comparison of the results for wet and fired clay shows differences in pressure trends. During drying the internal pressure changes from underpressure to overpressure at the level of 3÷5kPa, what correlates well with transition from the first to the second drying period.Adamska, A.; Pakowski, Z.; Adamski, R. (2018). The investigation of internal pressure development in convective drying of shrinking and non-shrinking materials using green and fired clay as an example. En IDS 2018. 21st International Drying Symposium Proceedings. Editorial Universitat Politècnica de València. 115-122. https://doi.org/10.4995/IDS2018.2018.7470OCS11512

The protective role of carbon monoxide (CO) produced by heme oxygenases and derived from the CO-releasing molecule CORM-2 in the pathogenesis of stress-induced gastric lesions : evidence for non-involvement of nitric oxide (NO)

Carbon monoxide (CO) produced by heme oxygenase (HO)-1 and HO-2 or released from the CO-donor, tricarbonyldichlororuthenium (II) dimer (CORM-2) causes vasodilation, with unknown efficacy against stress-induced gastric lesions. We studied whether pretreatment with CORM-2 (0.1–10 mg/kg oral gavage (i.g.)), RuCl3 (1 mg/kg i.g.), zinc protoporphyrin IX (ZnPP) (10 mg/kg intraperitoneally (i.p.)), hemin (1–10 mg/kg i.g.) and CORM-2 (1 mg/kg i.g.) combined with NG-nitro-l-arginine (l-NNA, 20 mg/kg i.p.), 1H-[1,2,4]oxadiazolo[4,3-a]quinoxalin-1-one (ODQ, 10 mg/kg i.p.), indomethacin (5 mg/kg i.p.), SC-560 (5 mg/kg i.g.), and celecoxib (10 mg/kg i.g.) affects gastric lesions following 3.5 h of water immersion and restraint stress (WRS). Gastric blood flow (GBF), the number of gastric lesions and gastric CO and nitric oxide (NO) contents, blood carboxyhemoglobin (COHb) level and the gastric expression of HO-1, HO-2, hypoxia inducible factor 1α (HIF-1α), tumor necrosis factor α (TNF-α), cyclooxygenase (COX)-2 and inducible NO synthase (iNOS) were determined. CORM-2 (1 mg/kg i.g.) and hemin (10 mg/kg i.g.) significantly decreased WRS lesions while increasing GBF, however, RuCl3 was ineffective. The impact of CORM-2 was reversed by ZnPP, ODQ, indomethacin, SC-560 and celecoxib, but not by l-NNA. CORM-2 decreased NO and increased HO-1 expression and CO and COHb content, downregulated HIF-1α, as well as WRS-elevated COX-2 and iNOS mRNAs. Gastroprotection by CORM-2 and HO depends upon CO’s hyperemic and anti-inflammatory properties, but is independent of NO

Cangrelor — Expanding therapeutic options in patients with acute coronary syndrome

Cangrelor is the only intravenous P2Y12 receptor antagonist. It is an adenosine triphosphate analog that selectively, directly, and reversibly binds to the platelet P2Y12 receptors exerting its antiaggregatory effect. Cangrelor is characterized by linear, dose-dependent pharmacokinetics and rapid onset of action providing potent platelet inhibition exceeding 90%. Cangrelor is rapidly metabolized by endothelial endonucleotidase; thus, its half-life is 2.9 to 5.5 min, and its antiplatelet effect subsides within 60 to 90 min. Data originating from three pivotal cangrelor trials (CHAMPION PLATFORM, CHAMPION PCI, and CHAMPION PHOENIX) indicate that cangrelor reduces the risk of periprocedural thrombotic complications during percutaneous coronary intervention at the expense of mild bleedings. Its unique pharmacological properties allow it to overcome the limitations of oral P2Y12 receptor inhibitors, mainly related to the delayed and decreased bioavailability and antiplatelet effect of these agents, which are often observed in the setting of acute coronary syndrome. Subgroups of patients who could theoretically benefit the most from cangrelor include those in whom pharmacokinetics and pharmacodynamics of oral P2Y12 receptor antagonists are most disturbed, namely patients with ST-segment elevation myocardial infarction, those treated with opioids, with mild therapeutic hypothermia, or in cardiogenic shock. Cangrelor could also be useful if bridging is required in patients undergoing surgery. According to the current guidelines cangrelor may be considered in P2Y12 receptor inhibitor-naïve patients undergoing percutaneous coronary intervention in both acute and stable settings