A Survey on Reinforcement Learning Security with Application to Autonomous Driving

Reinforcement learning allows machines to learn from their own experience. Nowadays, it is used in safety-critical applications, such as autonomous driving, despite being vulnerable to attacks carefully crafted to either prevent that the reinforcement learning algorithm learns an effective and reliable policy, or to induce the trained agent to make a wrong decision. The literature about the security of reinforcement learning is rapidly growing, and some surveys have been proposed to shed light on this field. However, their categorizations are insufficient for choosing an appropriate defense given the kind of system at hand. In our survey, we do not only overcome this limitation by considering a different perspective, but we also discuss the applicability of state-of-the-art attacks and defenses when reinforcement learning algorithms are used in the context of autonomous driving

Large Ecosystem Service Benefits of Assisted Natural Regeneration

China manages the largest monoculture plantations in the world, with 24% being Chinese fir plantations. Maximizing the ecosystem services of Chinese fir plantations has important implications in global carbon cycle and biodiversity protection. Assisted natural regeneration (ANR) is a practice to convert degraded lands into more productive forests with great ecosystems services. However, the quantitative understanding of ANR ecosystem service benefits is very limited. We conducted a comprehensive field manipulation experiment to evaluate the ANR potentials. We quantified and compared key ecosystem services including surface runoff, sediment yield, dissolved organic carbon export, plant diversity, and aboveground carbon accumulation of ANR of secondary forests dominated by Castanopsis carlesii to that of Chinese fir and C. carlesii plantations. Our results showed that ANR of C. carlesii forest reduced surface runoff and sediment yield up to 50% compared with other young plantations in the first 3 years and substantially increased plant diversity. ANR also reduced the export of dissolved organic carbon by 60–90% in the first 2 years. Aboveground biomass of the young ANR forest was approximately 3–4 times of that of other young plantations, while aboveground biomass of mature ANR forests was approximately 1.4 times of that of mature Chinese fir plantations of the same age. If all Chinese fir plantations in China were replaced by ANR forests, potentially 0.7 Pg more carbon will be stored in aboveground in one rotation (25 years). The results indicate that ANR triggers positive feedbacks among soil and water conservation, biodiversity protection, and biomass accumulation and thereby enhances ecosystem services

Thermochemical liquefaction of agricultural and forestry wastes into biofuels and chemicals from circular economy perspectives

Waste produced in various fields and activities in society has been increasing, thereby causing immediate environmental harm and a serious-global problem. Recently, the attitude towards waste has changed along with innovations making waste as a new resource. Agricultural and forestry wastes (AFWs) are globally produced in huge amounts and thought to be an important resource to be used for decreasing the dependence on fossil fuels. The central issue is to take use of AFW for different types of products making it a source of energy and at the same time refining it for the production of valuable chemicals. In this review, we present an overview of the composition and pretreatment of AFINs, thermochemical liquefaction including direct liquefaction and indirect liquefaction (liquid products from syngas by gasification) for producing biofuels and/or chemicals. The following two key points were discussed in-depth: the solvent or medium of thermochemical conversion and circular economy of liquid products. The concept of bio-economy entails economic use of waste streams, leading to the widened assessment of biomass use for energy where sustainability is a key issue coined in the circular economy. The smart use of AFWs requires a combination of available waste streams and local technical solutions to meet sustainability criteria. (C) 2020 Published by Elsevier B.V.Peer reviewe

Percutaneous angioplasty and/or stenting versus aggressive medical therapy in patients with symptomatic intracranial atherosclerotic stenosis: a 1-year follow-up study

BackgroundSymptomatic intracranial atherosclerotic stenosis (sICAS) is one of the common causes of ischemic stroke. However, the treatment of sICAS remains a challenge in the past with unfavorable findings. The purpose of this study was to explore the effect of stenting versus aggressive medical management on preventing recurrent stroke in patients with sICAS.MethodsWe prospectively collected the clinical information of patients with sICAS who underwent percutaneous angioplasty and/or stenting (PTAS) or aggressive medical therapy from March 2020 to February 2022. Propensity score matching (PSM) was employed to ensure well-balanced characteristics of two groups. The primary outcome endpoint was defined as recurrent stroke or transient ischemic attack (TIA) within 1 year.ResultsWe enrolled 207 patients (51 in the PTAS and 156 in the aggressive medical groups) with sICAS. No significant difference was found between PTAS group and aggressive medical group for the risk of stroke or TIA in the same territory beyond 30 days through 6 months (P = 0.570) and beyond 30 days through 1 year (P = 0.739) except for within 30 days (P = 0.003). Furthermore, none showed a significant difference for disabling stroke, death and intracranial hemorrhage within 1 year. These results remain stable after adjustment. After PSM, all the outcomes have no significant difference between these two groups.ConclusionThe PTAS has similar treatment outcomes compared with aggressive medical therapy in patients with sICAS across 1-year follow-up

Crystal Ball: Prediction-based Real-time Evasion Against Deep Reinforcement Learning

International audienc

PARP10 influences the proliferation of colorectal carcinoma cells, a preliminary study

PARP10 is an intracellular mono-ADP ribosyltransferase and recent reports suggest that it regulates proliferation of some cell types. However, its effect on the proliferation of colorectal carcinoma cells has not yet been systematically reported. We explored the influence of PARP10 on the proliferation of several colorectal carcinoma cell types and carried out initial studies on the underlying mechanisms. Inhibition of the enzymatic activity of PARP10 led to significantly decreases in proliferative ability in LoVo cells and CT26 cells in vitro and suppressed growth of CT26 tumours in the subaxilliary region in Balb/c mice in vivo. Cell-cycle arrest accompanied these observations. Expression of the nuclear transfer factor β-catenin and it translocation to the nucleus were also affected and the expression of its associated signal proteins Axin2 and c-Myb were increased and decreased, respectively. We demonstrate that PARP10 promotes proliferation of those colorectal carcinoma cells which express significant levels of PARP10. This promotion is suppressed when the enzymatic activity is inhibited. β-Catenin is likely to be the mediator of the antiproliferative effect

Conversion of Natural Evergreen Broadleaved Forests Decreases Soil Organic Carbon but Increases the Relative Contribution of Microbial Residue in Subtropical China

It has been recognized that land use change affects soil organic carbon (SOC) dynamics and the associated microbial turnover. However, the contribution of microbial residue to SOC storage remains largely unknown in land use change processes. To this end, we adopted a “space for time” approach to examine the dynamics of SOC and amino sugars, which was a biomarker of microbial residue C, in different natural forest conversions. Three typical converted forests were selected: an assisted natural regeneration (ANR) and two coniferous plantations of Cunninghamia lanceolata (Lamb.) Hook (Chinese fir) and Pinus massoniana Lamb. (pine) each. All of these were developed at the same time after the harvest of an old natural forest and they were used to evaluate the effects of forest conversions with contrasting anthropogenic disturbance on SOC and microbial residue C, along with the natural forest. Natural forest conversion led to an approximately 42% decrease in SOC for ANR with low anthropogenic disturbance, 60% for the Chinese fir plantation, and 64% for the pine plantation. In contrast, the natural forest conversion led to a 32% decrease in the total amino sugars (TAS) for ANR, 43% for the Chinese fir plantation, and 54% for the pine plantation at a soil depth of 0−10 cm. The ratios of TAS to SOC were significantly increased following natural forest conversion, with the highest ratio being observed in the Chinese fir plantation, whereas the ratios of glucosamine to muramic acid (GluN/MurA) were significantly decreased in the two plantations, but not in ANR. The contents of SOC, individual amino sugar, or TAS, and GluN/MurA ratios were consistently higher at a soil depth of 0−10 cm than at 10−20 cm for all of the experimental forests. Redundancy analysis showed that microbial residue C was significantly correlated with SOC, and both were positively correlated with fine root biomass, annual litterfall, and soil available phosphorus. Taken together, our findings demonstrated that microbial residue C accumulation varied with SOC and litter input, and played a more important role in SOC storage following forest conversion to plantations with higher anthropogenic disturbance

Increased litter in subtropical forests boosts soil respiration in natural forests but not plantations of Castanopsis carlesii

Background and aims: Changes in net primary productivity in response to climate change are likely to affect litter inputs to forest soil. However, feedbacks between changes in litter input and soil carbon dynamics remain poorly understood in tropical and subtropical forests. This study aims to test whether the effects of litter manipulation on soil respiration differ between natural and plantation forests. Methods: Soil respiration, soil properties, fine root biomass and enzyme activity were measured in adjacent plots with doubling vs. eliminating litter input in both natural and plantation forests of Castanopsis carlesii in southern China. Results: After only 3 years of litter manipulation, the magnitude of change in soil respiration was greater in response to a doubling of the litter input (+24%) than to the elimination of litter input (−15%) in the natural forest, possibly due to a positive priming effect on decomposition of soil organic carbon (SOC). The quick and intense priming effect was corroborated by elevated enzyme activities for five of the six enzymes analyzed. In contrast, the response to litter removal (−31%) was greater than the response to litter addition (1%; not significant) in the plantation forest. The lack of positive priming in the plantation forest may be related to its lower soil fertility, which could not meet the demand of soil microbes, and to its high clay content, which protected SOC from microbial attack. The positive priming effect in the natural forest but not plantation forest of C. carlesii is also consistent with the significant declines in total soil carbon observed following litter addition in the natural forest but not the plantation forest. Conclusions: Increases in aboveground litter production may trigger priming effects and subsequently transfer more soil carbon to atmospheric CO2 in the natural forest but not in the plantation forest with low fertility. Changes in litter inputs resulting from global change drivers may have different impacts on natural and plantation forests

The Role of High-Resolution Magnetic Resonance Imaging in Cerebrovascular Disease: A Narrative Review

High-resolution magnetic resonance imaging (HRMRI) is the most important and popular vessel wall imaging technique for the direct assessment of vessel wall and cerebral arterial disease. It can identify the cause of stroke in high-risk plaques and differentiate the diagnosis of head and carotid artery dissection, including inflammation, Moya Moya disease, cerebral aneurysm, vasospasm after subarachnoid hemorrhage, reversible cerebral vasoconstriction syndrome, blunt cerebrovascular injury, cerebral arteriovenous malformations, and other stenosis or occlusion conditions. Through noninvasive visualization of the vessel wall in vitro, quantified assessment of luminal stenosis and pathological features of the vessel wall can provide clinicians with further disease information. In this report, technical considerations of HRMRI are discussed, and current clinical applications of HRMRI are reviewed