DualApp: Tight Over-Approximation for Neural Network Robustness Verification via Under-Approximation

The robustness of neural networks is fundamental to the hosting system's reliability and security. Formal verification has been proven to be effective in providing provable robustness guarantees. To improve the verification scalability, over-approximating the non-linear activation functions in neural networks by linear constraints is widely adopted, which transforms the verification problem into an efficiently solvable linear programming problem. As over-approximations inevitably introduce overestimation, many efforts have been dedicated to defining the tightest possible approximations. Recent studies have however showed that the existing so-called tightest approximations are superior to each other. In this paper we identify and report an crucial factor in defining tight approximations, namely the approximation domains of activation functions. We observe that existing approaches only rely on overestimated domains, while the corresponding tight approximation may not necessarily be tight on its actual domain. We propose a novel under-approximation-guided approach, called dual-approximation, to define tight over-approximations and two complementary under-approximation algorithms based on sampling and gradient descent. The overestimated domain guarantees the soundness while the underestimated one guides the tightness. We implement our approach into a tool called DualApp and extensively evaluate it on a comprehensive benchmark of 84 collected and trained neural networks with different architectures. The experimental results show that DualApp outperforms the state-of-the-art approximation-based approaches, with up to 71.22% improvement to the verification result.Comment: 13 pages, 9 fugures, 3 table

Automatic Insertion of Hot Keywords to Drive Traffic on Advertisements

Product titles and descriptions that include appropriate keywords, when used in an online advertisement, can improve the shopping feed quality and resultant traffic to the advertiser. However, online merchants lack knowledge of currently trending or popular keywords, and lacking keyword ideation, may choose suboptimal product titles. This disclosure describes techniques that enable online merchants to automatically optimize product titles or descriptions, e.g., as used in online ads. Trending or popular keywords relevant to the product are automatically added to the product title or description. Unique, product-specific insights gleaned from searched terms are utilized to improve title effectiveness automatically and at scale

The Protective Effect of Magnesium Lithospermate B on Hepatic Ischemia/Reperfusion via Inhibiting the Jak2/Stat3 Signaling Pathway

Acute inflammation is an important component of the pathogenesis of hepatic ischemia/reperfusion injury (HIRI). Magnesium lithospermate B (MLB) has strong neuroprotective and cardioprotective effects. The purpose of this study was to determine whether MLB had underlying protective effects against hepatic I/R injury and to reveal the potential mechanisms related to the hepatoprotective effects. In this study, we first examined the protective effect of MLB on HIRI in mice that underwent 1 h ischemia followed by 6 h reperfusion. MLB pretreatment alleviated the abnormal liver function and hepatocyte damage induced by I/R injury. We found that serum inflammatory cytokines, including IL-6, IL-1β, and TNF-α, were significantly decreased by MLB during hepatic ischemia/reperfusion (I/R) injury, suggesting that MLB may alleviate hepatic I/R injury via inhibiting inflammatory signaling pathways. Second, we investigated the protein level of p-Jak2/Jak2 and p-Stat3/Stat3 using Western blotting and found that MLB could significantly inhibit the activation of the Jak2/Stat3 signaling pathway, which was further verified by AG490 in a mouse model. Finally, the effect of MLB on the Jak2/Stat3 pathway was further assessed in an in vitro model of RAW 264.7 cells; 1 µg/ml LPS induced the secretion of inflammatory mediators, including IL-6, TNF-α, and activation of the Jak2/Stat3 signaling pathway. MLB significantly inhibited the abnormal secretion of inflammatory factors and the activation of the Jak2/Stat3 signaling pathway in RAW264.7 cells. In conclusion, MLB was found for the first time to reduce inflammation induced by hepatic I/R via suppressing the Jak2/Stat3 pathway

Modeling the cost of influenza: the impact of missing costs of unreported complications and sick leave

Background Estimating the economic impact of influenza is complicated because the disease may have non-specific symptoms, and many patients with influenza are registered with other diagnoses. Furthermore, in some countries like Norway, employees can be on paid sick leave for a specified number of days without a doctor's certificate ("self-reported sick leave") and these sick leaves are not registered. Both problems result in gaps in the existing literature: costs associated with influenza-related illness and self-reported sick leave are rarely included. The aim of this study was to improve estimates of total influenza-related health-care costs and productivity losses by estimating these missing costs. Methods Using Norwegian data, the weekly numbers of influenza-attributable hospital admissions and certified sick leaves registered with other diagnoses were estimated from influenza-like illness surveillance data using quasi-Poisson regression. The number of self-reported sick leaves was estimated using a Monte-Carlo simulation model of illness recovery curves based on the number of certified sick leaves. A probabilistic sensitivity analysis was conducted on the economic outcomes. Results During the 1998/99 through 2005/06 influenza seasons, the models estimated an annual average of 2700 excess influenza-associated hospitalizations in Norway, of which 16% were registered as influenza, 51% as pneumonia and 33% were registered with other diagnoses. The direct cost of seasonal influenza totaled US$22 million annually, including costs of pharmaceuticals and outpatient services. The annual average number of working days lost was predicted at 793 000, resulting in an estimated productivity loss of US$231 million. Self-reported sick leave accounted for approximately one-third of the total indirect cost. During a pandemic, the total cost could rise to over US$800 million. Conclusions Influenza places a considerable burden on patients and society with indirect costs greatly exceeding direct costs. The cost of influenza-attributable complications and the cost of self-reported sick leave represent a considerable part of the economic burden of influenza

Arbuscular mycorrhizal fungi improve selenium uptake by modulating root transcriptome of rice (Oryza sativa L.)

Although selenium (Se) is an essential trace element in humans, the intake of Se from food is still generally inadequate throughout the world. Inoculation with arbuscular mycorrhizal fungi (AMF) improves the uptake of Se in rice (Oryza sativa L.). However, the mechanism by which AMF improves the uptake of Se in rice at the transcriptome level is unknown. Only a few studies have evaluated the effects of uptake of other elements in rice under the combined effects of Se and AMF. In this study, Se combined with the AMF Funneliformis mosseae (Fm) increased the biomass and Se concentration of rice plants, altered the pattern of ionomics of the rice roots and shoots, and reduced the antagonistic uptake of Se with nickel, molybdenum, phosphorus, and copper compared with the treatment of Se alone, indicating that Fm can enhance the effect of fertilizers rich in Se. Furthermore, a weighted gene co-expression network analysis (WGCNA) showed that the hub genes in modules significantly associated with the genes that contained Se and were related to protein phosphorylation, protein serine/threonine kinase activity, membrane translocation, and metal ion binding, suggesting that the uptake of Se by the rice roots may be associated with these genes when Fm and Se act in concert. This study provides a reference for the further exploration of genes related to Se uptake in rice under Fm treatment

Health tourism : trade patterns, trade motives and gains from trade

Health tourism refers to patients from one country seeking medical service in other countries in the purpose of saving money, avoiding long waiting time or improving the quality of the service. Like globalization in general, health tourism brings both opportunities and challenges. Some people think it will be the solution to public health care problems in developed countries while others argue that it will create a two-tier society in developing countries. This thesis is an attempt to give a structured analysis of health tourism from developed to developing countries, to discuss theoretically possible welfare gains from it and how to achieve that. It starts with a history review and a snapshot of current development of health tourism in the first two chapters. The first chapter deals with how health tourism came into being. The second chapter first gives a definition of health tourism and identifies the procedures that are feasible to be included in health tourism. It then puts health tourism into the framework of service trade in the WTO-framework and makes a profile of the exporting countries. It concludes with some indicative data which shows the trade volumes and their future potentials. Chapter 3 put forward the question: why health tourism fails to be as prevalent as traditional trade theory suggests, and proposes that there are at least three factors that distinguish trade in health care service from trade in other services. Chapter 4 and 5 go into more detail to answer this question by looking at different factors that have an implication on health tourism, and focusing at three parties involved in health tourism. In developed countries, the lack of portability of insurance contracts prevents health tourism from being more prevalent. In developing countries, governments need to implement regulatory policies to prevent health tourism from causing inequality. The last two chapters deal with these two aspects respectively. A model is set up in chapter 6 to analysis the portability of insurance contracts which is identified as the most crucial dampening factor on health tourism in this thesis. The model simulates the process and discusses the welfare gains of moving from a case of no health tourism through the case of health tourism but no insurance portability and finally the case of full portability of health care insurance. The model shows that Pareto gains will arise when health tourism becomes possible and the portability of insurance contracts decides how this welfare gain is shared between insurance company and patients. Some policy suggestions are made at chapter 7 for governments in developing countries to avoid a two-tier society as a result of health tourism. The conclusion is made in chapter 8, stating that health tourism may have a positive impact on both exporting countries and importing countries

Dynamic modelling of costs and health consequences of school closure during an influenza pandemic

Background The purpose of this article is to evaluate the cost-effectiveness of school closure during a potential influenza pandemic and to examine the trade-off between costs and health benefits for school closure involving different target groups and different closure durations. Methods We developed two models: a dynamic disease model capturing the spread of influenza and an economic model capturing the costs and benefits of school closure. Decisions were based on quality-adjusted life years gained using incremental cost-effectiveness ratios. The disease model is an age-structured SEIR compartmental model based on the population of Oslo. We studied the costs and benefits of school closure by varying the age targets (kindergarten, primary school, secondary school) and closure durations (1–10 weeks), given pandemics with basic reproductive number of 1.5, 2.0 or 2.5. Results The cost-effectiveness of school closure varies depending on the target group, duration and whether indirect costs are considered. Using a case fatality rate (CFR) of 0.1-0.2% and with current cost-effectiveness threshold for Norway, closing secondary school is the only cost-effective strategy, when indirect costs are included. The most cost-effective strategies would be closing secondary schools for 8 weeks if R 0 =1.5, 6 weeks if R 0 =2.0, and 4 weeks if R 0 = 2.5. For severe pandemics with case fatality rates of 1-2%, similar to the Spanish flu, or when indirect costs are disregarded, the optimal strategy is closing kindergarten, primary and secondary school for extended periods of time. For a pandemic with 2009 H1N1 characteristics (mild severity and low transmissibility), closing schools would not be cost-effective, regardless of the age target of school children. Conclusions School closure has moderate impact on the epidemic’s scope, but the resulting disruption to society imposes a potentially great cost in terms of lost productivity from parents’ work absenteeism