Adversarial Weight Perturbation Improves Generalization in Graph Neural Network

A lot of theoretical and empirical evidence shows that the flatter local minima tend to improve generalization. Adversarial Weight Perturbation (AWP) is an emerging technique to efficiently and effectively find such minima. In AWP we minimize the loss w.r.t. a bounded worst-case perturbation of the model parameters thereby favoring local minima with a small loss in a neighborhood around them. The benefits of AWP, and more generally the connections between flatness and generalization, have been extensively studied for i.i.d. data such as images. In this paper, we extensively study this phenomenon for graph data. Along the way, we first derive a generalization bound for non-i.i.d. node classification tasks. Then we identify a vanishing-gradient issue with all existing formulations of AWP and we propose a new Weighted Truncated AWP (WT-AWP) to alleviate this issue. We show that regularizing graph neural networks with WT-AWP consistently improves both natural and robust generalization across many different graph learning tasks and models.Comment: AAAI 202

Multi-task Representation Learning for Pure Exploration in Linear Bandits

Despite the recent success of representation learning in sequential decision making, the study of the pure exploration scenario (i.e., identify the best option and minimize the sample complexity) is still limited. In this paper, we study multi-task representation learning for best arm identification in linear bandits (RepBAI-LB) and best policy identification in contextual linear bandits (RepBPI-CLB), two popular pure exploration settings with wide applications, e.g., clinical trials and web content optimization. In these two problems, all tasks share a common low-dimensional linear representation, and our goal is to leverage this feature to accelerate the best arm (policy) identification process for all tasks. For these problems, we design computationally and sample efficient algorithms DouExpDes and C-DouExpDes, which perform double experimental designs to plan optimal sample allocations for learning the global representation. We show that by learning the common representation among tasks, our sample complexity is significantly better than that of the native approach which solves tasks independently. To the best of our knowledge, this is the first work to demonstrate the benefits of representation learning for multi-task pure exploration

Provably Safe Reinforcement Learning with Step-wise Violation Constraints

In this paper, we investigate a novel safe reinforcement learning problem with step-wise violation constraints. Our problem differs from existing works in that we consider stricter step-wise violation constraints and do not assume the existence of safe actions, making our formulation more suitable for safety-critical applications which need to ensure safety in all decision steps and may not always possess safe actions, e.g., robot control and autonomous driving. We propose a novel algorithm SUCBVI, which guarantees $\widetilde{O}(\sqrt{ST})$ step-wise violation and $\widetilde{O}(\sqrt{H^3SAT})$ regret. Lower bounds are provided to validate the optimality in both violation and regret performance with respect to $S$ and $T$. Moreover, we further study a novel safe reward-free exploration problem with step-wise violation constraints. For this problem, we design an $(\varepsilon,\delta)$-PAC algorithm SRF-UCRL, which achieves nearly state-of-the-art sample complexity $\widetilde{O}((\frac{S^2AH^2}{\varepsilon}+\frac{H^4SA}{\varepsilon^2})(\log(\frac{1}{\delta})+S))$, and guarantees $\widetilde{O}(\sqrt{ST})$ violation during the exploration. The experimental results demonstrate the superiority of our algorithms in safety performance, and corroborate our theoretical results

Ownership structure and corporate performance of Chinese listed companies

This paper investigates the relationship between the performance of listed Chinese companies and their ownership structure. This article analyses all of the non-financial companies, including 12 industries. These companies are listed on the Shanghai Stock Exchange (SHSE) and the Shenzhen Stock Exchange (SZSE) from 2012 to 2016. This study indicates that the state-owned shareholding is negatively related to corporate performance. There is a positive relationship between legal person shares and the proportion of institutional investors, but the opposite direction changes with the percentage of tradable share. The findings suggest that ownership structure affect the performance of listed companies. This paper finds that ownership concentration has an important influence on the performance of companies, and the characteristic of the large shareholders is also a significant determinant

EXPERIMENTAL RESEARCH ON THE VIBRATION CHARACTERISTICS OF BRIDGE'S HORIZONTAL ROTATION SYSTEM

As a new construction method, the bridge horizontal rotation construction method can reduce the impact of traffic under the bridge. During the horizontal rotation of the bridge, the overall structure will inevitably lead to a vibration response due to the construction error of the contact surface of the spherical hinge. Due to the large weight of the structure and the longer cantilever of the superstructure, the vibration at the spherical hinge will be amplified at the girder end, which will adversely affect the stability of the structure. Taking a 10,000-ton rotating bridge as a reference, a scaled model was made to test the vibration of the girder during the rotating process of the horizontal rotating system.And by analyzing the frequency domain curve of girder vibration and the results of simulation calculation, it is found that the vertical vibration displacement response is related to the first three modes of longitudinal bending of the girder structure, but has nothing to do with the higher modes or other modes. Applying the harmonic response analysis module in ANSYS software method, it is proposed that the structural vibration effect will reach the smallest by controlling the rotating speed in order to control the excitation frequency within the first-order mode frequency of girder. Also in this research, the expression of the relationship between the vertical vibration velocity and acceleration of the girder end of the horizontal rotation system and the vibration frequency of the girder is established. Based on that, it is proposed that the stability of the horizontal rotation can be predicted by monitoring the vertical velocity and acceleration of the cantilever girder end during the horizontal rotation

Programmable base editing of zebrafish genome using a modified CRISPR-Cas9 system.

Precise genetic modifications in model animals are essential for biomedical research. Here, we report a programmable "base editing" system to induce precise base conversion with high efficiency in zebrafish. Using cytidine deaminase fused to Cas9 nickase, up to 28% of site-specific single-base mutations are achieved in multiple gene loci. In addition, an engineered Cas9-VQR variant with 5'-NGA PAM specificities is used to induce base conversion in zebrafish. This shows that Cas9 variants can be used to expand the utility of this technology. Collectively, the targeted base editing system represents a strategy for precise and effective genome editing in zebrafish.The use of base editing enables precise genetic modifications in model animals. Here the authors show high efficient single-base editing in zebrafish using modified Cas9 and its VQR variant with an altered PAM specificity

Hepatitis E virus infection in swine workers: A meta‐analysis

Hepatitis E virus (HEV) infects both humans and animals. Swine has been confirmed to be the principal natural reservoir, which raises a concern that HEV infection would be substantially increasing among swine workers. The present study calculated the pooled prevalence of IgG antibodies against HEV among swine workers and the general population in previous cross‐sectional studies. We conducted a meta‐analysis comparing the prevalence of HEV infection between swine workers and the general population, including local residents, blood donors and non‐swine workers. Through searches in three databases (PubMed and OVID in English, and CNKI in Chinese) and after study selection, a total of 32 studies from 16 countries (from 1999 through 2018) were included in the meta‐analysis. A random‐effect model was employed in the study; an I 2 statistic assessed heterogeneity, and the Egger’s test detected publication bias. The comparative prevalence of anti‐HEV IgG was pooled from the studies. Compared to the general population, the prevalence ratio (PR) for swine workers was estimated to be 1.52 (95% CI 1.38–1.76) with the I 2 being 71%. No publication bias was detected (p = 0.40). A subgroup analysis further indicated increased prevalence of anti‐HEV IgG in the swine workers in Asia (PR = 1.49, 95% CI: 1.35–1.64), in Europe (PR = 1.93, 95% CI: 1.49–2.50) and in all five swine‐related occupations, including swine farmers, butchers, meat processors, pork retailers and veterinarians (PR ranged between 1.19 and 1.75). In summary, swine workers have a relatively higher prevalence of past HEV infection, and this finding is true across swine‐related occupations, which confirms zoonotic transmission between swine and swine workers.Peer Reviewedhttps://deepblue.lib.umich.edu/bitstream/2027.42/147857/1/zph12548_am.pdfhttps://deepblue.lib.umich.edu/bitstream/2027.42/147857/2/zph12548.pd

MECHANICAL BEHAVIOR OF HORIZONTAL SWIVEL SYSTEM WITH UHPC SPHERICAL HINGE UNDER SEISMIC ACTION

In the process of rotation, the total weight of the bridge structure is jointly supported by the spherical hinge and the supporting structure, and its lateral stability is poor. It is easy to lose stability under the action of dynamic loads such as seismic action effect. The present paper takes a 10,000-ton continuous rigid frame swivel bridge as the re-search object, analyzes the dynamic response of the seismic action to the horizontal swivel system, and establishes several structure simulation models. Eighteen seismic waves in three directions that meet the calculation requirements are screened for time history analysis and compared with the response spectrum method. Finally, an optimization algorithm for the seismic response of the bridge under horizontal swivel system is proposed based on the mode superposition method. The UHPC spherical hinge bears all the vertical forces and 20% of the bending moment caused by the seismic action, the support structure bearing the remaining 80% of the bending moment. The optimization algorithm proposed in this paper features high accuracy