MAT: Mixed-Strategy Game of Adversarial Training in Fine-tuning

Fine-tuning large-scale pre-trained language models has been demonstrated effective for various natural language processing (NLP) tasks. Previous studies have established that incorporating adversarial training during the fine-tuning stage can significantly enhance model generalization and robustness. However, from the perspective of game theory, such utilizations of adversarial training correspond to pure-strategy games, which are inherently limited in terms of the scope of their strategies, thereby still having room for improvement. In order to push the performance boundaries, we propose a novel Mixed-strategy Adversarial Training algorithm (MAT). Methodologically, we derive the Nash equilibrium of a mixed-strategy game for adversarial training using Entropy Mirror Descent to establish MAT by sampling method. To verify the effectiveness of MAT, we conducted extensive benchmark experiments on large-scale pre-trained models, such as BERT and RoBERTa. MAT significantly outperforms the state-of-the-art methods on both the GLUE and ANLI benchmarks in terms of generalization and robustness.Comment: Will appear on IJCAI 202

Research on the Intelligent Safety Monitoring System of Pipeline Corrosion in Acidic Oil and Gas Fields—II

AbstractAll kinds of corrosion monitoring techniques have their own advantages and obvious disadvantages when applied in acidic oil and gas fields. According to the characteristics of various technologies, an intelligent safety monitoring system was established based on electrochemical noise probe with galvanic corrosion probe, electrochemical hydrogen permeation probe and electric resistance probe. This paper presents the development of monitoring unit, system integration, and field test and data analysis. The results demonstrate that electrochemical noise not only determines the occurrence of corrosion, but also shows the characteristic of localized corrosion clearly; electrochemical hydrogen permeation technique reveals several advantages in the monitoring progress including simplicity, high sensitivity and high reliability, while the improved electric resistance probe shows a better environmental suitability. The accuracy and reliability of corrosion monitoring has been greatly increased by this integrated technique which can achieve the consistency and complementation of much information