Reducing Communication for Split Learning by Randomized Top-k Sparsification

Split learning is a simple solution for Vertical Federated Learning (VFL), which has drawn substantial attention in both research and application due to its simplicity and efficiency. However, communication efficiency is still a crucial issue for split learning. In this paper, we investigate multiple communication reduction methods for split learning, including cut layer size reduction, top-k sparsification, quantization, and L1 regularization. Through analysis of the cut layer size reduction and top-k sparsification, we further propose randomized top-k sparsification, to make the model generalize and converge better. This is done by selecting top-k elements with a large probability while also having a small probability to select non-top-k elements. Empirical results show that compared with other communication-reduction methods, our proposed randomized top-k sparsification achieves a better model performance under the same compression level.Comment: Accepted by IJCAI 202

Research on wear prediction of piston/cylinder pair in axial piston pumps

The piston/cylinder pair is the critical lubricating interface of axial piston pumps. It suffers from excessive wear, especially under high output pressure. The performance degradation of the piston/cylinder pair is significant to be clarified. In this paper, a wear prediction method of the piston/cylinder pair is established by coupling the load-bearing and lubrication parameters calculation model and the wear calculation model. The models are validated through experiments. The experimental and simulated results show that the wear of two ends of the cylinder bore is severe in the specific ranges of circumferential angle. The time-varying wear process of the piston/cylinder pair can be obtained by using this method; therefore, the maintenance time can be predicted

Pushing the Limits of ChatGPT on NLP Tasks

Despite the success of ChatGPT, its performances on most NLP tasks are still well below the supervised baselines. In this work, we looked into the causes, and discovered that its subpar performance was caused by the following factors: (1) token limit in the prompt does not allow for the full utilization of the supervised datasets; (2) mismatch between the generation nature of ChatGPT and NLP tasks; (3) intrinsic pitfalls of LLMs models, e.g., hallucination, overly focus on certain keywords, etc. In this work, we propose a collection of general modules to address these issues, in an attempt to push the limits of ChatGPT on NLP tasks. Our proposed modules include (1) a one-input-multiple-prompts strategy that employs multiple prompts for one input to accommodate more demonstrations; (2) using fine-tuned models for better demonstration retrieval; (3) transforming tasks to formats that are more tailored to the generation nature; (4) employing reasoning strategies that are tailored to addressing the task-specific complexity; (5) the self-verification strategy to address the hallucination issue of LLMs; (6) the paraphrase strategy to improve the robustness of model predictions. We conduct experiments on 21 datasets of 10 representative NLP tasks, including question answering, commonsense reasoning, natural language inference, sentiment analysis, named entity recognition, entity-relation extraction, event extraction, dependency parsing, semantic role labeling, and part-of-speech tagging. Using the proposed assemble of techniques, we are able to significantly boost the performance of ChatGPT on the selected NLP tasks, achieving performances comparable to or better than supervised baselines, or even existing SOTA performances

Safeguarding authenticity versus innovative development: methods of protecting traditional Chinese martial arts

This article reflects on the conflict between the two main viewpoints of the protection of Chinese martial arts culture and defines the two protection methods of “Safeguarding Authenticity” and “Innovative Development”. This article aims to enhance the vitality and cultural heritage of traditional Chinese martial arts and discusses the protection and development of traditional Chinese martial arts from the perspective of folklore intangible cultural heritage (ICH) protection. Studies indicate that to continue the development of traditional Chinese martial arts from generation to generation, it must adapt to the laws of current social and cultural development. With the goal of improving the vitality of traditional martial arts culture, on the basis of adhering to the inheritance of the core skills of traditional martial arts, it advocates an innovative development mode that keeps pace with the times. Its fundamental purpose is to enable the sustainable and healthy development of traditional martial arts

Fabrication of micro-scale radiation shielding structures using tungsten nanoink through electrohydrodynamic inkjet printing

Electronics components used in space and strategic missions are exposed to harsh radiation environments, which could cause operational malfunction of the system through lattice displacement or ionization effects. One potential solution is to use tungsten as radiation shielding. Tungsten is a very effective material in shielding electronic components and manufacturing gratings for x-ray imaging. However, intrinsic properties of tungsten (e.g. density, chemical/thermal inertness and hardness) post a significant challenge of fabricating the material into micro-scale and delicate structures, especially in electronic device fabrication. To address the problem, we designed a new tungsten nanoink and developed a straightforward approach to create tungsten micro-structures by 3D printing. Various microstructures down to 10 µm resolution have been patterned and fabricated by electrohydrodynamic inkjet (e-jet) printing using tungsten nanoink. By optimizing process parameters (voltage modality) and materials properties (ink formulation), the dimension and morphology of the structures can be precisely controlled. An AC-modulated voltage was employed during the e-jet printing process to make the patterns much more controllable and stable. Multi-layer tungsten lines were characterized by x-ray imaging and exhibited excellent absorption of x-ray radiation. With the same thickness, printed lines showed nearly 1/3 absorptivity of x-ray radiation of bulk tungsten, leading to significant radiation attenuation effectiveness. Tungsten nanoink is a new material used in e-jet printing that has not been reported in the literature to the best of authors\u27 knowledge. The study establishes a new methodology of manufacturing micro-nano scale shielding components for electronic devices and rapid prototyping of gratings and collimators in radiography for medical and inspection applications. The research also provides practical guidance to fabricate high melting-point metals via nanoink and micro/nano scale 3D printing