Multi-distribution noise quantisation: an extreme compression scheme for transformer according to parameter distribution

With the development of deep learning, neural networks are widely used in various fields, and the improved model performance also introduces a considerable number of parameters and computations. Model quantisation is a technique that turns floating-point computing into low-specific-point computing, which can effectively reduce model computation strength, parameter size, and memory consumption but often bring a considerable loss of accuracy. This paper mainly addresses the problem where the distribution of parameters is too concentrated during quantisation aware training (QAT). In the QAT process, we use a piecewise function to statistics the parameter distributions and simulate the effect of quantisation noise in each round of training, based on the statistical results. Experimental results show that by quantising the Transformer network, we lose less precision and significantly reduce the storage cost of the model; compared with the full precision LSTM network, our model has higher accuracy under the condition of a similar storage cost. Meanwhile, compared with other quantisation methods on language modelling task, our approach is more accurate. We validated the effectiveness of our policy on the WikiText-103 and PENN Treebank datasets. The experiments show that our method extremely compresses the storage cost and maintains high model performance

Does status stability benefit or hurt team creativity? the roles of status legitimacy and team conflict

Status stability, which refers to the stability of team members’ relative status levels, has a profound effect on team effectiveness, but this effect may be either constructive or destructive; the literature has failed to reach consensus on this topic. To reconcile two contradictory views based on differentiating between different types of conflict, we constructed a comprehensive theoretical model of the mechanism underlying the effect of status stability; this model features relationship conflict and task conflict as mediators, status legitimacy as a moderator, and team creativity as an outcome variable. We also proposed four hypotheses on the basis of theoretical analysis. In this study, we used SPSS 23.0, AMOS 24.0 and R software to conduct empirical analysis and testing of 369 valid questionnaires collected from 83 teams using a two-stage measurement method. The results revealed that status stability negatively affects team creativity via task conflict and positively affects team creativity via relationship conflict. However, under the influence of status legitimacy, the negative effect is restrained, while the positive effect is enhanced. This study thus expands the research on the process mechanism and boundary conditions associated with status stability, and can serve as a useful reference for the design of the status structure of modern enterprises

Optimal Operation of a Single Unit with an Adjustable Blade in an Interbasin Water Transfer Pumping Station Based on Successive Approximation Discretization for Blade Angle

In the mathematical model of the optimal operation of a single pump unit with a fully adjustable blade in the Chinese South-to-North Water Diversion Project, the decision variable, namely, blade angle, was uniformly dispersed in its feasible region in a fixed step size in consideration of the requirements of the pumping head and matching motor power. 1D dynamic programming was applied to solve the original model. When the obtained blade for each time period was set as the middle reference value and the discrete region of the blade was reduced to two times of the step size in the previous time, the blade angle was correspondingly reduced and dispersed in this new discrete region, thus eliminating unnecessary optimization space. Then, 1D dynamic programming was applied again to optimize the blade angle of the single pump unit further. After a series of successive approximation discretization of the blade angle and corresponding solutions of the obtained mathematical model, the optimization process was considered completed when the given control precision met the requirement. A case study showed that under typical operating conditions, the total cost saving percentage of water pumping quantity reached 0.048%–0.463%, with an average saving rate of 0.192%. The actual total water pumping quantity of the single unit decreased by 2153 m3 on the average. The proposed discretization method exerted a better optimization effect and needed a smaller computational amount compared with traditional one-time uniform discretization in the original feasible region of the blade angle

Measuring Bed Exchange Properties of Cohesive Sediments Using Tripod Data

The Krone–Partheniades (K-P) framework has been used for decades to quantify and analyze the sediment exchange at a water–bed interface. Measuring the erosion and deposition parameters that are part of this framework requires time-consuming field observations. Additionally, the erosion parameters are measured independently of deposition parameters, while in reality they are coupled. In numerical models applying the K-P framework these parameters are often assumed to be constant in time and mutually independent. In this study, we develop a relatively simple methodology to determine the erosion and deposition parameters, using conventional near-bed observations of bed level, sediment concentration and flow velocity. This methodology is subsequently applied to tripod observations collected in the Changjiang estuary, China, to compute continuous time-varying erosion and settling parameters. We propose a diagram to visualize the interdependency and accuracy of erosion and deposition parameters, which is the input for K-P framework models requiring this interdependency

A topological framework for real-time 3D weather radar data processing

Real-time 3D weather radar data processing makes it possible to efficiently simulate meteorological processes in digital Earth and support the assessment of meteorological disasters. The current real-time meteorological operation system can only deal with radar data within 2D space as a flat map and lacks supporting 3D characteristics. Thus, valuable 3D information imbedded in radar data cannot be completely presented to meteorological experts. Due to the large amount of data and high complexity of radar data 3D operation, regular methods are not competent for supporting real-time 3D radar data processing and representation. This study aims to perform radar data 3D operations with high efficiency and instant speed to provide real-time 3D support for the meteorological field. In this paper, a topological framework composed of basic inner topological objects is proposed along with the quadtree structure and LOD architecture, based on which 3D operations on radar data can be conducted in a split second and 3D information can be presented in real time. As the applications of the proposed topological framework, two widely used 3D algorithms in the meteorological field are also implemented in this paper. Finally, a case study verifies the applicability and validity of the proposed topological framework

Sustained and Targeted Delivery of Self-Assembled Doxorubicin Nonapeptides Using pH-Responsive Hydrogels for Osteosarcoma Chemotherapy

While chemotherapeutic agents have particularly potent effects in many types of cancer, their clinical applications are still far from satisfactory due to off-target drug exposure, chemotherapy resistance, and adverse effects, especially in osteosarcoma. Therefore, it is clinically promising to construct a novel tumor-targeted drug delivery system to control drug release and alleviate side effects. In this study, a pH-responsive nonapeptide hydrogel was designed and fabricated for the tumor-targeted drug delivery of doxorubicin (DOX). Using a solid-phase synthesis method, a nonapeptide named P1 peptide that is structurally akin to surfactant-like peptides (SLPs) due to its hydrophobic tail and hydrophilic head was synthesized. The physicochemical properties of the P1 hydrogel were characterized via encapsulation capacity, transmission electron microscopy (TEM), circular dichroism (CD), zeta potential, rheological analysis, and drug release studies. We also used in vitro and in vivo experiments to investigate the cytocompatibility and tumor inhibitory efficacy of the drug-loaded peptide hydrogel. The P1 peptide could self-assemble into biodegradable hydrogels under neutral conditions, and the prepared drug-loaded hydrogels exhibited good injectability and biocompatibility. The in vitro drug release studies showed that DOX-P1 hydrogels had high sensitivity to acidic conditions (pH 5.8 versus 7.4, up to 3.6-fold). Furthermore, the in vivo experiments demonstrated that the DOX-P1 hydrogel could not only amplify the therapeutic effect but also increase DOX accumulation at the tumor site. Our study proposes a promising approach to designing a pH-responsive hydrogel with controlled doxorubicin-release action based on self-assembled nonapeptides for targeted chemotherapy

Customizable process design for collaborative geographic analysis

Collaborative geographic analysis can lead to better outcomes but requires complicated interactions among participants, support resources and analytic tools. A process expression with explicit structure and content can help coordinate and guide these interactions. For different geographic problems, the structure and content of collaborative geographic analysis are generally distinct. Since the process structure embodies the pathway of problem-solving and the process content contains the information flow and internal interactions, both the structure and the content of the process expression must be clarified during process customization. However, relevant studies concerning the collaborative geographic analysis process mainly focus on the process structure, which remains a “black box” in terms of the process content, especially the internal interactions. Therefore, this article designs a customizable process expression model that takes both process structure and content into account and proposes a corresponding process customization method for collaborative geographic analysis. Additionally, a support method for geographic analysis process implementation is also provided. To verify the feasibility and capability, these methods were implemented in a prototype system, and a case study on traffic noise assessment was conducted. The results suggest that the proposed strategy can effectively improve geographic analysis by customizing processes, guiding participants, performing interactions, and recording operations throughout the process

Structural Studies of Fluoroborate Laser Glasses by Solid State NMR and EPR Spectroscopies

The structure of glasses in the systems (100 – <i>x</i>)­B₂O₃–<i>x</i>PbF₂ (<i>x</i> = 30, 40, and 50) and 50B₂O₃–(50 – <i>x</i>)­PbO–<i>x</i>PbF₂ (<i>x</i> = 5, 10, 15, 20, 25, 30, 35, 40, and 45) has been studied by solid state NMR and EPR spectroscopies. On the basis of ¹¹B and ¹⁹F high resolution solid state NMR as well as on ¹¹B/¹⁹F double resonance results, we develop a quantitative structural description on the atomic scale. ¹⁹F NMR results indicate a systematic dependence of the fluoride speciation on PbF₂ content: At low <i>x</i>-values, F^– ions are predominantly found on BO_3/2F^– units, whereas, at higher <i>x</i>-values, fluoride tends to be sequestrated into amorphous domains rich in PbF₂. In addition, both pulsed EPR studies of Yb³⁺ doped glasses and photophysical studies of Eu³⁺ doped samples indicate a mixed fluoride/borate coordination of the rare-earth ions and the absence of nanophase segregation effects