Ditto: A Simple and Efficient Approach to Improve Sentence Embeddings

Prior studies diagnose the anisotropy problem in sentence representations from pre-trained language models, e.g., BERT, without fine-tuning. Our analysis reveals that the sentence embeddings from BERT suffer from a bias towards uninformative words, limiting the performance in semantic textual similarity (STS) tasks. To address this bias, we propose a simple and efficient unsupervised approach, Diagonal Attention Pooling (Ditto), which weights words with model-based importance estimations and computes the weighted average of word representations from pre-trained models as sentence embeddings. Ditto can be easily applied to any pre-trained language model as a postprocessing operation. Compared to prior sentence embedding approaches, Ditto does not add parameters nor requires any learning. Empirical evaluations demonstrate that our proposed Ditto can alleviate the anisotropy problem and improve various pre-trained models on STS tasks.Comment: 8 pages, accepted by EMNLP 2023 short paper, the source code can be found at https://github.com/alibaba-damo-academy/SpokenNLP/tree/main/ditt

A 5 V-to-32 V Input PVT-Robust Charge-Pump Circuit with Adjustable Output in a 0.18 μm BCD Process

In this paper, a new closed-loop charge-pump circuit with adjustable output voltage and an on-chip compensation technique is proposed. The environmental temperature and process corner can be detected with an on-chip detection circuit and automatically feedback an adjusted reference voltage. With this, the magnitude of the charge-pump output voltage with Pulse-Width Modulation (PWM) can be compensated. The charge-pump circuit is designed and verified with a 180 nm Bipolar-CMOS-DMOS (BCD) process, and its output voltage at different process, voltage, and temperature (PVT) is controllable with low ripple. There are three selections for adjusting the output voltage: +5 V/+7 V/+10 V shifts, with the supply voltage ranging from 5 V to 32 V. It can remain tunable and stable at any shifts. The maximum deviation is ±0.265%, and the maximum load current can reach 30 mA. The ripple voltage is less than 0.3% (Δ Vripple/Vout) underthe maximum load. The Monte Carlo simulation results show that the worst case of the process sensitivity (σ/μ) is 0.1%. The charge-pump core area is 0.308 mm2, and the power consumption is 4.753 mW. The circuit can produce high-precision output and is suitable for high-side driving IC applications

Path of Promoting Industrial Transformation and Upgrading Based on Rural Revitalization: A Case Study of Green Plum Industry in Luhe County of Shanwei City

Taking green plum Industry in Luhe County of Shanwei City in Guangdong Province as an example, this paper made a precise positioning, based on the characteristics of rural tourism resources in Yongchuan Township, took the current situation as the guide and improving the tourism function as the carrier, made an innovation of the rural tourism industry system, in order to improve the quality of rural tourism development, and realize the strategic goal of rural revitalization

Optical Fiber Vibration Signal Recognition Based on the Fusion of Multi–Scale Features

Because of the problem of low recognition accuracy in the recognition of intrusion vibration events by the distributed Sagnac type optical fiber sensing system, this paper combines the traditional optical fiber vibration signal recognition idea and the characteristics of automatic feature extraction by a convolutional neural network (CNN) to construct a new endpoint detection algorithm and a method of fusing multiple–scale features CNN to recognize fiber vibration signals. Firstly, a new endpoint detection algorithm combining spectral centroid and energy spectral entropy product is used to detect the vibration part of the original signal, which is used to improve the detection effect of endpoint detection. Then, CNNs of different scales are used to extract the multi–level and multi–scale features of the signal. Aiming at the problem of information loss in the pooling process, a new method of combining differential pooling features is used. Finally, a multi–layer perceptron (MLP) is used to recognize the extracted features. Experiments show that the method has an average recognition accuracy rate of 98.75% for the four types of vibration signals. Compared with traditional EMD and VMD pattern recognition and 1D–CNN methods, the accuracy of the optical fiber vibration signal recognition is higher

The spatial distribution of traditional intangible cultural heritage medicine of China and its influencing factors

Abstract Intangible cultural heritage (ICH) of traditional Chinese medicine is a vivid testimony to the continuous inheritance of Chinese civilization. The study of ICH of traditional Chinese medicine from the perspective of the geographical environment, spatial relationships and diachronic development is of great significance for understanding objectively the reasons for the formation of spatial distribution patterns of ICH and the pathways and extent of its spread; as a consequence, such information can help us improve our understanding of the integrity and historical continuity of culture. From a geography perspective, this study seeks to explore the spatial patterns of traditional Chinese medicine ICH based on knowledge concerning the extent of spreading of traditional Chinese medicine ICH. At the same time, the spatial analysis technique ArcGIS is used to express the spatiotemporal development of traditional Chinese medicine ICH in a simple, clear and visual way. Also, the factors influencing the spatial distribution of traditional Chinese medicine ICH are analyzed. The main findings are as follows: (1) The spatial distribution of traditional Chinese medicine ICH practices is cohesive as a whole, with a tendency to aggregate and strong imbalance in distribution. (2) There are significant differences in the classification and number of traditional Chinese medicine ICH. (3) Traditional Chinese medicine ICH practices have obvious differentiation in time and space distribution when factoring in their announcement in batches. (4) Traditional medicine practices have significant spatial autocorrelation. Appreciation of the aforementioned features allows us to gain consensus on the development and evolution of traditional Chinese medicine ICH, and hence can justify how we allocate funds to promote traditional Chinese medicine ICH projects, paying particular attention to researching the historical context, and preserving the extraction of the local characteristics of traditional Chinese medicine ICH

Ae-Based Failure Warning Mechanism During Cemented Paste Backfilling: Experimental Investigation

To research the AE warning mechanism of cemented paste backfilling (CPB), the uniaxial compression test with AE monitoring was carried out on CPB. The effects of different moisture content, cement proportion, and loading rate on AE characteristics of CPB were analyzed. And a damage model based on AE is established. The results show that the increase of water content, gypsum content, and loading rate can enhance the ductility of CPB and lengthen the AE warning area. However, the increase of moisture content will lead to the delay of AE signal peak, which is bad for the early warning. With the increase of loading rate, the failure mode of specimens gradually changes from splitting failure to shear failure. The cracks produced under different failure modes can correspond to the peaks of AE signals. The damage model based on AE shows that the damage process of CPB samples can be divided into three stages, linear-exponential-linear. The experimental results can further research the optimal conditions for ae monitoring of backfill, and provide a theoretical basis for ae monitoring and warning of backfill