AWTE-BERT:Attending to Wordpiece Tokenization Explicitly on BERT for Joint Intent Classification and SlotFilling

Intent classification and slot filling are two core tasks in natural language understanding (NLU). The interaction nature of the two tasks makes the joint models often outperform the single designs. One of the promising solutions, called BERT (Bidirectional Encoder Representations from Transformers), achieves the joint optimization of the two tasks. BERT adopts the wordpiece to tokenize each input token into multiple sub-tokens, which causes a mismatch between the tokens and the labels lengths. Previous methods utilize the hidden states corresponding to the first sub-token as input to the classifier, which limits performance improvement since some hidden semantic informations is discarded in the fine-tune process. To address this issue, we propose a novel joint model based on BERT, which explicitly models the multiple sub-tokens features after wordpiece tokenization, thereby generating the context features that contribute to slot filling. Specifically, we encode the hidden states corresponding to multiple sub-tokens into a context vector via the attention mechanism. Then, we feed each context vector into the slot filling encoder, which preserves the integrity of the sentence. Experimental results demonstrate that our proposed model achieves significant improvement on intent classification accuracy, slot filling F1, and sentence-level semantic frame accuracy on two public benchmark datasets. The F1 score of the slot filling in particular has been improved from 96.1 to 98.2 (2.1% absolute) on the ATIS dataset

One In-Situ Extraction Algorithm for Monitoring Bunch-by-Bunch Profile in the Storage Ring

As the brightness of synchrotron radiation (SR) light sources improves, the operation stability of light sources is weakened. To explore various beam instability related issues in light sources, one transverse beam diagnostics system for bunch-by-bunch (BbB) profile measurement has been established at Hefei Light Source-II (HLS-II). In this paper, one in-situ extraction algorithm in the data processing backend of the system is developed for BbB profiles, so as to provide important beam information of the machine operation in time.Comment: Accepted by the International Conference on Optical Communication and Optical Information Processing (OCOIP 2023

A behavioral mechanistic investigation of the role of 5-HT\u3csub\u3e1A\u3c/sub\u3e receptors in the mediation of rat maternal behavior

Previous work suggests that 5-HT1A receptors play a special role in rodent maternal aggression, but not in other aspects of maternal care (e.g. pup retrieval and nest building). The present study re-assessed the basic effects of 5-HT1A activation or blockade on various maternal responses in postpartum female rats. We also examined the possible behavioral mechanisms underlying the maternal effects of 5-HT1A. Sprague–Dawley mother rats were injected with a 5-HT1A agonist 8-OH-DPAT (0.1, 0.5 or 1.0 mg/kg, sc), a 5-HT1A antagonist WAY-101405 (0.1, 0.5 or 1.0 mg/kg, sc) or 0.9% saline solution on postpartum days 3, 5, and 7. Maternal behavior was tested 30 min before, 30 min, 120 min, and 240 min after the injection. Acute and repeated 8-OH-DPAT treatment significantly disrupted pup retrieval, pup licking, nursing, and nest building in a dose-dependent fashion, whereas WAY-101405 had no effect at the tested doses. The 5-HT1A receptor specificity of 8-OH-DPAT\u27s action was confirmed as its maternal disruption effect was reversed by pretreatment of WAY-100635 (a highly selective 5-HT1A receptor antagonist). Subsequent pup preference test found that 8-OH-DPAT did not decrease the pup preference over a novel object, thus no inhibition on maternal motivation or maternal affect. The pup separation test and pup retrieval on an elevated plus maze test also failed to find any motivational and motor impairment effect with 8-OH-DPAT. However, 8-OH-DPAT at the maternal disruptive dose did disrupt the prepulse inhibition (a measure of attentional function) of acoustic startle response and enhanced the basal startle response. These findings suggest that stimulation of 5-HT1A receptors by 8-OH-DPAT impairs maternal care by partially interfering with the attentional processing or basal anxiety. More work is needed to further delineate the psychological and neuronal mechanisms underlying the maternal disruptive effect of 5-HT1A receptor activation

An ultra-stable cryogenic sapphire cavity laser with an instability of 1.9×10−161.9\times10^{-16} based on a low vibration level cryostat

Cryogenic ultra-stable lasers have extremely low thermal noise limits and frequency drifts, but they are more seriously affected by vibration noise from cryostats. Main material candidates for cryogenic ultra-stable cavities include silicon and sapphire. Although sapphire has many excellent properties at low temperature, the development of sapphire-based cavities is less advanced than that of silicon-based. Using a homemade cryogenic sapphire cavity, we develop an ultra-stable laser source with a frequency instability of $1.9\times10^{-16}$. This is the best frequency instability level among similar systems using cryogenic sapphire cavities reported so far. Low vibration performance of the cryostat is demonstrated with a two-stage vibration isolation, and the vibration suppression is further improved by different mixing ratio of the gas-liquid helium. With this technique, vibrations at frequencies higher than tens of hertz are greatly suppressed.Comment: 4 pages, 4 figure

Chlorido[1-(pyridin-2-yl)ethanone oximato-κ2 N,N′][1-(2-pyrid­yl)ethanone oxime-κ2 N,N′]copper(II) trihydrate

In the title compound, [Cu(C7H7N2O)Cl(C7H8N2O)]·3H2O, the metal ion is five-coordinated by the N atoms from the 1-(pyridin-2-yl)ethanone oximate and 1-(pyridin-2-yl)ethanone oxime ligands and by the chloride anion in a distorted square-pyramidal geometry. The distortion parameter is 0.192. The two organic ligands are linked by an intra­molecular O—H⋯O hydrogen bond. In the crystal, mol­ecules are linked by O—H⋯O and O—H⋯Cl hydrogen bonds. The title compound is the hydrated form of a previously reported structure [Wu & Wu (2008 ▶). Acta Cryst. E64, m828]. There are only slight variations in the mol­ecular geometries of the two compounds

Dual-frequency output of wireless power transfer system with single inverter using improved differential evolution algorithm

In wireless charging devices, a transmitter that applies a single inverter to output dual-frequency can effectively solve the charging incompatibility problem caused by different wireless charging standards and reduce the equipment volume. However, it is very difficult to solve the switching angle of the modulated dual-frequency waveform, which involves non-linear high-dimensional multi-objective optimization with multiple constraints. In this paper, an improved differential evolution (DE) algorithm is proposed to solve the transcendental equations of switching angle trains of dual-frequency programmed harmonic modulation (PHM) waveform. The proposed algorithm maintains diversity while preserving the elites and improves the convergence speed of the solution. The advantage of the proposed algorithm was verified by comparing with non-dominated sorting genetic algorithm II (NSGA II) and multi-objective particle swarm optimization (MOPSO). The simulation and experimental results validate that the proposed method can output dual-frequency with a single inverter for wireless power transfer (WPT).Web of Science139art. no. 220

Study of a metal hydride based thermal energy storage system using multi-phase heat exchange for the application of concentrated solar power system

Abstract: Thermal energy storage system is of great significance for the concentrated solar power system to keep the balance between power generation and demand. Metal hydride based thermal energy storage system is regarded as a promising method due to its good reversibility, low cost, and no by-product. Multi-phase heat exchange has much higher heat transfer coefficient than single-phase fluid heat exchange, thus facilitating the steam generation. In this study, a two-dimensional model of the metal hydride reactor using multi-phase heat exchange is proposed to estimate the performance and its feasibility of application in the concentrated solar power system. The results show that the velocity of the heat transfer fluid should match well with the thermal conductivity of the metal hydride bed to maintain the heat flux at a relatively constant value. The match of thermal conductivity of 3 or 5 W/(m·K) and fluid velocity of 0.0050 m/s results in the heat flux up to about 19 kW/m2, which is increased by 3 orders of magnitude than single-phase heat exchange. In the thermal energy storage system, the reheating cycle is recommended to improve the utilization of the thermal energy. The efficiency of the system could be improved from 18.4% to 30.8% using the reheating cycle. The increased efficiency is comparable to the previously reported efficiency of 39.2%. Besides, the operation strategy of raising the steam temperature by increasing the hydrogen pressure or the superheater temperature is suggested for the system to obtain higher efficiency