Non-Autoregressive Neural Machine Translation with Enhanced Decoder Input

Non-autoregressive translation (NAT) models, which remove the dependence on previous target tokens from the inputs of the decoder, achieve significantly inference speedup but at the cost of inferior accuracy compared to autoregressive translation (AT) models. Previous work shows that the quality of the inputs of the decoder is important and largely impacts the model accuracy. In this paper, we propose two methods to enhance the decoder inputs so as to improve NAT models. The first one directly leverages a phrase table generated by conventional SMT approaches to translate source tokens to target tokens, which are then fed into the decoder as inputs. The second one transforms source-side word embeddings to target-side word embeddings through sentence-level alignment and word-level adversary learning, and then feeds the transformed word embeddings into the decoder as inputs. Experimental results show our method largely outperforms the NAT baseline~\citep{gu2017non} by $5.11$ BLEU scores on WMT14 English-German task and $4.72$ BLEU scores on WMT16 English-Romanian task.Comment: AAAI 201

EFFECTS OF SHOE COLLAR HEIGHT ON SAGITTAL ANKLE ROM, KINETICS AND POWER OUTPUT DURING SINGLE-LEG AND DOUBLE-LEG JUMPS

The aim of this research was to examine the effects of high-top shoes and low-top shoes on sagittal ankle ROM, kinetics and power output during single-leg and double-leg jumps. Twelve male subjects were requested to wear high-top and low-top shoes to perform single-leg and double-leg jumps. Ankle joint kinematics and kinetics data were collected using Vicon system and force plates. Shoe collar heights did not influence the jump height in both single-leg and double-leg jump tasks. However, high-top shoes adopted in this study resulted in a significant smaller sagittal ankle ROM during a quasi-static movement. In addition, wearing high-top shoe could also decrease the dorsiflexion ankle joint torque and power output during the push-off phase in single-leg jump. These findings provide preliminary evidence suggesting that a changed ankle kinematic and kinetic behaviour in the sagittal plane may be induced when wearing high-top shoes

Structure determination of the zeolite IM-5 using electron crystallography

The structure of the complex zeolite IM-5 (Cmcm, a = 14.33(4) Å, b = 56.9(2) Å, c = 20.32(7) Å) was determined by combining selected area electron diffraction (SAED), 3D reconstruction of high resolution transmission electron microscopy (HRTEM) images from different zone axes and distance least squares (DLS) refinement. The unit cell parameters were determined from SAED. The space group was determined from extinctions in the SAED patterns and projection symmetries of HRTEM images. Using the structure factor amplitudes and phases of 144 independent reflections obtained from HRTEM images along the [100], [010] and [001] directions, a 3D electrostatic potential map was calculated by inverse Fourier transformation. From this 3D potential map, all 24 unique Si positions could be determined. Oxygen atoms were added between each Si-Si pair and further refined together with the Si positions by distance-least-squares. The final structure model deviates on average 0.16 Å for Si and 0.31 Å for O from the structure refined using X-ray powder diffraction data. This method is general and offers a new possibility for determining the structures of zeolites and other materials with complex structure

Occurrence Regularity of Methane Gas Molecules in Composite Nanopores: A Molecular Simulation Study

AbstractTo understand the occurrence regularity of methane gas molecules in composite nanopores, the effects of temperature, pressure, size of nanopore, and burial depth on the occurrence state of methane were studied theoretically by using the grand canonical Monte Carlo and molecular dynamic simulation methods. By comparing the results available in the literature, the reasons for the difference in the occurrence states of methane molecules in nanopores were analyzed, and a reasonable occurrence regularity of methane was proposed, which provides corresponding suggestions for the actual exploitation of shale gas. The results indicated that the methane gas molecules existed in nanopore only in the adsorption and transition states under different environmental conditions. They were preferentially adsorbed at the strong adsorption sites on the nanopore surface to form a stable adsorption layer. After the adsorption layer reached saturation, a transition layer with higher density than that of bulk methane was formed at the nanopore center. The total adsorption capacity of methane decreased gradually with an increase in the internal temperature of shale reservoirs and increased with an increase in nanopore size. In addition, the average amount of methane stored in the nanopore increased at a deeper burial depth. The occurrence state of methane under different pressure ranges was controlled under different action mechanisms. Under low pressure (P<20 MPa), the adsorption of methane molecules was controlled by the number of strong adsorption sites on the nanopore surface, where the density peak intensity of the adsorption layer increased with the pressure. However, under high pressure (P>20 MPa), the adsorption was controlled by the diffusion process of methane molecules in the organic matter layer, where both the adsorption and transition layers reached the saturation state, and excessive methane molecules diffused deeper into the kerogen layer. The approach to effectively improve the recovery efficiency was to inject water or carbon dioxide into the shale reservoir where the water or carbon dioxide molecules occupy strong adsorption positions than the methane molecules adsorbed originally under the competitive adsorption effect, and the adsorbed methane molecules were transformed to a free state

Tetraodon nigroviridis as a nonlethal model of infectious spleen and kidney necrosis virus (ISKNV) infection

AbstractInfectious spleen and kidney necrosis virus (ISKNV) is the type species of the genus Megalocytivirus, family Iridoviridae. We have previously established a high mortality ISKNV infection model of zebrafish (Danio rerio). In this study, a nonlethal Tetraodon nigroviridis model of ISKNV infection was established. ISKNV infection did not cause lethal disease in Tetraodon but could infect almost all the organs of this species. Electron microscopy showed ISKNV particles were present in infected tissues. Immunofluorescence and quantitative real-time PCR analysis showed that nearly all the virions and infected cells were cleared at 14d postinfection. The expression profiles of interferon-γ and tumor necrosis factor-α gene in response to ISKNV infection were significantly different in Tetraodon and zebrafish. The establishment of the nonlethal Tetraodon model of ISKNV infection can offer a valuable tool complementary to the zebrafish infection model for studying megalocytivirus disease, fish immune systems, and viral tropism

Evaluating Hallucinations in Chinese Large Language Models

In this paper, we establish a benchmark named HalluQA (Chinese Hallucination Question-Answering) to measure the hallucination phenomenon in Chinese large language models. HalluQA contains 450 meticulously designed adversarial questions, spanning multiple domains, and takes into account Chinese historical culture, customs, and social phenomena. During the construction of HalluQA, we consider two types of hallucinations: imitative falsehoods and factual errors, and we construct adversarial samples based on GLM-130B and ChatGPT. For evaluation, we design an automated evaluation method using GPT-4 to judge whether a model output is hallucinated. We conduct extensive experiments on 24 large language models, including ERNIE-Bot, Baichuan2, ChatGLM, Qwen, SparkDesk and etc. Out of the 24 models, 18 achieved non-hallucination rates lower than 50%. This indicates that HalluQA is highly challenging. We analyze the primary types of hallucinations in different types of models and their causes. Additionally, we discuss which types of hallucinations should be prioritized for different types of models.Comment: Work in progres

Recovery Pattern of High-Frequency Acceleration Vestibulo-Ocular Reflex in Unilateral Vestibular Neuritis: A Preliminary Study

Objective: To explore the recovery pattern of the high-frequency acceleration vestibulo-ocular reflex (VOR) function in unilateral vestibular neuritis (UVN).Methods: Forty-seven consecutive patients with UVN were recruited within 10 days of symptom onset for this study. The high-frequency acceleration horizontal VOR function was assessed using the video head impulse test (vHIT). Patients returned for follow-up evaluation at ~6 months after the onset of symptoms. According to the dizziness handicap inventory questionnaire (DHI), the patients were classified into the normal to mild dizziness group (DHI score ≤30) and moderate to severe dizziness group (DHI score >30) at the follow-up. All the obtained horizontal vHIT gains and corrective saccades parameters were analyzed.Results: vHIT results showed a significantly horizontal VOR gain recovery in UVN patients at the follow-up on the lesion side (p < 0.01). A significantly reduction in the occurrence of corrective saccades (overt and covert) and velocity of corrective saccades (overt and covert) were observed at the follow-up (p < 0.05). At the follow-up, the normal to mild dizziness group (DHI score ≤30) had a significantly higher normal rate of VOR gain, the mean vHIT gains and occurrence of isolated covert saccades (P < 0.05). Furthermore, the occurrence of mixed saccades and the mean velocity of covert saccades were significantly lower in normal to mild dizziness group (P < 0.05).Conclusion: Apart from the recovery of the VOR gain, recovery pattern of corrective saccades can play a key role in vestibular compensate