Complementary systems for Off-Topic spoken response detection

Increased demand to learn English for business and education has led to growing interest in automatic spoken language assessment and teaching systems. With this shift to automated approaches it is important that systems reliably assess all aspects of a candidate's responses. This paper examines one form of spoken language assessment; whether the response from the candidate is relevant to the prompt provided. This will be referred to as off-topic spoken response detection. Two forms of previously proposed approaches are examined in this work: the hierarchical attention-based topic model (HATM); and the similarity grid model (SGM). The work focuses on the scenario when the prompt, and associated responses, have not been seen in the training data, enabling the system to be applied to new test scripts without the need to collect data or retrain the model. To improve the performance of the systems for unseen prompts, data augmentation based on easy data augmentation (EDA) and translation based approaches are applied. Additionally for the HATM, a form of prompt dropout is described. The systems were evaluated on both seen and unseen prompts from Linguaskill Business and General English tests. For unseen data the performance of the HATM was improved using data augmentation, in contrast to the SGM where no gains were obtained. The two approaches were found to be complementary to one another, yielding a combined F(0.5) score of 0.814 for off-topic response detection where the prompts have not been seen in training.ALT

Universal adversarial attacks on spoken language assessment systems

There is an increasing demand for automated spoken language assessment (SLA) systems, partly driven by the performance improvements that have come from deep learning based approaches. One aspect of deep learning systems is that they do not require expert derived features, operating directly on the original signal such as a speech recognition (ASR) transcript. This, however, increases their potential susceptibility to adversarial attacks as a form of candidate malpractice. In this paper the sensitivity of SLA systems to a universal black-box attack on the ASR text output is explored. The aim is to obtain a single, universal phrase to maximally increase any candidate's score. Four approaches to detect such adversarial attacks are also described. All the systems, and associated detection approaches, are evaluated on a free (spontaneous) speaking section from a Business English test. It is shown that on deep learning based SLA systems the average candidate score can be increased by almost one grade level using a single six word phrase appended to the end of the response hypothesis. Although these large gains can be obtained, they can be easily detected based on detection shifts from the scores of a “traditional” Gaussian Process based grader

Nuclear deformation and neutrinoless double-β\beta decay of 94,96^{94,96}Zr, 98,100^{98,100}Mo, 104^{104}Ru, 110^{110}Pd, 128,130^{128,130}Te and 150^{150}Nd nuclei in mass mechanism

The $(\beta ^{-}\beta ^{-})_{0\nu}$ decay of $^{94,96}$Zr, $^{98,100}$Mo, $^{104}$Ru, $^{110}$Pd, $^{128,130}$Te and $^{150}$Nd isotopes for the $0^{+}\to 0^{+}$ transition is studied in the Projected Hartree-Fock-Bogoliubov framework. In our earlier work, the reliability of HFB intrinsic wave functions participating in the $\beta ^{-}\beta ^{-}$ decay of the above mentioned nuclei has been established by obtaining an overall agreement between the theoretically calculated spectroscopic properties, namely yrast spectra, reduced $B(E2$:$0^{+}\to 2^{+})$ transition probabilities, quadrupole moments $Q(2^{+})$, gyromagnetic factors $g(2^{+})$ as well as half-lives $T_{1/2}^{2\nu}$ for the $0^{+}\to 0^{+}$ transition and the available experimental data. In the present work, we study the $(\beta ^{-}\beta ^{-})_{0\nu}$ decay for the $0^{+}\to 0^{+}$ transition in the mass mechanism and extract limits on effective mass of light as well as heavy neutrinos from the observed half-lives $T_{1/2}^{0\nu}(0^{+}\to 0^{+})$ using nuclear transition matrix elements calculated with the same set of wave functions. Further, the effect of deformation on the nuclear transition matrix elements required to study the $(\beta ^{-}\beta ^{-})_{0\nu}$ decay in the mass mechanism is investigated. It is noticed that the deformation effect on nuclear transition matrix elements is of approximately same magnitude in $(\beta ^{-}\beta ^{-})_{2\nu}$ and $(\beta ^{-}\beta ^{-})_{0\nu}$ decay.Comment: 15 pages, 1 figur

New limit for the half-life of double beta decay of 94^{94}Zr to the first excited state of 94^{94}Mo

Neutrinoless Double Beta Decay is a phenomenon of fundamental interest in particle physics. The decay rates of double beta decay transitions to the excited states can provide input for Nuclear Transition Matrix Element calculations for the relevant two neutrino double beta decay process. It can be useful as supplementary information for the calculation of Nuclear Transition Matrix Element for the neutrinoless double beta decay process. In the present work, double beta decay of $^{94}$Zr to the $2^{+}_{1}$ excited state of $^{94}$Mo at 871.1 keV is studied using a low background $\sim$ 230 cm$^3$ HPGe detector. No evidence of this decay was found with a 232 g.y exposure of natural Zirconium. The lower half-life limit obtained for the double beta decay of $\rm^{94}Zr$ to the $2^{+}_{1}$ excited state of $\rm^{94}Mo$ is $T_{1/2} (0\nu + 2\nu)> 3.4 \times 10^{19}$ y at 90% C.L., an improvement by a factor of $\sim$ 4 over the existing experimental limit at 90\% C.L. The sensitivity is estimated to be $T_{1/2} (0\nu + 2\nu) > 2.0\times10^{19}$ y at 90% C.L. using the Feldman-Cousins method.Comment: 11 pages, 7 figures, Accepted in Eur. Phys. J.