End-to-end Task-oriented Dialogue: A Survey of Tasks, Methods, and Future Directions

End-to-end task-oriented dialogue (EToD) can directly generate responses in an end-to-end fashion without modular training, which attracts escalating popularity. The advancement of deep neural networks, especially the successful use of large pre-trained models, has further led to significant progress in EToD research in recent years. In this paper, we present a thorough review and provide a unified perspective to summarize existing approaches as well as recent trends to advance the development of EToD research. The contributions of this paper can be summarized: (1) \textbf{\textit{First survey}}: to our knowledge, we take the first step to present a thorough survey of this research field; (2) \textbf{\textit{New taxonomy}}: we first introduce a unified perspective for EToD, including (i) \textit{Modularly EToD} and (ii) \textit{Fully EToD}; (3) \textbf{\textit{New Frontiers}}: we discuss some potential frontier areas as well as the corresponding challenges, hoping to spur breakthrough research in EToD field; (4) \textbf{\textit{Abundant resources}}: we build a public website\footnote{We collect the related papers, baseline projects, and leaderboards for the community at \url{https://etods.net/}.}, where EToD researchers could directly access the recent progress. We hope this work can serve as a thorough reference for the EToD research community.Comment: Accepted at EMNLP202

GL-CLeF: A Global-Local Contrastive Learning Framework for Cross-lingual Spoken Language Understanding

Due to high data demands of current methods, attention to zero-shot cross-lingual spoken language understanding (SLU) has grown, as such approaches greatly reduce human annotation effort. However, existing models solely rely on shared parameters, which can only perform implicit alignment across languages. We present Global--Local Contrastive Learning Framework (GL-CLeF) to address this shortcoming. Specifically, we employ contrastive learning, leveraging bilingual dictionaries to construct multilingual views of the same utterance, then encourage their representations to be more similar than negative example pairs, which achieves to explicitly aligned representations of similar sentences across languages. In addition, a key step in GL-CLeF is a proposed Local and Global component, which achieves a fine-grained cross-lingual transfer (i.e., sentence-level Local intent transfer, token-level Local slot transfer, and semantic-level Global transfer across intent and slot). Experiments on MultiATIS++ show that GL-CLeF achieves the best performance and successfully pulls representations of similar sentences across languages closer.Comment: Accepted at ACL2022 Main Conferenc

The experience of long-stay patients in a forensic psychiatric hospital in China: a qualitative study

open access articleBackground Long stay in forensic psychiatric hospitals is common in patients who are defined as “not criminally responsible on account of mental disorder”. However, little is known about how these patients experience and perceive the long stay within these settings. The aim of this study is to explore the perception and needs of long-stay patients in forensic psychiatric hospitals in China. Methods In-depth semi-structured interviews were conducted with 21 participants who had lived in the forensic psychiatry hospital for more than 8 years. We used thematic analysis strategies to analyse the qualitative data. Results Participants’ perceptions clustered seven themes: hopelessness, loneliness, worthlessness, low mood, sleep disturbances, lack of freedom, and lack of mental health intervention. Conclusions The views and opinions expressed by long-stay patients showed that psychological distress is prevailing in forensic psychiatric hospitals. Adequate and effective care and mental health interventions are recommended to be tailored for their special needs

Through the Lens of Core Competency: Survey on Evaluation of Large Language Models

From pre-trained language model (PLM) to large language model (LLM), the field of natural language processing (NLP) has witnessed steep performance gains and wide practical uses. The evaluation of a research field guides its direction of improvement. However, LLMs are extremely hard to thoroughly evaluate for two reasons. First of all, traditional NLP tasks become inadequate due to the excellent performance of LLM. Secondly, existing evaluation tasks are difficult to keep up with the wide range of applications in real-world scenarios. To tackle these problems, existing works proposed various benchmarks to better evaluate LLMs. To clarify the numerous evaluation tasks in both academia and industry, we investigate multiple papers concerning LLM evaluations. We summarize 4 core competencies of LLM, including reasoning, knowledge, reliability, and safety. For every competency, we introduce its definition, corresponding benchmarks, and metrics. Under this competency architecture, similar tasks are combined to reflect corresponding ability, while new tasks can also be easily added into the system. Finally, we give our suggestions on the future direction of LLM's evaluation

Flexible Coherent Optical Access: Architectures, Algorithms, and Demonstrations

To cope with the explosive bandwidth demand, significant progress has been made in the ITU-T standardization sector to define a higher-speed passive optical network (PON) with a 50Gb/s line rate. Recently, 50G PON becomes mature gradually, which means it is time to discuss beyond 50G PON. For ensuring an acceptable optical power budget, beyond 50G PON will potentially use coherent technologies, which can simultaneously promote the applications of flexible multiple access such as time/frequency-domain multiple access (TFDMA). In this paper, we will introduce the architectures, algorithms, and demonstrations for TFDMA-based coherent PON. The system architectures based on an ultra-simple coherent transceiver and specific signal spectra are designed to greatly reduce the cost of ONUs. Meanwhile, fast and low-complexity digital signal processing (DSP) algorithms are proposed for dealing with upstream and downstream signals. Based on the architectures and algorithms, we experimentally demonstrate the first real-time TFDMA-based coherent PON, which can support at most 256 end users, and peak line rates of 100Gb/s and 200Gb/s in the upstream and downstream scenarios, respectively. In conclusion, the proposed technologies for the coherent PON make it more possible to be applied in the future beyond 50G PON.Comment: The paper has been submitted to the Journal of Lightwave Technolog

Effect of coal mining on net primary productivity of vegetation in Shendong Mining Area

Coal mining in Shendong Mining area has an important impact on the local ecological environment, especially the growth of vegetation. In order to describe this effect quantitatively, this study uses a regional evapotranspiration model to calculate the Potential Net Primary Productivity (PNP,p) of the Shendong mining area. MODIS17A3 dataset (2001—2022) was used to characterize the Actual Net Primary Productivity (PNP,a), and combined with the monthly net primary productivity raster dataset of terrestrial ecosystems in China (PNP,al, 1988—2015), using GWR model construction correction method to correct PNP,al to obtain 1988—2000 PNP,a data, and using the difference between the two PNP,h to characterize the impact of coal mining. The effect of coal mining on vegetation PNP in Shendong mining area was evaluated. The results show that: ① the accuracy of PNP,al data corrected by GWR model is about 0.76, and the corrected PNP,al data has a strong spatial correlation with the MODIS17A3 dataset, which indicates the reliability of the accuracy of the corrected model; ② The overall PNP,a and PNP,h of Shendong mining area showed a trend of decreasing first and then recovering gradually, but the PNP of vegetation did not recover to the pre-mining level. The mean values of PNP,h before mining and PNP,h after mining are 21.50 g/m2 and −60.20 g/m2, respectively. PNP,h<0 indicates that PNP vegetation growth in mining areas is disturbed by mining activities, and the degraded mines are mainly distributed in high-intensity mining areas (calculated in C, the same below). ③ The change of PNP value in Shendong mining area from 1996 to 2022 is mainly influenced by climate change and human activities. The proportion of human activities and climate change to ecological degradation is 35.7% and 8.2%, respectively. The \begin{document}${{I}}_{\mathrm{R}\mathrm{C}}$\end{document} from 1996 to 2015 is mainly about 0.5, indicating that coal mining plays a leading role in vegetation degradation. After 2016, the impact of photovoltaic power plant construction on PNP showed a promoting effect. This study is helpful to understand the impact of coal mining on the dynamic change of net primary productivity of vegetation, and provides scientific basis for vegetation restoration and high-quality development in Shendong mining area

Деградація земель у Калуському районі внаслідок сольового забруднення

Показано, що джерелами деградації ґрунтів внаслідок, їх засолення, є солевідвали Домбровського кар’єру. Основними чинниками, що призводять до деградації є вітрова і водна ерозія. Досліджено, що основну роль в засоленні ґрунтового покриву відіграють процеси дифузії. Встановлено, що площа засолення (деградація) ґрунтів у декілька разів перевищує площу солевідводів.Показано, что источниками деградации почв вследствие их засоления, являются солеотвалы Домбровского карьера. Основными факторами, которые приводят к деградации является ветровая и водная эрозия. Доказано, что основную роль в засолении почвенного покрова играют процессы диффузии. Установлено, что площадь засоления (деградация) почв в несколько раз превышает площадь солеотвалов.In the article is shown that the sources of land degradation occurs because of their salinity and salt piles from Dombrowsky career. The main factors that lead to the degradation are wind and water erosion. It is investigated that the main role in the salinity of soil processes play diffusion. It is established that the area of salinity (degradation) of soil several times salt piles are