72 research outputs found
Learning an Effective Context-Response Matching Model with Self-Supervised Tasks for Retrieval-based Dialogues
Building an intelligent dialogue system with the ability to select a proper
response according to a multi-turn context is a great challenging task.
Existing studies focus on building a context-response matching model with
various neural architectures or PLMs and typically learning with a single
response prediction task. These approaches overlook many potential training
signals contained in dialogue data, which might be beneficial for context
understanding and produce better features for response prediction. Besides, the
response retrieved from existing dialogue systems supervised by the
conventional way still faces some critical challenges, including incoherence
and inconsistency. To address these issues, in this paper, we propose learning
a context-response matching model with auxiliary self-supervised tasks designed
for the dialogue data based on pre-trained language models. Specifically, we
introduce four self-supervised tasks including next session prediction,
utterance restoration, incoherence detection and consistency discrimination,
and jointly train the PLM-based response selection model with these auxiliary
tasks in a multi-task manner. By this means, the auxiliary tasks can guide the
learning of the matching model to achieve a better local optimum and select a
more proper response. Experiment results on two benchmarks indicate that the
proposed auxiliary self-supervised tasks bring significant improvement for
multi-turn response selection in retrieval-based dialogues, and our model
achieves new state-of-the-art results on both datasets.Comment: 10 page
Improving Matching Models with Hierarchical Contextualized Representations for Multi-turn Response Selection
In this paper, we study context-response matching with pre-trained
contextualized representations for multi-turn response selection in
retrieval-based chatbots. Existing models, such as Cove and ELMo, are trained
with limited context (often a single sentence or paragraph), and may not work
well on multi-turn conversations, due to the hierarchical nature, informal
language, and domain-specific words. To address the challenges, we propose
pre-training hierarchical contextualized representations, including contextual
word-level and sentence-level representations, by learning a dialogue
generation model from large-scale conversations with a hierarchical
encoder-decoder architecture. Then the two levels of representations are
blended into the input and output layer of a matching model respectively.
Experimental results on two benchmark conversation datasets indicate that the
proposed hierarchical contextualized representations can bring significantly
and consistently improvement to existing matching models for response
selection.Comment: 6 pages, 1 figur
The migration of acetochlor from feed to milk
Acetochlor has been widely used globally for its effective weed control, but the dietary intake of associated residues by people has become a major concern nowadays. Milk is regarded as the best solvent to dissolve pesticides due to its fat-rich characteristic. In this study, we aimed to evaluate the transfer of acetochlor from feed to raw milk. Twenty lactating Australian Holstein cows were randomly chosen and divided into 1 control group and 3 treatment groups, feeding acetochlor at the dosages of 0, 0.45, 1.35 and 4.05 g per day during the treatment period. The concentration of acetochlor residues in raw milk was detected by QuEChERS together with a gas chromatography-mass spectrometry (GC-MS) method. The results showed that the highest concentrations of acetochlor residues in raw milk for the three treatment groups had a positive correlation with the dosage levels and the transfer efficiency of the low dose group was only 0.080%, higher than those of the other two groups. Besides, the national estimated daily intake (NEDI) of acetochlor from milk is 1.67 × 10(−5) mg kg(−1), which is 0.08% of the ADI. Overall, we concluded that the risk of acetochlor residues in milk was low, but high-dose acetochlor had a larger impact on milk quality and low-dose acetochlor had potential risks
Off-line evaluation of indoor positioning systems in different scenarios: the experiences from IPIN 2020 competition
Every year, for ten years now, the IPIN competition has aimed at evaluating real-world indoor localisation systems by testing them in a realistic environment, with realistic movement, using the EvAAL framework. The competition provided a unique overview of the state-of-the-art of systems, technologies, and methods for indoor positioning and navigation purposes. Through fair comparison of the performance achieved by each system, the competition was able to identify the most promising approaches and to pinpoint the most critical working conditions. In 2020, the competition included 5 diverse off-site off-site Tracks, each resembling real use cases and challenges for indoor positioning. The results in terms of participation and accuracy of the proposed systems have been encouraging. The best performing competitors obtained a third quartile of error of 1 m for the Smartphone Track and 0.5 m for the Foot-mounted IMU Track. While not running on physical systems, but only as algorithms, these results represent impressive achievements.Track 3 organizers were supported by the European Union’s Horizon 2020 Research and Innovation programme under the Marie Skłodowska Curie Grant 813278 (A-WEAR: A network for dynamic WEarable Applications with pRivacy constraints), MICROCEBUS (MICINN, ref. RTI2018-095168-B-C55, MCIU/AEI/FEDER UE), INSIGNIA (MICINN ref. PTQ2018-009981), and REPNIN+ (MICINN, ref. TEC2017-90808-REDT). We would like to thanks the UJI’s Library managers and employees for their support while collecting the required datasets for Track 3.
Track 5 organizers were supported by JST-OPERA Program, Japan, under Grant JPMJOP1612.
Track 7 organizers were supported by the Bavarian Ministry for Economic Affairs, Infrastructure, Transport and Technology through the Center for Analytics-Data-Applications (ADA-Center) within the framework of “BAYERN DIGITAL II. ”
Team UMinho (Track 3) was supported by FCT—Fundação para a Ciência e Tecnologia within the R&D Units Project Scope under Grant UIDB/00319/2020, and the Ph.D. Fellowship under Grant PD/BD/137401/2018.
Team YAI (Track 3) was supported by the Ministry of Science and Technology (MOST) of Taiwan under Grant MOST 109-2221-E-197-026.
Team Indora (Track 3) was supported in part by the Slovak Grant Agency, Ministry of Education and Academy of Science, Slovakia, under Grant 1/0177/21, and in part by the Slovak Research and Development Agency under Contract APVV-15-0091.
Team TJU (Track 3) was supported in part by the National Natural Science Foundation of China under Grant 61771338 and in part by the Tianjin Research Funding under Grant 18ZXRHSY00190.
Team Next-Newbie Reckoners (Track 3) were supported by the Singapore Government through the Industry Alignment Fund—Industry Collaboration Projects Grant. This research was conducted at Singtel Cognitive and Artificial Intelligence Lab for Enterprises (SCALE@NTU), which is a collaboration between Singapore Telecommunications Limited (Singtel) and Nanyang Technological University (NTU).
Team KawaguchiLab (Track 5) was supported by JSPS KAKENHI under Grant JP17H01762.
Team WHU&AutoNavi (Track 6) was supported by the National Key Research and Development Program of China under Grant 2016YFB0502202.
Team YAI (Tracks 6 and 7) was supported by the Ministry of Science and Technology (MOST) of Taiwan under Grant MOST 110-2634-F-155-001
- …