On Task-Adaptive Pretraining for Dialogue Response Selection

Recent advancements in dialogue response selection (DRS) are based on the \textit{task-adaptive pre-training (TAP)} approach, by first initializing their model with BERT~\cite{devlin-etal-2019-bert}, and adapt to dialogue data with dialogue-specific or fine-grained pre-training tasks. However, it is uncertain whether BERT is the best initialization choice, or whether the proposed dialogue-specific fine-grained learning tasks are actually better than MLM+NSP. This paper aims to verify assumptions made in previous works and understand the source of improvements for DRS. We show that initializing with RoBERTa achieve similar performance as BERT, and MLM+NSP can outperform all previously proposed TAP tasks, during which we also contribute a new state-of-the-art on the Ubuntu corpus. Additional analyses shows that the main source of improvements comes from the TAP step, and that the NSP task is crucial to DRS, different from common NLU tasks.Comment: 6 pages, 4 figure

Transcutaneous Electrical Stimulation of Acupoints Changes Body Composition and Heart Rate Variability in Postmenopausal Women with Obesity

This study aimed to evaluate the effect of transcutaneous electric acupoint stimulations (TEAS) on body composition and heart rate variability (HRV) in postmenopausal women with obesity. In this prospective study, 49 postmenopausal women were recruited in Taiwan. Body composition was used as a screening test for obesity (percentage body fat > 30%, waist circumference > 80 cm). The experimental group (n = 24) received TEAS treatment 30 min twice per week for 12 weeks at the Zusanli (ST 36) and Sanyinjiao (SP 6) acupoints. The control group (n = 25) did not receive any intervention. The study of HRV was analyzed by time (standard deviation of the normal-to-normal (NN) intervals (SDNN) and square root of the mean squared differences of successive NN intervals (RMSSD) indices) and frequency domain methods. Power spectral components were obtained at low (LF) and high (HF) frequencies. Body composition and HRV values were measured at the 4th, 8th, and 12th weeks. A total of 40 subjects completed this study. Waist circumference and percentage body fat in the experimental group (n = 20) were significantly less than those of the control group (n = 20) at the 8th and 12th weeks (all P < .05). Additionally, at the same time points, percentage lean body mass in the experimental group was significantly greater than that in the control group (P < .05). SDNN values increased significantly at the 4th and 8th weeks when compared with the control group (all P < .05). At 12 weeks, SDNN value was not significantly different from that of the control group (P = .105). TEAS treatment improves body composition, and has a transient effect on the HRV in postmenopausal women with obesity

Unusual dyspnea in a hemodialysis patient: A case report

The typical clinical symptoms of hemothorax include a rapid development of chest pain or dyspnea, which may be life-threatening without immediate management. As we know, spontaneous hemothorax, a collection of blood within the pleural cavity without previous history of trauma or other cause, which usually onsets suddenly. The early and accurate diagnosis of spontaneous hemothorax is imperative in clinical practice. We reported a middle-age male undergoing regular hemodialysis was referred to our emergency department due to unknown cause of dyspnea and acute respiratory failure. Chest radiography revealed bilateral patchy infiltration of lung. Pleural tap analysis showed exudative pleural effusion with numerous red blood cells. Video-assisted thoracic surgery (VATS) were performed and confirmed the final diagnosis of spontaneous hemothorax. He was then successfully treated with the surgery of VATS combined chest tube thoracostomy

A correlation among safety leadership, safety climate and safety performance.

Abstract There has not been much consensus on the causality of safety climates in the past 25 years. Moreover, there is an overall lack of models specifying the relationship among safety leadership, safety climate and safety performance. On the grounds of social system theory, this study has investigated the potential correlation among them. Self-administered questionnaires that included a safety leadership scale, a safety climate scale and a safety performance scale were used to collect data in four universities in central Taiwan. The survey was conducted among 754 subjects selected via simple random sampling. The number of returned valid questionnaires was 465, and the response rate was 61.67%. Path analysis showed that safety climate partially mediated the relationship between safety leadership and safety performance. Canonical correlation analysis showed that safety controlling, one factor of safety leadership, had main influence on CEOs and managers&apos; safety commitment and action in safety climate, and on safety organization and management, safety equipment and measures, and accident investigations in safety performance. The results of the statistical analysis indicated that organizational leaders would do well to develop a strategy by which they improve the safety climates within their organizations, which will then have a positive effect on safety performance.

RISK OF SLEEP DISORDERS IN PATIENTS WITH DECOMPRESSION SICKNESS: A NATIONWIDE, POPULATION-BASED STUDY IN TAIWAN

Background: Decompression sickness (DCS) primarily manifests musculoskeletal pain, cutaneous manifestations, lymphatic symptoms, and neurological symptoms. DCS might affect the central nervous system and induce the stress in the patients, but few studies about the psychiatric morbidity after DCS have been conducted. This study aimed to investigate the association between DCS and the risk of developing psychiatric disorders. Subjects and methods: This study was a population-based, matched cohort design. A total of 738 enrolled patients, with 123 study subjects who had suffered from DCS, and 615 controls matched for sex and age, from the Longitudinal Health Insurance Databank from 2000-2010 in Taiwan, and selected from the National Health Insurance Research Database. After adjusting for the confounding factors, Cox proportional hazards analysis was used to compare the risk of developing psychiatric disorders during the 10 years of follow-up period. Results: Of the study subjects, 10 (8.13%) developed psychiatric disorders when compared to 35 (5.69%) in the control group. The study subjects were more likely to develop psychiatric disorders (crude hazard ratio [HR]: 2.79 (95% CI=1.37-5.69, P<0.01). After adjusting for sex, age, monthly income, urbanization level, geographic region, and comorbidities, the adjusted HR was 3.83 (95% CI=1.60-9.16, P<0.01). Sleep disorders was associated with DCS with the adjusted HR as 5.74 (95% CI=1.04-31.56, P<0.01). Hyperbaric oxygenation therapy was not associated with a lower risk of psychiatric disorders. Conclusions: Patients who suffered from DCS have a 3.8-fold risk of developing psychiatric disorders, and a 5.7-fold risk of sleep disorders. This finding is a reminder for the clinicians that a regular psychiatric follow-up might well be needed for these patients

Phosphorous Diffuser Diverged Blue Laser Diode for Indoor Lighting and Communication.

An advanced light-fidelity (Li-Fi) system based on the blue Gallium nitride (GaN) laser diode (LD) with a compact white-light phosphorous diffuser is demonstrated for fusing the indoor white-lighting and visible light communication (VLC). The phosphorous diffuser adhered blue GaN LD broadens luminescent spectrum and diverges beam spot to provide ample functionality including the completeness of Li-Fi feature and the quality of white-lighting. The phosphorous diffuser diverged white-light spot covers a radiant angle up to 120(o) with CIE coordinates of (0.34, 0.37). On the other hand, the degradation on throughput frequency response of the blue LD is mainly attributed to the self-feedback caused by the reflection from the phosphor-air interface. It represents the current state-of-the-art performance on carrying 5.2-Gbit/s orthogonal frequency-division multiplexed 16-quadrature-amplitude modulation (16-QAM OFDM) data with a bit error rate (BER) of 3.1 × 10(-3) over a 60-cm free-space link. This work aims to explore the plausibility of the phosphorous diffuser diverged blue GaN LD for future hybrid white-lighting and VLC systems

Electroconvulsive Therapy and Risk of Dementia—A Nationwide Cohort Study in Taiwan

Background: Electroconvulsive therapy (ECT) is an effective treatment for schizophrenia, bipolar disorder, and major depressive disorder, and a temporary memory loss may occur after ECT. However, the association between ECT in patients with schizophrenia, bipolar disorder, and major depressive disorder, and the risk of dementia is yet to be examined.Objective: This study aimed to clarify as to whether ECT is associated with the risk of dementia after ECT in patients with schizophrenia, bipolar disorder, and major depressive disorder, using Taiwan's National Health Insurance Research Database (NHIRD).Methods: A total of 3,796 enrolled participants (schizophrenia, 46.68%; bipolar disorder, 11.77%; and major depressive disorder, 41.55%) with 994 patients who had received ECT and 2,982 controls matched for sex and age, between January 1, and December 31, 2000, were selected from the NHIRD. After adjusting for confounding factors, Fine and Gray's survival analysis was used to compare the risk of developing dementia during the 10 years of follow-up.Results: Of the study patients, 45 (4.53%) of them developed dementia when compared to 149 (5.0%) in the control group. Fine and Gray's survival analysis revealed that the study patients were not associated with an increased risk of dementia [hazard ratio (HR) = 0.612, 95% confidence interval (CI) = 0.438–1.854, P = 0.325]. After adjusting for sex, age, monthly income, urbanization level, geographic region, and comorbidities, the adjusted HR was 0.633 (95% CI = 0.448 – 1.895, P = 0.304).Conclusion: This study supports that ECT was not associated with the increased risk of dementia in patients with schizophrenia, bipolar disorder, and major depressive disorder, using the NHIRD

Ample Pairs

We show that the ample degree of a stable theory with trivial forking is preserved when we consider the corresponding theory of belles paires, if it exists. This result also applies to the theory of $H$-structures of a trivial theory of rank $1$.Comment: Research partially supported by the program MTM2014-59178-P. The second author conducted research with support of the programme ANR-13-BS01-0006 Valcomo. The third author would like to thank the European Research Council grant 33882