Ask Question First for Enhancing Lifelong Language Learning

Lifelong language learning aims to stream learning NLP tasks while retaining knowledge of previous tasks. Previous works based on the language model and following data-free constraint approaches have explored formatting all data as "begin token (\textit{B}) + context (\textit{C}) + question (\textit{Q}) + answer (\textit{A})" for different tasks. However, they still suffer from catastrophic forgetting and are exacerbated when the previous task's pseudo data is insufficient for the following reasons: (1) The model has difficulty generating task-corresponding pseudo data, and (2) \textit{A} is prone to error when \textit{A} and \textit{C} are separated by \textit{Q} because the information of the \textit{C} is diminished before generating \textit{A}. Therefore, we propose the Ask Question First and Replay Question (AQF-RQ), including a novel data format "\textit{BQCA}" and a new training task to train pseudo questions of previous tasks. Experimental results demonstrate that AQF-RQ makes it easier for the model to generate more pseudo data that match corresponding tasks, and is more robust to both sufficient and insufficient pseudo-data when the task boundary is both clear and unclear. AQF-RQ can achieve only 0.36\% lower performance than multi-task learning.Comment: This paper has been accepted for publication at COLING 202

Investigating word length effects in Chinese reading

A word’s length in English is fundamental in determining whether readers fixate it, and how long they spend processing it during reading. Chinese is unspaced and most words are two characters long: Is word length an important cue to eye guidance in Chinese reading? Eye movements were recorded as participants read sentences containing a one-, two-, or three-character word matched for frequency. Results showed that longer words took longer to process (primarily driven by refixations). Furthermore, skips were fewer, incoming saccades longer and landing positions further to the right of long than short words. Additional analyses of a three-character region (matched stroke number) showed an incremental processing cost when character(s) belonged to different, rather than the same, word. These results demonstrate that word length affects both lexical identification and saccade target selection in Chinese reading

Deep Generative Modeling for Financial Time Series with Application in VaR: A Comparative Review

In the financial services industry, forecasting the risk factor distribution conditional on the history and the current market environment is the key to market risk modeling in general and value at risk (VaR) model in particular. As one of the most widely adopted VaR models in commercial banks, Historical simulation (HS) uses the empirical distribution of daily returns in a historical window as the forecast distribution of risk factor returns in the next day. The objectives for financial time series generation are to generate synthetic data paths with good variety, and similar distribution and dynamics to the original historical data. In this paper, we apply multiple existing deep generative methods (e.g., CGAN, CWGAN, Diffusion, and Signature WGAN) for conditional time series generation, and propose and test two new methods for conditional multi-step time series generation, namely Encoder-Decoder CGAN and Conditional TimeVAE. Furthermore, we introduce a comprehensive framework with a set of KPIs to measure the quality of the generated time series for financial modeling. The KPIs cover distribution distance, autocorrelation and backtesting. All models (HS, parametric and neural networks) are tested on both historical USD yield curve data and additional data simulated from GARCH and CIR processes. The study shows that top performing models are HS, GARCH and CWGAN models. Future research directions in this area are also discussed

Overseas Returnees’ Entrepreneurial Competency and Personality Research

Overseas returnees who start or will start business in China is the key point of current overseas talent introduction work in China. However, during the overseas talent introducing process, it can be found out that the government has paid too much attention on talents’ “skills” but not their “competency” in entrepreneurship. This research constructs overseas returnees’ entrepreneurial competency model and ideal profile chart of their personality by doing research upon Wuxi city’s “530” overseas returnees who establish businesses in China. This research carries through BEI interviews and personality test on 43 overseas returnees and also does questionnaire surveys for 110 overseas returnees. Therefore, this research has developed the overseas returnees’ entrepreneurial competency assessment scale and also gives out related suggestions on the application of overseas returnees’ entrepreneurial competency model and ideal profile chart at last.Key words: Overseas talents; Entrepreneur; Competency; Personalit

Giant thermal transport tuning at a metal/ferroelectric interface

Interfacial thermal transport plays a prominent role in the thermal management of nanoscale objects and is of fundamental importance for basic research and nanodevices. At metal/insulator interfaces, a configuration commonly found in electronic devices, heat transport strongly depends upon the effective energy transfer from thermalized electrons in the metal to the phonons in the insulator. However, the mechanism of interfacial electron–phonon coupling and thermal transport at metal/insulator interfaces is not well understood. Here, the observation of a substantial enhancement of the interfacial thermal resistance and the important role of surface charges at the metal/ferroelectric interface in an Al/BiFeO3 membrane are reported. By applying uniaxial strain, the interfacial thermal resistance can be varied substantially (up to an order of magnitude), which is attributed to the renormalized interfacial electron–phonon coupling caused by the charge redistribution at the interface due to the polarization rotation. These results imply that surface charges at a metal/insulator interface can substantially enhance the interfacial electron–phonon-mediated thermal coupling, providing a new route to optimize the thermal transport performance in next-generation nanodevices, power electronics, and thermal logic devices.Peer ReviewedPostprint (author's final draft

Word length and frequency effects in natural Chinese reading: Evidence for character representations in lexical identification

Word length and frequency are two of the “big three” factors that affect eye movements in natural reading (Clifton et al., 2016). Whilst these factors have been extensively investigated, all previous studies manipulating word length have been confounded with changes in visual complexity (longer words have more letters and are more visually complex). We controlled stroke complexity across one-character (short) and two-character (long) high- and low-frequency Chinese words (to avoid complexity confounds) and recorded readers’ eye movements during sentence reading. Both word length and frequency yielded strong main effects for fixation time measures. For saccadic targeting and skipping probability, word length effects, but not word frequency effects, occurred. Critically, the interaction was not significant regardless of stroke complexity, indicating that word length and frequency independently influence lexical identification and saccade target selection during Chinese reading. The results provide evidence for character level representations during Chinese word recognition in natural reading

Cryptopleurine Targets NF-κB Pathway, Leading to Inhibition of Gene Products Associated with Cell Survival, Proliferation, Invasion, and Angiogenesis

Cryptopleurine, a phenanthroquinolizidine alkaloid, was known to exhibit anticancer activity; however, the underlying mechanism is poorly understood. Because the nuclear factor-κB (NF-κB) transcription factors control many physiological processes including inflammation, immunity, and development and progression of cancer, we investigated the effects of cryptopleurine on tumor necrosis factor alpha (TNF-α)-induced NF-κB activation pathway and on the expression of NF-κB-regulated gene products associated with many pathophysiological processes.MDA-MB231, MDA-MB435, MCF-7, HEK293, RAW264.7 and Hep3B cells were used to examine cryptopleurine's effect on the NF-κB activation pathway. Major assays were promoter-reporter gene assay, electrophoretic mobility shift assay (EMSA), in vitro immune complex kinase assay, real-time PCR, Western blot analysis, and Matrigel invasion assay. Experiments documenting cell proliferation and apoptosis were analyzed by MTT method and flow cytometry, respectively. The results indicated that cryptopleurine suppressed the NF-κB activation through the inhibition of IκB kinase (IKK) activation, thereby blocking the phosphorylation and degradation of the inhibitor of NF-κB alpha (IκBα) and the nuclear translocation and DNA-binding activity of p65. The suppression of NF-κB by cryptopleurine led to the down-regulation of gene products involved in inflammation, cell survival, proliferation, invasion, and angiogenesis.Our results show that cryptopleurine inhibited NF-κB activation pathway, which leads to inhibition of inflammation, proliferation, and invasion, as well as potentiation of apoptosis. Our findings provide a new insight into the molecular mechanisms and a potential application of cryptopleurine for inflammatory diseases as well as certain cancers associated with abnormal NF-κB activation