Once Upon a Time\textit{Time} in Graph\textit{Graph}: Relative-Time Pretraining for Complex Temporal Reasoning

Our physical world is constantly evolving over time, rendering challenges for pre-trained language models to understand and reason over the temporal contexts of texts. Existing work focuses on strengthening the direct association between a piece of text and its time-stamp. However, the knowledge-time association is usually insufficient for the downstream tasks that require reasoning over temporal dependencies between knowledge. In this work, we make use of the underlying nature of time, all temporally-scoped sentences are strung together through a one-dimensional time axis, and suggest creating a graph structure based on the relative placements of events along the time axis. Inspired by the graph view, we propose RemeMo ($\underline{Re}$lative Ti$\underline{me}$ $\underline{Mo}$deling), which explicitly connects all temporally-scoped facts by modeling the time relations between any two sentences. Experimental results show that RemeMo outperforms the baseline T5 on multiple temporal question answering datasets under various settings. Further analysis suggests that RemeMo is especially good at modeling long-range complex temporal dependencies. We release our code and pre-trained checkpoints at $\href{https://github.com/DAMO-NLP-SG/RemeMo}{\text{this url}}$.Comment: EMNLP 2023 mai

Boosting Distributed Machine Learning Training Through Loss-tolerant Transmission Protocol

Distributed Machine Learning (DML) systems are utilized to enhance the speed of model training in data centers (DCs) and edge nodes. The Parameter Server (PS) communication architecture is commonly employed, but it faces severe long-tail latency caused by many-to-one "incast" traffic patterns, negatively impacting training throughput. To address this challenge, we design the \textbf{L}oss-tolerant \textbf{T}ransmission \textbf{P}rotocol (LTP), which permits partial loss of gradients during synchronization to avoid unneeded retransmission and contributes to faster synchronization per iteration. LTP implements loss-tolerant transmission through \textit{out-of-order transmission} and \textit{out-of-order Acknowledges (ACKs)}. LTP employs \textit{Early Close} to adjust the loss-tolerant threshold based on network conditions and \textit{Bubble Filling} for data correction to maintain training accuracy. LTP is implemented by C++ and integrated into PyTorch. Evaluations on a testbed of 8 worker nodes and one PS node demonstrate that LTP can significantly improve DML training task throughput by up to 30x compared to traditional TCP congestion controls, with no sacrifice to final accuracy.Comment: This paper will be published on IWQoS 2023. Preview version onl

Short O-O separation in layered oxide Na0.67CoO2 enables an ultrafast oxygen evolution reaction.

The layered oxide Na0.67CoO2 with Na+ occupying trigonal prismatic sites between CoO2 layers exhibits a remarkably high room temperature oxygen evolution reaction (OER) activity in alkaline solution. The high activity is attributed to an unusually short O-O separation that favors formation of peroxide ions by O--O- interactions followed by O2 evolution in preference to the conventional route through surface O-OH- species. The dependence of the onset potential on the pH of the alkaline solution was found to be consistent with the loss of H+ ions from the surface oxygen to provide surface O- that may either be attacked by solution OH- or react with another O-; a short O-O separation favors the latter route. The role of a strong hybridization of the O-2p and low-spin CoIII/CoIV π-bonding d states is also important; the OER on other CoIII/CoIV oxides is compared with that on Na0.67CoO2 as well as that on IrO2

Mapping the potential distribution of major tick species in China

Ticks are known as the vectors of various zoonotic diseases such as Lyme borreliosis and tick-borne encephalitis. Though their occurrences are increasingly reported in some parts of China, our understanding of the pattern and determinants of ticks’ potential distribution over the country remain limited. In this study, we took advantage of the recently compiled spatial dataset of distribution and diversity of ticks in China, analyzed the environmental determinants of ten frequently reported tick species and mapped the spatial distribution of these species over the country using the MaxEnt model. We found that presence of urban fabric, cropland, and forest in a place are key determents of tick occurrence, suggesting ticks were likely inhabited close to where people live. Besides, precipitation in the driest month was found to have a relatively high contribution in mapping tick distribution. The model projected that theses ticks could be widely distributed in the Northwest, Central North, Northeast, and South China. Our results added new evidence on the potential distribution of a variety of major tick species in China and pinpointed areas with a high potential risk of tick bites and tick-borne diseases for raising public health awareness and prevention response

Microwave-Assisted Thermal Remediation of Diesel Contaminated Soil

Leakage of petroleum products, gasoline and diesel, at gas station had become one of major soil contamination sources in Taiwan. Total number of 154 petroleum contaminated gas stations was successively ascertained since the implementation of Soil and Groundwater Remediation Act in 2002. One of the contaminated gas stations, mainly diesel polluted, was studied for the feasibility of microwave-assisted thermal remediation. The average of total petroleum hydrocarbons (TPHt) in hotspot of this site was 2,845 mg/kg exceeding regulatory limit (1,000 mg/kg). According to the groundwater condition in the site, soil samples treated by microwave radiation with and without water as saturation and vadose zones were respectively tested in laboratory. The results show that a 12-min microwave energy can heat soil with water to reach 235°C and degrade its TPHt to 934 mg/kg; additionally, a 5 min microwave energy can heat soil without water to reach 220°C and degrade its TPHt to 520 mg/kg. Both soil samples passed TPHt regulatory limit and microwave remediation with fast and effective advantages for petroleum products contaminated soil was also verified

The expression profile of microRNAs in a model of 7,12-dimethyl-benz[a]anthrance-induced oral carcinogenesis in Syrian hamster

<p>Abstract</p> <p>Background</p> <p>Non-coding RNA molecules, such as microRNAs, may play an important role in carcinogenesis. Recent studies have indicated that microRNAs are involved in initiation and progression of various malignancies. However, little work has been done to compare the microRNA expression patterns in oral cancer. In this study, we constructed an animal model of oral squamous cell carcinoma to investigate expression profiles of microRNAs in oral carcinogenesis.</p> <p>Methods</p> <p>The animal model of oral squamous cell carcinoma was conducted by tri-weekly (Monday, Wednesday, and Friday) painting with 5% DMBA in acetone. Six Syrian hamsters, including three from the treated group and three from the control group, were used as a training group for microRNA microarray analysis. All microarray data were analyzed by Significance Analysis of Microarrays (SAM) and CLUSTER 3.0 software, and this result was further confirmed by qRT-PCR assay.</p> <p>Results</p> <p>Seventeen microRNAs were differentially expressed in oral squamous cell carcinoma. Five microRNAs (hsa-miR-21, hsa-miR-200b, hsa-miR-221, hsa-miR-338, and mmu-miR-762) were significantly upregulated and twelve microRNAs (hsa-miR-16, hsa-miR-26a, hsa-miR-29a, hsa-miR-124a, hsa-miR-125b, mmu-miR-126-5p, hsa-miR-143, hsa-miR-145, hsa-miR-148b, hsa-miR-155, hsa-miR-199a, and hsa-miR-203) were down-regulated in cancer tissues. The expression levels of hsa-miR-21 and hsa-miR-16 seen with Stem-loop qRT-PCR were also seen in microarray analysis in all samples.</p> <p>Conclusion</p> <p>Our findings identified specific microRNA expression in oral squamous cell carcinoma and suggested that microRNAs have a role in oral carcinogenesis.</p

Genetic characterization and passage instability of a novel hybrid virulence plasmid in a ST23 hypervirulent Klebsiella pneumoniae

Hypervirulent variants of Klebsiella pnuemoniae (hvKP), which causes life-threatening infections, is a global priority pathogen and frequently harbours virulence plasmids. The virulence plasmids have emerged as the predominant vehicles carrying the major pathogenic determinants of hypermucoviscosity and hypervirulence phenotypes. In the present study, we characterized a novel virulence plasmid in AP8555, an ST23 hvKP strain, which induced a metastatic infection and fatal septic shock in a critically ill patient. The serum killing assay, the quantitative biofilm formation assay, the G.mellonella infection model, and the mouse lethality assay demonstrated that AP8555 was almost as virulent as the hvKP strain NUTH-K2044. The plasmid pAP855 could be conjugated to Klebsiella quasipneumoniae ATCC700603 and E. coli J53 at a frequency of 7.2× 10−5 and 8.7× 10−7, respectively. Whole-genome sequencing and bioinformatics analysis confirmed that the plasmid was novel, clustered to the incompatibility type of IncHI1B/IncFIB/IncFII and presented high similarity to the pK2044 plasmid. In contrast, a 130-kb large-fragment insertion was observed on the plasmid, which introduced a genetic hybrid zone with multiple conjugation-related genes of type IV secretion systems (T4SS) and CcdAB toxin-antitoxin systems (TAS) to the plasmid. In the transconjugants, the presence of pAP855 had a negative impact on bacterial fitness, but enhancing the virulence-associated phenotypes. In vitro evolution experiments showed that pAP855 in the transconjugants could not be stably inherited after 10 days of passage. Our study not only reports a novel hybrid plasmid but also highlights the putative pathway of conjugative virulence plasmid formation and evolution by means of genetic rearrangement through sequence insertion. These findings indicate that structural versatility could contribute to the dissemination of cointegrate virulence plasmid, although the plasmid incurred a fitness cost. Therefore, continuous monitoring the acquisition of conjugative virulence plasmids may have critical value for plasmid research and increase awareness of hvKP