Controllable Text Generation with Residual Memory Transformer

Large-scale Causal Language Models (CLMs), e.g., GPT3 and ChatGPT, have brought great success in text generation. However, it is still an open challenge to control the generation process of CLM while balancing flexibility, control granularity, and generation efficiency. In this paper, we provide a new alternative for controllable text generation (CTG), by designing a non-intrusive, lightweight control plugin to accompany the generation of CLM at arbitrary time steps. The proposed control plugin, namely Residual Memory Transformer (RMT), has an encoder-decoder setup, which can accept any types of control conditions and cooperate with CLM through a residual learning paradigm, to achieve a more flexible, general, and efficient CTG. Extensive experiments are carried out on various control tasks, in the form of both automatic and human evaluations. The results show the superiority of RMT over a range of state-of-the-art approaches, proving the effectiveness and versatility of our approach.Comment: github:https://github.com/littlehacker26/Residual_Memory_Transforme

Investigation of the Permeability of Soil-rock Mixtures Using Lattice Boltzmann Simulations

Based on the discrete element method and the proposed virtual slicing technique for three-dimensional discrete element model, random pore-structural models of soil-rock mixtures are constructed and voxelized. Then, the three-dimensional lattice Boltzmann method is introduced to simulate the seepage flow in soil-rock mixtures on the pore scale. Finally, the influences of rock content, rock size, rock shape and rock orientation on the simulated permeability of soil-rock mixtures are comprehensively investigated. The results show that the permeability of soil-rock mixtures remarkably decreases with the increase of rock content. When the other conditions remain unchanged, the permeability of soil-rock mixtures increases with the increase of rock size. The permeability of soil-rock mixtures with bar-shaped rocks is smaller than that of soil-rock mixtures with block-shaped rocks, but larger than that of soil-rock mixtures with slab-shaped rocks. The rock orientation has a certain influence on the permeability of SRMs, and the amount of variation changes with the rock shape: when the rocks are bar-shaped, the permeability is slightly decreased as the major axes of these rocks change from parallel to perpendicular with respect to the direction of main flow; when the rocks are slab-shaped, the permeability decreases more significantly as the slab planes of these rocks change from parallel to perpendicular with respect to the direction of main flow

NH2+ implantations induced superior hemocompatibility of carbon nanotubes

NH(2)(+) implantation was performed on multiwalled carbon nanotubes (MWCNTs) prepared by chemical vapor deposition. The hemocompatibility of MWCNTs and NH(2)(+)-implanted MWCNTs was evaluated based on in vitro hemolysis, platelet adhesion, and kinetic-clotting tests. Compared with MWCNTs, NH(2)(+)-implanted MWCNTs displayed more perfect platelets and red blood cells in morphology, lower platelet adhesion rate, lower hemolytic rate, and longer kinetic blood-clotting time. NH(2)(+)-implanted MWCNTs with higher fluency of 1 × 10(16) ions/cm(2) led to the best thromboresistance, hence desired hemocompatibility. Fourier transfer infrared and X-ray photoelectron spectroscopy analyses showed that NH(2)(+) implantation caused the cleavage of some pendants and the formation of some new N-containing functional groups. These results were responsible for the enhanced hemocompatibility of NH(2)(+)-implanted MWCNTs

Elucidation of the 1-phenethylisoquinoline pathway from an endemic conifer Cephalotaxus hainanensis

Cephalotaxines harbor great medical potential, but their natural source, the endemic conifer Cephalotaxus is highly endangered, creating a conflict between biotechnological valorization and preservation of biodiversity. Here, we construct the whole biosynthetic pathway to the 1-phenethylisoquinoline scaffold, as first committed compound for phenylethylisoquinoline alkaloids (PIAs), combining metabolic modeling, and transcriptome mining of Cephalotaxus hainanensis to infer the biosynthesis for PIA precursor. We identify a novel protein, ChPSS, driving the Pictet–Spengler condensation and show that this enzyme represents the branching point where PIA biosynthesis diverges from the concurrent benzylisoquinoline-alkaloids pathway. We also pinpoint ChDBR as crucial step to form 4-hydroxydihydrocinnamaldehyde diverging from lignin biosynthesis. The elucidation of the early PIA pathway represents an important step toward microbe-based production of these pharmaceutically important alkaloids resolving the conflict between biotechnology and preservation of biodiversity

Mitigating heat-related mortality risk in Shanghai, China: system dynamics modeling simulations

Numerous studies in epidemiology, meteorology, and climate change research have demonstrated a significant association between abnormal ambient temperature and mortality. However, there is a shortage of research attention to a systematic assessment of potential mitigation measures which could effectively reduce the heat-related morbidity and mortality risks. This study first illustrates a conceptualization of a systems analysis version of urban framework for climate service (UFCS). It then constructs a system dynamics (SD) model for the UFCS and employs this model to quantify the impacts of heat waves on public health system in Shanghai and to evaluate the performances of two mitigation measures in the context of a real heat wave event in July 2013 in the city. Simulation results show that in comparison with the baseline without mitigation measures, if the hospital system could prepare 20% of beds available for emergency response to heat waves once receiving the warning in advance, the number of daily deaths could be reduced by 40–60 (15.8–19.5%) on the 2 days of day 7 and day 8; if increasing the minimum living allowance of 790 RMB/month in 2013 by 20%, the number of daily deaths could be reduced by 50–70 (17.7–21.9%) on the 2 days of day 8 and day 12. This tool can help policy makers systematically evaluate adaptation and mitigation options based on performance assessment, thus strengthening urban resilience to changing climate