62 research outputs found
DIANet: Dense-and-Implicit Attention Network
Attention networks have successfully boosted the performance in various
vision problems. Previous works lay emphasis on designing a new attention
module and individually plug them into the networks. Our paper proposes a
novel-and-simple framework that shares an attention module throughout different
network layers to encourage the integration of layer-wise information and this
parameter-sharing module is referred as Dense-and-Implicit-Attention (DIA)
unit. Many choices of modules can be used in the DIA unit. Since Long Short
Term Memory (LSTM) has a capacity of capturing long-distance dependency, we
focus on the case when the DIA unit is the modified LSTM (refer as DIA-LSTM).
Experiments on benchmark datasets show that the DIA-LSTM unit is capable of
emphasizing layer-wise feature interrelation and leads to significant
improvement of image classification accuracy. We further empirically show that
the DIA-LSTM has a strong regularization ability on stabilizing the training of
deep networks by the experiments with the removal of skip connections or Batch
Normalization in the whole residual network. The code is released at
https://github.com/gbup-group/DIANet
Instance Enhancement Batch Normalization: an Adaptive Regulator of Batch Noise
Batch Normalization (BN)(Ioffe and Szegedy 2015) normalizes the features of
an input image via statistics of a batch of images and hence BN will bring the
noise to the gradient of the training loss. Previous works indicate that the
noise is important for the optimization and generalization of deep neural
networks, but too much noise will harm the performance of networks. In our
paper, we offer a new point of view that self-attention mechanism can help to
regulate the noise by enhancing instance-specific information to obtain a
better regularization effect. Therefore, we propose an attention-based BN
called Instance Enhancement Batch Normalization (IEBN) that recalibrates the
information of each channel by a simple linear transformation. IEBN has a good
capacity of regulating noise and stabilizing network training to improve
generalization even in the presence of two kinds of noise attacks during
training. Finally, IEBN outperforms BN with only a light parameter increment in
image classification tasks for different network structures and benchmark
datasets
4-(2-ChloroÂethoxy)phthalonitrile
In the title compound, C10H7ClN2O, the O and both C atoms of the chloroethoxy group are disordered over two positions, the occupancy factor of the major disorder component refining to 0.54 (2)
Enhanced daytime secondary aerosol formation driven by gas-particle partitioning in downwind urban plumes
Anthropogenic emissions from city clusters can significantly enhance secondary organic aerosol (SOA) formation in the downwind regions, while the mechanism is poorly understood. To investigate the effect of pollutants within urban plumes on organic aerosol (OA) evolution, a field campaign was conducted at a downwind site of the Pearl River Delta region of China in the fall of 2019. A time-of-flight chemical ionization mass spectrometer coupled with a Filter Inlet for Gases and Aerosol (FIGAERO-CIMS) was used to probe the gas- and particle-phase molecular composition and thermograms of organic compounds. For air masses influenced by urban pollution, strong daytime SOA formation through gas-particle partitioning was observed, resulting in higher OA volatility. The obvious SOA enhancement was mainly attributed to the equilibrium partitioning of non-condensable (C * ≥ 100.5 μg m-3) organic vapors. We speculated that the elevated NOx concentration could suppress the formation of highly oxidized products, resulting in a smooth increase of condensable (C * < 100.5 μg m-3) organic vapors. Evidence showed that urban pollutants (NOx and VOCs) could enhance the oxidizing capacity, while the elevated VOCs was mainly responsible for promoting daytime SOA formation by increasing the RO2 production rate. Our results highlight the important role of urban anthropogenic pollutants in SOA control in the suburban region
Lymphoma endothelium preferentially expresses Tim-3 and facilitates the progression of lymphoma by mediating immune evasion
Angiogenesis is increasingly recognized as an important prognosticator associated with the progression of lymphoma and as an attractive target for novel modalities. We report a previously unrecognized mechanism by which lymphoma endothelium facilitates the growth and dissemination of lymphoma by interacting with circulated T cells and suppresses the activation of CD4+ T cells. Global gene expression profiles of microdissected endothelium from lymphoma and reactive lymph nodes revealed that T cell immunoglobulin and mucin domain–containing molecule 3 (Tim-3) was preferentially expressed in lymphoma-derived endothelial cells (ECs). Clinically, the level of Tim-3 in B cell lymphoma endothelium was closely correlated to both dissemination and poor prognosis. In vitro, Tim-3+ ECs modulated T cell response to lymphoma surrogate antigens by suppressing activation of CD4+ T lymphocytes through the activation of the interleukin-6–STAT3 pathway, inhibiting Th1 polarization, and providing protective immunity. In a lymphoma mouse model, Tim-3–expressing ECs promoted the onset, growth, and dissemination of lymphoma by inhibiting activation of CD4+ T cells and Th1 polarization. Our findings strongly argue that the lymphoma endothelium is not only a vessel system but also a functional barrier facilitating the establishment of lymphoma immune tolerance. These findings highlight a novel molecular mechanism that is a potential target for enhancing the efficacy of tumor immunotherapy and controlling metastatic diseases
Cassava genome from a wild ancestor to cultivated varieties
Cassava is a major tropical food crop in the Euphorbiaceae family that has high carbohydrate production potential and adaptability to diverse environments. Here we present the draft genome sequences of a wild ancestor and a domesticated variety of cassava and comparative analyses with a partial inbred line. We identify 1,584 and 1,678 gene models specific to the wild and domesticated varieties, respectively, and discover high heterozygosity and millions of single-nucleotide variations. Our analyses reveal that genes involved in photosynthesis, starch accumulation and abiotic stresses have been positively selected, whereas those involved in cell wall biosynthesis and secondary metabolism, including cyanogenic glucoside formation, have been negatively selected in the cultivated varieties, reflecting the result of natural selection and domestication. Differences in microRNA genes and retrotransposon regulation could partly explain an increased carbon flux towards starch accumulation and reduced cyanogenic glucoside accumulation in domesticated cassava. These results may contribute to genetic improvement of cassava through better understanding of its biology
Soluble polyimides based on a novel pyridine-containing diamine m,p-PAPP and various aromatic dianhydrides
Uncertainty of the Soil–Water Characteristic Curve and Its Effects on Slope Seepage and Stability Analysis under Conditions of Rainfall Using the Markov Chain Monte Carlo Method
It is important to determine the soil–water characteristic curve (SWCC) for analyzing slope seepage and stability under the conditions of rainfall. However, SWCCs exhibit high uncertainty because of complex influencing factors, which has not been previously considered in slope seepage and stability analysis under conditions of rainfall. This study aimed to evaluate the uncertainty of the SWCC and its effects on the seepage and stability analysis of an unsaturated soil slope under conditions of rainfall. The SWCC model parameters were treated as random variables. An uncertainty evaluation of the parameters was conducted based on the Bayesian approach and the Markov chain Monte Carlo (MCMC) method. Observed data from granite residual soil were used to test the uncertainty of the SWCC. Then, different confidence intervals for the model parameters of the SWCC were constructed. The slope seepage and stability analysis under conditions of rainfall with the SWCC of different confidence intervals was investigated using finite element software (SEEP/W and SLOPE/W). The results demonstrated that SWCC uncertainty had significant effects on slope seepage and stability. In general, the larger the percentile value, the greater the reduction of negative pore-water pressure in the soil layer and the lower the safety factor of the slope. Uncertainties in the model parameters of the SWCC can lead to obvious errors in predicted pore-water pressure profiles and the estimated safety factor of the slope under conditions of rainfall
DIANet: Dense-and-Implicit Attention Network
Attention networks have successfully boosted the performance in various vision problems. Previous works lay emphasis on designing a new attention module and individually plug them into the networks. Our paper proposes a novel-and-simple framework that shares an attention module throughout different network layers to encourage the integration of layer-wise information and this parameter-sharing module is referred to as Dense-and-Implicit-Attention (DIA) unit. Many choices of modules can be used in the DIA unit. Since Long Short Term Memory (LSTM) has a capacity of capturing long-distance dependency, we focus on the case when the DIA unit is the modified LSTM (called DIA-LSTM). Experiments on benchmark datasets show that the DIA-LSTM unit is capable of emphasizing layer-wise feature interrelation and leads to significant improvement of image classification accuracy. We further empirically show that the DIA-LSTM has a strong regularization ability on stabilizing the training of deep networks by the experiments with the removal of skip connections (He et al. 2016a) or Batch Normalization (Ioffe and Szegedy 2015) in the whole residual network
- …