Residual Attention Network for Image Classification

In this work, we propose "Residual Attention Network", a convolutional neural network using attention mechanism which can incorporate with state-of-art feed forward network architecture in an end-to-end training fashion. Our Residual Attention Network is built by stacking Attention Modules which generate attention-aware features. The attention-aware features from different modules change adaptively as layers going deeper. Inside each Attention Module, bottom-up top-down feedforward structure is used to unfold the feedforward and feedback attention process into a single feedforward process. Importantly, we propose attention residual learning to train very deep Residual Attention Networks which can be easily scaled up to hundreds of layers. Extensive analyses are conducted on CIFAR-10 and CIFAR-100 datasets to verify the effectiveness of every module mentioned above. Our Residual Attention Network achieves state-of-the-art object recognition performance on three benchmark datasets including CIFAR-10 (3.90% error), CIFAR-100 (20.45% error) and ImageNet (4.8% single model and single crop, top-5 error). Note that, our method achieves 0.6% top-1 accuracy improvement with 46% trunk depth and 69% forward FLOPs comparing to ResNet-200. The experiment also demonstrates that our network is robust against noisy labels.Comment: accepted to CVPR201

IGF-1R Inhibition Induces MEK Phosphorylation to Promote Survival in Colon Carcinomas

The insulin-like growth factor 1 receptor (IGF-1R) governs several signaling pathways for cell proliferation, survival, and anti-apoptosis. Thus, targeting IGF-1R appears as a reasonable rationale for tumor treatment. However, clinical studies showed that inhibition of IGF-1R has very limited efficacy due to the development of resistance to IGF-1R blockade in tumor cells. Here, we discovered that prolonged treatment of colon cancer cells with IGF-1R inhibitors (BMS-754807 and GSK1838705A) stimulates p70 KDa ribosomal protein S6 kinase 1 (p70S6K1) activation, a well-known kinase signaling for cell survival. We also found that p70S6K1 activation by IGF-1R inhibition is independent of K-Ras and PIK3CA mutations that frequently occur in colon cancer. Besides the increased p70S6K1 phosphorylation, the phosphorylation of mitogen-activated protein kinase kinase 1 and 2 (MEK1/2) was elevated in the cells treated with BMS-754807. Interestingly, the increases in MEK1/2 and p70S6K1 phosphorylation were also observed when cells were subjected to the treatment of AKT inhibitor or genetic knockdown of AKT2 but not AKT1, suggesting that AKT2 inhibition stimulates MEK1/2 phosphorylation to activate p70S6K1. Conversely, inhibition of MEK1/2 by MEK1/2 inhibitor (U0126) or knockdown of MEK1 and MEK2 by corresponding mek1 and mek2 siRNA enhanced AKT phosphorylation, indicating mutual inhibition between AKT and MEK. Furthermore, the combination of BMS-754807 and U0126 efficiently decreased the cell viability and increased cleaved caspase 3 and apoptosis in vitro and in vivo. Our data suggest that the treatment of colon tumor cells with IGF-1R inhibitors stimulates p70S6K1 activity via MEK1/2 to promote survival, providing a new strategy for colorectal cancer therapeutics

Multi-Objective Personalized Product Retrieval in Taobao Search

In large-scale e-commerce platforms like Taobao, it is a big challenge to retrieve products that satisfy users from billions of candidates. This has been a common concern of academia and industry. Recently, plenty of works in this domain have achieved significant improvements by enhancing embedding-based retrieval (EBR) methods, including the Multi-Grained Deep Semantic Product Retrieval (MGDSPR) model [16] in Taobao search engine. However, we find that MGDSPR still has problems of poor relevance and weak personalization compared to other retrieval methods in our online system, such as lexical matching and collaborative filtering. These problems promote us to further strengthen the capabilities of our EBR model in both relevance estimation and personalized retrieval. In this paper, we propose a novel Multi-Objective Personalized Product Retrieval (MOPPR) model with four hierarchical optimization objectives: relevance, exposure, click and purchase. We construct entire-space multi-positive samples to train MOPPR, rather than the single-positive samples for existing EBR models.We adopt a modified softmax loss for optimizing multiple objectives. Results of extensive offline and online experiments show that MOPPR outperforms the baseline MGDSPR on evaluation metrics of relevance estimation and personalized retrieval. MOPPR achieves 0.96% transaction and 1.29% GMV improvements in a 28-day online A/B test. Since the Double-11 shopping festival of 2021, MOPPR has been fully deployed in mobile Taobao search, replacing the previous MGDSPR. Finally, we discuss several advanced topics of our deeper explorations on multi-objective retrieval and ranking to contribute to the community.Comment: 9 pages, 4 figures, submitted to the 28th ACM SIGKDD Conference on Knowledge Discovery & Data Minin

Special IR properties of palladium nanoparticles and their aggregations in CO molecular probe infrared spectroscopy

Dispersed Pd nanoparticles (Pd-n) have been synthesized by reducing H2PdCl4 with ethanol, and stabilized using poly(vinylpyrrolidone) (PVP). The Pd-n is applied to the glassy carbon substrate to form a thin film, and then the potential cyclic scanning at 50 mV. s(-1) from -0.25 to 1.25 V was carried out for about 30 min to form the aggregations of Pd-n (Pd-n(ag)). FTIR spectroscopy of both transmission and reflection modes was employed to study CO adsorption on Pd-n and Pd-n(ag) in both solid\liquid and solid\gas; interfaces. It has been revealed that CO adsorption on Pd-n film yields two IR bands near 1964 and 1906 cm(-1), which are assigned to IR absorption of CO bonded on asymmetric and symmetric bridge sites, respectively. In contrast to the IR properties of CO adsorbed on Pd-n, only species of CO bonded on asymmetric bridge sites was determined on Pd-n(ag), and the direction of the IR band near 1963 cm(-1) is completely inverted. The full width at half-maximum (FWHM) of the COBas band near 1964 cm(-1) is measured to be 14 cm(-1) on Pd-n film, while it is 24 cm(-1) on Pd-n(ag) film. The results of the present study demonstrated that the inverting of the IR band direction is a general phenomenon that is closely related to the interaction between nanoparticles in aggregation of Pd-n

Novel Y-chromosomal microdeletions associated with non-obstructive azoospermia uncovered by high throughput sequencing of sequence-tagged sites (STSs)

Y-chromosomal microdeletion (YCM) serves as an important genetic factor in non-obstructive azoospermia (NOA). Multiplex polymerase chain reaction (PCR) is routinely used to detect YCMs by tracing sequence-tagged sites (STSs) in the Y chromosome. Here we introduce a novel methodology in which we sequence 1,787 (post-filtering) STSs distributed across the entire male-specific Y chromosome (MSY) in parallel to uncover known and novel YCMs. We validated this approach with 766 Chinese men with NOA and 683 ethnically matched healthy individuals and detected 481 and 98 STSs that were deleted in the NOA and control group, representing a substantial portion of novel YCMs which significantly influenced the functions of spermatogenic genes. The NOA patients tended to carry more and rarer deletions that were enriched in nearby intragenic regions. Haplogroup O2* was revealed to be a protective lineage for NOA, in which the enrichment of b1/b3 deletion in haplogroup C was also observed. In summary, our work provides a new high-resolution portrait of deletions in the Y chromosome.National Key Scientific Program of China [2011CB944303]; National Nature Science Foundation of China [31271244, 31471344]; Promotion Program for Shenzhen Key Laboratory [CXB201104220045A]; Shenzhen Project of Science and Technology [JCYJ20130402113131202, JCYJ20140415162543017]SCI(E)[email protected]; [email protected]; [email protected]