tSF: Transformer-based Semantic Filter for Few-Shot Learning

Few-Shot Learning (FSL) alleviates the data shortage challenge via embedding discriminative target-aware features among plenty seen (base) and few unseen (novel) labeled samples. Most feature embedding modules in recent FSL methods are specially designed for corresponding learning tasks (e.g., classification, segmentation, and object detection), which limits the utility of embedding features. To this end, we propose a light and universal module named transformer-based Semantic Filter (tSF), which can be applied for different FSL tasks. The proposed tSF redesigns the inputs of a transformer-based structure by a semantic filter, which not only embeds the knowledge from whole base set to novel set but also filters semantic features for target category. Furthermore, the parameters of tSF is equal to half of a standard transformer block (less than 1M). In the experiments, our tSF is able to boost the performances in different classic few-shot learning tasks (about 2% improvement), especially outperforms the state-of-the-arts on multiple benchmark datasets in few-shot classification task

Rethinking the Metric in Few-shot Learning: From an Adaptive Multi-Distance Perspective

Few-shot learning problem focuses on recognizing unseen classes given a few labeled images. In recent effort, more attention is paid to fine-grained feature embedding, ignoring the relationship among different distance metrics. In this paper, for the first time, we investigate the contributions of different distance metrics, and propose an adaptive fusion scheme, bringing significant improvements in few-shot classification. We start from a naive baseline of confidence summation and demonstrate the necessity of exploiting the complementary property of different distance metrics. By finding the competition problem among them, built upon the baseline, we propose an Adaptive Metrics Module (AMM) to decouple metrics fusion into metric-prediction fusion and metric-losses fusion. The former encourages mutual complementary, while the latter alleviates metric competition via multi-task collaborative learning. Based on AMM, we design a few-shot classification framework AMTNet, including the AMM and the Global Adaptive Loss (GAL), to jointly optimize the few-shot task and auxiliary self-supervised task, making the embedding features more robust. In the experiment, the proposed AMM achieves 2% higher performance than the naive metrics fusion module, and our AMTNet outperforms the state-of-the-arts on multiple benchmark datasets

Identification of potential angiogenic biomarkers in human follicular fluid for predicting oocyte maturity

BackgroundAngiogenesis in folliculogenesis contributes to oocyte developmental competence in natural and in vitro fertilization (IVF) cycles. Therefore, the identification of key angiogenic factors in follicular fluid (FF) during folliculogenesis is clinically significant and important for in vitro fertilization. This study aims to identify the key angiogenic factors in FF for predicting oocyte maturity during in vitro fertilization.Materials and methodsForty participants who received ovarian stimulation using a GnRH antagonist protocol in their first in vitro fertilization treatment were recruited. From each patient, two follicular samples (one preovulatory follicle, > 18 mm; one mid-antral follicle, < 14 mm) were collected without flushing during oocyte retrieval. In total, 80 FF samples were collected from 40 patients. The expression profiles of angiogenesis-related proteins in FF were analyzed via Luminex high-performance assays. Recorded patient data included antral follicle count, anti-müllerian hormone, age, and BMI. Serum samples were collected on menstrual cycle day 2, the trigger day, and the day of oocyte retrieval. Hormone concentrations including day 2 FSH/LH/E2/P4, trigger day E2/LH/P4, and retrieval day E2/LH/P4 were measured by chemiluminescence assay.ResultsTen angiogenic factors were highly expressed in FF: eotaxin, Gro-α, IL-8, IP-10, MCP-1, MIG, PAI-1 (Serpin), VEGF-A, CXCL-6, and HGF. The concentrations of eotaxin, IL-8, MCP1, PAI-1, and VEGF-A were significantly higher in preovulatory follicles than those in mid-antral follicles, while the Gro-α and CXCL-6 expressional levels were lower in preovulatory than in mid-antral follicles (p < 0.05). Logistic regression and receiver operating characteristic (ROC) analysis revealed that VEGF-A, eotaxin, and CXCL-6 were the three strongest predictors of oocyte maturity. The combination of VEGF-A and CXCL-6 predicted oocyte maturity with a higher sensitivity (91.7%) and specificity (72.7%) than other combinations.ConclusionOur findings suggest that VEGF-A, eotaxin, and CXCL-6 concentrations in FF strongly correlate with oocyte maturity from the mid-antral to preovulatory stage. The combination of VEGF-A and CXCL-6 exhibits a relatively good prediction rate of oocyte maturity during in vitro fertilization

ANALYSIS OF FACTORS CAUSING WATER DAMAGE TO LOESS DOUBLE-ARCHED TUNNEL BASED ON TFN-AHP

In order to analysis the factors causing water damage to loess double-arched tunnel, this paper conducts field investigation on water damage to tunnels on Lishi-Jundu Expressway in Shanxi, China, confirms its development characteristics, builds an index system (covering 36 evaluation indexes for construction condition, design stage, construction stage, and operation stage) for the factors causing water damage to loess double-arched tunnel, applies TFN-AHP (triangular fuzzy number-analytic hierarchy process) in calculating the weight of indexes at different levels, and obtains the final sequence of weight of the factors causing water seepage to loess double-arched tunnel. It is found out that water damage to loess double-arched tunnel always develops in construction joints, expansion joints, settlement joints, and lining joints of tunnel and even around them; there is dotted water seepage, linear water seepage, and planar water seepage according to the trace and scope of water damage to tunnel lining. The result shows that water damage to loess double-arched tunnel mainly refers to linear water seepage, planar water seepage is also developed well, and partition and equipment box at the entrance and exit of tunnel are prone to water seepage; construction stage is crucial for controlling water damage to loess double-arched tunnel, atmospheric precipitation is the main water source, and the structure defect of double-arched tunnel increases the possibility of water seepage; the final sequence for weight of various factors is similar to the actual result

Comparative evaluation of the diagnosis, reporting and investigation of malaria cases in China, 2005-2014: transition from control to elimination for the national malaria programme

Background: The elimination of malaria requires high-quality surveillance data to enable rapid detection and response to individual cases. Evaluation of the performance of a national malaria surveillance system could identify shortcomings which, if addressed, will improve the surveillance program for malaria elimination.Methods: Case-level data for the period 2005–2014 were extracted from the China National Notifiable Infectious Disease Reporting Information System and Malaria Enhanced Surveillance Information System. The occurrence of cases, accuracy and timeliness of case diagnosis, reporting and investigation, were assessed and compared between the malaria control stage (2005–2010) and elimination stage (2011–2014) in mainland China.Results: A total of 210 730 malaria cases were reported in mainland China in 2005–2014. The average annual incidence declined dramatically from 2.5 per 100 000 people at the control stage to 0.2 per 100 000 at the elimination stage, but the proportion of migrant cases increased from 9.8 % to 41.0 %. Since the initiation of the National Malaria Elimination Programme in 2010, the overall proportion of cases diagnosed by laboratory testing consistently improved, with the highest of 99.0 % in 2014. However, this proportion was significantly lower in non-endemic provinces (79.0 %) than that in endemic provinces (91.4 %) during 2011–2014. The median interval from illness onset to diagnosis was 3 days at the elimination stage, with one day earlier than that at the control stage. Since 2011, more than 99 % cases were reported within 1 day after being diagnosed, while the proportion of cases that were reported within one day after diagnosis was lowest in Tibet (37.5 %). The predominant source of cases reporting shifted from town-level hospitals at the control stage (67.9 % cases) to city-level hospitals and public health institutes at the eliminate stage (69.4 % cases). The proportion of investigation within 3 days after case reporting has improved, from 74.6 % in 2010 to 98.5 % in 2014.Conclusions: The individual case-based malaria surveillance system in China operated well during the malaria elimination stage. This ensured that malaria cases could be diagnosed, reported and timely investigated at local level. However, domestic migrants and overseas populations, as well as cases in the historically malarial non-endemic areas and hard-to-reach area are new challenges in the surveillance for malaria elimination.<br/

On the fairness of the main galaxy sample of SDSS

Flux-limited and volume-limited galaxy samples are constructed from SDSS data releases DR4, DR6 and DR7 for statistical analysis. The two-point correlation functions $\xi(s)$, monopole of three-point correlation functions $\zeta_0$, projected two-point correlation function $w_p$ and pairwise velocity dispersion $\sigma_{12}$ are measured to test if galaxy samples are fair for these statistics. We find that with increment of sky coverage of SDSS, $\xi(s)$ of flux-limited sample is extremely robust and insensitive to local structures at low redshift. But for volume-limited samples fainter than $L^*$ at large scales s>\sim 10\hmpc, deviation of $\xi(s)$ and $\zeta_0$ of DR7 to those of DR4 and DR6 increases with larger absolute magnitude. In the weakly nonlinear regime, there is no agreement between $\zeta_0$ of different data releases in all luminosity bins. Furthermore, $w_p$ of volume-limited samples of DR7 in luminosity bins fainter than $-M_{r,0.1}=[18.5,19.5]$ are significantly larger, and $\sigma_{12}$ of the two faintest volume-limited samples of DR7 display very different scale dependence than results of DR4 and DR6. Our findings call for cautions in understanding clustering analysis results of SDSS faint galaxy samples, and higher order statistics of SDSS volume-limited samples in the weakly nonlinear regime. The first zero-crossing points of $\xi(s)$ of volume-limited samples are also investigated and discussed.Comment: 16 pages, 12 figures, accepte

R-parity violation effect on the top-quark pair production at linear colliders

We investigate in detail the effects of the R-parity lepton number violation in the minimal supersymmetric standard model (MSSM) on the top-quark pair production via both $e^--e^+$ and $\gamma-\gamma$ collision modes at the linear colliders. We find that with the present experimental constrained $\rlap/{R}$ parameters, the effect from $\rlap/{R}$ interactions on the processes $e^+e^-\to t\bar{t}$ and $e^+e^- \to \gamma\gamma \to t\bar{t}$ could be significant and may reach -30% and several percent, respectively. Our results show that the $\rlap/{R}$ effects are sensitive to the c.m.s. energy and the relevant $\rlap/{R}$ parameters. However, they are not sensitive to squark and slepton masses when $m_{\tilde{q}} \geq 400 GeV$ (or $m_{\tilde{l}} \geq 300 GeV$) and are almost independent on the $\tan\beta$Comment: Accepted by Phys.Rev.

Isomeric Effects of Solution Processed Ladderâ Type Nonâ Fullerene Electron Acceptors

Peer Reviewedhttps://deepblue.lib.umich.edu/bitstream/2027.42/138922/1/solr201700107_am.pdfhttps://deepblue.lib.umich.edu/bitstream/2027.42/138922/2/solr201700107-sup-0001-SuppData-S1.pdfhttps://deepblue.lib.umich.edu/bitstream/2027.42/138922/3/solr201700107.pd

Twenty Novel Disease Group-Specific and 12 New Shared Macrophage Pathways in Eight Groups of 34 Diseases Including 24 Inflammatory Organ Diseases and 10 Types of Tumors.

The mechanisms underlying pathophysiological regulation of tissue macrophage (Mφ) subsets remain poorly understood. From the expression of 207 Mφ genes comprising 31 markers for 10 subsets, 45 transcription factors (TFs), 56 immunometabolism enzymes, 23 trained immunity (innate immune memory) enzymes, and 52 other genes in microarray data, we made the following findings. (1) When 34 inflammation diseases and tumor types were grouped into eight categories, there was differential expression of the 31 Mφ markers and 45 Mφ TFs, highlighted by 12 shared and 20 group-specific disease pathways. (2) Mφ in lung, liver, spleen, and intestine (LLSI-Mφ) express higher M1 Mφ markers than lean adipose tissue Mφ (ATMφ) physiologically. (3) Pro-adipogenic TFs C/EBPα and PPARγ and proinflammatory adipokine leptin upregulate the expression of M1 Mφ markers. (4) Among 10 immune checkpoint receptors (ICRs), LLSI-Mφ and bone marrow (BM) Mφ express higher levels of CD274 (PDL-1) than ATMφ, presumably to counteract the M1 dominant status via its reverse signaling behavior. (5) Among 24 intercellular communication exosome mediators, LLSI- and BM- Mφ prefer to use RAB27A and STX3 than RAB31 and YKT6, suggesting new inflammatory exosome mediators for propagating inflammation. (6) Mφ in peritoneal tissue and LLSI-Mφ upregulate higher levels of immunometabolism enzymes than does ATMφ. (7) Mφ from peritoneum and LLSI-Mφ upregulate more trained immunity enzyme genes than does ATMφ. Our results suggest that multiple new mechanisms including the cell surface, intracellular immunometabolism, trained immunity, and TFs may be responsible for disease group-specific and shared pathways. Our findings have provided novel insights on the pathophysiological regulation of tissue Mφ, the disease group-specific and shared pathways of Mφ, and novel therapeutic targets for cancers and inflammations