Self-Paced Learning: an Implicit Regularization Perspective

Self-paced learning (SPL) mimics the cognitive mechanism of humans and animals that gradually learns from easy to hard samples. One key issue in SPL is to obtain better weighting strategy that is determined by minimizer function. Existing methods usually pursue this by artificially designing the explicit form of SPL regularizer. In this paper, we focus on the minimizer function, and study a group of new regularizer, named self-paced implicit regularizer that is deduced from robust loss function. Based on the convex conjugacy theory, the minimizer function for self-paced implicit regularizer can be directly learned from the latent loss function, while the analytic form of the regularizer can be even known. A general framework (named SPL-IR) for SPL is developed accordingly. We demonstrate that the learning procedure of SPL-IR is associated with latent robust loss functions, thus can provide some theoretical inspirations for its working mechanism. We further analyze the relation between SPL-IR and half-quadratic optimization. Finally, we implement SPL-IR to both supervised and unsupervised tasks, and experimental results corroborate our ideas and demonstrate the correctness and effectiveness of implicit regularizers.Comment: 12 pages, 3 figure

Integrating remote sensing, GIS and dynamic models for landscape-level simulation of forest insect disturbance

Cellular automata (CA) is a powerful tool for modeling the evolution of macroscopic scale phenomena as it couples time, space, and variables together while remaining in a simplified form. However, such application has remained challenging in forest insect epidemics due to the highly dynamic nature of insect behavior. Recent advances in temporal trajectory-based image analysis offer an alternative way to obtain high-frequency model calibration data. In this study, we propose an insect-CA modeling framework that integrates cellular automata, remote sensing, and Geographic Information System to understand the insect ecological processes, and tested it with measured data of mountain pine beetle (MPB) in the Rocky Mountains. The overall accuracy of the predicted MPB mortality pattern in the test years ranged from 88% to 94%, which illuminates its effectiveness in modeling forest insect dynamics. We further conducted sensitivity analysis to examine responses of model performance to various parameter settings. In our case, the ensemble random forest algorithm outperforms the traditional linear regression in constructing the suitability surface. Small neighborhood size is more effective in simulating the MPB movement behavior, indicating that short-distance is the dominating dispersal mode of MPB. The introduction of a stochastic perturbation component did not improve the model performance after testing a broad range of randomness degree, reflecting a relative compact dispersal pattern rather than isolated outbreaks. We conclude that CA with remote sensing observation is useful for landscape insect movement analyses;however, consideration of several key parameters is critical in the modeling process and should be more thoroughly investigated in future work

A Large-scale Multiple-objective Method for Black-box Attack against Object Detection

Recent studies have shown that detectors based on deep models are vulnerable to adversarial examples, even in the black-box scenario where the attacker cannot access the model information. Most existing attack methods aim to minimize the true positive rate, which often shows poor attack performance, as another sub-optimal bounding box may be detected around the attacked bounding box to be the new true positive one. To settle this challenge, we propose to minimize the true positive rate and maximize the false positive rate, which can encourage more false positive objects to block the generation of new true positive bounding boxes. It is modeled as a multi-objective optimization (MOP) problem, of which the generic algorithm can search the Pareto-optimal. However, our task has more than two million decision variables, leading to low searching efficiency. Thus, we extend the standard Genetic Algorithm with Random Subset selection and Divide-and-Conquer, called GARSDC, which significantly improves the efficiency. Moreover, to alleviate the sensitivity to population quality in generic algorithms, we generate a gradient-prior initial population, utilizing the transferability between different detectors with similar backbones. Compared with the state-of-art attack methods, GARSDC decreases by an average 12.0 in the mAP and queries by about 1000 times in extensive experiments. Our codes can be found at https://github.com/LiangSiyuan21/ GARSDC.Comment: 14 pages, 5 figures, ECCV202

Improving winter wheat yield estimation by assimilation of the leaf area index from Landsat TM and MODIS data into the WOFOST model

To predict regional-scale winter wheat yield, we developed a crop model and data assimilation framework that assimilated leaf area index (LAI) derived from Landsat TM and MODIS data into the WOFOST crop growth model. We measured LAI during seven phenological phases in two agricultural cities in China’s Hebei Province. To reduce cloud contamination, we applied Savitzky–Golay (S–G) filtering to the MODIS LAI products to obtain a filtered LAI. We then regressed field-measured LAI on Landsat TM vegetation indices to derive multi-temporal TM LAIs. We developed a nonlinear method to adjust LAI by accounting for the scale mismatch between the remotely sensed data and the model’s state variables. The TM LAI and scale-adjusted LAI datasets were assimilated into the WOFOST model to allow evaluation of the yield estimation accuracy. We constructed a four-dimensional variational data assimilation (4DVar) cost function to account for the observations and model errors during key phenological stages. We used the shuffled complex evolution–University of Arizona algorithm to minimize the 4DVar cost function between the remotely sensed and modeled LAI and to optimize two important WOFOST parameters. Finally, we simulated winter wheat yield in a 1-km grid for cells with at least 50% of their area occupied by winter wheat using the optimized WOFOST, and aggregated the results at a regional scale. The scale adjustment substantially improved the accuracy of regional wheat yield predictions (R2 = 0.48; RMSE= 151.92 kg ha−1) compared with the unassimilated results (R2 = 0.23;RMSE= 373.6 kg ha−1) and the TM LAI results (R2 = 0.27; RMSE= 191.6 kg ha−1). Thus, the assimilation performance depends strongly on the LAI retrieval accuracy and the scaling correction. Our research provides a scheme to employ remotely sensed data, ground-measured data, and a crop growth model to improve regional crop yield estimates

The Probiotic Effectiveness in Preventing Experimental Colitis Is Correlated With Host Gut Microbiota

Current evidence to support extensive use of probiotics in inflammatory bowel disease is limited and factors that contribute to the inconsistent effectiveness of clinical probiotic therapy are not completely known. Here, we used Bifidobacterium longum JDM 301 as a model probiotic to study potential factors that may influence the effect of probiotics in experimental colitis. We found that the effect of B. longum JDM 301 in tempering experimental colitis varied across individual mice even with the same genetic background. The probiotic efficacy was highly correlated with the host gut microbial community features. Consumption of a diet rich in fat could exacerbate mucosal injury-induced colitis but could not change the host responsiveness to B. longum JDM 301 treatment, suggesting of potential mechanistic differences between regulating colitis pathogenesis, and modulating probiotic efficacies by the gut microbiota. Together, our results suggest that personalized microbiome features may modify the probiotic therapeutic effect and support the idea of personalized probiotic medicine in inflammatory bowel disease

Genomic Analyses Reveal Mutational Signatures and Frequently Altered Genes in Esophageal Squamous Cell Carcinoma

Esophageal squamous cell carcinoma (ESCC) is one of the most common cancers worldwide and the fourth most lethal cancer in China. However, although genomic studies have identified some mutations associated with ESCC, we know little of the mutational processes responsible. To identify genome-wide mutational signatures, we performed either whole-genome sequencing (WGS) or whole-exome sequencing (WES) on 104 ESCC individuals and combined our data with those of 88 previously reported samples. An APOBEC-mediated mutational signature in 47% of 192 tumors suggests that APOBEC-catalyzed deamination provides a source of DNA damage in ESCC. Moreover, PIK3CA hotspot mutations (c.1624G>A [p.Glu542Lys] and c.1633G>A [p.Glu545Lys]) were enriched in APOBEC-signature tumors, and no smoking-associated signature was observed in ESCC. In the samples analyzed by WGS, we identified focal (<100 kb) amplifications of CBX4 and CBX8. In our combined cohort, we identified frequent inactivating mutations in AJUBA, ZNF750, and PTCH1 and the chromatin-remodeling genes CREBBP and BAP1, in addition to known mutations. Functional analyses suggest roles for several genes (CBX4, CBX8, AJUBA, and ZNF750) in ESCC. Notably, high activity of hedgehog signaling and the PI3K pathway in approximately 60% of 104 ESCC tumors indicates that therapies targeting these pathways might be particularly promising strategies for ESCC. Collectively, our data provide comprehensive insights into the mutational signatures of ESCC and identify markers for early diagnosis and potential therapeutic targets