A Principled Approach for Learning Task Similarity in Multitask Learning

Multitask learning aims at solving a set of related tasks simultaneously, by exploiting the shared knowledge for improving the performance on individual tasks. Hence, an important aspect of multitask learning is to understand the similarities within a set of tasks. Previous works have incorporated this similarity information explicitly (e.g., weighted loss for each task) or implicitly (e.g., adversarial loss for feature adaptation), for achieving good empirical performances. However, the theoretical motivations for adding task similarity knowledge are often missing or incomplete. In this paper, we give a different perspective from a theoretical point of view to understand this practice. We first provide an upper bound on the generalization error of multitask learning, showing the benefit of explicit and implicit task similarity knowledge. We systematically derive the bounds based on two distinct task similarity metrics: H divergence and Wasserstein distance. From these theoretical results, we revisit the Adversarial Multi-task Neural Network, proposing a new training algorithm to learn the task relation coefficients and neural network parameters iteratively. We assess our new algorithm empirically on several benchmarks, showing not only that we find interesting and robust task relations, but that the proposed approach outperforms the baselines, reaffirming the benefits of theoretical insight in algorithm design

Separation of Different Contributions to the Total X-ray Luminosity in Gamma-ray Loud Blazars

The relativistic beaming model has been successfully used to explain many of the observational properties of active galactic nuclei. In this model the total emission is formed by two components, one beamed, one unbeamed. However, the exact contribution from each component in unresolved sources is still not clear. In the radio band, the core and extended emissions are clearly separated. We adopt the method proposed by Kembhavi to separate the two contributions in the X-ray emissions in a sample of 19 gamma-ray loud blazars. It is clearly shown that the beamed emission dominates the X-ray flux and the unbeamed X-ray emission is correlated with the extended radio emission of the considered objects. We also find that the ratio of the beamed to the unbeamed X-ray luminosity is correlated with the X-ray spectral index, an effect that should be a consequence of the underlying X-ray emission mechanism.Fil: Fan, Jun Hui. Guangzhou University. Center for Astrophysics; ChinaFil: Romero, Gustavo Esteban. Provincia de Buenos Aires. Gobernación. Comisión de Investigaciones Científicas. Instituto Argentino de Radioastronomía. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico Conicet - La Plata. Instituto Argentino de Radioastronomía; ArgentinaFil: Wang, Yong Xiang. College of Science and Trade; ChinaFil: Zhang, Jiang Shui. Guangzhou University. Center for Astrophysics; Chin

Correlation between Grafting Density and Confined Crystallization Behavior of Poly(ethylene glycol) Grafted to Silica

The interfacial interactions of polymer-nanoparticles have dramatical effects on the crystallization behavior of grafted polymers. In this study, methoxy polyethylene glycol (MPEG) (molecular weights 750, 2000 and 4000 g mol−1) was grafted onto amino-modified nanosized silica (SiO2-NH2) by the “grafting to” method. The effects of the grafting density and molecular weight on the confined crystallization of grafted MPEG (MPEG-g-SiO2) were systematically investigated by differential scanning calorimetry (DSC), thermogravimetric analysis (TGA) and wide-angle X-ray scattering (WAXS). It was found that confinement effects are stronger when lower molecular weights of grafted MPEG are employed. These grafted MPEG chains are more difficult to stretch out on SiO2-NH2 surfaces than when they are free in the bulk polymer. Both crystallization temperature (Tc) and crystallinity of grafted MPEG chains decrease with reductions of grafting density. Additionally, covalent bonding effects and interfacial interaction confinement effects are strengthened by the decrease in grafting density, leading to an increase in decomposition temperature and to the disappearance of the self-nucleation Domain (i.e., Domain II), when self-nucleation experiments are performed by DSC. Overall isothermal crystallization kinetics was studied by DSC and the results were analyzed with the Avrami equation. An Avrami index of n≈3 was obtained for neat MPEG (indicating that instantaneous spherulites are formed). However, in the case of MPEG-g-SiO2 with the lowest grafting density, the Avrami index of (n) was less than 1 (first order kinetics or lower), indicating that nucleation is the determining factor of the overall crystallization kinetics, a signature for confined crystallization. At the same time, the crystallization from the melt for this MPEG-g-SiO2 with the lowest grafting density occurs at Tc ≈-30 ºC, a temperature close to the glass transition temperature (Tg) of MPEG, indicating that this confined MPEG crystallizes from homogeneous nuclei.This project was supported by the National Natural Science Foundation of China (21574141) and the Ministry of Science and Technology of China (2017YFE0117800). The authors gratefully acknowledge the funding of project BIODEST, Research and Innovation Staff Exchange (RISE) H2020-MSCA-RISE-2017-778092. The authors thank beamline BL16B1 (Shanghai Synchrotron Radiation Facility) for providing the beam time and helps during experiments