Implicit Filter Sparsification In Convolutional Neural Networks

We show implicit filter level sparsity manifests in convolutional neural networks (CNNs) which employ Batch Normalization and ReLU activation, and are trained with adaptive gradient descent techniques and L2 regularization or weight decay. Through an extensive empirical study (Mehta et al., 2019) we hypothesize the mechanism behind the sparsification process, and find surprising links to certain filter sparsification heuristics proposed in literature. Emergence of, and the subsequent pruning of selective features is observed to be one of the contributing mechanisms, leading to feature sparsity at par or better than certain explicit sparsification / pruning approaches. In this workshop article we summarize our findings, and point out corollaries of selective-featurepenalization which could also be employed as heuristics for filter prunin

Quaternion Electromagnetism and the Relation with 2-Spinor Formalism

By using complex quaternion, which is the system of quaternion representation extended to complex numbers, we show that the laws of electromagnetism can be expressed much more simply and concisely. We also derive the quaternion representation of rotations and boosts from the spinor representation of Lorentz group. It is suggested that the imaginary 'i' should be attached to the spatial coordinates, and observe that the complex conjugate of quaternion representation is exactly equal to parity inversion of all physical quantities in the quaternion. We also show that using quaternion is directly linked to the two-spinor formalism. Finally, we discuss meanings of quaternion, octonion and sedenion in physics as n-fold rotationComment: Version published in journal Universe (2019

Glassy dynamics of partially pinned fluids: an alternative mode-coupling approach

We use a simple mode-coupling approach to investigate glassy dynamics of partially pinned fluid systems. Our approach is different from the mode-coupling theory developed by Krakoviack [Phys. Rev. Lett. 94, 065703 (2005), Phys. Rev. E 84, 050501(R) (2011)]. In contrast to Krakoviack's theory, our approach predicts a random pinning glass transition scenario that is qualitatively the same as the scenario obtained using a mean-field analysis of the spherical p-spin model and a mean-field version of the random first-order transition theory. We use our approach to calculate quantities which are often considered to be indicators of growing dynamic correlations and static point-to-set correlations. We find that the so-called static overlap is dominated by the simple, low pinning fraction contribution. Thus, at least for randomly pinned fluid systems, only a careful quantitative analysis of simulation results can reveal genuine, many-body point-to-set correlations

20 K superconductivity in heavily electron doped surface layer of FeSe bulk crystal

A superconducting transition temperature Tc as high as 100 K was recently discovered in 1 monolayer (1ML) FeSe grown on SrTiO3 (STO). The discovery immediately ignited efforts to identify the mechanism for the dramatically enhanced Tc from its bulk value of 7 K. Currently, there are two main views on the origin of the enhanced Tc; in the first view, the enhancement comes from an interfacial effect while in the other it is from excess electrons with strong correlation strength. The issue is controversial and there are evidences that support each view. Finding the origin of the Tc enhancement could be the key to achieving even higher Tc and to identifying the microscopic mechanism for the superconductivity in iron-based materials. Here, we report the observation of 20 K superconductivity in the electron doped surface layer of FeSe. The electronic state of the surface layer possesses all the key spectroscopic aspects of the 1ML FeSe on STO. Without any interface effect, the surface layer state is found to have a moderate Tc of 20 K with a smaller gap opening of 4 meV. Our results clearly show that excess electrons with strong correlation strength alone cannot induce the maximum Tc, which in turn strongly suggests need for an interfacial effect to reach the enhanced Tc found in 1ML FeSe/STO.Comment: 5 pages, 4 figure