COMIC: Towards A Compact Image Captioning Model with Attention

Recent works in image captioning have shown very promising raw performance. However, we realize that most of these encoder-decoder style networks with attention do not scale naturally to large vocabulary size, making them difficult to be deployed on embedded system with limited hardware resources. This is because the size of word and output embedding matrices grow proportionally with the size of vocabulary, adversely affecting the compactness of these networks. To address this limitation, this paper introduces a brand new idea in the domain of image captioning. That is, we tackle the problem of compactness of image captioning models which is hitherto unexplored. We showed that, our proposed model, named COMIC for COMpact Image Captioning, achieves comparable results in five common evaluation metrics with state-of-the-art approaches on both MS-COCO and InstaPIC-1.1M datasets despite having an embedding vocabulary size that is 39x - 99x smaller. The source code and models are available at: https://github.com/jiahuei/COMIC-Compact-Image-Captioning-with-AttentionComment: Added source code link and new results in Table

Casimir energy of a compact cylinder under the condition ϵμ=c−2\epsilon\mu = c^{-2}

The Casimir energy of an infinite compact cylinder placed in a uniform unbounded medium is investigated under the continuity condition for the light velocity when crossing the interface. As a characteristic parameter in the problem the ratio $\xi^2=(\epsilon_1-\epsilon_2)^2/ (\epsilon_1+\epsilon_2)^-2 = (\mu_1-\mu_2)^2/(\mu_1+ \mu_2)^2 \le 1$ is used, where $\epsilon_1$ and $\mu_1$ are, respectively, the permittivity and permeability of the material making up the cylinder and $\epsilon_2$ and $\mu_2$ are those for the surrounding medium. It is shown that the expansion of the Casimir energy in powers of this parameter begins with the term proportional to $\xi^4$. The explicit formulas permitting us to find numerically the Casimir energy for any fixed value of $\xi^2$ are obtained. Unlike a compact ball with the same properties of the materials, the Casimir forces in the problem under consideration are attractive. The implication of the calculated Casimir energy in the flux tube model of confinement is briefly discussed.Comment: REVTeX, 12 pages, 1 figure in a separate fig1.eps file, 1 table; minor corrections in English and misprints; version to be published in Phys. Rev. D1

Statistically Motivated Second Order Pooling

Second-order pooling, a.k.a.~bilinear pooling, has proven effective for deep learning based visual recognition. However, the resulting second-order networks yield a final representation that is orders of magnitude larger than that of standard, first-order ones, making them memory-intensive and cumbersome to deploy. Here, we introduce a general, parametric compression strategy that can produce more compact representations than existing compression techniques, yet outperform both compressed and uncompressed second-order models. Our approach is motivated by a statistical analysis of the network's activations, relying on operations that lead to a Gaussian-distributed final representation, as inherently used by first-order deep networks. As evidenced by our experiments, this lets us outperform the state-of-the-art first-order and second-order models on several benchmark recognition datasets.Comment: Accepted to ECCV 2018. Camera ready version. 14 page, 5 figures, 3 table

A class of compact dwarf galaxies from disruptive processes in galaxy clusters

Dwarf galaxies have attracted increased attention in recent years, because of their susceptibility to galaxy transformation processes within rich galaxy clusters. Direct evidence for these processes, however, has been difficult to obtain, with a small number of diffuse light trails and intra-cluster stars being the only signs of galaxy disruption. Furthermore, our current knowledge of dwarf galaxy populations may be very incomplete, because traditional galaxy surveys are insensitive to extremely diffuse or compact galaxies. Aware of these concerns, we recently undertook an all-object survey of the Fornax galaxy cluster. This revealed a new population of compact members, overlooked in previous conventional surveys. Here we demonstrate that these 'ultra-compact' dwarf galaxies are structurally and dynamically distinct from both globular star clusters and known types of dwarf galaxy, and thus represent a new class of dwarf galaxy. Our data are consistent with the interpretation that these are the remnant nuclei of disrupted dwarf galaxies, making them an easily observed tracer of galaxy disruption.Comment: Published version available online to subscribers at http://www.nature.com/nature/ This revised version includes a table of data values not given in the published pape