Automatic Concept Discovery from Parallel Text and Visual Corpora

Humans connect language and vision to perceive the world. How to build a similar connection for computers? One possible way is via visual concepts, which are text terms that relate to visually discriminative entities. We propose an automatic visual concept discovery algorithm using parallel text and visual corpora; it filters text terms based on the visual discriminative power of the associated images, and groups them into concepts using visual and semantic similarities. We illustrate the applications of the discovered concepts using bidirectional image and sentence retrieval task and image tagging task, and show that the discovered concepts not only outperform several large sets of manually selected concepts significantly, but also achieves the state-of-the-art performance in the retrieval task.Comment: To appear in ICCV 201

Factoring the unitary evolution operator and quantifying entanglement

The unitary evolution can be represented by a finite product of exponential operators. It leads to a perturbative expression of the density operator of a close system. Based on the perturbative expression scheme, we present a entanglement measure, this measure has the advantage that it is easy to compute for a general dynamical process.Comment: 11 pages, LATEX, no figure

VQS: Linking Segmentations to Questions and Answers for Supervised Attention in VQA and Question-Focused Semantic Segmentation

Rich and dense human labeled datasets are among the main enabling factors for the recent advance on vision-language understanding. Many seemingly distant annotations (e.g., semantic segmentation and visual question answering (VQA)) are inherently connected in that they reveal different levels and perspectives of human understandings about the same visual scenes --- and even the same set of images (e.g., of COCO). The popularity of COCO correlates those annotations and tasks. Explicitly linking them up may significantly benefit both individual tasks and the unified vision and language modeling. We present the preliminary work of linking the instance segmentations provided by COCO to the questions and answers (QAs) in the VQA dataset, and name the collected links visual questions and segmentation answers (VQS). They transfer human supervision between the previously separate tasks, offer more effective leverage to existing problems, and also open the door for new research problems and models. We study two applications of the VQS data in this paper: supervised attention for VQA and a novel question-focused semantic segmentation task. For the former, we obtain state-of-the-art results on the VQA real multiple-choice task by simply augmenting the multilayer perceptrons with some attention features that are learned using the segmentation-QA links as explicit supervision. To put the latter in perspective, we study two plausible methods and compare them to an oracle method assuming that the instance segmentations are given at the test stage.Comment: To appear on ICCV 201

Bond relaxation, electronic and magnetic behavior of 2D metals structures Y on Li(110) surface

We investigated the bond, electronic and magnetic behavior of adsorption Yttrium atoms on Lithium (110) surface using a combination of Bond-order-length-strength(BOLS) correlation and density-functional theory(DFT). We found that adsorption Y atoms on Li(110) surfaces form two-dimensional (2D) geometric structures of hexagon, nonagon, solid hexagonal, quadrangle and triangle. The consistent with the magnetic moment are 6.66{\mu}B, 5.54{\mu}B, 0.28{\mu}B, 1.04{\mu}B, 2.81{\mu}B, respectively. In addition, this work could pave the way for design new 2D metals electronic and magnetic properties

Sensitivity analysis of leaf blower vibration isolator based on ISIGHT

In order to reduce the optimal design space of the vibration isolator, a sensitivity analysis method based on ISIGHT for the leaf blower vibration isolator was proposed in this paper. Parametric modeling of the isolator was realized by Solidworks, Hypermesh, Optistruct and ADAMS, and a multi-software co-simulation working framework based on ISIGHT was established. Taking the design parameters of the vibration isolator as the variable and the minimum transmission force as the optimization, Sensitivity analysis of the vibration isolator was carried out based on the Latin Hypercube. The results show that the length of the vibration isolator has the greatest influence on the vibration isolation and the contribution of d1, d3, D3 and E3 is the smallest. The result provided a guiding significance for the design optimization of the vibration isolator

Adoption and implication of the Biased-Annotator Competence Estimation (BACE) model into COVID-19 vaccine Twitter data: Human annotation for latent message features

Traditional quantitative content analysis approach (human coding method) has weaknesses, such as assuming all human coders are equally accurate once the intercoder reliability for training reaches a threshold score. We applied the Biased-Annotator Competence Estimation (BACE) model (Tyler, 2021), which draws on Bayesian modeling to improve human coding. An important contribution of this model is it takes each coder's potential biases and reliability into consideration and treats the "true" label of each message as a latent parameter, with quantifiable estimation uncertainties. In contrast, in conventional human coding, each message will receive a fixed label without estimates for measurement uncertainties. In this extended abstract, we first summarize the weaknesses of conventional human coding; and then apply the BACE model to COVID-19 vaccine Twitter data and compare BACE with other statistical models; finally, we discuss how the BACE model can be applied to improve human coding of latent message features