Learning to Hash-tag Videos with Tag2Vec

User-given tags or labels are valuable resources for semantic understanding of visual media such as images and videos. Recently, a new type of labeling mechanism known as hash-tags have become increasingly popular on social media sites. In this paper, we study the problem of generating relevant and useful hash-tags for short video clips. Traditional data-driven approaches for tag enrichment and recommendation use direct visual similarity for label transfer and propagation. We attempt to learn a direct low-cost mapping from video to hash-tags using a two step training process. We first employ a natural language processing (NLP) technique, skip-gram models with neural network training to learn a low-dimensional vector representation of hash-tags (Tag2Vec) using a corpus of 10 million hash-tags. We then train an embedding function to map video features to the low-dimensional Tag2vec space. We learn this embedding for 29 categories of short video clips with hash-tags. A query video without any tag-information can then be directly mapped to the vector space of tags using the learned embedding and relevant tags can be found by performing a simple nearest-neighbor retrieval in the Tag2Vec space. We validate the relevance of the tags suggested by our system qualitatively and quantitatively with a user study

Interactive Segmentation of Radiance Fields

Radiance Fields (RF) are popular to represent casually-captured scenes for new view generation and have been used for applications beyond it. Understanding and manipulating scenes represented as RFs have to naturally follow to facilitate mixed reality on personal spaces. Semantic segmentation of objects in the 3D scene is an important step for that. Prior segmentation efforts using feature distillation show promise but don't scale to complex objects with diverse appearance. We present a framework to interactively segment objects with fine structure. Nearest neighbor feature matching identifies high-confidence regions of the objects using distilled features. Bilateral filtering in a joint spatio-semantic space grows the region to recover accurate segmentation. We show state-of-the-art results of segmenting objects from RFs and compositing them to another scene, changing appearance, etc., moving closer to rich scene manipulation and understanding. Project Page: https://rahul-goel.github.io/isrf/Comment: Project Page: https://rahul-goel.github.io/isrf

The rapid assembly of an elliptical galaxy of 400 billion solar masses at a redshift of 2.3

Stellar archeology shows that massive elliptical galaxies today formed rapidly about ten billion years ago with star formation rates above several hundreds solar masses per year (M_sun/yr). Their progenitors are likely the sub-millimeter-bright galaxies (SMGs) at redshifts (z) greater than 2. While SMGs' mean molecular gas mass of 5x10^10 M_sun can explain the formation of typical elliptical galaxies, it is inadequate to form ellipticals that already have stellar masses above 2x10^11 M_sun at z ~ 2. Here we report multi-wavelength high-resolution observations of a rare merger of two massive SMGs at z = 2.3. The system is currently forming stars at a tremendous rate of 2,000 M_sun/yr. With a star formation efficiency an order-of-magnitude greater than that of normal galaxies, it will quench the star formation by exhausting the gas reservoir in only ~200 million years. At a projected separation of 19 kiloparsecs, the two massive starbursts are about to merge and form a passive elliptical galaxy with a stellar mass of ~4x10^11 M_sun. Our observations show that gas-rich major galaxy mergers, concurrent with intense star formation, can form the most massive elliptical galaxies by z ~ 1.5.Comment: Appearing in Nature online on May 22 and in print on May 30. Submitted here is the accepted version (including the Supplementary Information), see nature.com for the final versio

Level spacings for weakly asymmetric real random matrices and application to two-color QCD with chemical potential

We consider antisymmetric perturbations of real symmetric matrices in the context of random matrix theory and two-color quantum chromodynamics. We investigate the level spacing distributions of eigenvalues that remain real or become complex conjugate pairs under the perturbation. We work out analytical surmises from small matrices and show that they describe the level spacings of large random matrices. As expected from symmetry arguments, these level spacings also apply to the overlap Dirac operator for two-color QCD with chemical potential.Comment: 23 pages, 6 figures, 1 animation; minor corrections, references added, as published in JHE

Exploring the use of skeletal tracking for cheaper motion graphs and on-set decision making in Free-Viewpoint Video production

In free-viewpoint video (FVV), the motion and surface appearance of a real-world performance is captured as an animated mesh. While this technology can produce high-fidelity recreations of actors, the required 3D reconstruction step has substantial processing demands. This means FVV experiences are currently expensive to produce, and the processing delay means on-set decisions are hampered by a lack of feedback. This work explores the possibility of using RGB-camera-based skeletal tracking to reduce the amount of content that must be 3D reconstructed, as well as aiding on-set decision making. One particularly relevant application is in the construction of Motion Graphs, where state-of-the-art techniques require large amounts of content to be 3D reconstructed before a graph can be built, resulting in large amounts of wasted processing effort. Here, we propose the use of skeletons to assess which clips of FVV content to process, resulting in substantial cost savings with a limited impact on performance accuracy. Additionally, we explore how this technique could be utilised on set to reduce the possibility of requiring expensive reshoots

A Novel Nonsense Mutation in the DMP1 Gene Identified by a Genome-Wide Association Study Is Responsible for Inherited Rickets in Corriedale Sheep

Inherited rickets of Corriedale sheep is characterized by decreased growth rate, thoracic lordosis and angular limb deformities. Previous outcross and backcross studies implicate inheritance as a simple autosomal recessive disorder. A genome wide association study was conducted using the Illumina OvineSNP50 BeadChip on 20 related sheep comprising 17 affected and 3 carriers. A homozygous region of 125 consecutive single-nucleotide polymorphism (SNP) loci was identified in all affected sheep, covering a region of 6 Mb on ovine chromosome 6. Among 35 candidate genes in this region, the dentin matrix protein 1 gene (DMP1) was sequenced to reveal a nonsense mutation 250C/T on exon 6. This mutation introduced a stop codon (R145X) and could truncate C-terminal amino acids. Genotyping by PCR-RFLP for this mutation showed all 17 affected sheep were “T T” genotypes; the 3 carriers were “C T”; 24 phenotypically normal related sheep were either “C T” or “C C”; and 46 unrelated normal control sheep from other breeds were all “C C”. The other SNPs in DMP1 were not concordant with the disease and can all be ruled out as candidates. Previous research has shown that mutations in the DMP1 gene are responsible for autosomal recessive hypophosphatemic rickets in humans. Dmp1_knockout mice exhibit rickets phenotypes. We believe the R145X mutation to be responsible for the inherited rickets found in Corriedale sheep. A simple diagnostic test can be designed to identify carriers with the defective “T” allele. Affected sheep could be used as animal models for this form of human rickets, and for further investigation of the role of DMP1 in phosphate homeostasis

Overexpression of Hydroxynitrile Lyase in Cassava Roots Elevates Protein and Free Amino Acids while Reducing Residual Cyanogen Levels

Cassava is the major source of calories for more than 250 million Sub-Saharan Africans, however, it has the lowest protein-to-energy ratio of any major staple food crop in the world. A cassava-based diet provides less than 30% of the minimum daily requirement for protein. Moreover, both leaves and roots contain potentially toxic levels of cyanogenic glucosides. The major cyanogen in cassava is linamarin which is stored in the vacuole. Upon tissue disruption linamarin is deglycosylated by the apolplastic enzyme, linamarase, producing acetone cyanohydrin. Acetone cyanohydrin can spontaneously decompose at pHs >5.0 or temperatures >35°C, or is enzymatically broken down by hydroxynitrile lyase (HNL) to produce acetone and free cyanide which is then volatilized. Unlike leaves, cassava roots have little HNL activity. The lack of HNL activity in roots is associated with the accumulation of potentially toxic levels of acetone cyanohydrin in poorly processed roots. We hypothesized that the over-expression of HNL in cassava roots under the control of a root-specific, patatin promoter would not only accelerate cyanogenesis during food processing, resulting in a safer food product, but lead to increased root protein levels since HNL is sequestered in the cell wall. Transgenic lines expressing a patatin-driven HNL gene construct exhibited a 2–20 fold increase in relative HNL mRNA levels in roots when compared with wild type resulting in a threefold increase in total root protein in 7 month old plants. After food processing, HNL overexpressing lines had substantially reduced acetone cyanohydrin and cyanide levels in roots relative to wild-type roots. Furthermore, steady state linamarin levels in intact tissues were reduced by 80% in transgenic cassava roots. These results suggest that enhanced linamarin metabolism contributed to the elevated root protein levels

Differential regulation of wild-type and mutant alpha-synuclein binding to synaptic membranes by cytosolic factors

BACKGROUND: Alpha-Synuclein (alpha-syn), a 140 amino acid protein associated with presynaptic membranes in brain, is a major constituent of Lewy bodies in Parkinson's disease (PD). Three missense mutations (A30P, A53T and E46K) in the alpha-syn gene are associated with rare autosomal dominant forms of familial PD. However, the regulation of alpha-syn's cellular localization in neurons and the effects of the PD-linked mutations are poorly understood. RESULTS: In the present study, we analysed the ability of cytosolic factors to regulate alpha-syn binding to synaptic membranes. We show that co-incubation with brain cytosol significantly increases the membrane binding of normal and PD-linked mutant alpha-syn. To characterize cytosolic factor(s) that modulate alpha-syn binding properties, we investigated the ability of proteins, lipids, ATP and calcium to modulate alpha-syn membrane interactions. We report that lipids and ATP are two of the principal cytosolic components that modulate Wt and A53T alpha-syn binding to the synaptic membrane. We further show that 1-O-hexadecyl-2-acetyl-sn-glycero-3-phosphocholine (C16:0 PAF) is one of the principal lipids found in complex with cytosolic proteins and is required to enhance alpha-syn interaction with synaptic membrane. In addition, the impaired membrane binding observed for A30P alpha-syn was significantly mitigated by the presence of protease-sensitive factors in brain cytosol. CONCLUSION: These findings suggest that endogenous brain cytosolic factors regulate Wt and mutant alpha-syn membrane binding, and could represent potential targets to influence alpha-syn solubility in brain

Changes in Mycobacterium tuberculosis Genotype Families Over 20 Years in a Population-Based Study in Northern Malawi

BACKGROUND: Despite increasing interest in possible differences in virulence and transmissibility between different genotypes of M. tuberculosis, very little is known about how genotypes within a population change over decades, or about relationships to HIV infection. METHODS AND PRINCIPAL FINDINGS: In a population-based study in rural Malawi we have examined smears and cultures from tuberculosis patients over a 20-year period using spoligotyping. Isolates were grouped into spoligotype families and lineages following previously published criteria. Time trends, HIV status, drug resistance and outcome were examined by spoligotype family and lineage. In addition, transmissibility was examined among pairs of cases with known epidemiological contact by assessing the proportion of transmissions confirmed for each lineage, on the basis of IS6110 RFLP similarity of the M tuberculosis strains. 760 spoligotypes were obtained from smears from 518 patients from 1986-2002, and 377 spoligotypes from cultures from 347 patients from 2005-2008. There was good consistency in patients with multiple specimens. Among 781 patients with first episode tuberculosis, the majority (76%) had Lineage 4 ("European/American") strains; 9% had Lineage 3 ("East-African/Indian"); 8% Lineage 1 ("Indo-Oceanic"); and 2% Lineage 2 ("East-Asian"); others unclassifiable. Over time the proportion of Lineage 4 decreased from >90% to 60%, with an increase in the other 3 lineages (p<0.001). Lineage 1 strains were more common in those with HIV infection, even after adjusting for age, sex and year. There were no associations with drug resistance or outcome, and no differences by lineage in the proportion of pairs in which transmission was confirmed. CONCLUSIONS: This is the first study to describe long term trends in the four M. tuberculosis lineages in a population. Lineage 4 has probably been longstanding in this population, with relatively recent introductions and spread of Lineages1-3, perhaps influenced by the HIV epidemic