Open Vocabulary Extreme Classification Using Generative Models

The extreme multi-label classification (XMC) task aims at tagging content with a subset of labels from an extremely large label set. The label vocabulary is typically defined in advance by domain experts and assumed to capture all necessary tags. However in real world scenarios this label set, although large, is often incomplete and experts frequently need to refine it. To develop systems that simplify this process, we introduce the task of open vocabulary XMC (OXMC): given a piece of content, predict a set of labels, some of which may be outside of the known tag set. Hence, in addition to not having training data for some labels-as is the case in zero-shot classification-models need to invent some labels on-the-fly. We propose GROOV, a fine-tuned seq2seq model for OXMC that generates the set of labels as a flat sequence and is trained using a novel loss independent of predicted label order. We show the efficacy of the approach, experimenting with popular XMC datasets for which GROOV is able to predict meaningful labels outside the given vocabulary while performing on par with state-of-the-art solutions for known labels

Pleiotropic role of TRAF7 in skull-base meningiomas and congenital heart disease

While somatic variants of TRAF7 (Tumor necrosis factor receptor-associated factor 7) underlie anterior skull-base meningiomas, here we report the inherited mutations of TRAF7 that cause congenital heart defects. We show that TRAF7 mutants operate in a dominant manner, inhibiting protein function via heterodimerization with wild-type protein. Further, the shared genetics of the two disparate pathologies can be traced to the common origin of forebrain meninges and cardiac outflow tract from the TRAF7-expressing neural crest. Somatic and inherited mutations disrupt TRAF7-IFT57 interactions leading to cilia degradation. TRAF7-mutant meningioma primary cultures lack cilia, and TRAF7 knockdown causes cardiac, craniofacial, and ciliary defects in Xenopus and zebrafish, suggesting a mechanistic convergence for TRAF7-driven meningiomas and developmental heart defects