HAL: Improved Text-Image Matching by Mitigating Visual Semantic Hubs

The hubness problem widely exists in high-dimensional embedding space and is a fundamental source of error for cross-modal matching tasks. In this work, we study the emergence of hubs in Visual Semantic Embeddings (VSE) with application to text-image matching. We analyze the pros and cons of two widely adopted optimization objectives for training VSE and propose a novel hubness-aware loss function (HAL) that addresses previous methods' defects. Unlike (Faghri et al.2018) which simply takes the hardest sample within a mini-batch, HAL takes all samples into account, using both local and global statistics to scale up the weights of "hubs". We experiment our method with various configurations of model architectures and datasets. The method exhibits exceptionally good robustness and brings consistent improvement on the task of text-image matching across all settings. Specifically, under the same model architectures as (Faghri et al. 2018) and (Lee at al. 2018), by switching only the learning objective, we report a maximum R@1improvement of 7.4% on MS-COCO and 8.3% on Flickr30k.Comment: AAAI-20 (to appear

MUSIED: A Benchmark for Event Detection from Multi-Source Heterogeneous Informal Texts

Event detection (ED) identifies and classifies event triggers from unstructured texts, serving as a fundamental task for information extraction. Despite the remarkable progress achieved in the past several years, most research efforts focus on detecting events from formal texts (e.g., news articles, Wikipedia documents, financial announcements). Moreover, the texts in each dataset are either from a single source or multiple yet relatively homogeneous sources. With massive amounts of user-generated text accumulating on the Web and inside enterprises, identifying meaningful events in these informal texts, usually from multiple heterogeneous sources, has become a problem of significant practical value. As a pioneering exploration that expands event detection to the scenarios involving informal and heterogeneous texts, we propose a new large-scale Chinese event detection dataset based on user reviews, text conversations, and phone conversations in a leading e-commerce platform for food service. We carefully investigate the proposed dataset's textual informality and multi-source heterogeneity characteristics by inspecting data samples quantitatively and qualitatively. Extensive experiments with state-of-the-art event detection methods verify the unique challenges posed by these characteristics, indicating that multi-source informal event detection remains an open problem and requires further efforts. Our benchmark and code are released at \url{https://github.com/myeclipse/MUSIED}.Comment: Accepted at EMNLP 202

Exploiting Pseudo Future Contexts for Emotion Recognition in Conversations

With the extensive accumulation of conversational data on the Internet, emotion recognition in conversations (ERC) has received increasing attention. Previous efforts of this task mainly focus on leveraging contextual and speaker-specific features, or integrating heterogeneous external commonsense knowledge. Among them, some heavily rely on future contexts, which, however, are not always available in real-life scenarios. This fact inspires us to generate pseudo future contexts to improve ERC. Specifically, for an utterance, we generate its future context with pre-trained language models, potentially containing extra beneficial knowledge in a conversational form homogeneous with the historical ones. These characteristics make pseudo future contexts easily fused with historical contexts and historical speaker-specific contexts, yielding a conceptually simple framework systematically integrating multi-contexts. Experimental results on four ERC datasets demonstrate our method's superiority. Further in-depth analyses reveal that pseudo future contexts can rival real ones to some extent, especially in relatively context-independent conversations.Comment: 15 pages, accepted by ADMA 202

Middle Jurassic ooidal ironstones (southern Tibet): Formation processes and implications for the paleoceanography of eastern Neo-Tethys

The major facies changes documented in shallow-marine sediments of the northern Indian passive margin of Neo-Tethys throughout the Jurassic, from widespread platform carbonates in the Early Jurassic to organic-rich black shales in the Late Jurassic, imply a substantial turnover in oceanic conditions. All along the Tethys (Tibetan) Himalaya, from the Zanskar Range to southern Tibet, a peculiar interval characterized by ooidal ironstones of Dingjie Formation (Ferruginous Oolite Formation, FOF) marks the base of the organic-rich Spiti Shale. This laterally-extensive ooidal ironstone interval is a fundamental testimony of the mechanisms that led to major paleoceanographic changes that occurred in the eastern Neo-Tethys during the Middle Jurassic. In this article, we illustrate in detail the petrology, mineralogy, and geochemistry of ooidal ironstones and the major element contents of the entire Lanongla section. The FOF is characterized by significantly high contents of Fe2O3 (56.80% ± 9.07%, n = 7) and P2O5 (1.72% ± 1.19%, n = 7). In contrast, the Fe2O3 and P2O5 contents average 3.58% and 0.15% in the overlain carbonates of Lanongla Fm., and 5.55% and 0.16% in the overlying Spiti Shale. The ooidal ironstones are mainly composed of iron ooids with a few quartz grains and bioclasts cemented by sparry calcite. The iron ooids consist of concentric dark layers of francolite (carbonate fluorapatite), hence enriched in Ca, P, and F, and bright layers of chamosite, enriched in Fe, Si, Al, and Mg. Precipitation of francolite ensued from oversaturation of phosphorous ascribed to intensified upwelling, high biogenous productivity, and degradation of organic matter, whereas the formation of chamosite reflects enhanced continental weathering and erosion leading to increased Fe input to the ocean during transgressive stages characterized by low sedimentation rate and scarce oxygenation at the seafloor. Modern upwelling zones in outer shelf or slope areas perform similar geochemical characteristics to those as observed in this study. Under the Mesozoic greenhouse background, fluctuating redox conditions induced the alternate growth of francolite under anoxic conditions and of chamosite under suboxic conditions. Ooids were thus formed on the seafloor during continued resuspension and vertical oscillations of the chemocline rather than from interstitial waters after burial. The mineralogy of iron ooids indicates mainly reducing conditions in the water column, suggesting that extensive upwelling along the continental margin of eastern Neo-Tethys contributed significantly to the transition from carbonate deposits to organic-rich black shales during the Jurassic, as testified by the transition from well-oxygenated in Lanongla Fm. To a reduceing condition in Spiti Shale indicated by the Mn/Al ratios compared to PAAS

Functional Role of Cyclin-Dependent Kinase 5 in the Regulation of Melanogenesis and Epidermal Structure

The mammalian integumentary system plays important roles in body homeostasis, and dysfunction of melanogenesis or epidermal development may lead to a variety of skin diseases, including melanoma. Skin pigmentation in humans and coat color in fleece-producing animals are regulated by many genes. Among them, microphthalmia-associated transcription factor (MITF) and paired-box 3 (PAX3) are at the top of the cascade and regulate activities of many important melanogenic enzymes. Here, we report for the first time that cyclin-dependent kinase 5 (Cdk5) is an essential regulator of MITF and PAX3. Cdk5 knockdown in mice causes a lightened coat color, a polarized distribution of melanin and hyperproliferation of basal keratinocytes. Reduced expression of Keratin 10 (K10) resulting from Cdk5knockdown may be responsible for an abnormal epidermal structure. In contrast, overexpression of Cdk5 in sheep (Ovis aries) only produces brown patches on a white background, with no other observable abnormalities. Collectively, our findings show that Cdk5 has an important functional role in the regulation of melanin production and transportation and in normal development of the integumentary system

An egg holders-inspired structure design for large-volume-change anodes with long cycle life

Abstract(#br)Silicon has been considered as a potential alternative of anodes for advanced lithium ion battery as it possesses high capacity and abundance. However, it encounters excessive volume expansion and inferior electoral conductivity, which imposes restrictions on its further development. In order to address these two problems, yolk-shell structure is employed, in which there is a suitable void for the expansion with a shell to protect the core and promote the conductivity. Here, by the inspiration from the egg holders and inverse-opal structure, an egg-stacking-like Si/C composite (ES) anode with spherical air holes was fabricated to gather the yolk-shell particles in a 3D carbon network with abundant channels allowing electrolyte to enter the material, which can facilitate the cycling performance. The half-cell battery assembled with these anodes presents high capacity and good rate performance, with a capacity reduction of only 2–7% per current density. And the cycling performance of ES anode is also praiseworthy that it delivers a high reversible discharge capacity of 2175 mAh g −1 after 300 cycles at 0.5 A g −1 . This kind of structure design is expected to be applicative for most of large-volume-change anodes

Impacts of different levels of urban expansion on habitats at the regional scale and their critical distance thresholds

With the rapid development of urbanization, natural habitats in many parts of the world have been seriously damaged by urban expansion. However, urban expansion is a complex process, and the impacts of different levels of urban expansion on habitats at regional scales and their distance thresholds are still unclear. We conducted a study in Hubei Province, China to evaluate the impacts of the expansion of prefecture-level cities and county towns on the quantity, area, and quality of natural habitats and the critical threshold distances affecting habitats. The results show that, at a regional scale, habitat degradation was driven primarily by the expansion of large numbers of county towns, but the expansion of prefecture-level cities affected habitat degradation over greater distances. Specifically, the impact of county town expansion on habitat first increased and then decreased with greater distance from built-up areas, the threshold distances for habitat quantity and quality being approximately 8 km and 80 km, respectively. The impact of expanding prefecture-level cities on habitat showed a similar nonlinear change with greater distance, but the distance thresholds for habitat quantity and quality rose to approximately 40 km and 130 km, respectively. These findings not only reverse the conventional view that the expansion of large cities dominates habitat degradation, but also draws more attention to the influence of the expansion of numerous small county and towns on habitat, when measured at the regional scale. Understanding the distance threshold of particular spatial impacts can be help to inform spatial decision-making with regards to habitat conservation

Assisted Da Vinci robotic surgery combined with 3D printing technology applied in septal myectomy

Abstract Generally, the standard surgical route of Morrow begins with the incision of median sternal, which leads to more trauma, pains and discomforts to patients with hypertrophic obstructive cardiomyopathy (HOCM). It is more difficult and rough to perform the competed resection of hypertrophic myocardium due to complicated anatomical morphology of left ventricular outflow tract and limited visual field of left ventricle during surgery. As the novel surgical strategy, firstly, under the guiding of 3D printing technology, the platform of effective preoperative evaluation focusing on how to resect the hypertrophic myocardium is established. Then, combined with assisted Da Vinci robotic surgery system, the outcome of patient with HOCM is positive and promised