Visually Grounded Commonsense Knowledge Acquisition

Large-scale commonsense knowledge bases empower a broad range of AI applications, where the automatic extraction of commonsense knowledge (CKE) is a fundamental and challenging problem. CKE from text is known for suffering from the inherent sparsity and reporting bias of commonsense in text. Visual perception, on the other hand, contains rich commonsense knowledge about real-world entities, e.g., (person, can_hold, bottle), which can serve as promising sources for acquiring grounded commonsense knowledge. In this work, we present CLEVER, which formulates CKE as a distantly supervised multi-instance learning problem, where models learn to summarize commonsense relations from a bag of images about an entity pair without any human annotation on image instances. To address the problem, CLEVER leverages vision-language pre-training models for deep understanding of each image in the bag, and selects informative instances from the bag to summarize commonsense entity relations via a novel contrastive attention mechanism. Comprehensive experimental results in held-out and human evaluation show that CLEVER can extract commonsense knowledge in promising quality, outperforming pre-trained language model-based methods by 3.9 AUC and 6.4 mAUC points. The predicted commonsense scores show strong correlation with human judgment with a 0.78 Spearman coefficient. Moreover, the extracted commonsense can also be grounded into images with reasonable interpretability. The data and codes can be obtained at https://github.com/thunlp/CLEVER.Comment: Accepted by AAAI 202

Vitamin B12 Levels in Methamphetamine Addicts

Objective: It has been established that reduced vitamin B12 serum levels are associated with cognitive decline and mental illness. The chronic use of methamphetamine (MA), which is a highly addictive drug, can induce cognitive impairment and psychopathological symptoms. There are few studies addressing the association of MA with vitamin B12 serum levels. This study examined whether the serum levels of B12 are associated with MA addiction.Methods: Serum vitamin B12, homocysteine (Hcy), glucose and triglyceride concentrations were measured in 123 MA addicts and 108 controls. In addition, data were collected on their age, marital status, level of education and Body Mass Index (BMI) for all participants. In the patient group, the data for each subject were collected using the Fagerstrom Test for Nicotine Dependence (FTND), the Alcohol Use Disorders Identification Test (AUDIT), and a drug use history, which included the age of onset, total duration of MA use, the number of relapses and addiction severity.Results: Our results showed that MA addicts had lower vitamin B12 levels (p < 0.05) than those of healthy controls, but Hcy levels were not significantly different between the two groups (p > 0.05). Serum B12 levels were negatively correlated with the number of relapses in the MA group. Furthermore, binary logistics regression analysis indicated that the B12 was an influencing factor contributing to addiction severity.Conclusion: The findings of this study suggest that some MA addicts might have vitamin B12 deficiency, and serum B12 levels may be involved in the prognosis of MA addiction