Generalizing Bayesian Optimization with Decision-theoretic Entropies

Bayesian optimization (BO) is a popular method for efficiently inferring optima of an expensive black-box function via a sequence of queries. Existing information-theoretic BO procedures aim to make queries that most reduce the uncertainty about optima, where the uncertainty is captured by Shannon entropy. However, an optimal measure of uncertainty would, ideally, factor in how we intend to use the inferred quantity in some downstream procedure. In this paper, we instead consider a generalization of Shannon entropy from work in statistical decision theory (DeGroot 1962, Rao 1984), which contains a broad class of uncertainty measures parameterized by a problem-specific loss function corresponding to a downstream task. We first show that special cases of this entropy lead to popular acquisition functions used in BO procedures such as knowledge gradient, expected improvement, and entropy search. We then show how alternative choices for the loss yield a flexible family of acquisition functions that can be customized for use in novel optimization settings. Additionally, we develop gradient-based methods to efficiently optimize our proposed family of acquisition functions, and demonstrate strong empirical performance on a diverse set of sequential decision making tasks, including variants of top-$k$ optimization, multi-level set estimation, and sequence search.Comment: Appears in Proceedings of the 36th Conference on Neural Information Processing Systems (NeurIPS 2022

Evaluation and Analysis of Hallucination in Large Vision-Language Models

Large Vision-Language Models (LVLMs) have recently achieved remarkable success. However, LVLMs are still plagued by the hallucination problem, which limits the practicality in many scenarios. Hallucination refers to the information of LVLMs' responses that does not exist in the visual input, which poses potential risks of substantial consequences. There has been limited work studying hallucination evaluation in LVLMs. In this paper, we propose Hallucination Evaluation based on Large Language Models (HaELM), an LLM-based hallucination evaluation framework. HaELM achieves an approximate 95% performance comparable to ChatGPT and has additional advantages including low cost, reproducibility, privacy preservation and local deployment. Leveraging the HaELM, we evaluate the hallucination in current LVLMs. Furthermore, we analyze the factors contributing to hallucination in LVLMs and offer helpful suggestions to mitigate the hallucination problem. Our training data and human annotation hallucination data will be made public soon.Comment: 11 pages, 5 figure

O2ATH: An OpenMP Offloading Toolkit for the Sunway Heterogeneous Manycore Platform

The next generation Sunway supercomputer employs the SW26010pro processor, which features a specialized on-chip heterogeneous architecture. Applications with significant hotspots can benefit from the great computation capacity improvement of Sunway many-core architectures by carefully making intensive manual many-core parallelization efforts. However, some legacy projects with large codebases, such as CESM, ROMS and WRF, contain numerous lines of code and do not have significant hotspots. The cost of manually porting such applications to the Sunway architecture is almost unaffordable. To overcome such a challenge, we have developed a toolkit named O2ATH. O2ATH forwards GNU OpenMP runtime library calls to Sunway's Athread library, which greatly simplifies the parallelization work on the Sunway architecture.O2ATH enables users to write both MPE and CPE code in a single file, and parallelization can be achieved by utilizing OpenMP directives and attributes. In practice, O2ATH has helped us to port two large projects, CESM and ROMS, to the CPEs of the next generation Sunway supercomputers via the OpenMP offload method. In the experiments, kernel speedups range from 3 to 15 times, resulting in 3 to 6 times whole application speedups.Furthermore, O2ATH requires significantly fewer code modifications compared to manually crafting CPE functions.This indicates that O2ATH can greatly enhance development efficiency when porting or optimizing large software projects on Sunway supercomputers.Comment: 15 pages, 6 figures, 5 tables

A note on business survival and social network

We extend Burt, Burzynska, and Opper's cross-sectional network prediction of relative success among Chinese entrepreneurs by predicting which ventures are still active five years later. The cross-sectional analysis is corroborated in three ways (despite the vicissitudes of a national anti-corruption campaign): (1) Businesses run in 2012 by CEOs with a network rich in structural holes are more likely to be active five years later, in 2017. (2) Survival odds are improved if the large, open network around a CEO in 2012 was initially a supportive ‘cocoon’ closed network when the business was founded. (3) Both results are contingent on capturing the guanxi ties valuable early in the history of the business. The two network effects disappear when the network around a CEO is limited to his or her currently valued contacts. Beyond corroboration, we find that advantage is concentrated in ventures that began well and had become successful. Network advantage here does not compensate for weakness – it is a mechanism for cumulative advantage, amplifying the success of businesses already doing well

Associations between Fast-Food Restaurants Surrounding Kindergartens and Childhood Obesity: Evidence from China

The prevalence of obesity among preschool children has risen dramatically due to the influx of Western fast food in China. In this study, we aimed to provide clear evidence on the associations between fast-food restaurants and childhood obesity. We collected and combined three unique cross-sectional datasets: physical fitness data, geographic information, and the financial data of each kindergarten. The two-stage least squares were used for empirical analyses. The final data including 75,730 children were from 785 kindergartens in 82 cities and 23 provinces in China in 2018. The mean age of participants was 4.94 ± 0.87; 34,249 (45.2%) females and 41,481 (54.8%) males. The number of fast-food restaurants within 1, 2, and 3 km radii had a significant and positive correlation with obesity, and this correlation decreased as the radius increased. Furthermore, the distance to the nearest fast-food restaurant had a significant and negative correlation with obesity. Western fast-food restaurants contributed more to obesity than the broader definition of fast-food restaurants. There was marked heterogeneity between urban and rural areas. Our findings documented that fast-food restaurants had a significant and positive association with childhood obesity, thus the restriction of fast-food restaurants surrounding kindergartens might be considered

Paleowind Directions over the Tarim Block during the Mesoproterozoic, Northwestern China

The Tarim Block is an ancient plate with a basement of ancient continental crust, which has been separated from the Rodinia supercontinent since the Neoproterozoic. During the Neoproterozoic, which lasted nearly 500 Myr, this block experienced significant evolutionary processes, such as proliferation, radioactive decay of elements, and gradual cooling and solidification. The investigation of Neoproterozoic paleogeography may shed light on the evolution of these geological events. In order to realize this potential, this study aimed to infer paleowind directions over the Tarim Block during each epoch of the Cryogenian–Ediacaran and to constrain the paleogeographic location of the Tarim Block. To this end, outcrop magnetic fabric data were employed to analyze the anisotropy of magnetic susceptibility within the Tarim Block. The anisotropy of magnetic susceptibility measurements yielded mean paleowind directions of 308° ± 69°, 277° ± 78°, and 256° ± 76° from the present north for the Early, Middle, and Late Cryogenian, respectively; the corresponding values for the Early and Late Ediacaran were 237° ± 77° and 254° ± 73° from the present north, respectively. Considering the rotation relationship of the Tarim Block from the Neoproterozoic to the present, the paleowind directions during the Early, Middle, and Late Cryogenian were ~55°, ~35°, and ~35° from the paleo-north, respectively. The paleowind directions during the Early and Late Ediacaran were ~35° and ~60° from paleo-north, respectively. By referring to the correspondence between the paleowind directions over the Tarim Block and trade winds in the Northern Hemisphere, this study provides evidence for the location of the Tarim Block during the Cryogenian–Ediacaran. The main contributions of this study can be summarized as follows: (1) paleowind patterns are established through the analysis of the anisotropy of magnetic susceptibility; (2) the paleogeographic location of the Tarim Block during the Cryogenian–Ediacaran is constrained; and (3) a reference for further study of the paleogeography of the Tarim Block during the Cryogenian–Ediacaran is provided

The imbalance in the complement system and its possible physiological mechanisms in patients with lung cancer

Abstract Background The clinical and experimental evidences for complement-cancer relationships are solid, whereas an epidemiological study reporting the imbalance of complement system in patients is still lacking. Methods Using publicly available databases, we jointly compared the levels of complement components in plasma and lung cancer tissues. With iTRAQ proteomics, quantitative RT-PCR and western blotting, we analysed the differences in complement levels in lung cancer tissues and normal control tissues. Complement components are mainly synthesized by the liver and secreted into the blood. Using paired co-cultures of human normal QSG-7701 hepatocytes with lung cancer cells (A549, LTEP-α-2 or NCI-H1703) or human normal bronchial epithelial (HBE) cells, we examined the effects of lung cancer cells on complement synthesis and secretion in QSG-7701 hepatocytes. Results An integrated analysis of transcriptome and proteome datasets from 43 previous studies revealed lower mRNA and protein levels of 25 complement and complement-related components in lung cancer tissues than those in normal control tissues; conversely, higher levels of complement proteins were detected in plasma from patients than those in healthy subjects. Our iTRAQ proteome study identified decreased and increased levels of 31 and 2 complement and complement-related proteins, respectively, in lung cancer tissues, of which the reduced levels of 10 components were further confirmed using quantitative RT-PCR and western blotting. Paired co-cultures of QSG-7701 hepatocytes with A549, LTEP-α-2, NCI-H1703 or HBE cells indicated that lung cancer cells increased complement synthesis and secretion in QSG-7701 cells compared to HBE cells. Conclusions The opposite associations between the levels of complement and complement-related components in lung cancer tissues and plasma from patients that have been repeatedly reported by independent publications may indicate the prevalence of an imbalance in the complement system of lung cancer patients. The possible mechanism of the imbalance may be associated not only with the decreased complement levels in lung cancer tissues but also the concurrent lung cancer tissue-induced increase in hepatocyte complement synthesis and plasma secretion in patients. And the imbalance should be accompanied by a suppression of complement-dependent immunity in lung cancer tissues coupled with a burden of complement immunity in the circulation of patients

Clinical pharmacy undergraduate education in China: a comparative analysis based on ten universities’ training programs

Abstract Background In recent years, the scale of personnel training for clinical pharmacy professionals in China has expanded increasingly, however, the shortage of clinical pharmacists is still prominent. In 2018, the Ministry of Education of China released national standards for the teaching quality of undergraduate majors at regular colleges and universities, which has developed a core policy for undergraduate clinical pharmacy training. To explore the training methods for clinical pharmacy professionals in China and to promote the healthy and sustainable development of the clinical pharmacy education system. This study comparatively analyzed the training programs for clinical pharmacy undergraduates in China’s ten universities, discussed training programs suitable for clinical pharmacy professionals in China. Methods The clinical pharmacy education programs in these ten universities were obtained through official school websites or by interviewing relevant people, and then compared and analyzed. Results The school with the largest number of courses and the most class hours in general courses is University A1 (34 courses, 1316 class hours), and the school with the most credits is University B1 (75.5 credits). The schools with the largest number of courses and the most class hours in the basic courses are University A1 (50 courses, 1997 class hours), and the schools with the most credits are University B3 and University B1 (105.5 credits). The schools with the largest number of courses in the core courses are University C1 (23 courses), and the school with the most credits and class hours is University B2 (51 credits, 914 class hours). The school with the most class hours in practical teaching is University B6 (1406 class hours), and the schools with the longest internship time are University A1 and University B6 (52 weeks). Conclusions There was substantial variation in programs. There remains a gap between the existing educational model and clinical training in pharmacy in China and developed countries. China should explore the most appropriate method for undergraduate education in clinical pharmacy based on studying foreign excellent educational models and the experience of China

Correction to: The imbalance in the complement system and its possible physiological mechanisms in patients with lung cancer

Following publication of the original article [1], it was noticed that Fig. 3c was omitted from the final published article