Speeding up Permutation Testing in Neuroimaging

Multiple hypothesis testing is a significant problem in nearly all neuroimaging studies. In order to correct for this phenomena, we require a reliable estimate of the Family-Wise Error Rate (FWER). The well known Bonferroni correction method, while simple to implement, is quite conservative, and can substantially under-power a study because it ignores dependencies between test statistics. Permutation testing, on the other hand, is an exact, non-parametric method of estimating the FWER for a given $\alpha$-threshold, but for acceptably low thresholds the computational burden can be prohibitive. In this paper, we show that permutation testing in fact amounts to populating the columns of a very large matrix ${\bf P}$. By analyzing the spectrum of this matrix, under certain conditions, we see that ${\bf P}$ has a low-rank plus a low-variance residual decomposition which makes it suitable for highly sub--sampled --- on the order of $0.5\%$ --- matrix completion methods. Based on this observation, we propose a novel permutation testing methodology which offers a large speedup, without sacrificing the fidelity of the estimated FWER. Our evaluations on four different neuroimaging datasets show that a computational speedup factor of roughly $50\times$ can be achieved while recovering the FWER distribution up to very high accuracy. Further, we show that the estimated $\alpha$-threshold is also recovered faithfully, and is stable.Comment: NIPS 1

Voting Systems with Trust Mechanisms in Cyberspace: Vulnerabilities and Defenses

With the popularity of voting systems in cyberspace, there is growing evidence that current voting systems can be manipulated by fake votes. This problem has attracted many researchers working on guarding voting systems in two areas: relieving the effect of dishonest votes by evaluating the trust of voters, and limiting the resources that can be used by attackers, such as the number of voters and the number of votes. In this paper, we argue that powering voting systems with trust and limiting attack resources are not enough. We present a novel attack named as Reputation Trap (RepTrap). Our case study and experiments show that this new attack needs much less resources to manipulate the voting systems and has a much higher success rate compared with existing attacks. We further identify the reasons behind this attack and propose two defense schemes accordingly. In the first scheme, we hide correlation knowledge from attackers to reduce their chance to affect the honest voters. In the second scheme, we introduce robustness-of-evidence, a new metric, in trust calculation to reduce their effect on honest voters. We conduct extensive experiments to validate our approach. The results show that our defense schemes not only can reduce the success rate of attacks but also significantly increase the amount of resources an adversary needs to launch a successful attack

Numerical modelling of micron particle inhalation in a realistic nasal airway with pediatric adenoid hypertrophy: A virtual comparison between pre- and postoperative models

Adenoid hypertrophy (AH) is an obstructive condition due to enlarged adenoids, causing mouth breathing, nasal blockage, snoring and/or restless sleep. While reliable diagnostic techniques, such as lateral soft tissue x-ray imaging or flexible nasopharyngoscopy, have been widely adopted in general practice, the actual impact of airway obstruction on nasal airflow and inhalation exposure to drug aerosols remains largely unknown. In this study, the effects of adenoid hypertrophy on airflow and micron particle inhalation exposure characteristics were analysed by virtually comparing pre- and postoperative models based on a realistic 3-year-old nasal airway with AH. More specifically, detailed comparison focused on anatomical shape variations, overall airflow and olfactory ventilation, associated particle deposition in overall and local regions were conducted. Our results indicate that the enlarged adenoid tissue can significantly alter the airflow fields. By virtually removing the enlarged tissue and restoring the airway, peak velocity and wall shear stress were restored, and olfactory ventilation was considerably improved (with a 16∼63% improvement in terms of local ventilation speed). Furthermore, particle deposition results revealed that nasal airway with AH exhibits higher particle filtration tendency with densely packed deposition hot spots being observed along the floor region and enlarged adenoid tissue area. While for the postoperative model, the deposition curve was shifted to the right. The local deposition efficiency results demonstrated that more particles with larger inertia can be delivered to the targeted affected area following Adenoidectomy (Adenoid Removal). Research findings are expected to provide scientific evidence for adenoidectomy planning and aerosol therapy following Adenoidectomy, which can substantially improve present clinical treatment outcomes.</p

Evaluating Hallucinations in Chinese Large Language Models

In this paper, we establish a benchmark named HalluQA (Chinese Hallucination Question-Answering) to measure the hallucination phenomenon in Chinese large language models. HalluQA contains 450 meticulously designed adversarial questions, spanning multiple domains, and takes into account Chinese historical culture, customs, and social phenomena. During the construction of HalluQA, we consider two types of hallucinations: imitative falsehoods and factual errors, and we construct adversarial samples based on GLM-130B and ChatGPT. For evaluation, we design an automated evaluation method using GPT-4 to judge whether a model output is hallucinated. We conduct extensive experiments on 24 large language models, including ERNIE-Bot, Baichuan2, ChatGLM, Qwen, SparkDesk and etc. Out of the 24 models, 18 achieved non-hallucination rates lower than 50%. This indicates that HalluQA is highly challenging. We analyze the primary types of hallucinations in different types of models and their causes. Additionally, we discuss which types of hallucinations should be prioritized for different types of models.Comment: Work in progres

Life cycle exposure to 2-phenylbenzimidazole-5-sulfonic acid disrupts reproductive endocrine system and induces transgenerational adverse effects in zebrafish

Global attention has been focused on organic UV filters due to their ubiquity and potential damage to aquatic environment, yet the effects of their life cycle exposure on fish reproduction remain unknown. In the present study, the influence of 2-phenylbenzimidazole-5-sulfonic acid (PBSA) exposure on the reproductive endocrine system of zebrafish was examined, from 6 hours post fertilization (hpf) until 150 days, at levels that near-environmentally relevant (0 to 20 μg/L). Our results showed that exposure to PBSA at 20 μg/L caused a slight decrease in the Gonadosomatic Index (GSI) of female zebrafish in the F0 generation. Furthermore, this exposure had a negatively effect on reproduction, accompanied by delayed oocyte maturation, reduced cumulative egg production and decreased fertilization rate. Additionally, offspring embryos displayed reduced egg diameter at 0.75 hpf, delayed cumulative hatching rate at 60 hpf, and increased deformities rate at 72 hpf, indicating an adverse transgenerational effect. Moreover, PBSA exposure was associated with decreased plasma levels of sex hormones of 17β-estradiol (E2) and 11-ketotestosterone (11-KT), as well as altered the transcriptional profiles of certain genes in the HPG (hypothalamic–pituitary–gonadal) and liver axis. Molecular docking (MD) simulations revealed that specific amino acid residues of PBSA interact with zebrafish estrogen receptors, confirming its xenoestrogenic properties. Therefore, exposure to PBSA during its life cycle can disturb fish reproduction through endocrine disruption, thus necessitating strict environmental regulations for the disposal of UV filters to protect ecological and public health

Analysis of COVID-19 Guideline Quality and Change of Recommendations: A Systematic Review.

Background Hundreds of coronavirus disease 2019 (COVID-19) clinical practice guidelines (CPGs) and expert consensus statements have been developed and published since the outbreak of the epidemic. However, these CPGs are of widely variable quality. So, this review is aimed at systematically evaluating the methodological and reporting qualities of COVID-19 CPGs, exploring factors that may influence their quality, and analyzing the change of recommendations in CPGs with evidence published. Methods We searched five electronic databases and five websites from 1 January to 31 December 2020 to retrieve all COVID-19 CPGs. The assessment of the methodological and reporting qualities of CPGs was performed using the AGREE II instrument and RIGHT checklist. Recommendations and evidence used to make recommendations in the CPGs regarding some treatments for COVID-19 (remdesivir, glucocorticoids, hydroxychloroquine/chloroquine, interferon, and lopinavir-ritonavir) were also systematically assessed. And the statistical inference was performed to identify factors associated with the quality of CPGs. Results We included a total of 92 COVID-19 CPGs developed by 19 countries. Overall, the RIGHT checklist reporting rate of COVID-19 CPGs was 33.0%, and the AGREE II domain score was 30.4%. The overall methodological and reporting qualities of COVID-19 CPGs gradually improved during the year 2020. Factors associated with high methodological and reporting qualities included the evidence-based development process, management of conflicts of interest, and use of established rating systems to assess the quality of evidence and strength of recommendations. The recommendations of only seven (7.6%) CPGs were informed by a systematic review of evidence, and these seven CPGs have relatively high methodological and reporting qualities, in which six of them fully meet the Institute of Medicine (IOM) criteria of guidelines. Besides, a rapid advice CPG developed by the World Health Organization (WHO) of the seven CPGs got the highest overall scores in methodological (72.8%) and reporting qualities (83.8%). Many CPGs covered the same clinical questions (it refers to the clinical questions on the effectiveness of treatments of remdesivir, glucocorticoids, hydroxychloroquine/chloroquine, interferon, and lopinavir-ritonavir in COVID-19 patients) and were published by different countries or organizations. Although randomized controlled trials and systematic reviews on the effectiveness of treatments of remdesivir, glucocorticoids, hydroxychloroquine/chloroquine, interferon, and lopinavir-ritonavir for patients with COVID-19 have been published, the recommendations on those treatments still varied greatly across COVID-19 CPGs published in different countries or regions, which may suggest that the CPGs do not make sufficient use of the latest evidence. Conclusions Both the methodological and reporting qualities of COVID-19 CPGs increased over time, but there is still room for further improvement. The lack of effective use of available evidence and management of conflicts of interest were the main reasons for the low quality of the CPGs. The use of formal rating systems for the quality of evidence and strength of recommendations may help to improve the quality of CPGs in the context of the COVID-19 pandemic. During the pandemic, we suggest developing a living guideline of which recommendations are supported by a systematic review for it can facilitate the timely translation of the latest research findings to clinical practice. We also suggest that CPG developers should register the guidelines in a registration platform at the beginning for it can reduce duplication development of guidelines on the same clinical question, increase the transparency of the development process, and promote cooperation among guideline developers all over the world. Since the International Practice Guideline Registry Platform has been created, developers could register guidelines prospectively and internationally on this platform

Detailed Assessment of Nasal Inter-Chamber Anatomical Variations and Its Effect on Flow Apportionment and Inhalation Exposure Patterns

Although many parametric studies have been conducted in developing standardized nasal geometry and analysing associated airflow dynamics, most of them are based on symmetrical nasal chambers assumption, while the inter-chamber variations due to the morphological asymmetry of the two nasal chambers are much less investigated. To address this issue, this paper presents an inter-chamber anatomical variability study by developing a shape comparison method to quantify inter-chamber anatomical differences. Then the anatomical deviation is correlated with the flow apportionment and the associated nanoparticle deposition patterns using CFD method. Results show that noticeable inter-chamber difference is observed especially in the inferior and middle passages where most inhaled flow is distributed to. Additionally, the shape of vestibule notch and septum deviation contributes to the discrepancy flow behaviour between two chambers. Consequently, these differences lead to variations in regional nanoparticle deposition, especially for 1 nm particles in the olfactory region, where the inter-chamber differences can reach up to 400%. Our results suggest that the inter-chamber anatomical variation should be considered when developing standardized nasal models

Geochemistry of tin (Sn) in Chinese coals

Based on 1625 data collected from the published literature, the geochemistry of tin (Sn) in Chinese coals, including the abundance, distribution, modes of occurrence, genetic types and combustion behavior, was discussed to make a better understanding. Our statistic showed the average Sn of Chinese coal was 3.38 mg/kg, almost two times higher than the world. Among all the samples collected, Guangxi coals occupied an extremely high Sn enrichment (10.46 mg/kg), making sharp contrast to Xinjiang coals (0.49 mg/kg). Two modes of occurrence of Sn in Chinese coals were found, including sulfide-bounded Sn and clay-bounded Sn. In some coalfields, such as Liupanshui, Huayingshan and Haerwusu, a response between REEs distribution and Sn content was found which may caused by the transportation of Sn including clay minerals between coal seams. According to the responses reflecting on REEs patterns of each coalfield, several genetic types of Sn in coalfields were discussed. The enrichment of Sn in Guangxi coals probably caused by Sn-rich source rocks and multiple-stage hydrothermal fluids. The enriched Sn in western Guizhou coals was probably caused by volcanic ashes and sulfide-fixing mechanism. The depletion of Sn in Shengli coalfield, Inner Mongolia, may attribute to hardly terrigenous input and fluids erosion. As a relative easily volatilized element, the Sn-containing combustion by-products tended to be absorbed on the fine particles of fly ash. In 2012, the emission flux of Sn by Chinese coal combustion was estimated to be 0.90 x 10(9) g