Structured Bayesian Compression for Deep Neural Networks Based on The Turbo-VBI Approach

With the growth of neural network size, model compression has attracted increasing interest in recent research. As one of the most common techniques, pruning has been studied for a long time. By exploiting the structured sparsity of the neural network, existing methods can prune neurons instead of individual weights. However, in most existing pruning methods, surviving neurons are randomly connected in the neural network without any structure, and the non-zero weights within each neuron are also randomly distributed. Such irregular sparse structure can cause very high control overhead and irregular memory access for the hardware and even increase the neural network computational complexity. In this paper, we propose a three-layer hierarchical prior to promote a more regular sparse structure during pruning. The proposed three-layer hierarchical prior can achieve per-neuron weight-level structured sparsity and neuron-level structured sparsity. We derive an efficient Turbo-variational Bayesian inferencing (Turbo-VBI) algorithm to solve the resulting model compression problem with the proposed prior. The proposed Turbo-VBI algorithm has low complexity and can support more general priors than existing model compression algorithms. Simulation results show that our proposed algorithm can promote a more regular structure in the pruned neural networks while achieving even better performance in terms of compression rate and inferencing accuracy compared with the baselines

Effect of real-time computer-aided polyp detection system (ENDO-AID) on adenoma detection in endoscopists-in-training: a randomized trial

Background The effect of computer-aided polyp detection (CADe) on adenoma detection rate (ADR) among endoscopists-in-training remains unknown. Methods We performed a single-blind, parallel-group, randomized controlled trial in Hong Kong between April 2021 and July 2022 (NCT04838951). Eligible subjects undergoing screening/surveillance/diagnostic colonoscopies were randomized 1:1 to receive colonoscopies with CADe (ENDO-AID(OIP-1), Olympus Co., Japan) or not (control) during withdrawal. Procedures were performed by endoscopists-in-training with <500 procedures and <3 years’ experience. Randomization was stratified by patient age, sex, and endoscopist experience (beginner vs intermediate-level, <200 vs 200-500 procedures). Image enhancement and distal attachment devices were disallowed. Subjects with incomplete colonoscopies or inadequate bowel preparation were excluded. Treatment allocation was blinded to outcome assessors. The primary outcome was ADR. Secondary outcomes were ADR for different adenoma sizes and locations, mean number of adenomas, and non-neoplastic resection rate. Results 386 and 380 subjects were randomized to CADe and control groups, respectively. The overall ADR was significantly higher in CADe than control group (57.5% vs 44.5%, adjusted relative risk 1.41, 95%CI 1.17-1.72, p<0.001). The ADRs for <5mm (40.4% vs 25.0%) and 5-10mm adenomas (36.8% vs 29.2%) were higher in CADe group. The ADRs were higher in CADe group in both right (42.0% vs 30.8%) and left colon (34.5% vs 27.6%), but there was no significant difference in advanced ADR. The ADRs were higher in CADe group among beginners (60.0% vs 41.9%) and intermediate-level endoscopists (56.5% vs 45.5%). Mean number of adenomas (1.48 vs 0.86) and non-neoplastic resection rate were higher in CADe group (52.1% vs 35.0%). Conclusions Among endoscopists-in-training, the use of CADe during colonoscopies was associated with increased overall ADR. (ClinicalTrials.gov: NCT04838951

Surveillance of emerging drugs of abuse in Hong Kong: Validation of an analytical tool

© 2015, Hong Kong Academy of Medicine Press. All rights reserved. Objective: To validate a locally developed chromatography-based method to monitor emerging drugs of abuse whilst performing regular drug testing in abusers. Design: Cross-sectional study. Setting: Eleven regional hospitals, seven social service units, and a tertiary level clinical toxicology laboratory in Hong Kong. Participants: A total of 972 drug abusers and high-risk individuals were recruited from acute, rehabilitation, and high-risk settings between 1 November 2011 and 31 July 2013. A subset of the participants was of South Asian ethnicity. In total, 2000 urine or hair specimens were collected. Main outcome measures: Proof of concept that surveillance of emerging drugs of abuse can be performed whilst conducting routine drug of abuse testing in patients. Results: The method was successfully applied to 2000 samples with three emerging drugs of abuse detected in five samples: PMMA (paramethoxymethamphetamine), TFMPP [1-(3-trifluoromethylphenyl)piperazine], and methcathinone. The method also detected conventional drugs of abuse, with codeine, methadone, heroin, methamphetamine, and ketamine being the most frequently detected drugs. Other findings included the observation that South Asians had significantly higher rates of using opiates such as heroin, methadone, and codeine; and that ketamine and cocaine had significantly higher detection rates in acute subjects compared with the rehabilitation population. Conclusions: This locally developed analytical method is a valid tool for simultaneous surveillance of emerging drugs of abuse and routine drug monitoring of patients at minimal additional cost and effort. Continued, proactive surveillance and early identification of emerging drugs will facilitate prompt clinical, social, and legislative management.Link_to_subscribed_fulltex

Wild Type and Mutant 2009 Pandemic Influenza A (H1N1) Viruses Cause More Severe Disease and Higher Mortality in Pregnant BALB/c Mice

BACKGROUND: Pregnant women infected by the pandemic influenza A (H1N1) 2009 virus had more severe disease and higher mortality but its pathogenesis is still unclear. PRINCIPAL FINDINGS: We showed that higher mortality, more severe pneumonitis, higher pulmonary viral load, lower peripheral blood T lymphocytes and antibody responses, higher levels of proinflammatory cytokines and chemokines, and worse fetal development occurred in pregnant mice than non-pregnant controls infected by either wild type (clinical isolate) or mouse-adapted mutant virus with D222G substitution in hemagglutinin. These disease-associated changes and the lower respiratory tract involvement were worse in pregnant mice challenged by mutant virus. Though human placental origin JEG-3 cell line could be infected and proinflammatory cytokines or chemokines were elevated in amniotic fluid of some mice, no placental or fetal involvement by virus were detected by culture, real-time reverse transcription polymerase chain reaction or histopathological changes. Dual immunofluorescent staining of viral nucleoprotein and type II alveolar cell marker SP-C protein suggested that the majority of infected alveolar epithelial cells were type II pneumocytes. CONCLUSION: The adverse effect of this pandemic virus on maternal and fetal outcome is largely related to the severe pulmonary disease and the indirect effect of inflammatory cytokine spillover into the systemic circulation

Detailed spectral and morphological analysis of the shell type SNR RCW 86

Aims: We aim for an understanding of the morphological and spectral properties of the supernova remnant RCW~86 and for insights into the production mechanism leading to the RCW~86 very high-energy gamma-ray emission. Methods: We analyzed High Energy Spectroscopic System data that had increased sensitivity compared to the observations presented in the RCW~86 H.E.S.S. discovery publication. Studies of the morphological correlation between the 0.5-1~keV X-ray band, the 2-5~keV X-ray band, radio, and gamma-ray emissions have been performed as well as broadband modeling of the spectral energy distribution with two different emission models. Results:We present the first conclusive evidence that the TeV gamma-ray emission region is shell-like based on our morphological studies. The comparison with 2-5~keV X-ray data reveals a correlation with the 0.4-50~TeV gamma-ray emission.The spectrum of RCW~86 is best described by a power law with an exponential cutoff at $E_{cut}=(3.5\pm 1.2_{stat})$ TeV and a spectral index of $\Gamma$~$1.6\pm 0.2$. A static leptonic one-zone model adequately describes the measured spectral energy distribution of RCW~86, with the resultant total kinetic energy of the electrons above 1 GeV being equivalent to $\sim$0.1\% of the initial kinetic energy of a Type I a supernova explosion. When using a hadronic model, a magnetic field of $B$~100$\mu$G is needed to represent the measured data. Although this is comparable to formerly published estimates, a standard E$^{-2}$ spectrum for the proton distribution cannot describe the gamma-ray data. Instead, a spectral index of $\Gamma_p$~1.7 would be required, which implies that ~$7\times 10^{49}/n_{cm^{-3}}$erg has been transferred into high-energy protons with the effective density $n_{cm^{-3}}=n/ 1$ cm^-3. This is about 10\% of the kinetic energy of a typical Type Ia supernova under the assumption of a density of 1~cm^-3.Comment: accepted for publication by A&

Detection of variable VHE gamma-ray emission from the extra-galactic gamma-ray binary LMC P3

Context. Recently, the high-energy (HE, 0.1-100 GeV) $\gamma$-ray emission from the object LMC P3 in the Large Magellanic Cloud (LMC) has been discovered to be modulated with a 10.3-day period, making it the first extra-galactic $\gamma$-ray binary. Aims. This work aims at the detection of very-high-energy (VHE, >100 GeV) $\gamma$-ray emission and the search for modulation of the VHE signal with the orbital period of the binary system. Methods. LMC P3 has been observed with the High Energy Stereoscopic System (H.E.S.S.); the acceptance-corrected exposure time is 100 h. The data set has been folded with the known orbital period of the system in order to test for variability of the emission. Energy spectra are obtained for the orbit-averaged data set, and for the orbital phase bin around the VHE maximum. Results. VHE $\gamma$-ray emission is detected with a statistical significance of 6.4 $\sigma$. The data clearly show variability which is phase-locked to the orbital period of the system. Periodicity cannot be deduced from the H.E.S.S. data set alone. The orbit-averaged luminosity in the $1-10$ TeV energy range is $(1.4 \pm 0.2) \times 10^{35}$ erg/s. A luminosity of $(5 \pm 1) \times 10^{35}$ erg/s is reached during 20% of the orbit. HE and VHE $\gamma$-ray emissions are anti-correlated. LMC P3 is the most luminous $\gamma$-ray binary known so far.Comment: 5 pages, 3 figures, 1 table, accepted for publication in A&

Characterizing the gamma-ray long-term variability of PKS 2155-304 with H.E.S.S. and Fermi-LAT

Studying the temporal variability of BL Lac objects at the highest energies provides unique insights into the extreme physical processes occurring in relativistic jets and in the vicinity of super-massive black holes. To this end, the long-term variability of the BL Lac object PKS 2155-304 is analyzed in the high (HE, 100 MeV 200 GeV) gamma-ray domain. Over the course of ~9 yr of H.E.S.S observations the VHE light curve in the quiescent state is consistent with a log-normal behavior. The VHE variability in this state is well described by flicker noise (power-spectral-density index {\ss}_VHE = 1.10 +0.10 -0.13) on time scales larger than one day. An analysis of 5.5 yr of HE Fermi LAT data gives consistent results ({\ss}_HE = 1.20 +0.21 -0.23, on time scales larger than 10 days) compatible with the VHE findings. The HE and VHE power spectral densities show a scale invariance across the probed time ranges. A direct linear correlation between the VHE and HE fluxes could neither be excluded nor firmly established. These long-term-variability properties are discussed and compared to the red noise behavior ({\ss} ~ 2) seen on shorter time scales during VHE-flaring states. The difference in power spectral noise behavior at VHE energies during quiescent and flaring states provides evidence that these states are influenced by different physical processes, while the compatibility of the HE and VHE long-term results is suggestive of a common physical link as it might be introduced by an underlying jet-disk connection.Comment: 11 pages, 16 figure