Seeing Beyond the Brain: Conditional Diffusion Model with Sparse Masked Modeling for Vision Decoding

Decoding visual stimuli from brain recordings aims to deepen our understanding of the human visual system and build a solid foundation for bridging human and computer vision through the Brain-Computer Interface. However, reconstructing high-quality images with correct semantics from brain recordings is a challenging problem due to the complex underlying representations of brain signals and the scarcity of data annotations. In this work, we present MinD-Vis: Sparse Masked Brain Modeling with Double-Conditioned Latent Diffusion Model for Human Vision Decoding. Firstly, we learn an effective self-supervised representation of fMRI data using mask modeling in a large latent space inspired by the sparse coding of information in the primary visual cortex. Then by augmenting a latent diffusion model with double-conditioning, we show that MinD-Vis can reconstruct highly plausible images with semantically matching details from brain recordings using very few paired annotations. We benchmarked our model qualitatively and quantitatively; the experimental results indicate that our method outperformed state-of-the-art in both semantic mapping (100-way semantic classification) and generation quality (FID) by 66% and 41% respectively. An exhaustive ablation study was also conducted to analyze our framework.Comment: 8 pages, 9 figures, 2 tables, accepted by CVPR2023, see https://mind-vis.github.io/ for more informatio

Wild2Avatar: Rendering Humans Behind Occlusions

Rendering the visual appearance of moving humans from occluded monocular videos is a challenging task. Most existing research renders 3D humans under ideal conditions, requiring a clear and unobstructed scene. Those methods cannot be used to render humans in real-world scenes where obstacles may block the camera's view and lead to partial occlusions. In this work, we present Wild2Avatar, a neural rendering approach catered for occluded in-the-wild monocular videos. We propose occlusion-aware scene parameterization for decoupling the scene into three parts - occlusion, human, and background. Additionally, extensive objective functions are designed to help enforce the decoupling of the human from both the occlusion and the background and to ensure the completeness of the human model. We verify the effectiveness of our approach with experiments on in-the-wild videos

In-painting Radiography Images for Unsupervised Anomaly Detection

We propose space-aware memory queues for in-painting and detecting anomalies from radiography images (abbreviated as SQUID). Radiography imaging protocols focus on particular body regions, therefore producing images of great similarity and yielding recurrent anatomical structures across patients. To exploit this structured information, our SQUID consists of a new Memory Queue and a novel in-painting block in the feature space. We show that SQUID can taxonomize the ingrained anatomical structures into recurrent patterns; and in the inference, SQUID can identify anomalies (unseen/modified patterns) in the image. SQUID surpasses the state of the art in unsupervised anomaly detection by over 5 points on two chest X-ray benchmark datasets. Additionally, we have created a new dataset (DigitAnatomy), which synthesizes the spatial correlation and consistent shape in chest anatomy. We hope DigitAnatomy can prompt the development, evaluation, and interpretability of anomaly detection methods, particularly for radiography imaging.Comment: Main paper with appendi

Exploiting Structural Consistency of Chest Anatomy for Unsupervised Anomaly Detection in Radiography Images

Radiography imaging protocols focus on particular body regions, therefore producing images of great similarity and yielding recurrent anatomical structures across patients. Exploiting this structured information could potentially ease the detection of anomalies from radiography images. To this end, we propose a Simple Space-Aware Memory Matrix for In-painting and Detecting anomalies from radiography images (abbreviated as SimSID). We formulate anomaly detection as an image reconstruction task, consisting of a space-aware memory matrix and an in-painting block in the feature space. During the training, SimSID can taxonomize the ingrained anatomical structures into recurrent visual patterns, and in the inference, it can identify anomalies (unseen/modified visual patterns) from the test image. Our SimSID surpasses the state of the arts in unsupervised anomaly detection by +8.0%, +5.0%, and +9.9% AUC scores on ZhangLab, COVIDx, and CheXpert benchmark datasets, respectively. Code: https://github.com/MrGiovanni/SimSIDComment: IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI). arXiv admin note: substantial text overlap with arXiv:2111.1349

Serum Fetuin-A Associates with Type 2 Diabetes and Insulin Resistance in Chinese Adults

Previous studies have demonstrated that fetuin-A is related to insulin resistance among subjects with normal glucose tolerance but not patients with type 2 diabetes. There are limited data available concerning fetuin-A and insulin resistance in Chinese. We aimed to study the association of fetuin-A with insulin resistance among participants with or without type 2 diabetes in a large sample size of adults aged 40 and older.A community-based cross-sectional study was performed among 5,227 Chinese adults. The average age of our study was 61.5±9.9 years. Serum fetuin-A concentrations were not significantly different between male and female (296.9 vs. 292.9 mg/l, p = 0.11). Compared with the lowest quartile, the highest quartile of serum fetuin-A revealed a significant higher proportion of type 2 diabetic patients (34.8% vs. 27.3%, p<0.0001). In the multinomial logit models, the risk of type 2 diabetes was associated with each one quartile increase of serum fetuin-A concentrations when referenced not only to normal glucose tolerance (OR 1.24, 95% CI 1.07-1.43, p = 0.004) but also to impaired glucose regulation (OR 1.25, 95% CI 1.08-1.44, p = 0.003, respectively), after adjustment for age, sex, community, current smoking, and current drinking. The logistic regression analysis showed that fetuin-A were associated with elevated HOMA-IR and fasting serum insulin both among the participants with or without type 2 diabetes in the full adjusted analysis. There was no significant association between elevated serum fetuin-A concentrations and impaired glucose regulation (all p≥0.12).Higher fetuin-A concentrations were associated with type 2 diabetes and insulin resistance in middle aged and elderly Chinese

Study of the B−→Λc+Λˉc−K−B^{-} \to \Lambda_{c}^{+} \bar{\Lambda}_{c}^{-} K^{-} decay

The decay $B^{-} \to \Lambda_{c}^{+} \bar{\Lambda}_{c}^{-} K^{-}$ is studied in proton-proton collisions at a center-of-mass energy of $\sqrt{s}=13$ TeV using data corresponding to an integrated luminosity of 5 $\mathrm{fb}^{-1}$ collected by the LHCb experiment. In the $\Lambda_{c}^+ K^{-}$ system, the $\Xi_{c}(2930)^{0}$ state observed at the BaBar and Belle experiments is resolved into two narrower states, $\Xi_{c}(2923)^{0}$ and $\Xi_{c}(2939)^{0}$, whose masses and widths are measured to be $$m(\Xi_{c}(2923)^{0}) = 2924.5 \pm 0.4 \pm 1.1 \,\mathrm{MeV}, \\ m(\Xi_{c}(2939)^{0}) = 2938.5 \pm 0.9 \pm 2.3 \,\mathrm{MeV}, \\ \Gamma(\Xi_{c}(2923)^{0}) = \phantom{000}4.8 \pm 0.9 \pm 1.5 \,\mathrm{MeV},\\ \Gamma(\Xi_{c}(2939)^{0}) = \phantom{00}11.0 \pm 1.9 \pm 7.5 \,\mathrm{MeV},$$ where the first uncertainties are statistical and the second systematic. The results are consistent with a previous LHCb measurement using a prompt $\Lambda_{c}^{+} K^{-}$ sample. Evidence of a new $\Xi_{c}(2880)^{0}$ state is found with a local significance of $3.8\,\sigma$, whose mass and width are measured to be $2881.8 \pm 3.1 \pm 8.5\,\mathrm{MeV}$ and $12.4 \pm 5.3 \pm 5.8 \,\mathrm{MeV}$, respectively. In addition, evidence of a new decay mode $\Xi_{c}(2790)^{0} \to \Lambda_{c}^{+} K^{-}$ is found with a significance of $3.7\,\sigma$. The relative branching fraction of $B^{-} \to \Lambda_{c}^{+} \bar{\Lambda}_{c}^{-} K^{-}$ with respect to the $B^{-} \to D^{+} D^{-} K^{-}$ decay is measured to be $2.36 \pm 0.11 \pm 0.22 \pm 0.25$, where the first uncertainty is statistical, the second systematic and the third originates from the branching fractions of charm hadron decays.Comment: All figures and tables, along with any supplementary material and additional information, are available at https://cern.ch/lhcbproject/Publications/p/LHCb-PAPER-2022-028.html (LHCb public pages

Measurement of the ratios of branching fractions R(D∗)\mathcal{R}(D^{*}) and R(D0)\mathcal{R}(D^{0})

The ratios of branching fractions $\mathcal{R}(D^{*})\equiv\mathcal{B}(\bar{B}\to D^{*}\tau^{-}\bar{\nu}_{\tau})/\mathcal{B}(\bar{B}\to D^{*}\mu^{-}\bar{\nu}_{\mu})$ and $\mathcal{R}(D^{0})\equiv\mathcal{B}(B^{-}\to D^{0}\tau^{-}\bar{\nu}_{\tau})/\mathcal{B}(B^{-}\to D^{0}\mu^{-}\bar{\nu}_{\mu})$ are measured, assuming isospin symmetry, using a sample of proton-proton collision data corresponding to 3.0 fb${ }^{-1}$ of integrated luminosity recorded by the LHCb experiment during 2011 and 2012. The tau lepton is identified in the decay mode $\tau^{-}\to\mu^{-}\nu_{\tau}\bar{\nu}_{\mu}$. The measured values are $\mathcal{R}(D^{*})=0.281\pm0.018\pm0.024$ and $\mathcal{R}(D^{0})=0.441\pm0.060\pm0.066$, where the first uncertainty is statistical and the second is systematic. The correlation between these measurements is $\rho=-0.43$. Results are consistent with the current average of these quantities and are at a combined 1.9 standard deviations from the predictions based on lepton flavor universality in the Standard Model.Comment: All figures and tables, along with any supplementary material and additional information, are available at https://cern.ch/lhcbproject/Publications/p/LHCb-PAPER-2022-039.html (LHCb public pages

Measurement of forward charged hadron flow harmonics in peripheral PbPb collisions at √sNN = 5.02 TeV with the LHCb detector

Flow harmonic coefficients, v n , which are the key to studying the hydrodynamics of the quark-gluon plasma (QGP) created in heavy-ion collisions, have been measured in various collision systems and kinematic regions and using various particle species. The study of flow harmonics in a wide pseudorapidity range is particularly valuable to understand the temperature dependence of the shear viscosity to entropy density ratio of the QGP. This paper presents the first LHCb results of the second- and the third-order flow harmonic coefficients of charged hadrons as a function of transverse momentum in the forward region, corresponding to pseudorapidities between 2.0 and 4.9, using the data collected from PbPb collisions in 2018 at a center-of-mass energy of 5.02 TeV . The coefficients measured using the two-particle angular correlation analysis method are smaller than the central-pseudorapidity measurements at ALICE and ATLAS from the same collision system but share similar features