I2^2-SDF: Intrinsic Indoor Scene Reconstruction and Editing via Raytracing in Neural SDFs

In this work, we present I$^2$-SDF, a new method for intrinsic indoor scene reconstruction and editing using differentiable Monte Carlo raytracing on neural signed distance fields (SDFs). Our holistic neural SDF-based framework jointly recovers the underlying shapes, incident radiance and materials from multi-view images. We introduce a novel bubble loss for fine-grained small objects and error-guided adaptive sampling scheme to largely improve the reconstruction quality on large-scale indoor scenes. Further, we propose to decompose the neural radiance field into spatially-varying material of the scene as a neural field through surface-based, differentiable Monte Carlo raytracing and emitter semantic segmentations, which enables physically based and photorealistic scene relighting and editing applications. Through a number of qualitative and quantitative experiments, we demonstrate the superior quality of our method on indoor scene reconstruction, novel view synthesis, and scene editing compared to state-of-the-art baselines.Comment: Accepted by CVPR 202

Quantitative profiling of integrin alpha v beta 3 on single cells with quantum dot labeling to reveal the phenotypic heterogeneity of glioblastoma

The distribution, localization and density of individual molecules (e.g. drug-specific receptors) on single cells can offer profound information about cell phenotypes. Profiling this information is a new research direction within the field of single cell biology, but it remains technically challenging. Through the combined use of quantum dot labeling, structured illumination microscopy (SIM) and computer-aided local surface reconstruction, we acquired a 3D imaging map of a drug target molecule, integrin alpha v beta 3, on glioblastoma cells at the single cell level. The results revealed that integrin alpha v beta 3 exhibits discrete distribution on the surface of glioblastoma cells, with its density differing significantly among cell lines. The density is illustrated as the approximate number of target molecules per mu m(2) on the irregular cell surface, ranging from 0 to 1.6. Functional studies revealed that the sensitivity of glioblastoma cells to inhibitor molecules depends on the density of the target molecules. After inhibitor treatment, the viability and invasion ability of different glioblastoma cells were highly correlated with the density of integrin alpha v beta 3 on their surfaces. This study not only provides a novel protocol for the quantitative analysis of surface proteins from irregular single cells, but also offers a clue for understanding the heterogeneity of tumor cells on the basis of molecular phenotypes. Thus, this work has potential significance in guiding targeted therapies for cancers