50 research outputs found

    Parallel Diffusion Models of Operator and Image for Blind Inverse Problems

    Full text link
    Diffusion model-based inverse problem solvers have demonstrated state-of-the-art performance in cases where the forward operator is known (i.e. non-blind). However, the applicability of the method to blind inverse problems has yet to be explored. In this work, we show that we can indeed solve a family of blind inverse problems by constructing another diffusion prior for the forward operator. Specifically, parallel reverse diffusion guided by gradients from the intermediate stages enables joint optimization of both the forward operator parameters as well as the image, such that both are jointly estimated at the end of the parallel reverse diffusion procedure. We show the efficacy of our method on two representative tasks -- blind deblurring, and imaging through turbulence -- and show that our method yields state-of-the-art performance, while also being flexible to be applicable to general blind inverse problems when we know the functional forms.Comment: 25 pages, 13 figure

    Stimulated penetrating keratoplasty using real-time virtual intraoperative surgical optical coherence tomography

    Get PDF
    An intraoperative surgical microscope is an essential tool in a neuro-or ophthalmological surgical environment. Yet, it has an inherent limitation to classify subsurface information because it only provides the surface images. To compensate for and assist in this problem, combining the surgical microscope with optical coherence tomography (OCT) has been adapted. We developed a real-time virtual intraoperative surgical OCT (VISOCT) system by adapting a spectral-domain OCT scanner with a commercial surgical microscope. Thanks to our custommade beam splitting and image display subsystems, the OCT images and microscopic images are simultaneously visualized through an ocular lens or the eyepiece of the microscope. This improvement helps surgeons to focus on the operation without distraction to view OCT images on another separate display. Moreover, displaying the OCT live images on the eyepiece helps surgeon's depth perception during the surgeries. Finally, we successfully processed stimulated penetrating keratoplasty in live rabbits. We believe that these technical achievements are crucial to enhance the usability of the VISOCT system in a real surgical operating condition.open0

    3D Denoisers are Good 2D Teachers: Molecular Pretraining via Denoising and Cross-Modal Distillation

    Full text link
    Pretraining molecular representations from large unlabeled data is essential for molecular property prediction due to the high cost of obtaining ground-truth labels. While there exist various 2D graph-based molecular pretraining approaches, these methods struggle to show statistically significant gains in predictive performance. Recent work have thus instead proposed 3D conformer-based pretraining under the task of denoising, which led to promising results. During downstream finetuning, however, models trained with 3D conformers require accurate atom-coordinates of previously unseen molecules, which are computationally expensive to acquire at scale. In light of this limitation, we propose D&D, a self-supervised molecular representation learning framework that pretrains a 2D graph encoder by distilling representations from a 3D denoiser. With denoising followed by cross-modal knowledge distillation, our approach enjoys use of knowledge obtained from denoising as well as painless application to downstream tasks with no access to accurate conformers. Experiments on real-world molecular property prediction datasets show that the graph encoder trained via D&D can infer 3D information based on the 2D graph and shows superior performance and label-efficiency against other baselines.Comment: 16 pages, 5 figure

    Promoting Thermal Conductivity of Alumina-Based Composite Materials by Systematically Incorporating Modified Graphene Oxide

    Get PDF
    Small amounts of thermally conductive graphene oxide (GO) and modified GO are systematically introduced as a second filler to thermal interface materials (TIMs) consisting of alumina (Al2O3) particles and polydimethylsiloxane (PDMS). The surface of GO is covalently linked with an organic moiety, octadecylamine (ODA), to significantly improve the miscibility and dispersity of GO across the TIM matrix. Subsequently, two series of PDMS-Al2O3 composite TIMs are manufactured as a function of GO and ODA-GO content (0.25 wt%–2.5 wt%) to understand the effect of these second additives. The incorporation of GO into the Al2O3-PDMS composite materials generally increases the thermal conductivity (TC), ranging from 18% to 29%. Conversely, the use of ODA-GO further enhances the overall performance of TIMs (22–54%) by facilitating the dispersion degree of GO across the composite matrix. The great improvement in TC is presumably related to the formation of conductive pathways by uniformly integrating 2D-type GO flakes across spherical Al2O3 particle networks. The ability to simply regulate the polarity of the thermally conductive second filler can provide an idea for designing cost-effective and practical TIM-2-type pads that can be commercially applicable in between an integrated heat spreader and a heat sink

    High tumor hexokinase-2 expression promotes a pro-tumorigenic immune microenvironment by modulating CD8+/regulatory T-cell infiltration

    Get PDF
    Background Relationship between cancer cell glycolysis and the landscape of tumor immune microenvironment in human cancers was investigated. Methods Forty-one fresh lung adenocarcinoma (ADC) tissues were analyzed using flow cytometry for comprehensive immunoprofiling. Formalin-fixed tissues were immunostained for hexokinase-2 (HK2) to assess cancer cell glycolysis. For validation, formalin-fixed tissues from 375 lung ADC, 118 lung squamous cell carcinoma (SqCC), 338 colon ADC, and 78 lung cancer patients treated with anti-PD-1/PD-L1 immunotherapy were immunostained for HK2, CD8, and FOXP3. Results Based on immunoprofiling of lung ADC, HK2 tumor expression was associated with the composition of lymphoid cells rather than myeloid cells. High HK2 tumor expression was associated with immunosuppressive/pro-tumorigenic features, especially decreased ratio of CD8 + T-cells to Tregs (rho = −0.415, P = 0.012). This correlation was also confirmed in four different cohorts including lung ADC and SqCC, colon ADC, and the immunotherapy cohort (rho = −0.175~-0.335, all P < 0.05). A low CD8 + T-cell to Treg ratio was associated with poor progression-free survival and overall survival in lung SqCC patients, and a shorter overall survival in the immunotherapy cohort (all, P < 0.05). Conclusion An increase in HK2 expression may contribute to shaping the immunosuppressive/pro-tumorigenic tumor microenvironment by modulating the CD8 + T-cell to Treg ratio. Targeting tumor HK2 expression might be a potential strategy for enhancing anti-tumor immunity.This work was supported by the Basic Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Science and ICT (MSIT) (grant No.: 2020R1A4A1017515)

    Wide Field-of-View, High-Resolution Endoscopic Lens Design with Low F-Number for Disposable Endoscopy

    No full text
    In the past few decades, video endoscopy has become one of the primary medical devices in diverse clinical fields for examination, treatment, and early disease diagnosis of the gastrointestinal tract. For an accurate diagnosis, an endoscopic camera offering bright and wide field-of-view images is required while maintaining its compact dimensions to enter the long, narrow, and dark tract inside of the body. Recent endoscopic lenses successfully provide wide fields-of-view and have compact sizes for the system; however, their f-numbers still remain at 2.8 or higher. Therefore, further improvement in f-numbers is required to compensate for the restricted illumination system of the endoscopic probe. Here, we present a low f-number endoscopic lens design while providing wide field-of-view and high-resolution imaging. The proposed lens system achieved a low f-number of 2.2 and a field-of-view of 140 deg. The modulation transfer function (MTF) is over 20% at 180 lp/mm, and relative illumination is more than 60% in the full field. Additionally, the proposed lens is designed for a 1/4” 5-megapixel complementary metal-oxide-semiconductor (CMOS) image sensor with a pixel size of 1.4 µm. This all-plastic lens design could help develop a high-performance disposable endoscope that prevents the risk of infection or cross-contamination with mass manufacture and low cost

    Two-axis polydimethylsiloxane-based electromagnetic microelectromechanical system scanning mirror for optical coherence tomography

    No full text
    Compact size and fast imaging abilities are key requirements for the clinical implementation of an optical coherence tomography (OCT) system. Among the various small-sized technology, a microelectromechanical system (MEMS) scanning mirror is widely used in a miniaturized OCT system. However, the complexities of conventional MEMS fabrication processes and relatively high costs have restricted fast clinical translation and commercialization of the OCT systems. To resolve these problems, we developed a two-axis polydimethylsiloxane (PDMS)-based MEMS (2A-PDMS-MEMS) scanning mirror through simple processes with low costs. It had a small size of 15 x 15 x 15 mm(3), was fast, and had a wide scanning range at a low voltage. The AC/ DC responses were measured to evaluate the performance of the 2A-PDMS-MEMS scanning mirror. The maximum scanning angles were measured as +/- 16.6 deg and +/- 11.6 deg along the X and Y axes, respectively, and the corresponding field of view was 29.8 mm x 20.5 mm with an optical focal length of 50 mm. The resonance frequencies were 82 and 57 Hz along the X and Y axes, respectively. Finally, in vivo B-scan and volumetric OCT images of human fingertips and palms were successfully acquired using the developed SD-OCT system based on the 2A-PDMS-MEMS scanning mirror. (C) 2016 Society of Photo-Optical Instrumentation Engineers (SPIE)111Nsciescopu
    corecore