JSI-GAN: GAN-Based Joint Super-Resolution and Inverse Tone-Mapping with Pixel-Wise Task-Specific Filters for UHD HDR Video

Joint learning of super-resolution (SR) and inverse tone-mapping (ITM) has been explored recently, to convert legacy low resolution (LR) standard dynamic range (SDR) videos to high resolution (HR) high dynamic range (HDR) videos for the growing need of UHD HDR TV/broadcasting applications. However, previous CNN-based methods directly reconstruct the HR HDR frames from LR SDR frames, and are only trained with a simple L2 loss. In this paper, we take a divide-and-conquer approach in designing a novel GAN-based joint SR-ITM network, called JSI-GAN, which is composed of three task-specific subnets: an image reconstruction subnet, a detail restoration (DR) subnet and a local contrast enhancement (LCE) subnet. We delicately design these subnets so that they are appropriately trained for the intended purpose, learning a pair of pixel-wise 1D separable filters via the DR subnet for detail restoration and a pixel-wise 2D local filter by the LCE subnet for contrast enhancement. Moreover, to train the JSI-GAN effectively, we propose a novel detail GAN loss alongside the conventional GAN loss, which helps enhancing both local details and contrasts to reconstruct high quality HR HDR results. When all subnets are jointly trained well, the predicted HR HDR results of higher quality are obtained with at least 0.41 dB gain in PSNR over those generated by the previous methods.Comment: The first two authors contributed equally to this work. Accepted at AAAI 2020. (Camera-ready version

Prevention and Treatment of Multiple Osteoporotic Compression Fracture

Korea's demographic profile is undergoing tremendous change as the country rapidly ages at one of the fastest rates in the world. Indeed, the country is expected to become an "aged society" in 2018 when the proportion of elderly is estimated to reach 14.3% of the total population. With the notable increase in the number of elderly individuals, the incidence of osteoporotic fractures will also likely increase. Osteoporosis is a systemic musculoskeletal disease that is characterized by the decreased bone quantity and the abnormalities of the microstructures. There are both conservative and surgical treatment modalities for the fracture: conservative treatments include pharmacological treatments and orthosis; surgical treatments include vertebroplasty, kyphoplasty, and reconstructive surgery. Clinicians should consider the severity of osteoporosis, the concurrent osteoporotic fracture, the age and sex of the patient, and the underlying diseases in making a patient-tailored prescription

Modernizing Old Photos Using Multiple References via Photorealistic Style Transfer

This paper firstly presents old photo modernization using multiple references by performing stylization and enhancement in a unified manner. In order to modernize old photos, we propose a novel multi-reference-based old photo modernization (MROPM) framework consisting of a network MROPM-Net and a novel synthetic data generation scheme. MROPM-Net stylizes old photos using multiple references via photorealistic style transfer (PST) and further enhances the results to produce modern-looking images. Meanwhile, the synthetic data generation scheme trains the network to effectively utilize multiple references to perform modernization. To evaluate the performance, we propose a new old photos benchmark dataset (CHD) consisting of diverse natural indoor and outdoor scenes. Extensive experiments show that the proposed method outperforms other baselines in performing modernization on real old photos, even though no old photos were used during training. Moreover, our method can appropriately select styles from multiple references for each semantic region in the old photo to further improve the modernization performance.Comment: Accepted to CVPR 2023. Website: https://kaist-viclab.github.io/old-photo-modernizatio

Ammonium Inhibits Chromomethylase 3-Mediated Methylation of the Arabidopsis Nitrate Reductase Gene NIA2

Gene methylation is an important mechanism regulating gene expression and genome stability. Our previous work showed that methylation of the nitrate reductase (NR) gene NIA2 was dependent on chromomethylase 3 (CMT3). Here, we show that CMT3-mediated NIA2 methylation is regulated by ammonium in Arabidopsis thaliana. CHG sequences (where H can be A, T, or C) were methylated in NIA2 but not in NIA1, and ammonium [(NH4)2SO4] treatment completely blocked CHG methylation in NIA2. By contrast, ammonium had no effect on CMT3 methylation, indicating that ammonium negatively regulates CMT3-mediated NIA2 methylation without affecting CMT3 methylation. Ammonium upregulated NIA2 mRNA expression, which was consistent with the repression of NIA2 methylation by ammonium. Ammonium treatment also reduced the overall genome methylation level of wild-type Arabidopsis. Moreover, CMT3 bound to specific promoter and intragenic regions of NIA2. These combined results indicate that ammonium inhibits CMT3-mediated methylation of NIA2 and that of other target genes, and CMT3 selectively binds to target DNA sequences for methylation

Synthetic chloride transporters with the binding mode observed in a ClC chloride channel

A series of synthetic molecules bearing the same hydrogen bonding mode observed in StClC were prepared and their transport ability of chloride ion across a lipid membrane was systematically optimized.close4