Leveraging Hidden Positives for Unsupervised Semantic Segmentation

Dramatic demand for manpower to label pixel-level annotations triggered the advent of unsupervised semantic segmentation. Although the recent work employing the vision transformer (ViT) backbone shows exceptional performance, there is still a lack of consideration for task-specific training guidance and local semantic consistency. To tackle these issues, we leverage contrastive learning by excavating hidden positives to learn rich semantic relationships and ensure semantic consistency in local regions. Specifically, we first discover two types of global hidden positives, task-agnostic and task-specific ones for each anchor based on the feature similarities defined by a fixed pre-trained backbone and a segmentation head-in-training, respectively. A gradual increase in the contribution of the latter induces the model to capture task-specific semantic features. In addition, we introduce a gradient propagation strategy to learn semantic consistency between adjacent patches, under the inherent premise that nearby patches are highly likely to possess the same semantics. Specifically, we add the loss propagating to local hidden positives, semantically similar nearby patches, in proportion to the predefined similarity scores. With these training schemes, our proposed method achieves new state-of-the-art (SOTA) results in COCO-stuff, Cityscapes, and Potsdam-3 datasets. Our code is available at: https://github.com/hynnsk/HP.Comment: Accepted to CVPR 202

Sub-fingerprint masking for a robust audio fingerprinting system in a real-noise environment for portable consumer devices

author's final draftThe robustness of audio fingerprinting system in a noisy environment is a principal challenge in the area of content-based music retrieval, especially for use in portable consumer devices. Our new audio fingerprint method using sub-fingerprint masking based on the predominant pitch extraction dramatically increases the accuracy of the audio fingerprinting system in a noisy environment, while requiring much less computing power for matching, compared to the expanded hash table lookup method, where the searching complexity increases by the factor of 33 times the degree of expansion.This research was supported by Konkuk University

Efficient terahertz generation in highly nonlinear organic crystal HMB-TMS

We report on generation of strong and broadband terahertz (THz) pulses via collinearly phase-matched optical rectification of near-infrared femtosecond pulses in the organic nonlinear optical HMB-TMS (2-(4-hydroxy-3-methoxystyryl)-3-methylbenzo[d]thiazol-3-ium 2,4,6-trimethylbenzenesulfonate) single crystals which exhibit optimal molecular orientation and large macroscopic optical nonlinearity for efficient THz wave generation. Single-cycle THz pulses with a peak electric field strength of 0.66 MV/cm and a bandwidth from 0.1 to 5.4 THz are achieved from an HMB-TMS crystal with only a 2-mm clear aperture pumped by 1350 nm pulses at moderate fluences. The generated THz energy is about 1 µJ and the corresponding pump-to-THz energy conversion efficiency reaches 0.23%.United States. Office of Naval Research (N00014-13-1-0509)United States. Office of Naval Research. Defense University Research Instrumentation Program (N00014-15-1-2879)Samsung Global Research Outreach ProgramNational Research Foundation of Korea (No. 2016R1A2B4011050National Research Foundation of Korea (No. 2014R1A5A1009799)National Research Foundation of Korea (No. 2015K1A3A1A14004646)National Research Foundation of Korea (No. 2009-0093826

Patient-specific Guides Using 3-dimensional Reconstruction Provide Accuracy and Reproducibility in Reverse Total Shoulder Arthroplasty

Background We aimed to evaluate whether the use of our novel patient-specific guide (PSG) with 3-dimensional reconstruction in reverse total shoulder arthroplasty (RTSA) would allow accurate and reliable implantation of the glenoid and humeral components. Methods 20 fresh-frozen cadaveric shoulders were used. The PSG group (n=10) and conventional group (n=10) was evaluated the accuracy and reproducibility of implant positioning between before and after surgery on the computed tomography image. Results The superoinferior and anteroposterior offset in the glenoid component were 0.42 ± 0.07, 0.50 ± 0.08 in the conventional group and 0.45 ± 0.03, 0.46 ± 0.02 in the PSG group. The inclination and version angles were -1.93° ± 4.31°, 2.27° ± 5.91° and 0.46° ± 0.02°, 3.38° ± 2.79°. The standard deviation showed a smaller difference in the PSG group. The anteroposterior and lateromedial humeral canal center offset in the humeral component were 0.45 ± 0.12, 0.48 ± 0.15 in the conventional group and 0.46 ± 0.59 (p=0.794), 0.46 ± 0.06 (p=0.702) in the PSG group. The PSG showed significantly better humeral stem alignment. Conclusions The use of PSGs with 3-dimensional reconstruction reduces variabilities in glenoid and humerus component positions and prevents extreme positioning errors in RTSA

Melatonin restores Muc2 depletion induced by V. vulnificus VvpM via melatonin receptor 2 coupling with Gαq

Background Melatonin (5-methoxy-N-acetyltryptamine), a hormone produced in the pineal gland, has a variety of biological functions as an antioxidant, but a functional role of melatonin in the regulation of intestinal mucin (Muc) production during bacterial infection has yet to be described in detail. In this study, we investigate the effects of melatonin during Muc2 repression elicited by the Gram-negative bacterium V. vulnificus. Methods Mucus-secreting human HT29-MTX cells were used to study the functional role of melatonin during Muc2 depletion induced by the recombinant protein (r) VvpM produced by V. vulnificus. The regulatory effects of melatonin coupling with melatonin receptor 2 (MT2) on the production of reactive oxygen species (ROS), the activation of PKCδ and ERK, and the hypermethylation of the Muc2 promoter as induced by rVvpM were examined. Experimental mouse models of V. vulnificus infection were used to study the role of melatonin and how it neutralizes the bacterial toxin activity related to Muc2 repression. Results Recombinant protein (r) VvpM significantly reduced the level of Muc2 in HT29-MTX cells. The repression of Muc2 induced by rVvpM was significantly restored upon a treatment with melatonin (1 μM), which had been inhibited by the knockdown of MT2 coupling with Gαq and the NADPH oxidase subunit p47 phox. Melatonin inhibited the ROS-mediated phosphorylation of PKCδ and ERK responsible for region-specific hypermethylation in the Muc2 promoter in rVvpM-treated HT29-MTX cells. In the mouse models of V. vulnificus infection, treatment with melatonin maintained the level of Muc2 expression in the intestine. In addition, the mutation of the VvpM gene from V. vulnificus exhibited an effect similar to that of melatonin. Conclusions These results demonstrate that melatonin acting on MT2 inhibits the hypermethylation of the Muc2 promoter to restore the level of Muc2 production in intestinal epithelial cells infected with V. vulnificus.This research was supported by Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Education (NRF-2016R1D1A1B03930458)