FickleNet: Weakly and Semi-supervised Semantic Image Segmentation using Stochastic Inference

The main obstacle to weakly supervised semantic image segmentation is the difficulty of obtaining pixel-level information from coarse image-level annotations. Most methods based on image-level annotations use localization maps obtained from the classifier, but these only focus on the small discriminative parts of objects and do not capture precise boundaries. FickleNet explores diverse combinations of locations on feature maps created by generic deep neural networks. It selects hidden units randomly and then uses them to obtain activation scores for image classification. FickleNet implicitly learns the coherence of each location in the feature maps, resulting in a localization map which identifies both discriminative and other parts of objects. The ensemble effects are obtained from a single network by selecting random hidden unit pairs, which means that a variety of localization maps are generated from a single image. Our approach does not require any additional training steps and only adds a simple layer to a standard convolutional neural network; nevertheless it outperforms recent comparable techniques on the Pascal VOC 2012 benchmark in both weakly and semi-supervised settings.Comment: To appear in CVPR 201

Improving Visual Prompt Tuning for Self-supervised Vision Transformers

Visual Prompt Tuning (VPT) is an effective tuning method for adapting pretrained Vision Transformers (ViTs) to downstream tasks. It leverages extra learnable tokens, known as prompts, which steer the frozen pretrained ViTs. Although VPT has demonstrated its applicability with supervised vision transformers, it often underperforms with self-supervised ones. Through empirical observations, we deduce that the effectiveness of VPT hinges largely on the ViT blocks with which the prompt tokens interact. Specifically, VPT shows improved performance on image classification tasks for MAE and MoCo v3 when the prompt tokens are inserted into later blocks rather than the first block. These observations suggest that there exists an optimal location of blocks for the insertion of prompt tokens. Unfortunately, identifying the optimal blocks for prompts within each self-supervised ViT for diverse future scenarios is a costly process. To mitigate this problem, we propose a simple yet effective method that learns a gate for each ViT block to adjust its intervention into the prompt tokens. With our method, prompt tokens are selectively influenced by blocks that require steering for task adaptation. Our method outperforms VPT variants in FGVC and VTAB image classification and ADE20K semantic segmentation. The code is available at https://github.com/ryongithub/GatedPromptTuning.Comment: International Conference on Machine Learning (ICML) 202

Probabilistic Concept Bottleneck Models

Interpretable models are designed to make decisions in a human-interpretable manner. Representatively, Concept Bottleneck Models (CBM) follow a two-step process of concept prediction and class prediction based on the predicted concepts. CBM provides explanations with high-level concepts derived from concept predictions; thus, reliable concept predictions are important for trustworthiness. In this study, we address the ambiguity issue that can harm reliability. While the existence of a concept can often be ambiguous in the data, CBM predicts concepts deterministically without considering this ambiguity. To provide a reliable interpretation against this ambiguity, we propose Probabilistic Concept Bottleneck Models (ProbCBM). By leveraging probabilistic concept embeddings, ProbCBM models uncertainty in concept prediction and provides explanations based on the concept and its corresponding uncertainty. This uncertainty enhances the reliability of the explanations. Furthermore, as class uncertainty is derived from concept uncertainty in ProbCBM, we can explain class uncertainty by means of concept uncertainty. Code is publicly available at https://github.com/ejkim47/prob-cbm.Comment: International Conference on Machine Learning (ICML) 202

Frame-to-Frame Aggregation of Active Regions in Web Videos for Weakly Supervised Semantic Segmentation

When a deep neural network is trained on data with only image-level labeling, the regions activated in each image tend to identify only a small region of the target object. We propose a method of using videos automatically harvested from the web to identify a larger region of the target object by using temporal information, which is not present in the static image. The temporal variations in a video allow different regions of the target object to be activated. We obtain an activated region in each frame of a video, and then aggregate the regions from successive frames into a single image, using a warping technique based on optical flow. The resulting localization maps cover more of the target object, and can then be used as proxy ground-truth to train a segmentation network. This simple approach outperforms existing methods under the same level of supervision, and even approaches relying on extra annotations. Based on VGG-16 and ResNet 101 backbones, our method achieves the mIoU of 65.0 and 67.4, respectively, on PASCAL VOC 2012 test images, which represents a new state-of-the-art.Comment: ICCV 201

Alterations in Brain Morphometric Networks and Their Relationship with Memory Dysfunction in Patients with Type 2 Diabetes Mellitus

Cognitive dysfunction, a significant complication of type 2 diabetes mellitus (T2DM), can potentially manifest even from the early stages of the disease. Despite evidence of global brain atrophy and related cognitive dysfunction in early-stage T2DM patients, specific regions vulnerable to these changes have not yet been identified. The study enrolled patients with T2DM of less than five years’ duration and without chronic complications (T2DM group, n=100) and demographically similar healthy controls (control group, n=50). High-resolution T1-weighted magnetic resonance imaging data were subjected to independent component analysis to identify structurally significant components indicative of morphometric networks. Within these networks, the groups’ gray matter volumes were compared, and distinctions in memory performance were assessed. In the T2DM group, the relationship between changes in gray matter volume within these networks and declines in memory performance was examined. Among the identified morphometric networks, the T2DM group exhibited reduced gray matter volumes in both the precuneus (Bonferroni-corrected p=0.003) and insular-opercular (Bonferroni-corrected p=0.024) networks relative to the control group. Patients with T2DM demonstrated significantly lower memory performance than the control group (p=0.001). In the T2DM group, reductions in gray matter volume in both the precuneus (r=0.316, p=0.001) and insular-opercular (r=0.199, p=0.047) networks were correlated with diminished memory performance. Our findings indicate that structural alterations in the precuneus and insular-opercular networks, along with memory dysfunction, can manifest within the first 5 years following a diagnosis of T2DM

Congenital miliary tuberculosis in an 18-day-old boy

Congenital tuberculosis (TB) is a rare disease that is associated with high mortality. Mycobacterium tuberculosis, the causative agent, may be transmitted from the infected mother to the fetus by the transplacental route or by aspiration of infected amniotic fluid. Clinical symptoms and signs are not specific. Miliary patterns are the most common findings in the chest X-rays of many infants with congenital TB. In this case, an 18-day-old boy had jaundice on the fifth day of birth, and fever and respiratory distress appeared on the 18th day. Chest X-ray showed diffuse fine bilateral infiltration. Clinically, pneumonia or sepsis was suspected. Respiratory symptoms and chest X-ray findings worsened despite empirical antibiotic therapy. The lungs showed miliary infiltration suggestive of TB. Gastric aspirates were positive for M. tuberculosis. Respiratory distress and fever were gradually improved after anti-TB medication. Congenital TB is difficult to detect because of minimal or no symptoms during pregnancy and nonspecific symptoms in neonates. Hence, clinicians should suspect the possibility of TB infection even if neonates have non-specific symptoms. Early diagnosis and meticulous treatment are required for the survival of neonates with TB

Engineered biosynthesis of milbemycins in the avermectin high-producing strain Streptomyces avermitilis

Additional file 3 : Figure S2. HPLC analysis of milbemycins produced from S. avermitilis mutant strains and authentic standard milbemycins

A Case of Placenta Increta Presenting as Delayed Postabortal Intraperitoneal Bleeding in the First Trimester

Placenta increta is an uncommon and life-threatening complication of pregnancy characterized by complete or partial absence of the decidua basalis. Placenta increta usually presents with vaginal bleeding during difficult placental removal in the third-trimester. Although placenta increta may complicate first and early second-trimester pregnancy loss, the diagnosis can be very difficult during early pregnancy and thus the lesion is difficult to identify. We encountered with a woman who was diagnosed with placenta increta after receiving emergency hysterectomy due to intraperitoneal bleeding 2 months after an uncomplicated dilatation and curettage in the first trimester. Therefore, we report this case with a brief review of the literature