6 research outputs found
Masked Supervised Learning for Semantic Segmentation
Self-attention is of vital importance in semantic segmentation as it enables
modeling of long-range context, which translates into improved performance. We
argue that it is equally important to model short-range context, especially to
tackle cases where not only the regions of interest are small and ambiguous,
but also when there exists an imbalance between the semantic classes. To this
end, we propose Masked Supervised Learning (MaskSup), an effective single-stage
learning paradigm that models both short- and long-range context, capturing the
contextual relationships between pixels via random masking. Experimental
results demonstrate the competitive performance of MaskSup against strong
baselines in both binary and multi-class segmentation tasks on three standard
benchmark datasets, particularly at handling ambiguous regions and retaining
better segmentation of minority classes with no added inference cost. In
addition to segmenting target regions even when large portions of the input are
masked, MaskSup is also generic and can be easily integrated into a variety of
semantic segmentation methods. We also show that the proposed method is
computationally efficient, yielding an improved performance by 10\% on the mean
intersection-over-union (mIoU) while requiring less learnable
parameters
Learning to recognize occluded and small objects with partial inputs
Recognizing multiple objects in an image is challenging due to occlusions,
and becomes even more so when the objects are small. While promising, existing
multi-label image recognition models do not explicitly learn context-based
representations, and hence struggle to correctly recognize small and occluded
objects. Intuitively, recognizing occluded objects requires knowledge of
partial input, and hence context. Motivated by this intuition, we propose
Masked Supervised Learning (MSL), a single-stage, model-agnostic learning
paradigm for multi-label image recognition. The key idea is to learn
context-based representations using a masked branch and to model label
co-occurrence using label consistency. Experimental results demonstrate the
simplicity, applicability and more importantly the competitive performance of
MSL against previous state-of-the-art methods on standard multi-label image
recognition benchmarks. In addition, we show that MSL is robust to random
masking and demonstrate its effectiveness in recognizing non-masked objects.
Code and pretrained models are available on GitHub
Fill in Fabrics: Body-Aware Self-Supervised Inpainting for Image-Based Virtual Try-On
Previous virtual try-on methods usually focus on aligning a clothing item
with a person, limiting their ability to exploit the complex pose, shape and
skin color of the person, as well as the overall structure of the clothing,
which is vital to photo-realistic virtual try-on. To address this potential
weakness, we propose a fill in fabrics (FIFA) model, a self-supervised
conditional generative adversarial network based framework comprised of a
Fabricator and a unified virtual try-on pipeline with a Segmenter, Warper and
Fuser. The Fabricator aims to reconstruct the clothing image when provided with
a masked clothing as input, and learns the overall structure of the clothing by
filling in fabrics. A virtual try-on pipeline is then trained by transferring
the learned representations from the Fabricator to Warper in an effort to warp
and refine the target clothing. We also propose to use a multi-scale structural
constraint to enforce global context at multiple scales while warping the
target clothing to better fit the pose and shape of the person. Extensive
experiments demonstrate that our FIFA model achieves state-of-the-art results
on the standard VITON dataset for virtual try-on of clothing items, and is
shown to be effective at handling complex poses and retaining the texture and
embroidery of the clothing
Recommended from our members
Neutral sphingomyelinase 2 regulates inflammatory responses in monocytes/macrophages induced by TNF-α
Obesity is associated with elevated levels of TNF-alpha and proinflammatory CD11c monocytes/macrophages. TNF-alpha mediated dysregulation in the plasticity of monocytes/macrophages is concomitant with pathogenesis of several inflammatory diseases, including metabolic syndrome, but the underlying mechanisms are incompletely understood. Since neutral sphingomyelinase-2 (nSMase2: SMPD3) is a key enzyme for ceramide production involved in inflammation, we investigated whether nSMase2 contributed to the inflammatory changes in the monocytes/macrophages induced by TNF-alpha. In this study, we demonstrate that the disruption of nSMase activity in monocytes/macrophages either by chemical inhibitor GW4869 or small interfering RNA (siRNA) against SMPD3 results in defects in the TNF-alpha mediated expression of CD11c. Furthermore, blockage of nSMase in monocytes/macrophages inhibited the secretion of inflammatory mediators IL-1 beta and MCP-1. In contrast, inhibition of acid SMase (aSMase) activity did not attenuate CD11c expression or secretion of IL-1 beta and MCP-1. TNF-alpha-induced phosphorylation of JNK, p38 and NF-kappa B was also attenuated by the inhibition of nSMase2. Moreover, NF-kB/AP-1 activity was blocked by the inhibition of nSMase2. SMPD3 was elevated in PBMCs from obese individuals and positively corelated with TNF-alpha gene expression. These findings indicate that nSMase2 acts, at least in part, as a master switch in the TNF-alpha mediated inflammatory responses in monocytes/macrophages.Open access journalThis item from the UA Faculty Publications collection is made available by the University of Arizona with support from the University of Arizona Libraries. If you have questions, please contact us at [email protected]
Understanding the neuroprotective effect of tranexamic acid: an exploratory analysis of the CRASH-3 randomised trial
Background: The CRASH-3 trial hypothesised that timely tranexamic acid (TXA) treatment might reduce deaths from intracranial bleeding after traumatic brain injury (TBI). To explore the mechanism of action of TXA in TBI, we examined the timing of its effect on death. Methods: The CRASH-3 trial randomised 9202 patients within 3 h of injury with a GCS score ≤ 12 or intracranial bleeding on CT scan and no significant extracranial bleeding to receive TXA or placebo. We conducted an exploratory analysis of the effects of TXA on all-cause mortality within 24 h of injury and within 28 days, excluding patients with a GCS score of 3 or bilateral unreactive pupils, stratified by severity and country income. We pool data from the CRASH-2 and CRASH-3 trials in a one-step fixed effects individual patient data meta-analysis. Results: There were 7637 patients for analysis after excluding patients with a GCS score of 3 or bilateral unreactive pupils. Of 1112 deaths, 23.3% were within 24 h of injury (early deaths). The risk of early death was reduced with TXA (112 (2.9%) TXA group vs 147 (3.9%) placebo group; risk ratio [RR] RR 0.74, 95% CI 0.58–0.94). There was no evidence of heterogeneity by severity (p = 0.64) or country income (p = 0.68). The risk of death beyond 24 h of injury was similar in the TXA and placebo groups (432 (11.5%) TXA group vs 421 (11.7%) placebo group; RR 0.98, 95% CI 0.69–1.12). The risk of death at 28 days was 14.0% in the TXA group versus 15.1% in the placebo group (544 vs 568 events; RR 0.93, 95% CI 0.83–1.03). When the CRASH-2 and CRASH-3 trial data were pooled, TXA reduced early death (RR 0.78, 95% CI 0.70–0.87) and death within 28 days (RR 0.88, 95% CI 0.82–0.94). Conclusions: Tranexamic acid reduces early deaths in non-moribund TBI patients regardless of TBI severity or country income. The effect of tranexamic acid in patients with isolated TBI is similar to that in polytrauma. Treatment is safe and even severely injured patients appear to benefit when treated soon after injury. Trial registration: ISRCTN15088122, registered on 19 July 2011; NCT01402882, registered on 26 July 2011