7 research outputs found
Knowledge-aware Deep Framework for Collaborative Skin Lesion Segmentation and Melanoma Recognition
Deep learning techniques have shown their superior performance in
dermatologist clinical inspection. Nevertheless, melanoma diagnosis is still a
challenging task due to the difficulty of incorporating the useful
dermatologist clinical knowledge into the learning process. In this paper, we
propose a novel knowledge-aware deep framework that incorporates some clinical
knowledge into collaborative learning of two important melanoma diagnosis
tasks, i.e., skin lesion segmentation and melanoma recognition. Specifically,
to exploit the knowledge of morphological expressions of the lesion region and
also the periphery region for melanoma identification, a lesion-based pooling
and shape extraction (LPSE) scheme is designed, which transfers the structure
information obtained from skin lesion segmentation into melanoma recognition.
Meanwhile, to pass the skin lesion diagnosis knowledge from melanoma
recognition to skin lesion segmentation, an effective diagnosis guided feature
fusion (DGFF) strategy is designed. Moreover, we propose a recursive mutual
learning mechanism that further promotes the inter-task cooperation, and thus
iteratively improves the joint learning capability of the model for both skin
lesion segmentation and melanoma recognition. Experimental results on two
publicly available skin lesion datasets show the effectiveness of the proposed
method for melanoma analysis.Comment: Pattern Recognitio
Toward achieving robust low-level and high-level scene parsing
In this paper, we address the challenging task of scene segmentation. We first discuss and compare two widely used approaches to retain detailed spatial information from pretrained CNN - "dilation" and "skip". Then, we demonstrate that the parsing performance of "skip" network can be noticeably improved by modifying the parameterization of skip layers. Furthermore, we introduce a "dense skip" architecture to retain a rich set of low-level information from pre-trained CNN, which is essential to improve the low-level parsing performance. Meanwhile, we propose a convolutional context network (CCN) and place it on top of pre-trained CNNs, which is used to aggregate contexts for high-level feature maps so that robust high-level parsing can be achieved. We name our segmentation network enhanced fully convolutional network (EFCN) based on its significantly enhanced structure over FCN. Extensive experimental studies justify each contribution separately. Without bells and whistles, EFCN achieves state-of-the-arts on segmentation datasets of ADE20K, Pascal Context, SUN-RGBD and Pascal VOC 2012.NRF (Natl Research Foundation, S’pore)MOE (Min. of Education, S’pore)Accepted versio