AAU-net: An Adaptive Attention U-net for Breast Lesions Segmentation in Ultrasound Images

Various deep learning methods have been proposed to segment breast lesion from ultrasound images. However, similar intensity distributions, variable tumor morphology and blurred boundaries present challenges for breast lesions segmentation, especially for malignant tumors with irregular shapes. Considering the complexity of ultrasound images, we develop an adaptive attention U-net (AAU-net) to segment breast lesions automatically and stably from ultrasound images. Specifically, we introduce a hybrid adaptive attention module, which mainly consists of a channel self-attention block and a spatial self-attention block, to replace the traditional convolution operation. Compared with the conventional convolution operation, the design of the hybrid adaptive attention module can help us capture more features under different receptive fields. Different from existing attention mechanisms, the hybrid adaptive attention module can guide the network to adaptively select more robust representation in channel and space dimensions to cope with more complex breast lesions segmentation. Extensive experiments with several state-of-the-art deep learning segmentation methods on three public breast ultrasound datasets show that our method has better performance on breast lesion segmentation. Furthermore, robustness analysis and external experiments demonstrate that our proposed AAU-net has better generalization performance on the segmentation of breast lesions. Moreover, the hybrid adaptive attention module can be flexibly applied to existing network frameworks.Comment: Breast cancer segmentation, Ultrasound images, Hybrid attention, Adaptive learning, Deep learnin

ESKNet-An enhanced adaptive selection kernel convolution for breast tumors segmentation

Breast cancer is one of the common cancers that endanger the health of women globally. Accurate target lesion segmentation is essential for early clinical intervention and postoperative follow-up. Recently, many convolutional neural networks (CNNs) have been proposed to segment breast tumors from ultrasound images. However, the complex ultrasound pattern and the variable tumor shape and size bring challenges to the accurate segmentation of the breast lesion. Motivated by the selective kernel convolution, we introduce an enhanced selective kernel convolution for breast tumor segmentation, which integrates multiple feature map region representations and adaptively recalibrates the weights of these feature map regions from the channel and spatial dimensions. This region recalibration strategy enables the network to focus more on high-contributing region features and mitigate the perturbation of less useful regions. Finally, the enhanced selective kernel convolution is integrated into U-net with deep supervision constraints to adaptively capture the robust representation of breast tumors. Extensive experiments with twelve state-of-the-art deep learning segmentation methods on three public breast ultrasound datasets demonstrate that our method has a more competitive segmentation performance in breast ultrasound images.Comment: 12 pages, 8 figure

Two-Level Evaluation on Sensor Interoperability of Features in Fingerprint Image Segmentation

Features used in fingerprint segmentation significantly affect the segmentation performance. Various features exhibit different discriminating abilities on fingerprint images derived from different sensors. One feature which has better discriminating ability on images derived from a certain sensor may not adapt to segment images derived from other sensors. This degrades the segmentation performance. This paper empirically analyzes the sensor interoperability problem of segmentation feature, which refers to the feature’s ability to adapt to the raw fingerprints captured by different sensors. To address this issue, this paper presents a two-level feature evaluation method, including the first level feature evaluation based on segmentation error rate and the second level feature evaluation based on decision tree. The proposed method is performed on a number of fingerprint databases which are obtained from various sensors. Experimental results show that the proposed method can effectively evaluate the sensor interoperability of features, and the features with good evaluation results acquire better segmentation accuracies of images originating from different sensors

AAU-Net: an Adaptive Attention U-Net for breast lesions segmentation in ultrasound images

Various deep learning methods have been proposed to segment breast lesions from ultrasound images. However, similar intensity distributions, variable tumor morphologies and blurred boundaries present challenges for breast lesions segmentation, especially for malignant tumors with irregular shapes. Considering the complexity of ultrasound images, we develop an adaptive attention U-net (AAU-net) to segment breast lesions automatically and stably from ultrasound images. Specifically, we introduce a hybrid adaptive attention module (HAAM), which mainly consists of a channel self-attention block and a spatial self-attention block, to replace the traditional convolution operation. Compared with the conventional convolution operation, the design of the hybrid adaptive attention module can help us capture more features under different receptive fields. Different from existing attention mechanisms, the HAAM module can guide the network to adaptively select more robust representation in channel and space dimensions to cope with more complex breast lesions segmentation. Extensive experiments with several state-of-the-art deep learning segmentation methods on three public breast ultrasound datasets show that our method has better performance on breast lesions segmentation. Furthermore, robustness analysis and external experiments demonstrate that our proposed AAU-net has better generalization performance in the breast lesion segmentation. Moreover, the HAAM module can be flexibly applied to existing network frameworks. The source code is available on https://github.com/CGPxy/AAU-net

Multimodal Failure Matching Point Based Motion Object Saliency Detection for Unconstrained Videos

Inspired by classical feature descriptors in motion matching, this paper proposes a multimodal failure matching point collection method, which is defined as FMP. FMP is, in fact, a collection of unstable features with a low matching degree in the conventional matching task. Based on FMP, a novel model for the saliency detection of motion object is developed. Models are evaluated on the DAVIS and SegTrackv2 datasets and compared with recently advanced object detection algorithms. The comparison results demonstrate the availability and effectiveness of FMP in the detection of motion object saliency

Reshaping immunometabolism in the tumour microenvironment to improve cancer immunotherapy

The evolving understanding of cellular metabolism has revealed a the promise of strategies aiming to modulate anticancer immunity by targeting metabolism. The combination of metabolic inhibitors with immune checkpoint blockade (ICB), chemotherapy and radiotherapy may offer new approaches to cancer treatment. However, it remains unclear how these strategies can be better utilized despite the complex tumour microenvironment (TME). Oncogene-driven metabolic changes in tumour cells can affect the TME, limiting the immune response and creating many barriers to cancer immunotherapy. These changes also reveal opportunities to reshape the TME to restore immunity by targeting metabolic pathways. Further exploration is required to determine how to make better use of these mechanistic targets. Here, we review the mechanisms by which tumour cells reshape the TME and cause immune cells to transition into an abnormal state by secreting multiple factors, with the ultimate goal of proposing targets and optimizing the use of metabolic inhibitors. Deepening our understanding of changes in metabolism and immune function in the TME will help advance this promising field and enhance immunotherapy

Rethinking the unpretentious U-net for medical ultrasound image segmentation

Breast tumor segmentation from ultrasound images is one of the key steps that help us characterize and localize tumor regions. However, variable tumor morphology, blurred boundaries, and similar intensity distributions bring challenges for radiologists to segment breast tumors manually. During clinical diagnosis, there are higher demands on the segmentation accuracy and efficiency of breast ultrasound images, so there is an urgent need for an automated method to improve the segmentation accuracy as a technical tool to assist diagnosis. Inspired by the U-net and its many variations, this paper proposed an unpretentious nested U-net (NU-net) for accurate and efficient breast tumor segmentation. The key idea is to utilize U-nets with different depths and shared weights to achieve robust characterization of breast tumors. Specifically, we first utilize the deeper U-net (fifteen layers) as the backbone network to extract more sufficient breast tumor features. Then, we developed a multi-output U-net to be taken as the bond between the encoder and the decoder to enhance the network adaptability for breast tumors with different scales. Finally, the short-connection based on multi-step down-sampling is used to enhance the correlation of long-range information of encoded features. Extensive experimental results with fifteen state-of-the-art segmentation methods on three public breast ultrasound datasets demonstrate that our method has a more competitive segmentation performance on breast tumors. Furthermore, the robustness of our approach is further illustrated by the segmentation of renal ultrasound images. The source code is publicly available on https://github.com/CGPxy/NU-net.</p