59 research outputs found
ICNet for Real-Time Semantic Segmentation on High-Resolution Images
We focus on the challenging task of real-time semantic segmentation in this
paper. It finds many practical applications and yet is with fundamental
difficulty of reducing a large portion of computation for pixel-wise label
inference. We propose an image cascade network (ICNet) that incorporates
multi-resolution branches under proper label guidance to address this
challenge. We provide in-depth analysis of our framework and introduce the
cascade feature fusion unit to quickly achieve high-quality segmentation. Our
system yields real-time inference on a single GPU card with decent quality
results evaluated on challenging datasets like Cityscapes, CamVid and
COCO-Stuff.Comment: ECCV 201
Learning Fully Dense Neural Networks for Image Semantic Segmentation
Semantic segmentation is pixel-wise classification which retains critical
spatial information. The "feature map reuse" has been commonly adopted in CNN
based approaches to take advantage of feature maps in the early layers for the
later spatial reconstruction. Along this direction, we go a step further by
proposing a fully dense neural network with an encoder-decoder structure that
we abbreviate as FDNet. For each stage in the decoder module, feature maps of
all the previous blocks are adaptively aggregated to feed-forward as input. On
the one hand, it reconstructs the spatial boundaries accurately. On the other
hand, it learns more efficiently with the more efficient gradient
backpropagation. In addition, we propose the boundary-aware loss function to
focus more attention on the pixels near the boundary, which boosts the "hard
examples" labeling. We have demonstrated the best performance of the FDNet on
the two benchmark datasets: PASCAL VOC 2012, NYUDv2 over previous works when
not considering training on other datasets
Towards Multi-class Object Detection in Unconstrained Remote Sensing Imagery
Automatic multi-class object detection in remote sensing images in
unconstrained scenarios is of high interest for several applications including
traffic monitoring and disaster management. The huge variation in object scale,
orientation, category, and complex backgrounds, as well as the different camera
sensors pose great challenges for current algorithms. In this work, we propose
a new method consisting of a novel joint image cascade and feature pyramid
network with multi-size convolution kernels to extract multi-scale strong and
weak semantic features. These features are fed into rotation-based region
proposal and region of interest networks to produce object detections. Finally,
rotational non-maximum suppression is applied to remove redundant detections.
During training, we minimize joint horizontal and oriented bounding box loss
functions, as well as a novel loss that enforces oriented boxes to be
rectangular. Our method achieves 68.16% mAP on horizontal and 72.45% mAP on
oriented bounding box detection tasks on the challenging DOTA dataset,
outperforming all published methods by a large margin (+6% and +12% absolute
improvement, respectively). Furthermore, it generalizes to two other datasets,
NWPU VHR-10 and UCAS-AOD, and achieves competitive results with the baselines
even when trained on DOTA. Our method can be deployed in multi-class object
detection applications, regardless of the image and object scales and
orientations, making it a great choice for unconstrained aerial and satellite
imagery.Comment: ACCV 201
- …