131 research outputs found
DeepGlobe 2018: A Challenge to Parse the Earth through Satellite Images
We present the DeepGlobe 2018 Satellite Image Understanding Challenge, which
includes three public competitions for segmentation, detection, and
classification tasks on satellite images. Similar to other challenges in
computer vision domain such as DAVIS and COCO, DeepGlobe proposes three
datasets and corresponding evaluation methodologies, coherently bundled in
three competitions with a dedicated workshop co-located with CVPR 2018.
We observed that satellite imagery is a rich and structured source of
information, yet it is less investigated than everyday images by computer
vision researchers. However, bridging modern computer vision with remote
sensing data analysis could have critical impact to the way we understand our
environment and lead to major breakthroughs in global urban planning or climate
change research. Keeping such bridging objective in mind, DeepGlobe aims to
bring together researchers from different domains to raise awareness of remote
sensing in the computer vision community and vice-versa. We aim to improve and
evaluate state-of-the-art satellite image understanding approaches, which can
hopefully serve as reference benchmarks for future research in the same topic.
In this paper, we analyze characteristics of each dataset, define the
evaluation criteria of the competitions, and provide baselines for each task.Comment: Dataset description for DeepGlobe 2018 Challenge at CVPR 201
TernausNetV2: Fully Convolutional Network for Instance Segmentation
The most common approaches to instance segmentation are complex and use
two-stage networks with object proposals, conditional random-fields, template
matching or recurrent neural networks. In this work we present TernausNetV2 - a
simple fully convolutional network that allows extracting objects from a
high-resolution satellite imagery on an instance level. The network has popular
encoder-decoder type of architecture with skip connections but has a few
essential modifications that allows using for semantic as well as for instance
segmentation tasks. This approach is universal and allows to extend any network
that has been successfully applied for semantic segmentation to perform
instance segmentation task. In addition, we generalize network encoder that was
pre-trained for RGB images to use additional input channels. It makes possible
to use transfer learning from visual to a wider spectral range. For
DeepGlobe-CVPR 2018 building detection sub-challenge, based on public
leaderboard score, our approach shows superior performance in comparison to
other methods. The source code corresponding pre-trained weights are publicly
available at https://github.com/ternaus/TernausNetV
Weakly Supervised Semantic Segmentation of Satellite Images
International audienceWhen one wants to train a neural network to perform semantic segmentation, creating pixel-level annotations for each of the images in the database is a tedious task. If he works with aerial or satellite images, which are usually very large, it is even worse. With that in mind, we investigate how to use image-level annotations in order to perform semantic segmentation. Image-level annotations are much less expensive to acquire than pixel-level annotations, but we lose a lot of information for the training of the model. From the annotations of the images, the model must find by itself how to classify the different regions of the image. In this work, we use the method proposed by Anh and Kwak [1] to produce pixel-level annotation from image level annotation. We compare the overall quality of our generated dataset with the original dataset. In addition, we propose an adaptation of the AffinityNet that allows us to directly perform a semantic segmentation. Our results show that the generated labels lead to the same performances for the training of several segmentation networks. Also, the quality of semantic segmentation performed directly by the AffinityNet and the Random Walk is close to the one of the best fully-supervised approaches
- …