19,219 research outputs found
Residual Attention Network for Image Classification
In this work, we propose "Residual Attention Network", a convolutional neural
network using attention mechanism which can incorporate with state-of-art feed
forward network architecture in an end-to-end training fashion. Our Residual
Attention Network is built by stacking Attention Modules which generate
attention-aware features. The attention-aware features from different modules
change adaptively as layers going deeper. Inside each Attention Module,
bottom-up top-down feedforward structure is used to unfold the feedforward and
feedback attention process into a single feedforward process. Importantly, we
propose attention residual learning to train very deep Residual Attention
Networks which can be easily scaled up to hundreds of layers. Extensive
analyses are conducted on CIFAR-10 and CIFAR-100 datasets to verify the
effectiveness of every module mentioned above. Our Residual Attention Network
achieves state-of-the-art object recognition performance on three benchmark
datasets including CIFAR-10 (3.90% error), CIFAR-100 (20.45% error) and
ImageNet (4.8% single model and single crop, top-5 error). Note that, our
method achieves 0.6% top-1 accuracy improvement with 46% trunk depth and 69%
forward FLOPs comparing to ResNet-200. The experiment also demonstrates that
our network is robust against noisy labels.Comment: accepted to CVPR201
Transmission resonance in a composite plasmonic structure
The design, fabrication, and optical properties of a composite plasmonic
structure, a two-dimentional array of split-ring resonators inserted into
periodic square holes of a metal film, have been reported. A new type of
transmission resonance, which makes a significant difference from the
conventional peaks, has been suggested both theoretically and experimentally.
To understand this effect, a mechanism of ring- resonance induced dipole
emission is proposed.Comment: 14 pages, 4 figure
- …