3,126 research outputs found
About Pyramid Structure in Convolutional Neural Networks
Deep convolutional neural networks (CNN) brought revolution without any doubt
to various challenging tasks, mainly in computer vision. However, their model
designing still requires attention to reduce number of learnable parameters,
with no meaningful reduction in performance. In this paper we investigate to
what extend CNN may take advantage of pyramid structure typical of biological
neurons. A generalized statement over convolutional layers from input till
fully connected layer is introduced that helps further in understanding and
designing a successful deep network. It reduces ambiguity, number of
parameters, and their size on disk without degrading overall accuracy.
Performance are shown on state-of-the-art models for MNIST, Cifar-10,
Cifar-100, and ImageNet-12 datasets. Despite more than 80% reduction in
parameters for Caffe_LENET, challenging results are obtained. Further, despite
10-20% reduction in training data along with 10-40% reduction in parameters for
AlexNet model and its variations, competitive results are achieved when
compared to similar well-engineered deeper architectures.Comment: Published in 2016 International Joint Conference on Neural Networks
(IJCNN
Interactive Visualization of Graph Pyramids
Hierarchies of plane graphs, called graph pyramids, can be used for collecting, storing and analyzing geographical information based on satellite images or other input data. The visualization of graph pyramids facilitates studies about their structure, such as their vertex distribution or height in relation of a specific input image. Thus, a researcher can debug algorithms and ask for statistical information. Furthermore,
it improves the better understanding of geographical data, like landscape properties or thematical maps.
In this paper, we present an interactive 3D visualization tool that supports several coordinated views on graph pyramids, subpyramids, level graphs, thematical maps, etc. Additionally, some implementation details and application results are discussed
Exploiting Image-trained CNN Architectures for Unconstrained Video Classification
We conduct an in-depth exploration of different strategies for doing event
detection in videos using convolutional neural networks (CNNs) trained for
image classification. We study different ways of performing spatial and
temporal pooling, feature normalization, choice of CNN layers as well as choice
of classifiers. Making judicious choices along these dimensions led to a very
significant increase in performance over more naive approaches that have been
used till now. We evaluate our approach on the challenging TRECVID MED'14
dataset with two popular CNN architectures pretrained on ImageNet. On this
MED'14 dataset, our methods, based entirely on image-trained CNN features, can
outperform several state-of-the-art non-CNN models. Our proposed late fusion of
CNN- and motion-based features can further increase the mean average precision
(mAP) on MED'14 from 34.95% to 38.74%. The fusion approach achieves the
state-of-the-art classification performance on the challenging UCF-101 dataset
Explorative Graph Visualization
Netzwerkstrukturen (Graphen) sind heutzutage weit verbreitet. Ihre Untersuchung dient dazu, ein besseres Verständnis ihrer Struktur und der durch sie modellierten realen Aspekte zu gewinnen. Die Exploration solcher Netzwerke wird zumeist mit Visualisierungstechniken unterstützt. Ziel dieser Arbeit ist es, einen Überblick über die Probleme dieser Visualisierungen zu geben und konkrete Lösungsansätze aufzuzeigen. Dabei werden neue Visualisierungstechniken eingeführt, um den Nutzen der geführten Diskussion für die explorative Graphvisualisierung am konkreten Beispiel zu belegen.Network structures (graphs) have become a natural part of everyday life and their analysis helps to gain an understanding of their inherent structure and the real-world aspects thereby expressed. The exploration of graphs is largely supported and driven by visual means. The aim of this thesis is to give a comprehensive view on the problems associated with these visual means and to detail concrete solution approaches for them. Concrete visualization techniques are introduced to underline the value of this comprehensive discussion for supporting explorative graph visualization
- …