(c) 2012. The copyright of this document resides with its authors.
It may be distributed unchanged freely in print or electronic forms

Fu, Y

Gong, S

Hospedales, TM

Xiang, T

IEEE Transactions on Pattern Analysis and Machine Intelligence

English

arXiv

Queen Mary Research Online

A kernel method for multi-labelled classification.

A pac-bayesian bound for lifelong learning.

A review on multi-label learning algorithms.

Analysis and Evaluation of Visual Information Systems Performance.

Attribute learning for understanding unstructured social activity.

Attribute-based classification for zero-shot visual object categorization.

Augmented attribute representations.

Cnn features off-theshelf : an astounding baseline for recognition. arXiv:1403.6382v1,

Correlated label propagation with application to multi-label learning.

Devise: A deep visual-semantic embedding model andrea. In

Distributed representations of words and phrases and their compositionality.

Efficient estimation of word representation in vector space.

Efficient max-margin multi-label classification with applications to zero-shot learning.

Evaluating knowledge transfer and zero-shot learning in a large-scale setting. In

Hybrid decision tree.

Imagenet classification with deep convolutional neural networks.

Improving word representations via global context and multiple word prototypes.

Interestingness prediction by robust learning to rank.

Learning to detect unseen object classes by between-class attribute transfer.

Learning visual attributes.

Learning with augmented class by exploiting unlabeled data. In

LIBSVM: a library for support vector machines,

Ml-knn: A lazy learning approach to multi-label learning. Pattern Recognition,

Modeling the shape of the scene: A holistic representation of the spatial envelope.

Multi-label classification with unlabeled data: An inductive approach.

Overfeat: Integrated recognition, localization and detection using convolutional networks.

Re-id: Hunting attributes in the wild.

Recognition by components - a theory of human image understanding. Psychological Review,

Shaogang Gong, Tao Xiang, and Chen Chang Loy. Cumulative attribute space for age and crowd density estimation.

Tao Xiang, and Shaogang Gong. Learning multimodal latent attributes. TPAMI,

Tao Xiang, Zhengyong Fu, and Shaogang Gong. Transductive multi-view embedding for zero-shot recognition and annotation.

The Elements of Statistical Learning: Data Mining, Inference, and Prediction.

Transductive multilabel learning via label set propagation.

Zero-shot learning through cross-modal transfer.

Zero-shot learning with semantic output codes.

Transductive Multi-View Zero-Shot Learning

Yanwei Fu

Timothy M. Hospedales

Tao Xiang

Shaogang Gong

Crossref

Most existing zero-shot learning approaches exploit transfer learning via an intermediate semantic representation shared between an annotated auxiliary dataset and a target dataset with different classes and no annotation. A projection from a low-level feature space to the semantic representation space is learned from the auxiliary dataset and applied without adaptation to the target dataset. In this paper we identify two inherent limitations with these approaches. First, due to having disjoint and potentially unrelated classes, the projection functions learned from the auxiliary dataset/domain are biased when applied directly to the target dataset/domain. We call this problem the projection domain shift problem and propose a novel framework, transductive multi-view embedding, to solve it. The second limitation is the prototype sparsity problem which refers to the fact that for each target class, only a single prototype is available for zero-shot learning given a semantic representation. To overcome this problem, a novel heterogeneous multi-view hypergraph label propagation method is formulated for zero-shot learning in the transductive embedding space. It effectively exploits the complementary information offered by different semantic representations and takes advantage of the manifold structures of multiple representation spaces in a coherent manner. We demonstrate through extensive experiments that the proposed approach (1) rectifies the projection shift between the auxiliary and target domains, (2) exploits the complementarity of multiple semantic representations, (3) significantly outperforms existing methods for both zero-shot and N-shot recognition on three image and video benchmark datasets, and (4) enables novel cross-view annotation tasks

Transductive Multi-View Zero-Shot Learning

Abstract

Similar works

Full text

Available Versions

Queen Mary Research Online

Crossref

CiteSeerX

Queen Mary Research Online

Queen Mary Research Online