126 research outputs found
Image Aesthetics Assessment Using Composite Features from off-the-Shelf Deep Models
Deep convolutional neural networks have recently achieved great success on
image aesthetics assessment task. In this paper, we propose an efficient method
which takes the global, local and scene-aware information of images into
consideration and exploits the composite features extracted from corresponding
pretrained deep learning models to classify the derived features with support
vector machine. Contrary to popular methods that require fine-tuning or
training a new model from scratch, our training-free method directly takes the
deep features generated by off-the-shelf models for image classification and
scene recognition. Also, we analyzed the factors that could influence the
performance from two aspects: the architecture of the deep neural network and
the contribution of local and scene-aware information. It turns out that deep
residual network could produce more aesthetics-aware image representation and
composite features lead to the improvement of overall performance. Experiments
on common large-scale aesthetics assessment benchmarks demonstrate that our
method outperforms the state-of-the-art results in photo aesthetics assessment.Comment: Accepted by ICIP 201
Social Media Advertisement Outreach: Learning the Role of Aesthetics
Corporations spend millions of dollars on developing creative image-based
promotional content to advertise to their user-base on platforms like Twitter.
Our paper is an initial study, where we propose a novel method to evaluate and
improve outreach of promotional images from corporations on Twitter, based
purely on their describable aesthetic attributes. Existing works in aesthetic
based image analysis exclusively focus on the attributes of digital
photographs, and are not applicable to advertisements due to the influences of
inherent content and context based biases on outreach.
Our paper identifies broad categories of biases affecting such images,
describes a method for normalization to eliminate effects of those biases and
score images based on their outreach, and examines the effects of certain
handcrafted describable aesthetic features on image outreach. Optimizing on the
describable aesthetic features resulting from this research is a simple method
for corporations to complement their existing marketing strategy to gain
significant improvement in user engagement on social media for promotional
images.Comment: Accepted to SIGIR 201
An Universal Image Attractiveness Ranking Framework
We propose a new framework to rank image attractiveness using a novel
pairwise deep network trained with a large set of side-by-side multi-labeled
image pairs from a web image index. The judges only provide relative ranking
between two images without the need to directly assign an absolute score, or
rate any predefined image attribute, thus making the rating more intuitive and
accurate. We investigate a deep attractiveness rank net (DARN), a combination
of deep convolutional neural network and rank net, to directly learn an
attractiveness score mean and variance for each image and the underlying
criteria the judges use to label each pair. The extension of this model
(DARN-V2) is able to adapt to individual judge's personal preference. We also
show the attractiveness of search results are significantly improved by using
this attractiveness information in a real commercial search engine. We evaluate
our model against other state-of-the-art models on our side-by-side web test
data and another public aesthetic data set. With much less judgments (1M vs
50M), our model outperforms on side-by-side labeled data, and is comparable on
data labeled by absolute score.Comment: Accepted by 2019 Winter Conference on Application of Computer Vision
(WACV
- …