1,329 research outputs found
A2-RL: Aesthetics Aware Reinforcement Learning for Image Cropping
Image cropping aims at improving the aesthetic quality of images by adjusting
their composition. Most weakly supervised cropping methods (without bounding
box supervision) rely on the sliding window mechanism. The sliding window
mechanism requires fixed aspect ratios and limits the cropping region with
arbitrary size. Moreover, the sliding window method usually produces tens of
thousands of windows on the input image which is very time-consuming. Motivated
by these challenges, we firstly formulate the aesthetic image cropping as a
sequential decision-making process and propose a weakly supervised Aesthetics
Aware Reinforcement Learning (A2-RL) framework to address this problem.
Particularly, the proposed method develops an aesthetics aware reward function
which especially benefits image cropping. Similar to human's decision making,
we use a comprehensive state representation including both the current
observation and the historical experience. We train the agent using the
actor-critic architecture in an end-to-end manner. The agent is evaluated on
several popular unseen cropping datasets. Experiment results show that our
method achieves the state-of-the-art performance with much fewer candidate
windows and much less time compared with previous weakly supervised methods.Comment: Accepted by CVPR 201
Aesthetic-Driven Image Enhancement by Adversarial Learning
We introduce EnhanceGAN, an adversarial learning based model that performs
automatic image enhancement. Traditional image enhancement frameworks typically
involve training models in a fully-supervised manner, which require expensive
annotations in the form of aligned image pairs. In contrast to these
approaches, our proposed EnhanceGAN only requires weak supervision (binary
labels on image aesthetic quality) and is able to learn enhancement operators
for the task of aesthetic-based image enhancement. In particular, we show the
effectiveness of a piecewise color enhancement module trained with weak
supervision, and extend the proposed EnhanceGAN framework to learning a deep
filtering-based aesthetic enhancer. The full differentiability of our image
enhancement operators enables the training of EnhanceGAN in an end-to-end
manner. We further demonstrate the capability of EnhanceGAN in learning
aesthetic-based image cropping without any groundtruth cropping pairs. Our
weakly-supervised EnhanceGAN reports competitive quantitative results on
aesthetic-based color enhancement as well as automatic image cropping, and a
user study confirms that our image enhancement results are on par with or even
preferred over professional enhancement
Image Cropping with Composition and Saliency Aware Aesthetic Score Map
Aesthetic image cropping is a practical but challenging task which aims at
finding the best crops with the highest aesthetic quality in an image.
Recently, many deep learning methods have been proposed to address this
problem, but they did not reveal the intrinsic mechanism of aesthetic
evaluation. In this paper, we propose an interpretable image cropping model to
unveil the mystery. For each image, we use a fully convolutional network to
produce an aesthetic score map, which is shared among all candidate crops
during crop-level aesthetic evaluation. Then, we require the aesthetic score
map to be both composition-aware and saliency-aware. In particular, the same
region is assigned with different aesthetic scores based on its relative
positions in different crops. Moreover, a visually salient region is supposed
to have more sensitive aesthetic scores so that our network can learn to place
salient objects at more proper positions. Such an aesthetic score map can be
used to localize aesthetically important regions in an image, which sheds light
on the composition rules learned by our model. We show the competitive
performance of our model in the image cropping task on several benchmark
datasets, and also demonstrate its generality in real-world applications.Comment: Accepted by AAAI 2
- …