Attention-Aware Face Hallucination via Deep Reinforcement Learning

Face hallucination is a domain-specific super-resolution problem with the goal to generate high-resolution (HR) faces from low-resolution (LR) input images. In contrast to existing methods that often learn a single patch-to-patch mapping from LR to HR images and are regardless of the contextual interdependency between patches, we propose a novel Attention-aware Face Hallucination (Attention-FH) framework which resorts to deep reinforcement learning for sequentially discovering attended patches and then performing the facial part enhancement by fully exploiting the global interdependency of the image. Specifically, in each time step, the recurrent policy network is proposed to dynamically specify a new attended region by incorporating what happened in the past. The state (i.e., face hallucination result for the whole image) can thus be exploited and updated by the local enhancement network on the selected region. The Attention-FH approach jointly learns the recurrent policy network and local enhancement network through maximizing the long-term reward that reflects the hallucination performance over the whole image. Therefore, our proposed Attention-FH is capable of adaptively personalizing an optimal searching path for each face image according to its own characteristic. Extensive experiments show our approach significantly surpasses the state-of-the-arts on in-the-wild faces with large pose and illumination variations

Palatini formulation of f(R,T)f(R,T) gravity theory, and its cosmological implications

We consider the Palatini formulation of $f(R,T)$ gravity theory, in which a nonminimal coupling between the Ricci scalar and the trace of the energy-momentum tensor is introduced, by considering the metric and the affine connection as independent field variables. The field equations and the equations of motion for massive test particles are derived, and we show that the independent connection can be expressed as the Levi-Civita connection of an auxiliary, energy-momentum trace dependent metric, related to the physical metric by a conformal transformation. Similarly to the metric case, the field equations impose the non-conservation of the energy-momentum tensor. We obtain the explicit form of the equations of motion for massive test particles in the case of a perfect fluid, and the expression of the extra-force, which is identical to the one obtained in the metric case. The thermodynamic interpretation of the theory is also briefly discussed. We investigate in detail the cosmological implications of the theory, and we obtain the generalized Friedmann equations of the $f(R,T)$ gravity in the Palatini formulation. Cosmological models with Lagrangians of the type $f=R-\alpha ^2/R+g(T)$ and $f=R+\alpha ^2R^2+g(T)$ are investigated. These models lead to evolution equations whose solutions describe accelerating Universes at late times.Comment: 22 pages, no figures, accepted for publication in EPJC; references adde