BiSeg: Simultaneous Instance Segmentation and Semantic Segmentation with Fully Convolutional Networks

We present a simple and effective framework for simultaneous semantic segmentation and instance segmentation with Fully Convolutional Networks (FCNs). The method, called BiSeg, predicts instance segmentation as a posterior in Bayesian inference, where semantic segmentation is used as a prior. We extend the idea of position-sensitive score maps used in recent methods to a fusion of multiple score maps at different scales and partition modes, and adopt it as a robust likelihood for instance segmentation inference. As both Bayesian inference and map fusion are performed per pixel, BiSeg is a fully convolutional end-to-end solution that inherits all the advantages of FCNs. We demonstrate state-of-the-art instance segmentation accuracy on PASCAL VOC.Comment: BMVC201

Facial deblur inference to improve recognition of blurred faces

Abstract This paper proposes a novel method for deblurring facial images to recognize faces degraded by blur. The main problem is how to infer a Point Spread Function (PSF) representing the process of blur. Inferring a PSF from a single facial image is an ill-posed problem. To make this problem more tractable, our method uses learned prior information derived from a training set of blurred facial images of several individuals. We construct a feature space such that blurred faces degraded by the same PSF are similar to one another and form a cluster. During training, we compute a statistical model of each PSF cluster in this feature space. For PSF inference we compare a query image of unknown blur with each model and select the closest one. Using the PSF corresponding to that model, the query image is deblurred, ready for recognition. Experiments on a standard face database artificially degraded by focus or motion blur show that our method substantially improves the recognition performance compared with state-of-the-art methods. We also demonstrate improved performance on real blurred images