This paper presents a method inspired by natural image statistics where a second order prior is learnt that models the relationship between the spatiotemporal gradients in the image sequence and those in the alpha mattes. This is used in combination with a learnt foreground color model and a prior on the alpha distribution to help regularize the solution and greatly improve the automatic performance of the syste