Lie symmetries in cortical inspired CNNs

Our scope in this thesis is to propose architectures of CNNs in such a way to model the early visual pathway, including the Lateral Geniculate Nucleus and the Horizontal Connectivity of the primary visual cortex. Moreover, we will show how cortically inspired architectures allow to perform contrast perceptual invariance as well as grouping and the emergence of visual percepts. Particularly, the LGN is modeled with a first layer l0 containing a single filter Ψ0 that pre-filters the image I. Since the RPs of the LGN cells can be modeled as a LoG, we expect to obtain a radially symmetric filter with a similar shape; to this end, we prove the rotational invariance of Ψ0 and we study the influence of this filter to the subsequent layer. Indeed, we compare the statistic distribution of the filters in the second layer l1 of our architecture with the statistic distribution of the RPs of V1 cells of a macaque. Then, we model the horizontal connectivity of V1 implementing a transition kernel K1 to the layer l1. In this setting, we study the vector fields and the association fields induced by the connectivity kernel K1. To this end, we first approximate the filters bank in l1 with a Gabor function and use the parameters just found to re-parameterize the kernel. Thanks to this step, the kernel is now re-parameterized into a sub-Riemmanian space R2 × S1. Now we are able to compare the vector and association fields induced by K1 with the models of the horizontal connectivity

Image inpainting via a control-theoretical model of human vision

International audienceIn this paper we consider several algorithms for image inpainting based on the hypoelliptic diffusion naturally associated with a mathematical model of the primary visual cortex. In particular, we present one algorithm that does not exploit the information of where the image is corrupted, and others that do it. While the first algorithm is able to reconstruct only images that our visual system is still capable of recognize, we show that those of the second type completely transcend such limitation providing reconstructions at the state-of-the-art in image inpainting. This can be interpreted as a validation of the fact that our visual cortex actually encodes the first type of algorithm