Perceptual modelling for 2D and 3D

Livrable D1.1 du projet ANR PERSEECe rapport a été réalisé dans le cadre du projet ANR PERSEE (n° ANR-09-BLAN-0170). Exactement il correspond au livrable D1.1 du projet

Off-line Foveated Compression and Scene Perception: An Eye-Tracking Approach

With the continued growth of digital services offering storage and communication of pictorial information, the need to efficiently represent this information has become increasingly important, both from an information theoretic and a perceptual point of view. There has been a recent interest to design systems for efficient representation and compression of image and video data that take the features of the human visual system into account. One part of this thesis investigates whether knowledge about viewers' gaze positions as measured by an eye-tracker can be used to improve compression efficiency of digital video; regions not directly looked at by a number of previewers are lowpass filtered. This type of video manipulation is called off-line foveation. The amount of compression due to off-line foveation is assessed along with how it affects new viewers' gazing behavior as well as subjective quality. We found additional bitrate savings up to 50% (average 20%) due to off-line foveation prior to compression, without decreasing the subjective quality. In off-line foveation, it would be of great benefit to algorithmically predict where viewers look without having to perform eye-tracking measurements. In the first part of this thesis, new experimental paradigms combined with eye-tracking are used to understand the mechanisms behind gaze control during scene perception, thus investigating the prerequisites for such algorithms. Eye-movements are recorded from observers viewing contrast manipulated images depicting natural scenes under a neutral task. We report that image semantics, rather than the physical image content itself, largely dictates where people choose to look. Together with recent work on gaze prediction in video, the results in this thesis give only moderate support for successful applicability of algorithmic gaze prediction for off-line foveated video compression

An Automatic ROI of The Fundus Photography

The Region of interest (ROI) of the fundus photography is an important task in medical image processing. It contains a lot of information related to the diagnosis of the retinal disease. So the determination of this ROI is a very influential first step in fundus image processing later. This research proposed a threshold method of segmentation to determine ROI of the fundus photography automatically. Data to be elaborated were the fundus photography’s of 13 patients, captured using Nonmyd7 camera of Kowa Company Ltd in Dr. M. Djamil Hospital, Padang. The results of this processing could determine ROI automatically. The automatic cropping successfully omits as much as possible the non-medical areas shown as darkbackground, while still maintaining the whole medical areas, comprised the posterior pole of retina captured through the pupil. Thus, this method is  helpful in further image processing of posterior areas. We hope that this research will be useful for researchers