A proposal for dependent optimization in scalabale region-based coding systems

We address in this paper the problem of optimal coding in the framework of region-based video coding systems, with a special stress on content-based functionalities. We present a coding system that can provide scaled layers (using PSNR or temporal content-based scalability) such that each one has an optimal partition with optimal bit allocation among the resulting regions. This coding system is based on a dependent optimization algorithm that can provide joint optimality for a group of layers or a group of frames.Peer ReviewedPostprint (published version

A morphological approach for segmentation and tracking of human faces

A new technique for segmenting and tracking human faces in video sequences is presented. The technique relies on morphological tools such as using connected operators to extract the connected component that more likely belongs to a face, and partition projection to track this component through the sequence. A binary partition tree (BPT) is used to implement the connected operator. The BPT is constructed based on the chrominance criteria and its nodes are analyzed so that the selected node maximizes an estimation of the likelihood of being part of a face. The tracking is performed using a partition projection approach. Images are divided into face and non-face parts, which are tracked through the sequence. The technique has been successfully assessed using several test sequences from the MPEG-4 (raw format) and the MPEG-7 databases (MPEG-1 format).Peer ReviewedPostprint (published version

Recursive image sequence segmentation by hierarchical models

This paper addresses the problem of image sequence segmentation. A technique using a sequence model based on compound random fields is presented. This technique is recursive in the sense that frames are processed in the same cadency as they are produced. New regions appearing in the sequence are detected by a morphological procedure.Peer ReviewedPostprint (published version

A contour matching approach for accurate NOAA-AVHRR image navigation

Although different methods for NOAA AVHRR image navigation have already been established, the multitemporal and multi-satellite character of most studies requires automatic and accurate methods for navigation of satellite images. In the proposed method, a simple Kepplerian orbital model for the NOAA satellites is considered as reference model, and mean orbital elements are given as input to the model from ephemeris data. In order to correct the errors caused by these simplifications, errors resulting from inaccuracies in the positioning of the satellite and failures in the satellite internal clock, an automatic global contour matching approach has been adopted. First, the sensed image is preprocessed to obtain a gradient energy map of the reliable areas (sea-land contours) using a cloud detection algorithm and a morphological gradient operator. An initial estimation of the reliable contour positions is automatically obtained. The final positions of the contours are obtained by means of an iterative local minimization procedure that allows a contour to converge on an area of high image energy (edge). Global transformation parameters are estimated based on the initial and final positions of all reliable contour points. Finally, the performance of this approach is assessed using NOAA 14 AVHRR images from different geographic areas.Postprint (published version

Coagulation time detection by means of a real-time image processing

Several techniques for semi-automatic or automatic detection of coagulation time in blood or in plasma analysis are available in the literature. However, these techniques are either complex and demand for specialized equipment, or allow the analysis of very few samples in parallel. In this paper a new system based on computer vision is presented. An easy image processing algorithm has been developed, which leads to an accurate estimation of the coagulation time of several samples in parallel. The estimation can be performed in real time using transputer architecture supported by a PC.Peer ReviewedPostprint (published version

Segmentation-based video coding:temporals links

This paper analyzes the main elements that a segmentation-based video coding approach should be based on so that it can address coding efficiency and content-based functionalities. Such elements can be defined as temporal linking and rate control. The basic features of such elements are discussed and, in both cases, a specific implementation is proposed.Peer ReviewedPostprint (published version

Hierarchical object detection with deep reinforcement learning

We present a method for performing hierarchical object detection in images guided by a deep reinforcement learning agent. The key idea is to focus on those parts of the image that contain richer information and zoom on them. We train an intelligent agent that, given an image window, is capable of deciding where to focus the attention among five different predefined region candidates (smaller windows). This procedure is iterated providing a hierarchical image analysis. We compare two different candidate proposal strategies to guide the object search: with and without overlap. Moreover, our work compares two different strategies to extract features from a convolutional neural network for each region proposal: a first one that computes new feature maps for each region proposal, and a second one that computes the feature maps for the whole image to later generate crops for each region proposal. Experiments indicate better results for the overlapping candidate proposal strategy and a loss of performance for the cropped image features due to the loss of spatial resolution. We argue that, while this loss seems unavoidable when working with large amounts of object candidates, the much more reduced amount of region proposals generated by our reinforcement learning agent allows considering to extract features for each location without sharing convolutional computation among regions.Postprint (published version

Accurate and automatic NOAA-AVHRR image navigation using a global contour matching approach

The problem of precise and automatic AVHRR image navigation is tractable in theory, but has proved to be somewhat difficult in practice. The authors' work has been motivated by the need for a fully automatic and operational navigation system capable of geo-referencing NOAA-AVHRR images with high accuracy and without operator supervision. The proposed method is based on the simultaneous use of an orbital model and a contour matching approach. This last process, relying on an affine transformation model, is used to correct the errors caused by inaccuracies in orbit modeling, nonzero value for the spacecraft's roll, pitch and yaw, errors due to inaccuracies in the satellite positioning and failures in the satellite internal clock. The automatic global contour matching process is summarized as follows: i) Estimation of the gradient energy map (edges) in the sensed image and detection of the cloudless (reliable) areas in this map. ii) Initialization of the affine model parameters by minimizing the Euclidean distance between the reference and sensed images objects. iii) Simultaneous optimization of all reference image contours on the sensed image by energy minimization in the domain of the global transformation parameters. The process is iterated in a hierarchical way, reducing the parameter searching space at each iteration. The proposed image navigation algorithm has proved to be capable of geo-referencing a satellite image within 1 pixel.Peer ReviewedPostprint (published version

Distribution pattern of anchovy abundance and biomass in Division IXa from research surveys in 2007 and 2008.

A total of 4 acoustic surveys (3 Portuguese and 1 Spanish) rendering seasonal estimates of anchovy abundance, either for almost the whole Division IXa (spring and autumn Portuguese surveys) or only for the Subarea IXa South (Algarve + Gulf ofCadiz areas, early summer Spanish survey), were carried out during 2007 and the first half in 2008. In the November 2007 ICES WGACEGG meeting was presented - after detecting some computational errors - a corrected version of the estimates from the early summer 2007 Spanish survey previously provided to the September 2007 WGMHSA meeting. Anchovy total estimates from these surveys with indications of its general distribution patterns were as follow: Portuguese surveys surveying almost the whole Division (except Subarea IXa North): -PELAGO07(2007 Spr. Port. Surv.): 3247 million fish; 40.0 thousand tonnes. Most of anchovy in Gulf of Cadiz. Present but relatively scarce in front of Lisbon. -SAR07NOV (2007 Aut. Port. Surv.): 1921 million fish; 24.8 thousand tonnes. Most of anchovy in Gulf of Cadiz. Present but relatively scarce in front of Lisbon. -PELAGO08 (2008 Spr. Port. Surv.): 2353 million fish; 39.7 thousand tonnes. Most of anchovy in Gulf of Cadiz. Present but relativelyscarce in front of Lisbon and in northernmost coastal waters denoting a northernwards expansion of the population in the Division. Spanish survey surveying the Subarea IXa South only: -ECOCÁDIZ 0707(2007 Summ. Sp. Surv.): 1790 million fish; 28.9 thousand tonnes. Anchovy all over the Gulf of Cadiz, also widely distributed through the Algarve, but mainly concentrated in the Spanish waters.Versión del edito

Supervised evaluation of image segmentation and object proposal techniques

This paper tackles the supervised evaluation of image segmentation and object proposal algorithms. It surveys, structures, and deduplicates the measures used to compare both segmentation results and object proposals with a ground truth database; and proposes a new measure: the precision-recall for objects and parts. To compare the quality of these measures, eight state-of-the-art object proposal techniques are analyzed and two quantitative meta-measures involving nine state of the art segmentation methods are presented. The meta-measures consist in assuming some plausible hypotheses about the results and assessing how well each measure reflects these hypotheses. As a conclusion of the performed experiments, this paper proposes the tandem of precision-recall curves for boundaries and for objects-and-parts as the tool of choice for the supervised evaluation of image segmentation. We make the datasets and code of all the measures publicly available.Peer ReviewedPostprint (author's final draft