Markov mezők a képmodellezésben, alkalmazásuk az automatikus képszegmentálás területén = Markovian Image Models: Applications in Unsupervised Image Segmentation

1) Kifejlesztettünk egy olyan szín és textúra alapú szegmentáló MRF algoritmust, amely alkalmas egy kép automatikus szegmentálását elvégezni. Az eredményeinket az Image and Vision Computing folyóiratban publikáltuk. 2) Kifejlesztettünk egy Reversible Jump Markov Chain Monte Carlo technikán alapuló automatikus képszegmentáló eljárást, melyet sikeresen alkalmaztunk színes képek teljesen automatikus szegmentálására. Az eredményeinket a BMVC 2004 konferencián és az Image and Vision Computing folyóiratban publikáltuk. 3) A modell többrétegű továbbfejlesztését alkalmaztuk video objektumok szín és mozgás alapú szegmentálására, melynek eredményeit a HACIPPR 2005 illetve az ACCV 2006 nemzetközi konferenciákon publikáltuk. Szintén ehhez az alapproblémához kapcsolódik Horváth Péter hallgatómmal az optic flow szamításával illetve szín, textúra és mozgás alapú GVF aktív kontúrral kapcsoltos munkáink. TDK dolgozata első helyezést ért el a 2004-es helyi versenyen, az eredményeinket pedig a KEPAF 2004 konferencián publikáltuk. 4) Horváth Péter PhD hallgatómmal illetve az franciaországi INRIA Ariana csoportjával, kidolgoztunk egy olyan képszegmentáló eljárást, amely a szegmentálandó objektum alakját is figyelembe veszi. Az eredményeinket az ICPR 2006 illetve az ICCVGIP 2006 konferencián foglaltuk össze. A modell előzményeként kidolgoztunk továbbá egy alakzat-momemntumokon alapuló aktív kontúr modellt, amelyet a HACIPPR 2005 konferencián publikáltunk. | 1) We have proposed a monogrid MRF model which is able to combine color and texture features in order to improve the quality of segmentation results. We have also solved the estimation of model parameters. This work has been published in the Image and Vision Computing journal. 2) We have proposed an RJMCMC sampling method which is able to identify multi-dimensional Gaussian mixtures. Using this technique, we have developed a fully automatic color image segmentation algorithm. Our results have been published at BMVC 2004 international conference and in the Image and Vision Computing journal. 3) A new multilayer MRF model has been proposed which is able to segment an image based on multiple cues (such as color, texture, or motion). This work has been published at HACIPPR 2005 and ACCV 2006 international conferences. The work on optic flow computation and color-, texture-, and motion-based GVF active contours doen with my student, Mr. Peter Horvath, won a first price at the local Student Research Competition in 2004. Results have been presented at KEPAF 2004 conference. 4) A new shape prior, called 'gas of circles' has been introduced using active contour models. This work is done in collaboration with the Ariana group of INRIA, France and my PhD student, Mr. Peter Horvath. Results are published at the ICPR 2006 and ICCVGIP 2006 conferences. A preliminary study on active contour models using shape-moments has also been done, these results are published at HACIPPR 2005

Report of subpanel on feature extraction

The state of knowledge in feature extraction for Earth resource observation systems is reviewed and research tasks are proposed. Issues in the subpixel feature estimation problem are defined as: (1) the identification of image models which adequately describe the data and the sensor it is using; (2) the construction of local feature models based on those image models; and (3) the problem of trying to understand these effects of preprocessing on the entire process. The development of ground control point (GCP) libraries for automated selection presents two concerns. One is the organization of these GCP libraries for rectification problems, i.e., the problems of automatically selecting by computer the specific GCP's for particular registration tasks. Second is the importance of integrating ground control patterns in a data base management system, allowing interface to a large number of sensor image types with an automatic selection system. The development of data validation criteria for the comparison of different extraction techniques is also discussed

Measuring axiomatic soundness of counterfactual image models

We use the axiomatic definition of counterfactual to derive metrics that enable quantifying the correctness of approximate counterfactual inference models. Abstract: We present a general framework for evaluating image counterfactuals. The power and flexibility of deep generative models make them valuable tools for learning mechanisms in structural causal models. However, their flexibility makes counterfactual identifiability impossible in the general case. Motivated by these issues, we revisit Pearl's axiomatic definition of counterfactuals to determine the necessary constraints of any counterfactual inference model: composition, reversibility, and effectiveness. We frame counterfactuals as functions of an input variable, its parents, and counterfactual parents and use the axiomatic constraints to restrict the set of functions that could represent the counterfactual, thus deriving distance metrics between the approximate and ideal functions. We demonstrate how these metrics can be used to compare and choose between different approximate counterfactual inference models and to provide insight into a model's shortcomings and trade-offs

Generative Image Modeling Using Spatial LSTMs

Modeling the distribution of natural images is challenging, partly because of strong statistical dependencies which can extend over hundreds of pixels. Recurrent neural networks have been successful in capturing long-range dependencies in a number of problems but only recently have found their way into generative image models. We here introduce a recurrent image model based on multi-dimensional long short-term memory units which are particularly suited for image modeling due to their spatial structure. Our model scales to images of arbitrary size and its likelihood is computationally tractable. We find that it outperforms the state of the art in quantitative comparisons on several image datasets and produces promising results when used for texture synthesis and inpainting