Some Issues in the Art Image Database Systems

In this paper we illustrate several aspects of art databases, such as: the spread of the multimedia art images; the main characteristics of art images; main art images search models; unique characteristics for art image retrieval; the importance of the sensory and semantic gaps. In addition, we present several interesting features of an art image database, such as: image indexing; feature extraction; analysis on various levels of precision; style classification. We stress color features and their base, painting analysis and painting styles. We study also which MPEG-7 descriptors are best for fine painting images retrieval. An experimental system is developed to see how these descriptors work on 900 art images from several remarkable art periods. On the base of our experiments some suggestions for improving the process of searching and analysis of fine art images are given

Analysis of the Distributions of Color Characteristics in Art Painting Images

In this paper we study some of the characteristics of the art painting image color semantics. We analyze the color features of differ- ent artists and art movements. The analysis includes exploration of hue, saturation and luminance. We also use quartile’s analysis to obtain the dis- tribution of the dispersion of defined groups of paintings and measure the degree of purity for these groups. A special software system “Art Paint- ing Image Color Semantics” (APICSS) for image analysis and retrieval was created. The obtained result can be used for automatic classification of art paintings in image retrieval systems, where the indexing is based on color characteristics

Accelerating object extraction and detection using a hierarchical approach with shape descriptors

Automatic object recognition is a fundamental problem in the fields of computer vision and machine learning, that has received a lot of research attention lately. Miniaturization and affordability, of both, high resolution digital cameras and advanced computing hardware, have further advanced the scope and applications of object recognition methods. While there are different methods, that build upon various low level features to construct object models, this work explores and implements the use of closed-contours as formidable object features. A hierarchical technique is employed to extract the contours, exploiting the inherent spatial relationships between the parent and child contours of an object, and later describing them as part of the query feature vector. Fourier Descriptors are used to effectively and invariantly describe the extracted contours. A diverse database of shapes is created and later used to train standard classification algorithms, for shape-labeling. A simple-hierarchical, shape label and spatial descriptor matching method is implemented, to find the nearest object-model, from a collection of stored templates. Multi-threaded architecture and GPU efficient image-processing functions are adopted wherever possible, speeding up the running time of the proposed technique, and making it efficient for use in real world applications. The technique is successfully tested on common traffic signs in real world images, with overall good performance and robustness being obtained as an end result

Indexing Techniques for Image and Video Databases: an approach based on Animate Vision Paradigm

[ITALIANO]In questo lavoro di tesi vengono presentate e discusse delle innovative tecniche di indicizzazione per database video e di immagini basate sul paradigma della “Animate Vision” (Visione Animata). Da un lato, sarà mostrato come utilizzando, quali algoritmi di analisi di una data immagine, alcuni meccanismi di visione biologica, come i movimenti saccadici e le fissazioni dell'occhio umano, sia possibile ottenere un query processing in database di immagini più efficace ed efficiente. In particolare, verranno discussi, la metodologia grazie alla quale risulta possibile generare due sequenze di fissazioni, a partire rispettivamente, da un'immagine di query I_q ed una di test I_t del data set, e, come confrontare tali sequenze al fine di determinare una possibile misura della similarità (consistenza) tra le due immagini. Contemporaneamente, verrà discusso come tale approccio unito a tecniche classiche di clustering possa essere usato per scoprire le associazioni semantiche nascoste tra immagini, in termini di categorie, che, di contro, permettono un'automatica pre-classificazione (indicizzazione) delle immagini e possono essere usate per guidare e migliorare il processo di query. Saranno presentati, infine, dei risultati preliminari e l'approccio proposto sarà confrontato con le più recenti tecniche per il recupero di immagini descritte in letteratura. Dall'altro lato, sarà mostrato come utilizzando la precedente rappresentazione “foveata” di un'immagine, risulti possibile partizionare un video in shot. Più precisamente, il metodo per il rilevamento dei cambiamenti di shot si baserà sulla computazione, in ogni istante di tempo, della misura di consistenza tra le sequenze di fissazioni generate da un osservatore ideale che guarda il video. Lo schema proposto permette l'individuazione, attraverso l'utilizzo di un'unica tecnica anziché di più metodi dedicati, sia delle transizioni brusche sia di quelle graduali. Vengono infine mostrati i risultati ottenuti su varie tipologie di video e, come questi, validano l'approccio proposto. / [INGLESE]In this dissertation some novel indexing techniques for video and image database based on “Animate Vision” Paradigm are presented and discussed. From one hand, it will be shown how, by embedding within image inspection algorithms active mechanisms of biological vision such as saccadic eye movements and fixations, a more effective query processing in image database can be achieved. In particular, it will be discussed the way to generate two fixation sequences from a query image I_q and a test image I_t of the data set, respectively, and how to compare the two sequences in order to compute a possible similarity (consistency) measure between the two images. Meanwhile, it will be shown how the approach can be used with classical clustering techniques to discover and represent the hidden semantic associations among images, in terms of categories, which, in turn, allow an automatic pre-classification (indexing), and can be used to drive and improve the query processing. Eventually, preliminary results will be presented and the proposed approach compared with the most recent techniques for image retrieval described in the literature. From the other one, it will be discussed how by taking advantage of such foveated representation of an image, it is possible to partitioning of a video into shots. More precisely, the shot-change detection method will be based on the computation, at each time instant, of the consistency measure of the fixation sequences generated by an ideal observer looking at the video. The proposed scheme aims at detecting both abrupt and gradual transitions between shots using a single technique, rather than a set of dedicated methods. Results on videos of various content types are reported and validate the proposed approach

Oszillatorische Gamma-Band-Aktivität bei der Verarbeitung auditorischer Reize im Kurzzeitgedächtnis im MEG

Recent studies have suggested an important role of cortical gamma oscillatory activity (30-100 Hz) as a correlate of encoding, maintaining and retrieving auditory, visual or tactile information in and from memory. It was shown that these cortical stimulus representations were modulated by attention processes. Gamma-band activity (GBA) occurred as an induced response peaking at approximately 200-300 ms after stimulus presentation. Induced cortical responses appear as non-phase-locked activity and are assumed to reflect active cortical processing rather than passive perception. Induced GBA peaking 200-300 ms after stimulus presentation has been assumed to reflect differences between experimental conditions containing various stimuli. By contrast, the relationship between specific oscillatory signals and the representation of individual stimuli has remained unclear. The present study aimed at the identification of such stimulus-specific gamma-band components. We used magnetoencephalography (MEG) to assess gamma activity during an auditory spatial delayed matching-to-sample task. 28 healthy adults were assigned to one of two groups R and L who were presented with only right- or left-lateralized sounds, respectively. Two sample stimuli S1 with lateralization angles of either 15° or 45° deviation from the midsagittal plane were used in each group. Participants had to memorize the lateralization angle of S1 and compare it to a second lateralized sound S2 presented after an 800-ms delay phase. S2 either had the same or a different lateralization angle as S1. After the presentation of S2, subjects had to indicate whether S1 and S2 matched or not. Statistical probability mapping was applied to the signals at sensor level to identify spectral amplitude differences between 15° and 45° stimuli. We found distinct gamma-band components reflecting each sample stimulus with center frequencies ranging between 59 and 72 Hz in different sensors over parieto-occipital cortex contralateral to the side of stimulation. These oscillations showed maximal spectral amplitudes during the middle 200-300 ms of the delay phase and decreased again towards its end. Additionally, we investigated correlations between the activation strength of the gamma-band components and memory task performance. The magnitude of differentiation between oscillatory components representing 'preferred' and 'nonpreferred' stimuli during the final 100 ms of the delay phase correlated positively with task performance. These findings suggest that the observed gamma-band components reflect the activity of neuronal networks tuned to specific auditory spatial stimulus features. The activation of these networks seems to contribute to the maintenance of task-relevant information in short-term memory.Ergebnisse aus aktuellen Studien legen nahe, dass kortikale oszillatorische Aktivität im Gamma-Bereich (30-100 Hz) eine wichtige Rolle für verschiedene kognitive Prozesse spielt. Dazu zählen das Kodieren, die Aufrechterhaltung und der Abruf auditorischer, visueller oder taktiler Informationen in das bzw. aus dem Gedächtnis. Es konnte gezeigt werden, dass diese kortikale Aktivität durch Aufmerksamkeitsprozesse beeinflusst wird. Gamma-Aktivität trat bei vorangegangenen Untersuchungen als induzierte Antwort ca. 200-300 ms nach Stimuluspräsentation auf. Es wird angenommen, dass diese nicht phasengebundenen kortikalen Reizantworten aktive kortikale Verarbeitungs-prozesse widerspiegeln. In früheren Studien wurde induzierte Gamma-Aktivität während der Aufrechterhaltung von Stimulusinformationen über Regionen gefunden, die an der Verarbeitung aufgabenrelevanter Reizmerkmale beteiligt sind. Diese Antworten im Gamma-Bereich spiegelten Unterschiede zwischen verschieden experimentellen Bedingungen wider, jedoch ist wenig über die Repräsentation spezifischer Stimuluseigenschaften durch Gamma-Aktivität bekannt. Mit der vorliegenden Studie haben wir versucht, solche stimulus spezifischen Gamma-Komponenten zu untersuchen. Dafür verwendeten wir Magnetenzephalographie (MEG) und eine auditorische räumliche “delayed matching-to-sample“ Aufgabe. 28 gesunde Erwachsene wurden dabei zwei verschiedenen Gruppen zugeordnet. Gruppe R bekam rechtslateralisierte Stimuli präsentiert, während diese in Gruppe L linkslateralisiert waren. Dabei unterschieden sich die Reize nur in ihrer räumlichen Charakteristik, die Klangmuster blieben unverändert. In beiden Gruppen wurden zwei Beispielstimuli S1 mit Lateralisierungswinkeln von 15° bzw. 45° verwendet. Die Probanden mussten sich den Lateralisierungswinkel von S1 merken und anschließend mit einem zweiten Stimulus S2, der nach einer Verzögerungsphase von 800 ms präsentiert wurde, vergleichen. S2 hatte dabei entweder den gleichen Lateralisierungswinkel wie S1, oder unterschied sich darin von dem ersten Stimulus. Nach der Präsentation von S2 mussten die Probanden signalisieren, ob die Lateralisierungswinkel der beiden Stimuli übereinstimmten oder nicht. Die Signale der einzelnen Sensoren wurden mit einem statistischen Wahrscheinlichkeitsmapping untersucht. Dabei wollten wir Unterschiede in der spektralen Amplitude für Stimuli mit 15° bzw. 45° Lateralisierungswinkel identifizieren. Wir konnten spezifische Gamma-Aktivität für alle Beispielstimuli nachweisen. Die Signale wurden im Bereich von 59-72 Hz gefunden und waren über dem parieto-okzipitalen Kortex jeweils kontralateral zur stimulierten Seite lokalisiert. Die maximalen Spektralamplituden dieser Oszillationen traten während der mittleren 200-300 ms der Verzögerungsphase auf und nahmen zu ihrem Ende hin ab. Zusätzlich haben wir Korrelationen zwischen der Aktivierungsstärke der Gamma-Komponenten und dem Abschneiden bei der Gedächtnisaufgabe untersucht. Dabei zeigte sich, dass der Unterschied der oszillatorischen Antworten auf bevorzugte und nicht-bevorzugte Stimuli während der letzten 100 ms der Verzögerungsphase positiv mit der Leistung in der Gedächtnisaufgabe korrelierte. Diese Ergebnisse sprechen dafür, dass die beobachteten Gamma Komponenten die Aktivität neuronaler Netzwerke, die auf die Verarbeitung räumlicher auditorischer Information spezialisiert sind, widerspiegeln. Die Aktivierung dieser Netzwerke scheint zur Aufrechterhaltung aufgabenbezogener Information im Kurzzeitgedächtnis beizutragen

Neuron-Based Heredity and Human Evolution

It is widely recognized that human evolution has been driven by two systems of heredity: one DNA-based and the other based on the transmission of behaviorally acquired information via nervous system functions. The genetic system is ancient, going back to the appearance of life on Earth. It is responsible for the evolutionary processes described by Darwin. By comparison, the nervous system is relatively newly minted and in its highest form, responsible for ideation and mind-to-mind transmission of information. Here the informational capabilities and functions of the two systems are compared. While employing quite different mechanisms for encoding, storing and transmission of information, both systems perform these generic hereditary functions. Three additional features of neuron-based heredity in humans are identified: the ability to transfer hereditary information to other members of their population, not just progeny; a selection process for the information being transferred; and a profoundly shorter time span for creation and dissemination of survival-enhancing information in a population. The mechanisms underlying neuron-based heredity involve hippocampal neurogenesis and memory and learning processes modifying and creating new neural assemblages changing brain structure and functions. A fundamental process in rewiring brain circuitry is through increased neural activity (use) strengthening and increasing the number of synaptic connections. Decreased activity in circuitry (disuse) leads to loss of synapses. Use and disuse modifying an organ to bring about new modes of living, habits and functions are processes in line with Neolamarckian concepts of evolution (Packard, 1901). Evidence is presented of bipartite evolutionary processes-Darwinian and Neolamarckian-driving human descent from a common ancestor shared with the great apes