Convolutional Neural Network on Three Orthogonal Planes for Dynamic Texture Classification

Dynamic Textures (DTs) are sequences of images of moving scenes that exhibit certain stationarity properties in time such as smoke, vegetation and fire. The analysis of DT is important for recognition, segmentation, synthesis or retrieval for a range of applications including surveillance, medical imaging and remote sensing. Deep learning methods have shown impressive results and are now the new state of the art for a wide range of computer vision tasks including image and video recognition and segmentation. In particular, Convolutional Neural Networks (CNNs) have recently proven to be well suited for texture analysis with a design similar to a filter bank approach. In this paper, we develop a new approach to DT analysis based on a CNN method applied on three orthogonal planes x y , xt and y t . We train CNNs on spatial frames and temporal slices extracted from the DT sequences and combine their outputs to obtain a competitive DT classifier. Our results on a wide range of commonly used DT classification benchmark datasets prove the robustness of our approach. Significant improvement of the state of the art is shown on the larger datasets.Comment: 19 pages, 10 figure

The TREC-2002 video track report

TREC-2002 saw the second running of the Video Track, the goal of which was to promote progress in content-based retrieval from digital video via open, metrics-based evaluation. The track used 73.3 hours of publicly available digital video (in MPEG-1/VCD format) downloaded by the participants directly from the Internet Archive (Prelinger Archives) (internetarchive, 2002) and some from the Open Video Project (Marchionini, 2001). The material comprised advertising, educational, industrial, and amateur films produced between the 1930's and the 1970's by corporations, nonprofit organizations, trade associations, community and interest groups, educational institutions, and individuals. 17 teams representing 5 companies and 12 universities - 4 from Asia, 9 from Europe, and 4 from the US - participated in one or more of three tasks in the 2001 video track: shot boundary determination, feature extraction, and search (manual or interactive). Results were scored by NIST using manually created truth data for shot boundary determination and manual assessment of feature extraction and search results. This paper is an introduction to, and an overview of, the track framework - the tasks, data, and measures - the approaches taken by the participating groups, the results, and issues regrading the evaluation. For detailed information about the approaches and results, the reader should see the various site reports in the final workshop proceedings

The TREC2001 video track: information retrieval on digital video information

The development of techniques to support content-based access to archives of digital video information has recently started to receive much attention from the research community. During 2001, the annual TREC activity, which has been benchmarking the performance of information retrieval techniques on a range of media for 10 years, included a ”track“ or activity which allowed investigation into approaches to support searching through a video library. This paper is not intended to provide a comprehensive picture of the different approaches taken by the TREC2001 video track participants but instead we give an overview of the TREC video search task and a thumbnail sketch of the approaches taken by different groups. The reason for writing this paper is to highlight the message from the TREC video track that there are now a variety of approaches available for searching and browsing through digital video archives, that these approaches do work, are scalable to larger archives and can yield useful retrieval performance for users. This has important implications in making digital libraries of video information attainable

Digital Image Access & Retrieval

The 33th Annual Clinic on Library Applications of Data Processing, held at the University of Illinois at Urbana-Champaign in March of 1996, addressed the theme of "Digital Image Access & Retrieval." The papers from this conference cover a wide range of topics concerning digital imaging technology for visual resource collections. Papers covered three general areas: (1) systems, planning, and implementation; (2) automatic and semi-automatic indexing; and (3) preservation with the bulk of the conference focusing on indexing and retrieval.published or submitted for publicatio

Classification of urban areas from GeoEye-1 imagery through texture features based on Histograms of Equivalent Patterns

A family of 26 non-parametric texture descriptors based on Histograms of Equivalent Patterns (HEP) has been tested, many of them for the first time in remote sensing applications, to improve urban classification through object-based image analysis of GeoEye-1 imagery. These HEP descriptors have been compared to the widely known texture measures derived from the gray-level co-occurrence matrix (GLCM). All the five finally selected HEP descriptors (Local Binary Patterns, Improved Local Binary Patterns, Binary Gradient Contours and two different combinations of Completed Local Binary Patterns) performed faster in terms of execution time and yielded significantly better accuracy figures than GLCM features. Moreover, the HEP texture descriptors provided additional information to the basic spectral features from the GeoEye-1's bands (R, G, B, NIR, PAN) significantly improving overall accuracy values by around 3%. Conversely, and in statistic terms, strategies involving GLCM texture derivatives did not improve the classification accuracy achieved from only the spectral information. Lastly, both approaches (HEP and GLCM) showed similar behavior with regard to the training set size applied

The visual preferences for forest regeneration and field afforestation : four case studies in Finland

The overall aim of this dissertation was to study the public's preferences for forest regeneration fellings and field afforestations, as well as to find out the relations of these preferences to landscape management instructions, to ecological healthiness, and to the contemporary theories for predicting landscape preferences. This dissertation includes four case studies in Finland, each based on the visualization of management options and surveys. Guidelines for improving the visual quality of forest regeneration and field afforestation are given based on the case studies. The results show that forest regeneration can be connected to positive images and memories when the regeneration area is small and some time has passed since the felling. Preferences may not depend only on the management alternative itself but also on the viewing distance, viewing point, and the scene in which the management options are implemented. The current Finnish forest landscape management guidelines as well as the ecological healthiness of the studied options are to a large extent compatible with the public's preferences. However, there are some discrepancies. For example, the landscape management instructions as well as ecological hypotheses suggest that the retention trees need to be left in groups, whereas people usually prefer individually located retention trees to those trees in groups. Information and psycho-evolutionary theories provide some possible explanations for people's preferences for forest regeneration and field afforestation, but the results cannot be consistently explained by these theories. The preferences of the different stakeholder groups were very similar. However, the preference ratings of the groups that make their living from forest - forest owners and forest professionals - slightly differed from those of the others. These results provide support for the assumptions that preferences are largely consistent at least within one nation, but that knowledge and a reference group may also influence preferences.Väitöskirjassa tutkittiin ihmisten maisemapreferenssejä (maisemallisia arvostuksia) metsänuudistamishakkuiden ja pellonmetsitysten suhteen sekä analysoitiin näiden preferenssien yhteyksiä maisemanhoito-ohjeisiin, vaihtoehtojen ekologiseen terveyteen ja preferenssejä ennustaviin teorioihin. Väitöskirja sisältää neljä tapaustutkimusta, jotka perustuvat hoitovaihtoehtojen visualisointiin ja kyselytutkimuksiin. Tapaustutkimusten pohjalta annetaan ohjeita siitä, kuinka uudistushakkuiden ja pellonmetsitysten visuaalista laatua voidaan parantaa. Väitöskirjan tulokset osoittavat, että uudistamishakkuut voivat herättää myös myönteisiä mielikuvia ja muistoja, jos uudistusala on pieni ja hakkuun välittömät jäljet ovat jo peittyneet. Preferensseihin vaikuttaa hoitovaihtoehdon lisäksi mm. katseluetäisyys, katselupiste ja ympäristö, jossa vaihtoehto on toteutettu. Eri viiteryhmien (metsäammattilaiset, pääkaupunkiseudun asukkaat, ympäristönsuojelijat, tutkimusalueiden matkailijat, paikalliset asukkaat sekä metsänomistajat) maisemapreferenssit olivat hyvin samankaltaisia. Kuitenkin ne ryhmät, jotka saavat ainakin osan elannostaan metsästä - metsänomistajat ja metsäammattilaiset - pitivät metsänhakkuita esittävistä kuvista hieman enemmän kuin muut ryhmät. Nämä tulokset tukevat oletusta, että maisemapreferenssit ovat laajalti yhteneväisiä ainakin yhden kansan tai kulttuurin keskuudessa, vaikka myös viiteryhmä saattaa vaikuttaa preferensseihin jonkin verran. Nykyiset metsämaisemanhoito-ohjeet ovat pitkälti samankaltaisia tässä väitöskirjassa havaittujen maisemapreferenssien kanssa. Myöskään tutkittujen vaihtoehtoisten hoitotapojen ekologisen paremmuuden ja niihin kohdistuvien maisemallisten arvostusten välillä ei ollut suurta ristiriitaa. Kuitenkin joitakin eroavaisuuksia oli; esimerkiksi sekä maisemanhoito-ohjeiden että ekologisten hypoteesien mukaan säästöpuut tulisi jättää ryhmiin, kun taas ihmiset pitivät eniten yksittäin jätetyistä puista. Informaatiomalli ja psyko-evolutionaarinen teoria tarjoavat mahdollisia selityksiä uudistushakkuisiin ja pellonmetsitykseen kohdistuville preferensseille, vaikkakaan tutkimuksen tuloksia ei voida täysin selittää näillä teorioilla