A Sub-block Based Image Retrieval Using Modified Integrated Region Matching

This paper proposes a content based image retrieval (CBIR) system using the local colour and texture features of selected image sub-blocks and global colour and shape features of the image. The image sub-blocks are roughly identified by segmenting the image into partitions of different configuration, finding the edge density in each partition using edge thresholding followed by morphological dilation. The colour and texture features of the identified regions are computed from the histograms of the quantized HSV colour space and Gray Level Co- occurrence Matrix (GLCM) respectively. The colour and texture feature vectors is computed for each region. The shape features are computed from the Edge Histogram Descriptor (EHD). A modified Integrated Region Matching (IRM) algorithm is used for finding the minimum distance between the sub-blocks of the query and target image. Experimental results show that the proposed method provides better retrieving result than retrieval using some of the existing methods.Comment: 7 page

Image Retrieval Based on Texton Frequency-Inverse Image Frequency

In image retrieval, the user hopes to find the desired image by entering another image as a query. In this paper, the approach used to find similarities between images is feature weighting, where between one feature with another feature has a different weight. Likewise, the same features in different images may have different weights. This approach is similar to the term weighting model that usually implemented in document retrieval, where the system will search for keywords from each document and then give different weights to each keyword. In this research, the method of weighting the TF-IIF (Texton Frequency-Inverse Image Frequency) method proposed, this method will extract critical features in an image based on the frequency of the appearance of texton in an image, and the appearance of the texton in another image. That is, the more often a texton appears in an image, and the less texton appears in another image, the higher the weight. The results obtained indicate that the proposed method can increase the value of precision by 7% compared to the previous method

Local and deep texture features for classification of natural and biomedical images

Developing efficient feature descriptors is very important in many computer vision applications including biomedical image analysis. In the past two decades and before the popularity of deep learning approaches in image classification, texture features proved to be very effective to capture the gradient variation in the image. Following the success of the Local Binary Pattern (LBP) descriptor, many variations of this descriptor were introduced to further improve the ability of obtaining good classification results. However, the problem of image classification gets more complicated when the number of images increases as well as the number of classes. In this case, more robust approaches must be used to address this problem. In this thesis, we address the problem of analyzing biomedical images by using a combination of local and deep features. First, we propose a novel descriptor that is based on the motif Peano scan concept called Joint Motif Labels (JML). After that, we combine the features extracted from the JML descriptor with two other descriptors called Rotation Invariant Co-occurrence among Local Binary Patterns (RIC-LBP) and Joint Adaptive Medina Binary Patterns (JAMBP). In addition, we construct another descriptor called Motif Patterns encoded by RIC-LBP and use it in our classification framework. We enrich the performance of our framework by combining these local descriptors with features extracted from a pre-trained deep network called VGG-19. Hence, the 4096 features of the Fully Connected 'fc7' layer are extracted and combined with the proposed local descriptors. Finally, we show that Random Forests (RF) classifier can be used to obtain superior performance in the field of biomedical image analysis. Testing was performed on two standard biomedical datasets and another three standard texture datasets. Results show that our framework can beat state-of-the-art accuracy on the biomedical image analysis and the combination of local features produce promising results on the standard texture datasets.Includes bibliographical reference

Music Synchronization, Audio Matching, Pattern Detection, and User Interfaces for a Digital Music Library System

Over the last two decades, growing efforts to digitize our cultural heritage could be observed. Most of these digitization initiatives pursuit either one or both of the following goals: to conserve the documents - especially those threatened by decay - and to provide remote access on a grand scale. For music documents these trends are observable as well, and by now several digital music libraries are in existence. An important characteristic of these music libraries is an inherent multimodality resulting from the large variety of available digital music representations, such as scanned score, symbolic score, audio recordings, and videos. In addition, for each piece of music there exists not only one document of each type, but many. Considering and exploiting this multimodality and multiplicity, the DFG-funded digital library initiative PROBADO MUSIC aimed at developing a novel user-friendly interface for content-based retrieval, document access, navigation, and browsing in large music collections. The implementation of such a front end requires the multimodal linking and indexing of the music documents during preprocessing. As the considered music collections can be very large, the automated or at least semi-automated calculation of these structures would be recommendable. The field of music information retrieval (MIR) is particularly concerned with the development of suitable procedures, and it was the goal of PROBADO MUSIC to include existing and newly developed MIR techniques to realize the envisioned digital music library system. In this context, the present thesis discusses the following three MIR tasks: music synchronization, audio matching, and pattern detection. We are going to identify particular issues in these fields and provide algorithmic solutions as well as prototypical implementations. In Music synchronization, for each position in one representation of a piece of music the corresponding position in another representation is calculated. This thesis focuses on the task of aligning scanned score pages of orchestral music with audio recordings. Here, a previously unconsidered piece of information is the textual specification of transposing instruments provided in the score. Our evaluations show that the neglect of such information can result in a measurable loss of synchronization accuracy. Therefore, we propose an OCR-based approach for detecting and interpreting the transposition information in orchestral scores. For a given audio snippet, audio matching methods automatically calculate all musically similar excerpts within a collection of audio recordings. In this context, subsequence dynamic time warping (SSDTW) is a well-established approach as it allows for local and global tempo variations between the query and the retrieved matches. Moving to real-life digital music libraries with larger audio collections, however, the quadratic runtime of SSDTW results in untenable response times. To improve on the response time, this thesis introduces a novel index-based approach to SSDTW-based audio matching. We combine the idea of inverted file lists introduced by Kurth and Müller (Efficient index-based audio matching, 2008) with the shingling techniques often used in the audio identification scenario. In pattern detection, all repeating patterns within one piece of music are determined. Usually, pattern detection operates on symbolic score documents and is often used in the context of computer-aided motivic analysis. Envisioned as a new feature of the PROBADO MUSIC system, this thesis proposes a string-based approach to pattern detection and a novel interactive front end for result visualization and analysis

Indexing, learning and content-based retrieval for special purpose image databases

This chapter deals with content-based image retrieval in special purpose image databases. As image data is amassed ever more effortlessly, building efficient systems for searching and browsing of image databases becomes increasingly urgent. We provide an overview of the current state-of-the art by taking a tour along the entir

Analisis Tekstur untuk Klasifikasi Motif Kain (Studi Kasus Kain Tenun Nusa Tenggara Timur)

AbstrakIndonesia memiliki banyak kekayaan budaya dalam bentuk kain tradisional, salah satunya kain tenun dari Nusa Tenggara Timur (NTT). Kain tenun dari tiap etnik di NTT memiliki cirikhas motif masing-masing yang merupakan manifestasi kehidupan sehari-hari, kebudayaan dan kepercayaan masyarakat setempat. Di mata pemerhati kain tenun NTT, asal kain tenun dapat diketahui dari motifnya. Tidak semua orang dapat membedakan asal daerah dari motif kain tenun tertentu dikarenakan sulitnya mendefinisikan karakteristik motif kain tenun suatu daerah dan beragamnya motif kain tenun yang ada dan komposisi warna yang beragam pula.Analisis tekstur adalah teknik analisis citra berdasarkan anggapan bahwa citra dibentuk oleh variasi intensitas piksel, baik citra keabuan maupun warna. Motif kain tenun terbentuk dari variasi intensitas warna sehingga dapat dipandang sebagai tekstur berwarna dari kain tenun. Penelitian ini bertujuan untuk mengetahui diantara pendekatan analisis tekstur menggunakan Gray Level Co-occurrence Matrix (GLCM) yang dikombinasikan dengan momen warna dan pendekatan analisis tekstur menggunakan Color Co-occurrence Matrix (CCM), metode manakah yang memberikan hasil lebih baik untuk klasifikasi motif kain tenun NTT.Hasil penelitian menunjukkan bahwa untuk klasifikasi motif kain tenun NTT, pendekatan analisis tekstur menggunakan metode CCM memberikan hasil lebih baik dibandingkan pendekatan analisis tekstur menggunakan GLCM yang dikombinasikan dengan momen warna. Kata kunci—klasifikasi citra, GLCM, CCM, momen warna, motif kain tenun NTT AbstractIndonesia have many culture in the form of traditional fabrics, one of them is woven fabric from Nusa Tenggara Timur (NTT). Each NTT ethnic has motif characteristic which ismanifestation of daily life, culture and the faith of local people. For a NTT woven fabric observer, the origin of a woven fabric can be known from the motif. But its difficult to recognising the origin of a woven fabrics because it is hard to define the characteristics of woven fabric motif from a region and wide variety of existing woven fabric motifs and also color composition.Texture analysis is image analysis technique based on assumption that an image formed by the variation of pixels intensity, both gray and color image. Woven fabric motif formed by the variation of color intensity that can be seen as color texture of the woven fabric. This study aims to determine between texture analysis using GLCM combined with color moment and texture analysis using CCM, which method gives better results for the NTT woven fabric motif classification.The results showed that for the NTT woven fabric motif classification, texture analysis using CCM gives better results than the texture analysis using GLCM combined with color moment. Keywords— image classification, GLCM, CCM, color moment, NTT woven fabric moti