A survey of kernel and spectral methods for clustering

Clustering algorithms are a useful tool to explore data structures and have been employed in many disciplines. The focus of this paper is the partitioning clustering problem with a special interest in two recent approaches: kernel and spectral methods. The aim of this paper is to present a survey of kernel and spectral clustering methods, two approaches able to produce nonlinear separating hypersurfaces between clusters. The presented kernel clustering methods are the kernel version of many classical clustering algorithms, e.g., K-means, SOM and neural gas. Spectral clustering arise from concepts in spectral graph theory and the clustering problem is configured as a graph cut problem where an appropriate objective function has to be optimized. An explicit proof of the fact that these two paradigms have the same objective is reported since it has been proven that these two seemingly different approaches have the same mathematical foundation. Besides, fuzzy kernel clustering methods are presented as extensions of kernel K-means clustering algorithm. (C) 2007 Pattem Recognition Society. Published by Elsevier Ltd. All rights reserved

In-Vitro Biological Tissue State Monitoring based on Impedance Spectroscopy

The relationship between post-mortem state and changes of biological tissue impedance has been investigated to serve as a basis for developing an in-vitro measurement method for monitoring the freshness of meat. The main challenges thereby are the reproducible measurement of the impedance of biological tissues and the classification method of their type and state. In order to realize reproducible tissue bio-impedance measurements, a suitable sensor taking into account the anisotropy of the biological tissue has been developed. It consists of cylindrical penetrating multi electrodes realizing good contacts between electrodes and the tissue. Experimental measurements have been carried out with different tissues and for a long period of time in order to monitor the state degradation with time. Measured results have been evaluated by means of the modified Fricke-Cole-Cole model. Results are reproducible and correspond to the expected behavior due to aging. An appropriate method for feature extraction and classification has been proposed using model parameters as features as input for classification using neural networks and fuzzy logic. A Multilayer Perceptron neural network (MLP) has been proposed for muscle type computing and the age computing and respectively freshness state of the meat. The designed neural network is able to generalize and to correctly classify new testing data with a high performance index of recognition. It reaches successful results of test equal to 100% for 972 created inputs for each muscle. An investigation of the influence of noise on the classification algorithm shows, that the MLP neural network has the ability to correctly classify the noisy testing inputs especially when the parameter noise is less than 0.6%. The success of classification is 100% for the muscles Longissimus Dorsi (LD) of beef, Semi-Membraneous (SM) of beef and Longissimus Dorsi (LD) of veal and 92.3% for the muscle Rectus Abdominis (RA) of veal. Fuzzy logic provides a successful alternative for easy classification. Using the Gaussian membership functions for the muscle type detection and trapezoidal member function for the classifiers related to the freshness detection, fuzzy logic realized an easy method of classification and generalizes correctly the inputs to the corresponding classes with a high level of recognition equal to 100% for meat type detection and with high accuracy for freshness computing equal to 84.62% for the muscle LD beef, 92.31 % for the muscle RA beef, 100 % for the muscle SM veal and 61.54% for the muscle LD veal.  Auf der Basis von Impedanzspektroskopie wurde ein neuartiges in-vitro-Messverfahren zur Überwachung der Frische von biologischem Gewebe entwickelt. Die wichtigsten Herausforderungen stellen dabei die Reproduzierbarkeit der Impedanzmessung und die Klassifizierung der Gewebeart sowie dessen Zustands dar. Für die Reproduzierbarkeit von Impedanzmessungen an biologischen Geweben, wurde ein zylindrischer Multielektrodensensor realisiert, der die 2D-Anisotropie des Gewebes berücksichtigt und einen guten Kontakt zum Gewebe realisiert. Experimentelle Untersuchungen wurden an verschiedenen Geweben über einen längeren Zeitraum durchgeführt und mittels eines modifizierten Fricke-Cole-Cole-Modells analysiert. Die Ergebnisse sind reproduzierbar und entsprechen dem physikalisch-basierten erwarteten Verhalten. Als Merkmale für die Klassifikation wurden die Modellparameter genutzt

Learning deep embeddings by learning to rank

We study the problem of embedding high-dimensional visual data into low-dimensional vector representations. This is an important component in many computer vision applications involving nearest neighbor retrieval, as embedding techniques not only perform dimensionality reduction, but can also capture task-specific semantic similarities. In this thesis, we use deep neural networks to learn vector embeddings, and develop a gradient-based optimization framework that is capable of optimizing ranking-based retrieval performance metrics, such as the widely used Average Precision (AP) and Normalized Discounted Cumulative Gain (NDCG). Our framework is applied in three applications. First, we study Supervised Hashing, which is concerned with learning compact binary vector embeddings for fast retrieval, and propose two novel solutions. The first solution optimizes Mutual Information as a surrogate ranking objective, while the other directly optimizes AP and NDCG, based on the discovery of their closed-form expressions for discrete Hamming distances. These optimization problems are NP-hard, therefore we derive their continuous relaxations to enable gradient-based optimization with neural networks. Our solutions establish the state-of-the-art on several image retrieval benchmarks. Next, we learn deep neural networks to extract Local Feature Descriptors from image patches. Local features are used universally in low-level computer vision tasks that involve sparse feature matching, such as image registration and 3D reconstruction, and their matching is a nearest neighbor retrieval problem. We leverage our AP optimization technique to learn both binary and real-valued descriptors for local image patches. Compared to competing approaches, our solution eliminates complex heuristics, and performs more accurately in the tasks of patch verification, patch retrieval, and image matching. Lastly, we tackle Deep Metric Learning, the general problem of learning real-valued vector embeddings using deep neural networks. We propose a learning to rank solution through optimizing a novel quantization-based approximation of AP. For downstream tasks such as retrieval and clustering, we demonstrate promising results on standard benchmarks, especially in the few-shot learning scenario, where the number of labeled examples per class is limited

Pemanfaatan Sistem Informasi Geografis untuk Analisa Potensi Sumber Daya Lahan Pertanian di Kabupaten Kudus

Kudus merupakan kota industri dan juga agraris. Potensi lahan pertanian di Kudus masih sangat luas. Untuk mengetahui seberapa penggunaan lahan di Kudus khususnya lahan pertanian dibutuhkan suatu sistim informasi yang mendukung akan hal tersebut. Salah satu teknologi yang memfasilitasi hal tersebut adalah dengan menggunakan Sistim Informasi Geografis (SIG). SIG merupakan sisntim informasi yang berbasis komputer dan data digital sehingga pengelolaa serta penyajiannya lebih baik dibanding dengan yang bersifat manual. Data SIG didapat dari citra satelit yang memetakan bumi dengan data digital yang bisa dimanfaatkan utk SIG sesuai dengan kebutuhan, dengan kata lain ketersediaan data digital tersebut bisa dari beberapa tahun kebelakang sampai data terkini. Penelitian ini mencoba memetakan potensi lahan khususnya lahan pertanian di Kudus dengan Sistim Informasi Geografis ini. Kata kunci : sistim informasi geografis, lahan kritis, citra satelit, potensi lahan