671 research outputs found

    A Local Density-Based Approach for Local Outlier Detection

    Full text link
    This paper presents a simple but effective density-based outlier detection approach with the local kernel density estimation (KDE). A Relative Density-based Outlier Score (RDOS) is introduced to measure the local outlierness of objects, in which the density distribution at the location of an object is estimated with a local KDE method based on extended nearest neighbors of the object. Instead of using only kk nearest neighbors, we further consider reverse nearest neighbors and shared nearest neighbors of an object for density distribution estimation. Some theoretical properties of the proposed RDOS including its expected value and false alarm probability are derived. A comprehensive experimental study on both synthetic and real-life data sets demonstrates that our approach is more effective than state-of-the-art outlier detection methods.Comment: 22 pages, 14 figures, submitted to Pattern Recognition Letter

    FSMJ: Feature Selection with Maximum Jensen-Shannon Divergence for Text Categorization

    Full text link
    In this paper, we present a new wrapper feature selection approach based on Jensen-Shannon (JS) divergence, termed feature selection with maximum JS-divergence (FSMJ), for text categorization. Unlike most existing feature selection approaches, the proposed FSMJ approach is based on real-valued features which provide more information for discrimination than binary-valued features used in conventional approaches. We show that the FSMJ is a greedy approach and the JS-divergence monotonically increases when more features are selected. We conduct several experiments on real-life data sets, compared with the state-of-the-art feature selection approaches for text categorization. The superior performance of the proposed FSMJ approach demonstrates its effectiveness and further indicates its wide potential applications on data mining.Comment: 8 pages, 6 figures, World Congress on Intelligent Control and Automation, 201

    Toward Optimal Feature Selection in Naive Bayes for Text Categorization

    Full text link
    Automated feature selection is important for text categorization to reduce the feature size and to speed up the learning process of classifiers. In this paper, we present a novel and efficient feature selection framework based on the Information Theory, which aims to rank the features with their discriminative capacity for classification. We first revisit two information measures: Kullback-Leibler divergence and Jeffreys divergence for binary hypothesis testing, and analyze their asymptotic properties relating to type I and type II errors of a Bayesian classifier. We then introduce a new divergence measure, called Jeffreys-Multi-Hypothesis (JMH) divergence, to measure multi-distribution divergence for multi-class classification. Based on the JMH-divergence, we develop two efficient feature selection methods, termed maximum discrimination (MDMD) and MD−χ2MD-\chi^2 methods, for text categorization. The promising results of extensive experiments demonstrate the effectiveness of the proposed approaches.Comment: This paper has been submitted to the IEEE Trans. Knowledge and Data Engineering. 14 pages, 5 figure

    Probabilistic Human Mobility Model in Indoor Environment

    Full text link
    Understanding human mobility is important for the development of intelligent mobile service robots as it can provide prior knowledge and predictions of human distribution for robot-assisted activities. In this paper, we propose a probabilistic method to model human motion behaviors which is determined by both internal and external factors in an indoor environment. While the internal factors are represented by the individual preferences, aims and interests, the external factors are indicated by the stimulation of the environment. We model the randomness of human macro-level movement, e.g., the probability of visiting a specific place and staying time, under the Bayesian framework, considering the influence of both internal and external variables. We use two case studies in a shopping mall and in a college student dorm building to show the effectiveness of our proposed probabilistic human mobility model. Real surveillance camera data are used to validate the proposed model together with survey data in the case study of student dorm.Comment: 8 pages, 9 figures, International Joint Conference on Neural Networks (IJCNN) 201

    Detection of False Data Injection Attacks in Smart Grid under Colored Gaussian Noise

    Full text link
    In this paper, we consider the problems of state estimation and false data injection detection in smart grid when the measurements are corrupted by colored Gaussian noise. By modeling the noise with the autoregressive process, we estimate the state of the power transmission networks and develop a generalized likelihood ratio test (GLRT) detector for the detection of false data injection attacks. We show that the conventional approach with the assumption of Gaussian noise is a special case of the proposed method, and thus the new approach has more applicability. {The proposed detector is also tested on an independent component analysis (ICA) based unobservable false data attack scheme that utilizes similar assumptions of sample observation.} We evaluate the performance of the proposed state estimator and attack detector on the IEEE 30-bus power system with comparison to conventional Gaussian noise based detector. The superior performance of {both observable and unobservable false data attacks} demonstrates the effectiveness of the proposed approach and indicates a wide application on the power signal processing.Comment: 8 pages, 4 figures in IEEE Conference on Communications and Network Security (CNS) 201

    EEF: Exponentially Embedded Families with Class-Specific Features for Classification

    Full text link
    In this letter, we present a novel exponentially embedded families (EEF) based classification method, in which the probability density function (PDF) on raw data is estimated from the PDF on features. With the PDF construction, we show that class-specific features can be used in the proposed classification method, instead of a common feature subset for all classes as used in conventional approaches. We apply the proposed EEF classifier for text categorization as a case study and derive an optimal Bayesian classification rule with class-specific feature selection based on the Information Gain (IG) score. The promising performance on real-life data sets demonstrates the effectiveness of the proposed approach and indicates its wide potential applications.Comment: 9 pages, 3 figures, to be published in IEEE Signal Processing Letter. IEEE Signal Processing Letter, 201

    Benzisothiazol‐3‐ones through a Metal‐Free Intramolecular N–S Bond Formation

    Get PDF
    The highly efficient synthesis of benzoisothiazol‐3‐ones from thiobenzamides has been described with good functional group compatibility and excellent yields. This work represents the first example of selectfluor‐promoted N–S bond formation processes. This method provides a facile approach to access various important bioactive benzoisothiazol‐3‐ones

    Using canopy greenness index to identify leaf ecophysiological traits during the foliar senescence in an oak forest

    Get PDF
    © The Author(s), 2018. This article is distributed under the terms of the Creative Commons Attribution License. The definitive version was published in Ecosphere 9 (2018): e02337, doi:10.1002/ecs2.2337.Camera‐based observation of forest canopies allows for low‐cost, continuous, high temporal‐spatial resolutions of plant phenology and seasonality of functional traits. In this study, we extracted canopy color index (green chromatic coordinate, Gcc) from the time‐series canopy images provided by a digital camera in a deciduous forest in Massachusetts, USA. We also measured leaf‐level photosynthetic activities and leaf area index (LAI) development in the field during the growing season, and corresponding leaf chlorophyll concentrations in the laboratory. We used the Bayesian change point (BCP) approach to analyze Gcc. Our results showed that (1) the date of starting decline of LAI (DOY 263), defined as the start of senescence, could be mathematically identified from the autumn Gcc pattern by analyzing change points of the Gcc curve, and Gcc is highly correlated with LAI after the first change point when LAI was decreasing (R2 = 0.88, LAI < 2.5 m2/m2); (2) the second change point of Gcc (DOY 289) started a more rapid decline of Gcc when chlorophyll concentration and photosynthesis rates were relatively low (13.4 ± 10.0% and 23.7 ± 13.4% of their maximum values, respectively) and continuously reducing; and (3) the third change point of Gcc (DOY 295) marked the end of growing season, defined by the termination of photosynthetic activities, two weeks earlier than the end of Gcc curve decline. Our results suggested that with the change point analysis, camera‐based phenology observation can effectively quantify the dynamic pattern of the start of senescence (with declining LAI) and the end of senescence (when photosynthetic activities terminated) in the deciduous forest.Priority Academic Program Development of Jiangsu Higher Education Institutions in Discipline of Environmental Science and Engineer in Nanjing Forest University; China Scholarship Council Grant Number: 201506190095; Brown University Seed Funds for International Research Projects on the Environmen
    • 

    corecore