Classification of Systematic Measurement Errors within the Framework of Robust Data Reconciliation

A robust data reconciliation strategy provides unbiased variable estimates in the presence of a moderate quantity of atypical measurements. However, estimates get worse if systematic measurement errors that persist in time (e.g., biases and drifts) are undetected and the breakdown point of the robust strategy is surpassed. The detection and classification of those errors allow taking corrective actions on the inputs of the robust data reconciliation that preserve the instrumentation system redundancy while the faulty sensor is repaired. In this work, a new methodology for variable estimation and systematic error classification, which is based on the concepts of robust statistics, is presented. It has been devised to be part of the real-time optimization loop of an industrial plant; therefore, it runs for processes operating under steady-state conditions. The robust measurement test is proposed in this article and used to detect the presence of sporadic and continuous systematic errors. Also, the robust linear regression of the data contained in a moving window is applied to classify the continuous errors as biases or drifts. Results highlight the performance of the proposed methodology to detect and classify outliers, biases, and drifts for linear and nonlinear benchmarks.Fil: Llanos, Claudia Elizabeth. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico Conicet - Bahía Blanca. Planta Piloto de Ingeniería Química. Universidad Nacional del Sur. Planta Piloto de Ingeniería Química; ArgentinaFil: Sanchez, Mabel Cristina. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico Conicet - Bahía Blanca. Planta Piloto de Ingeniería Química. Universidad Nacional del Sur. Planta Piloto de Ingeniería Química; ArgentinaFil: Maronna, Ricardo Antonio. Universidad Nacional de La Plata. Facultad de Ciencias Exactas. Departamento de Matemáticas; Argentin

Classification of Systematic Measurement Errors within the Framework of Robust Data Reconciliation

A robust data reconciliation strategy provides unbiased variable estimates in the presence of a moderate quantity of atypical measurements. However, estimates get worse if systematic measurement errors that persist in time (e.g., biases and drifts) are undetected and the breakdown point of the robust strategy is surpassed. The detection and classification of those errors allow taking corrective actions on the inputs of the robust data reconciliation that preserve the instrumentation system redundancy while the faulty sensor is repaired. In this work, a new methodology for variable estimation and systematic error classification, which is based on the concepts of robust statistics, is presented. It has been devised to be part of the real-time optimization loop of an industrial plant; therefore, it runs for processes operating under steady-state conditions. The robust measurement test is proposed in this article and used to detect the presence of sporadic and continuous systematic errors. Also, the robust linear regression of the data contained in a moving window is applied to classify the continuous errors as biases or drifts. Results highlight the performance of the proposed methodology to detect and classify outliers, biases, and drifts for linear and nonlinear benchmarks.Facultad de Ciencias Exacta

Classification of Systematic Measurement Errors within the Framework of Robust Data Reconciliation

A robust data reconciliation strategy provides unbiased variable estimates in the presence of a moderate quantity of atypical measurements. However, estimates get worse if systematic measurement errors that persist in time (e.g., biases and drifts) are undetected and the breakdown point of the robust strategy is surpassed. The detection and classification of those errors allow taking corrective actions on the inputs of the robust data reconciliation that preserve the instrumentation system redundancy while the faulty sensor is repaired. In this work, a new methodology for variable estimation and systematic error classification, which is based on the concepts of robust statistics, is presented. It has been devised to be part of the real-time optimization loop of an industrial plant; therefore, it runs for processes operating under steady-state conditions. The robust measurement test is proposed in this article and used to detect the presence of sporadic and continuous systematic errors. Also, the robust linear regression of the data contained in a moving window is applied to classify the continuous errors as biases or drifts. Results highlight the performance of the proposed methodology to detect and classify outliers, biases, and drifts for linear and nonlinear benchmarks.Facultad de Ciencias Exacta

Who’s the Fairest of them All?:A Comparison of Methods for Classifying Tone and Attribution in Earnings-related Management Discourse

We compare the relative and absolute performance of various machine learning algorithms and wordlists at replicating manual coding results for tone and attribution by domain experts in management performance commentary. Our suite of learning classifiers comprises Naïve Bayes, random forest, support vector machines, and an artificial neural network called multilayer perceptron. We use wordlists proposed by Henry (2006, 2008) and Loughran and McDonald (2010) to classify tone. Wordlists for attribution are based on the causal reasoning list from Language Inquirer and Word Count (LIWC), together with two self-constructed lists. We use a self-constructed wordlist to distinguish between internal and external attributions. We train learning classifiers using a large sample of manually annotated performance sentences. Results for all classifiers are assessed using a separate manually annotated holdout sample. Conclusions regarding the best classification method vary according to the classification task. None of the approaches are capable of identifying the presence of an attribution reliably. Even for more reliable classification tasks such as tone and attribution type, absolute measurement errors often exceed 20%. We conclude that while automated textual analysis methods offer important opportunities in certain settings, manual content analysis remains an essential tool for researchers interested in studying the properties and consequences of financial discourse

Data-driven Localization and Estimation of Disturbance in the Interconnected Power System

Identifying the location of a disturbance and its magnitude is an important component for stable operation of power systems. We study the problem of localizing and estimating a disturbance in the interconnected power system. We take a model-free approach to this problem by using frequency data from generators. Specifically, we develop a logistic regression based method for localization and a linear regression based method for estimation of the magnitude of disturbance. Our model-free approach does not require the knowledge of system parameters such as inertia constants and topology, and is shown to achieve highly accurate localization and estimation performance even in the presence of measurement noise and missing data

Analysis of drawbacks and constraints of classification algorithms for three-phase voltage dips

Voltage events are one of the most common and harmful disturbances of power electric systems. Voltage dips, swells and interruptions are included under this heading. Given the economic cost that these disturbances represent for electrical power transmission and distribution companies and the industry, it becomes imperative to detect and classify them properly. Several classification criteria and algorithms have been proposed in the literature as analysis tools to differentiate voltage events by their characteristics and, if possible, to determine their causes and consequences. Even though some of these approaches make a correct classification of the voltage events, there are certain operation conditions that are common in real electrical grids, in which the classification criteria, and their corresponding algorithms, make a wrong classification. These particular conditions, together with the lack of a fair comparison in a common scenario, have not been addressed in the specific field literature. This work explores in detail all these aspects by evaluating the symmetrical components criterion and ABC classification criterion, and rigorously analyzes three specific algorithms: the Symmetrical Components Algorithm, the Six Phases Algorithm and the Space Vector Algorithm. Drawbacks arise from both classification criteria and algorithms. The causes of the classification errors are described and discussed in detail in order to better understand the problem, and evidence the constraints of these classification methods.Fil: Strack, Jorge Luis. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico Conicet - Mar del Plata. Instituto de Investigaciones Científicas y Tecnológicas en Electrónica. Universidad Nacional de Mar del Plata. Facultad de Ingeniería. Instituto de Investigaciones Científicas y Tecnológicas en Electrónica; ArgentinaFil: Carugati, Ignacio. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico Conicet - Mar del Plata. Instituto de Investigaciones Científicas y Tecnológicas en Electrónica. Universidad Nacional de Mar del Plata. Facultad de Ingeniería. Instituto de Investigaciones Científicas y Tecnológicas en Electrónica; ArgentinaFil: Orallo, Carlos Martin. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico Conicet - Mar del Plata. Instituto de Investigaciones Científicas y Tecnológicas en Electrónica. Universidad Nacional de Mar del Plata. Facultad de Ingeniería. Instituto de Investigaciones Científicas y Tecnológicas en Electrónica; ArgentinaFil: Donato, Patricio Gabriel. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico Conicet - Mar del Plata. Instituto de Investigaciones Científicas y Tecnológicas en Electrónica. Universidad Nacional de Mar del Plata. Facultad de Ingeniería. Instituto de Investigaciones Científicas y Tecnológicas en Electrónica; ArgentinaFil: Maestri, Sebastian Oscar. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico Conicet - Mar del Plata. Instituto de Investigaciones Científicas y Tecnológicas en Electrónica. Universidad Nacional de Mar del Plata. Facultad de Ingeniería. Instituto de Investigaciones Científicas y Tecnológicas en Electrónica; ArgentinaFil: Carrica, Daniel Oscar. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico Conicet - Mar del Plata. Instituto de Investigaciones Científicas y Tecnológicas en Electrónica. Universidad Nacional de Mar del Plata. Facultad de Ingeniería. Instituto de Investigaciones Científicas y Tecnológicas en Electrónica; Argentin

Outlier detection techniques for wireless sensor networks: A survey

In the field of wireless sensor networks, those measurements that significantly deviate from the normal pattern of sensed data are considered as outliers. The potential sources of outliers include noise and errors, events, and malicious attacks on the network. Traditional outlier detection techniques are not directly applicable to wireless sensor networks due to the nature of sensor data and specific requirements and limitations of the wireless sensor networks. This survey provides a comprehensive overview of existing outlier detection techniques specifically developed for the wireless sensor networks. Additionally, it presents a technique-based taxonomy and a comparative table to be used as a guideline to select a technique suitable for the application at hand based on characteristics such as data type, outlier type, outlier identity, and outlier degree

Outlier Detection Techniques For Wireless Sensor Networks: A Survey

In the field of wireless sensor networks, measurements that significantly deviate from the normal pattern of sensed data are considered as outliers. The potential sources of outliers include noise and errors, events, and malicious attacks on the network. Traditional outlier detection techniques are not directly applicable to wireless sensor networks due to the multivariate nature of sensor data and specific requirements and limitations of the wireless sensor networks. This survey provides a comprehensive overview of existing outlier detection techniques specifically developed for the wireless sensor networks. Additionally, it presents a technique-based taxonomy and a decision tree to be used as a guideline to select a technique suitable for the application at hand based on characteristics such as data type, outlier type, outlier degree

Joint segmentation and classification of retinal arteries/veins from fundus images

Objective Automatic artery/vein (A/V) segmentation from fundus images is required to track blood vessel changes occurring with many pathologies including retinopathy and cardiovascular pathologies. One of the clinical measures that quantifies vessel changes is the arterio-venous ratio (AVR) which represents the ratio between artery and vein diameters. This measure significantly depends on the accuracy of vessel segmentation and classification into arteries and veins. This paper proposes a fast, novel method for semantic A/V segmentation combining deep learning and graph propagation. Methods A convolutional neural network (CNN) is proposed to jointly segment and classify vessels into arteries and veins. The initial CNN labeling is propagated through a graph representation of the retinal vasculature, whose nodes are defined as the vessel branches and edges are weighted by the cost of linking pairs of branches. To efficiently propagate the labels, the graph is simplified into its minimum spanning tree. Results The method achieves an accuracy of 94.8% for vessels segmentation. The A/V classification achieves a specificity of 92.9% with a sensitivity of 93.7% on the CT-DRIVE database compared to the state-of-the-art-specificity and sensitivity, both of 91.7%. Conclusion The results show that our method outperforms the leading previous works on a public dataset for A/V classification and is by far the fastest. Significance The proposed global AVR calculated on the whole fundus image using our automatic A/V segmentation method can better track vessel changes associated to diabetic retinopathy than the standard local AVR calculated only around the optic disc.Comment: Preprint accepted in Artificial Intelligence in Medicin