Multivariate Statistical Process Control Charts: An Overview

In this paper we discuss the basic procedures for the implementation of multivariate statistical process control via control charting. Furthermore, we review multivariate extensions for all kinds of univariate control charts, such as multivariate Shewhart-type control charts, multivariate CUSUM control charts and multivariate EWMA control charts. In addition, we review unique procedures for the construction of multivariate control charts, based on multivariate statistical techniques such as principal components analysis (PCA) and partial lest squares (PLS). Finally, we describe the most significant methods for the interpretation of an out-of-control signal.quality control, process control, multivariate statistical process control, Hotelling's T-square, CUSUM, EWMA, PCA, PLS

On Data Depth and the Application of Nonparametric Multivariate Statistical Process Control Charts

The purpose of this article is to summarize recent research results for constructing nonparametric multivariate control charts with main focus on data depth based control charts. Data depth provides data reduction to large-variable problems in a completely nonparametric way. Several depth measures including Tukey depth are shown to be particularly effective for purposes of statistical process control in case that the data deviates normality assumption. For detecting slow or moderate shifts in the process target mean, the multivariate version of the EWMA is generally robust to non-normal data, so that nonparametric alternatives may be less often required

Simple data analysis for biologists

This document provides a simple introduction to research methods and analysis tools for biologists or environmental scientists, with particular emphasis on fish biology in devleoping countries

Statistical Quality Control with the qcr Package

[Abstract] The R package qcr for Statistical Quality Control (SQC) is introduced and described. It includes a comprehensive set of univariate and multivariate SQC tools that completes and increases the SQC techniques available in R. Apart from integrating different R packages devoted to SQC (qcc, MSQC), qcr provides nonparametric tools that are highly useful when Gaussian assumption is not met. This package computes standard univariate control charts for individual measurements, (Formula presented), S, R, p, np, c, u, EWMA, and CUSUM. In addition, it includes functions to perform multivariate control charts such as Hotelling T2, MEWMA and MCUSUM. As representative features, multivariate nonparametric alternatives based on data depth are implemented in this package: r, Q and S control charts. The qcr library also estimates the most complete set of capability indices from first to the fourth generation, covering the nonparametric alternatives, and performing the corresponding capability analysis graphical outputs, including the process capability plots. Moreover, Phase I and II control charts for functional data are included.The work of Salvador Naya, Javier Tarrío-Saavedra, Miguel Flores and Rubén Fernández-Casal has been supported by MINECO grant MTM2017-82724-R, and by the Xunta de Galicia (Grupos de Referencia Competitiva ED431C-2020-14 and Centro de Investigación del Sistema universitario de Galicia ED431G 2019/01), all of them through the ERDF. The research of Miguel Flores has been partially supported by Grant PII-DM-002-2016 of Escuela Politécnica Nacional of Ecuador. In addition, the research of Javier Tarrío-Saavedra has been also founded by the eCOAR project (PC18/03) of CITICXunta de Galicia; ED431C-2020-14Xunta de Galicia; ED431G 2019/01Escuela Politécnica Nacional de Ecuador; PII-DM-002-201

Constructing a Control Chart Using Functional Data

[Abstract] This study proposes a control chart based on functional data to detect anomalies and estimate the normal output of industrial processes and services such as those related to the energy efficiency domain. Companies providing statistical consultancy services in the fields of energy efficiency; heating, ventilation and air conditioning (HVAC); installation and control; and big data for buildings, have been striving to solve the problem of automatic anomaly detection in buildings controlled by sensors. Given the functional nature of the critical to quality (CTQ) variables, this study proposed a new functional data analysis (FDA) control chart method based on the concept of data depth. Specifically, it developed a control methodology, including the Phase I and II control charts. It is based on the calculation of the depth of functional data, the identification of outliers by smooth bootstrap resampling and the customization of nonparametric rank control charts. A comprehensive simulation study, comprising scenarios defined with different degrees of dependence between curves, was conducted to evaluate the control procedure. The proposed statistical process control procedure was also applied to detect energy efficiency anomalies in the stores of a textile company in the Panama City. In this case, energy consumption has been defined as the CTQ variable of the HVAC system. Briefly, the proposed methodology, which combines FDA and multivariate techniques, adapts the concept of the control chart based on a specific case of functional data and thereby presents a novel alternative for controlling facilities in which the data are obtained by continuous monitoring, as is the case with a great deal of process in the framework of Industry 4.0.This study has been funded by the eCOAR project (PC18/03) of CITIC. The work of Salvador Naya, Javier Tarrío-Saavedra, Miguel Flores and Rubén Fernández-Casal has been supported by MINECO grants MTM2014-52876-R, MTM2017-82724-R, the Xunta de Galicia (Grupos de Referencia Competitiva ED431C-2016-015, and Centro Singular de Investigación de Galicia ED431G/01 2016-19), through the ERDF. The research of Miguel Flores has been partially supported by Grant PII-DM-002-2016 of Escuela Politécnica Nacional of EcuadorXunta de Galicia; ED431C-2016-015Xunta de Galicia; ED431G/01 2016-19Escuela Politécnica Nacional de Ecuador; PII-DM-002-201

Parametric, Nonparametric, and Semiparametric Linear Regression in Classical and Bayesian Statistical Quality Control

Statistical process control (SPC) is used in many fields to understand and monitor desired processes, such as manufacturing, public health, and network traffic. SPC is categorized into two phases; in Phase I historical data is used to inform parameter estimates for a statistical model and Phase II implements this statistical model to monitor a live ongoing process. Within both phases, profile monitoring is a method to understand the functional relationship between response and explanatory variables by estimating and tracking its parameters. In profile monitoring, control charts are often used as graphical tools to visually observe process behaviors. We construct a practitioner’s guide to provide a stepby- step application for parametric, nonparametric, and semiparametric methods in profile monitoring, creating an in-depth guideline for novice practitioners. We then consider the commonly used cumulative sum (CUSUM), multivariate CUSUM (mCUSUM), exponentially weighted moving average (EWMA), multivariate EWMA (mEWMA) charts under a Bayesian framework for monitoring respiratory disease related hospitalizations and global suicide rates with parametric, nonparametric, and semiparametric linear models

Online network monitoring

An important problem in network analysis is the online detection of anomalous behaviour. In this paper, we introduce a network surveillance method bringing together network modelling and statistical process control. Our approach is to apply multivariate control charts based on exponential smoothing and cumulative sums in order to monitor networks generated by temporal exponential random graph models (TERGM). The latter allows us to account for temporal dependence while simultaneously reducing the number of parameters to be monitored. The performance of the considered charts is evaluated by calculating the average run length and the conditional expected delay for both simulated and real data. To justify the decision of using the TERGM to describe network data, some measures of goodness of fit are inspected. We demonstrate the effectiveness of the proposed approach by an empirical application, monitoring daily flights in the United States to detect anomalous patterns. © 2021, The Author(s)

Latent Structures based-Multivariate Statistical Process Control: a paradigm shift

The basic fundamentals of statistical process control (SPC) were proposed by Walter Shewhart for data-starved production environments typical in the 1920s and 1930s. In the 21st century, the traditional scarcity of data has given way to a data-rich environment typical of highly automated and computerized modern processes. These data often exhibit high correlation, rank deficiency, low signal-to-noise ratio, multistage and multiway structures, and missing values. Conventional univariate and multivariate SPC techniques are not suitable in these environments. This article discusses the paradigm shift to which those working in the quality improvement field should pay keen attention. We advocate the use of latent structure based multivariate statistical process control methods as efficient quality improvement tools in these massive data contexts. This is a strategic issue for industrial success in the tremendously competitive global market.This research work was partially supported by the Spanish Ministry of Economy and Competitiveness under the project DPI2011-28112-C04-02.Ferrer, A. (2014). Latent Structures based-Multivariate Statistical Process Control: a paradigm shift. Quality Engineering. 26(1):72-91. https://doi.org/10.1080/08982112.2013.846093S7291261Aparisi, F., Jabaioyes, J., & Carrion, A. (1999). Statistical properties of the lsi multivariate control chart. Communications in Statistics - Theory and Methods, 28(11), 2671-2686. doi:10.1080/03610929908832445Arteaga, F., & Ferrer, A. (2002). Dealing with missing data in MSPC: several methods, different interpretations, some examples. Journal of Chemometrics, 16(8-10), 408-418. doi:10.1002/cem.750Bersimis, S., Psarakis, S., & Panaretos, J. (2007). Multivariate statistical process control charts: an overview. Quality and Reliability Engineering International, 23(5), 517-543. doi:10.1002/qre.829Bharati, M. H., & MacGregor, J. F. (1998). Multivariate Image Analysis for Real-Time Process Monitoring and Control. Industrial & Engineering Chemistry Research, 37(12), 4715-4724. doi:10.1021/ie980334lBharati, M. H., MacGregor, J. F., & Tropper, W. (2003). Softwood Lumber Grading through On-line Multivariate Image Analysis Techniques. Industrial & Engineering Chemistry Research, 42(21), 5345-5353. doi:10.1021/ie0210560Bisgaard, S. (2012). The Future of Quality Technology: From a Manufacturing to a Knowledge Economy & From Defects to Innovations. Quality Engineering, 24(1), 30-36. doi:10.1080/08982112.2011.627010Box, G. E. P. (1954). Some Theorems on Quadratic Forms Applied in the Study of Analysis of Variance Problems, I. Effect of Inequality of Variance in the One-Way Classification. The Annals of Mathematical Statistics, 25(2), 290-302. doi:10.1214/aoms/1177728786Camacho, J., & Ferrer, A. (2012). Cross-validation in PCA models with the element-wise k-fold (ekf) algorithm: theoretical aspects. Journal of Chemometrics, 26(7), 361-373. doi:10.1002/cem.2440Duchesne, C., Liu, J. J., & MacGregor, J. F. (2012). Multivariate image analysis in the process industries: A review. Chemometrics and Intelligent Laboratory Systems, 117, 116-128. doi:10.1016/j.chemolab.2012.04.003Efron, B., & Gong, G. (1983). A Leisurely Look at the Bootstrap, the Jackknife, and Cross-Validation. The American Statistician, 37(1), 36-48. doi:10.1080/00031305.1983.10483087Ferrer, A. (2007). Multivariate Statistical Process Control Based on Principal Component Analysis (MSPC-PCA): Some Reflections and a Case Study in an Autobody Assembly Process. Quality Engineering, 19(4), 311-325. doi:10.1080/08982110701621304Fuchs, C. (1998). Multivariate Quality Control. doi:10.1201/9781482273731Geladi, P., & Kowalski, B. R. (1986). Partial least-squares regression: a tutorial. Analytica Chimica Acta, 185, 1-17. doi:10.1016/0003-2670(86)80028-9Helland, I. S. (1988). On the structure of partial least squares regression. Communications in Statistics - Simulation and Computation, 17(2), 581-607. doi:10.1080/03610918808812681Höskuldsson, A. (1988). PLS regression methods. Journal of Chemometrics, 2(3), 211-228. doi:10.1002/cem.1180020306Hunter, J. S. (1986). The Exponentially Weighted Moving Average. Journal of Quality Technology, 18(4), 203-210. doi:10.1080/00224065.1986.11979014Edward Jackson, J. (1985). Multivariate quality control. Communications in Statistics - Theory and Methods, 14(11), 2657-2688. doi:10.1080/03610928508829069Jackson, J. E., & Mudholkar, G. S. (1979). Control Procedures for Residuals Associated With Principal Component Analysis. Technometrics, 21(3), 341-349. doi:10.1080/00401706.1979.10489779Process analysis and abnormal situation detection: from theory to practice. (2002). IEEE Control Systems, 22(5), 10-25. doi:10.1109/mcs.2002.1035214Kourti, T. (2005). Application of latent variable methods to process control and multivariate statistical process control in industry. International Journal of Adaptive Control and Signal Processing, 19(4), 213-246. doi:10.1002/acs.859Kourti, T. (2006). Process Analytical Technology Beyond Real-Time Analyzers: The Role of Multivariate Analysis. Critical Reviews in Analytical Chemistry, 36(3-4), 257-278. doi:10.1080/10408340600969957Kourti, T., & MacGregor, J. F. (1996). Multivariate SPC Methods for Process and Product Monitoring. Journal of Quality Technology, 28(4), 409-428. doi:10.1080/00224065.1996.11979699Liu, R. Y. (1995). Control Charts for Multivariate Processes. Journal of the American Statistical Association, 90(432), 1380-1387. doi:10.1080/01621459.1995.10476643Liu, R. Y., Singh, K., & Teng*, J. H. (2004). DDMA-charts: Nonparametric multivariate moving average control charts based on data depth. Allgemeines Statistisches Archiv, 88(2), 235-258. doi:10.1007/s101820400170Liu, R. Y., & Tang, J. (1996). Control Charts for Dependent and Independent Measurements Based on Bootstrap Methods. Journal of the American Statistical Association, 91(436), 1694-1700. doi:10.1080/01621459.1996.10476740LOWRY, C. A., & MONTGOMERY, D. C. (1995). A review of multivariate control charts. IIE Transactions, 27(6), 800-810. doi:10.1080/07408179508936797MacGregor, J. F. (1997). Using On-Line Process Data to Improve Quality: Challenges for Statisticians. International Statistical Review, 65(3), 309-323. doi:10.1111/j.1751-5823.1997.tb00311.xMason, R. L., Champ, C. W., Tracy, N. D., Wierda, S. J., & Young, J. C. (1997). Assessment of Multivariate Process Control Techniques. Journal of Quality Technology, 29(2), 140-143. doi:10.1080/00224065.1997.11979743Montgomery, D. C., & Woodall, W. H. (1997). A Discussion on Statistically-Based Process Monitoring and Control. Journal of Quality Technology, 29(2), 121-121. doi:10.1080/00224065.1997.11979738Nelson, P. R. C., Taylor, P. A., & MacGregor, J. F. (1996). Missing data methods in PCA and PLS: Score calculations with incomplete observations. Chemometrics and Intelligent Laboratory Systems, 35(1), 45-65. doi:10.1016/s0169-7439(96)00007-xNomikos, P., & MacGregor, J. F. (1995). Multivariate SPC Charts for Monitoring Batch Processes. Technometrics, 37(1), 41-59. doi:10.1080/00401706.1995.10485888Prats-Montalbán, J. M., de Juan, A., & Ferrer, A. (2011). Multivariate image analysis: A review with applications. Chemometrics and Intelligent Laboratory Systems, 107(1), 1-23. doi:10.1016/j.chemolab.2011.03.002Prats-Montalbán, J. M., Ferrer, A., Malo, J. L., & Gorbeña, J. (2006). A comparison of different discriminant analysis techniques in a steel industry welding process. Chemometrics and Intelligent Laboratory Systems, 80(1), 109-119. doi:10.1016/j.chemolab.2005.08.005Prats-Montalbán, J. M., & Ferrer, A. (2007). Integration of colour and textural information in multivariate image analysis: defect detection and classification issues. Journal of Chemometrics, 21(1-2), 10-23. doi:10.1002/cem.1026Bisgaard, S., Doganaksoy, N., Fisher, N., Gunter, B., Hahn, G., Keller-McNulty, S., … Wu, C. F. J. (2008). The Future of Industrial Statistics: A Panel Discussion. Technometrics, 50(2), 103-127. doi:10.1198/004017008000000136Stoumbos, Z. G., Reynolds, M. R., Ryan, T. P., & Woodall, W. H. (2000). The State of Statistical Process Control as We Proceed into the 21st Century. Journal of the American Statistical Association, 95(451), 992-998. doi:10.1080/01621459.2000.10474292Tracy, N. D., Young, J. C., & Mason, R. L. (1992). Multivariate Control Charts for Individual Observations. Journal of Quality Technology, 24(2), 88-95. doi:10.1080/00224065.1992.12015232Wierda, S. J. (1994). Multivariate statistical process control—recent results and directions for future research. Statistica Neerlandica, 48(2), 147-168. doi:10.1111/j.1467-9574.1994.tb01439.xWold, S. (1978). Cross-Validatory Estimation of the Number of Components in Factor and Principal Components Models. Technometrics, 20(4), 397-405. doi:10.1080/00401706.1978.10489693Woodall, W. H. (2000). Controversies and Contradictions in Statistical Process Control. Journal of Quality Technology, 32(4), 341-350. doi:10.1080/00224065.2000.11980013Woodall, W. H., & Montgomery, D. C. (1999). Research Issues and Ideas in Statistical Process Control. Journal of Quality Technology, 31(4), 376-386. doi:10.1080/00224065.1999.11979944Yu, H., & MacGregor, J. F. (2003). Multivariate image analysis and regression for prediction of coating content and distribution in the production of snack foods. Chemometrics and Intelligent Laboratory Systems, 67(2), 125-144. doi:10.1016/s0169-7439(03)00065-0Yu, H., MacGregor, J. F., Haarsma, G., & Bourg, W. (2003). Digital Imaging for Online Monitoring and Control of Industrial Snack Food Processes. Industrial & Engineering Chemistry Research, 42(13), 3036-3044. doi:10.1021/ie020941