Detection and Localization of Leaks in Water Networks

Today, 844 million humans around the world have no access to safe drinking water. Furthermore, every 90 seconds, one child dies from water-related illnesses. Major cities lose 15% - 50% of their water and, in some cases, losses may reach up to 70%, mostly due to leaks. Therefore, it is paramount to preserve water as an invaluable resource through water networks, particularly in large cities in which leak repair may cause disruption. Municipalities usually tackle leak problems using various detection systems and technologies, often long after leaks occur; however, such efforts are not enough to detect leaks at early stages. Therefore, the main objectives of the present research are to develop and validate a leak detection system and to optimize leak repair prioritization. The development of the leak detection models goes through several phases: (1) technology and device selection, (2) experimental work, (3) signal analysis, (4) selection of parameters, (5) machine learning model development and (6) validation of developed models. To detect leaks, vibration signals are collected through a variety of controlled experiments on PVC and ductile iron pipelines using wireless accelerometers, i.e., micro-electronic mechanical sensors (MEMS). The signals are analyzed to pinpoint leaks in water pipelines. Similarly, acoustic signals are collected from a pilot project in the city of Montreal, using noise loggers as another detection technology. The collected signals are also analyzed to detect and pinpoint the leaks. The leak detection system has presented promising results using both technologies. The developed MEMS model is capable of accurately pinpointing leaks within 12 centimeters from the exact location. Comparatively, for noise loggers, the developed model can detect the exact leak location within a 25-cm radius for an actual leak. The leak repair prioritization model uses two optimization techniques: (1) a well-known genetic algorithm and (2) a newly innovative Lazy Serpent Algorithm that is developed in the present research. The Lazy Serpent Algorithm has proved capable of surpassing the genetic algorithm in determining a more optimal schedule using much less computation time. The developed research proves that automated real-time leak detection is possible and can help governments save water resource and funds. The developed research proves the viability of accelerometers as a standalone leak detection technology and opens the door for further research and experimentations. The leak detection system model helps municipalities and water resource agencies rapidly detect leaks when they occur in real-time. The developed pinpointing models facilitate the leak repair process by precisely determine the leak location where the repair works should be conducted. The Lazy Serpent Algorithm helps municipalities better distribute their resources to maximize their desired benefits

Application of software and hardware-based technologies in leaks and burst detection in water pipe networks: a literature review

With the rise of smart water cities, water resource management has become increasingly important. The increase in the use of intelligent leak detection technologies in the water, gas, oil, and chemical industries has led to a significant improvement in safety, customer, and environmental results, and management costs. The aim of this review article is to provide a comprehensive overview of the application of software and hardware-based technologies in leak detection and bursts in water pipeline networks. This review aims to investigate the existing literature on the subject and to analyse the key leak detection systems in the water industry. The novelty of this review is the comprehensive analysis of the literature on software and hardware-based technologies for leak and burst detection in water pipe networks. Overall, this review article contributes to understanding the latest developments and challenges in the application of software- and hardware-based technologies for leak and burst detection in water pipe networks, and serves as a valuable resource for researchers, engineers, and practitioners working in the field of water distribution systems

Detection and Localisation of Pipe Bursts in a District Metered Area Using an Online Hydraulic Model

This thesis presents a research work on the development of new methodology for near-real-time detection and localisation of pipe bursts in a Water Distribution System (WDS) at the District Meters Area (DMA) level. The methodology makes use of online hydraulic model coupled with a demand forecasting methodology and several statistical techniques to process the hydraulic meters data (i.e., flows and pressures) coming from the field at regular time intervals (i.e. every 15 minutes). Once the detection part of the methodology identifies a potential burst occurrence in a system it raises an alarm. This is followed by the application of the burst localisation methodology to approximately locate the event within the District Metered Area (DMA). The online hydraulic model is based on data assimilation methodology coupled with a short-term Water Demand Forecasting Model (WDFM) based on Multi-Linear Regression. Three data assimilation methods were tested in the thesis, namely the iterative Kalman Filter method, the Ensemble Kalman Filter method and the Particle Filter method. The iterative Kalman Filter (i-KF) method was eventually chosen for the online hydraulic model based on the best overall trade-off between water system state prediction accuracy and computational efficiency. The online hydraulic model created this way was coupled with the Statistical Process Control (SPC) technique and a newly developed burst detection metric based on the moving average residuals between the predicted and observed hydraulic states (flows/pressures). Two new SPC-based charts with associated generic set of control rules for analysing burst detection metric values over consecutive time steps were introduced to raise burst alarms in a reliable and timely fashion. The SPC rules and relevant thresholds were determined offline by performing appropriate statistical analysis of residuals. The above was followed by the development of the new methodology for online burst localisation. The methodology integrates the information on burst detection metric values obtained during the detection stage with the new sensitivity matrix developed offline and hydraulic model runs used to simulate potential bursts to identify the most likely burst location in the pipe network. A new data algorithm for estimating the ‘normal’ DMA demand and burst flow during the burst period is developed and used for localisation. A new data algorithm for statistical analysis of flow and pressure data was also developed and used to determine the approximate burst area by producing a list of top ten suspected burst location nodes. The above novel methodologies for burst detection and localisation were applied to two real-life District Metred Areas in the United Kingdom (UK) with artificially generated flow and pressure observations and assumed bursts. The results obtained this way show that the developed methodology detects pipe bursts in a reliable and timely fashion, provides good estimate of a burst flow and accurately approximately locates the burst within a DMA. In addition, the results obtained show the potential of the methodology described here for online burst detection and localisation in assisting Water Companies (WCs) to conserve water, save energy and money. It can also enhance the UK WCs’ profile customer satisfaction, improve operational efficiency and improve the OFWAT’s Service Incentive Mechanism (SIM) scores.This STREAM project is funded by the Engineering and Physical Sciences Research Council and Industrial Collaborator, United Utilities

A Statistical Framework for Automatic Leakage Detection in Smart Water and Gas Grids

In the last few years, due to the technological improvement of advanced metering infrastructures, water and natural gas grids can be regarded as smart-grids, similarly to power ones. However, considering the number of studies related to the application of computational intelligence to distribution grids, the gap between power grids and water/gas grids is notably wide. For this purpose, in this paper, a framework for leakage identification is presented. The framework is composed of three sections aimed at the extraction and the selection of features and at the detection of leakages. A variation of the Sequential Feature Selection (SFS) algorithm is used to select the best performing features within a set, including, also, innovative temporal ones. The leakage identification is based on novelty detection and exploits the characterization of a normality model. Three statistical approaches, The Gaussian Mixture Model (GMM), Hidden Markov Model (HMM) and One-Class Support Vector Machine (OC-SVM), are adopted, under a comparative perspective. Both residential and office building environments are investigated by means of two datasets. One is the Almanac of Minutely Power dataset (AMPds), and it provides water and gas data consumption at 1, 10 and 30 min of time resolution; the other is the Department of International Development (DFID) dataset, and it provides water and gas data consumption at 30 min of time resolution. The achieved performance, computed by means of the Area Under the Curve (AUC), reaches 90 % in the office building case study, thus confirming the suitability of the proposed approach for applications in smart water and gas grids

Acoustic Monitoring for Leaks in Water Distribution Networks

Water distribution networks (WDNs) are complex systems that are subjected to stresses due to a number of hydraulic and environmental loads. Small leaks can run continuously for extended periods, sometimes indefinitely, undetected due to their minimal impact on the global system characteristics. As a result, system leaks remain an unavoidable reality and water loss estimates range from 10\%-25\% between treatment and delivery. This is a significant economic loss due to non-revenue water and a waste of valuable natural resource. Leaks produce perceptible changes in the sound and vibration fields in their vicinity and this aspect as been exploited in various techniques to detect leaks today. For example, the vibrations caused on the pipe wall in metal pipes, or acoustic energy in the vicinity of the leak, have all been exploited to develop inspection tools. However, most techniques in use today suffer from the following: (i) they are primarily inspection techniques (not monitoring) and often involve an expert user to interpret inspection data; (ii) they employ intrusive procedures to gain access into the WDN and, (iii) their algorithms remain closed and publicly available blind benchmark tests have shown that the detection rates are quite low. The main objective of this thesis is to address each of the aforementioned three problems existing in current methods. First, a technology conducive to long-term monitoring will be developed, which can be deployed year-around in live WDN. Secondly, this technology will be developed around existing access locations in a WDN, specifically from fire hydrant locations. To make this technology conducive to operate in cold climates such as Canada, the technology will be deployed from dry-barrel hydrants. Finally, the technology will be tested with a range of powerful machine learning algorithms, some new and some well-proven, and results published in the open scientific literature. In terms of the technology itself, unlike a majority of technologies that rely on accelerometer or pressure data, this technology relies on the measurement of the acoustic (sound) field within the water column. The problem of leak detection and localization is addressed through a technique called linear prediction (LP). Extensively used in speech processing, LP is shown in this work to be effective in capturing the composite spectrum effects of radiation, pipe system, and leak-induced excitation of the pipe system, with and without leaks, and thus has the potential to be an effective tool to detect leaks. The relatively simple mathematical formulation of LP lends itself well to online implementation in long-term monitoring applications and hence motivates an in-depth investigation. For comparison purposes, model-free methods including a powerful signal processing technique and a technique from machine learning are employed. In terms of leak detection, three data-driven anomaly detection approaches are employed and the LP method is explored for leak localization as well. Tests were conducted on several laboratory test beds, with increasing levels of complexity and in a live WDN in the city of Guelph, Ontario, Canada. Results form this study show that the LP method developed in this thesis provides a unified framework for both leak detection and localization when used in conjunction with semi-supervised anomaly detection algorithms. A novel two-part localization approach is developed which utilizes LP pre-processed data, in tandem with the traditional cross-correlation approach. Results of the field study show that the presented method is able to perform both leak-detection and localization using relatively short time signal lengths. This is advantageous in continuous monitoring situations as this minimizes the data transmission requirements, the latter being one of the main impediments to full-scale implementation and deployment of leak-detection technology

Literature review of data analytics for leak detection in water distribution networks: A focus on pressure and flow smart sensors

This is the author accepted manuscript. The final version is available from ASCE via the DOI in this recordDATA AVAILABILITY STATEMENT: No data, models, or code were generated or used during the study (e.g. opinion or dateless paper)Leakage detection is one of the important aspects of water distribution management. Water companies are exploring alternative approaches to detect leaks in a timely manner with high accuracy to reduce water losses and minimise environmental and economic consequences. In this article, a literature review is presented to develop a step-by-step analytic framework for the leakage detection process based on flow and pressure data collected from water distribution networks. The main steps of the data analytic for leakage detection are: setting up the goals, data collection, preparing the gathered data, analysing the prepared data, and method evaluation. The issues of concern for each step of the proposed leakage detection framework are analysed and discussed. The smart sensor-based leakage detection methods can be categorised as data-driven methods and model-based methods. Data-driven methods can be further categorised as statistical process control-based methods, prediction-classification methods, and clustering methods. Hydraulic model-based methods can be further categorised as calibration-based methods, sensitivity analysis, and classifier-based methods. The advantages and disadvantages of each method are discussed, and suggestions for future research are provided. This review represents a new perspective on the subject from five aspects: 1) most of the leakage detection methods are focused on burst detection, and different types of leakages should be considered in future research; 2) it is important to consider data uncertainties, and more robust real-time leakage detection methods should be developed; 3) it is important to consider hydraulic model uncertainties; 4) unrealistic assumptions should be addressed in future research; 5) spatial relations between sensors could provide more information and should be considered.China Scholarship CouncilRoyal Academy of Engineerin

SMART-DETECT: AN IOT BASED MONITORING SYSTEM FOR OIL LEAK DETECTION

In the past couple of years, the oil and gas industry is aiming to reduce it’s day-to-day costs due to reasons such as reduction in oil prices, mass overproduction and so on. This has the Oil and Gas industries aiming for innovative ways to reduce costs and minimize nonproductive time. In order to accomplish this goal, oil companies need to improve and control measurements with more reliable but relatively cheaper systems. One of the methods is using Internet-of-Things (IoT) based monitoring systems which can help in remote monitoring. IoT is offering better solutions for oil and gas companies to reduce potential failures and downtime by achieving a better and faster method to acquire information efficiently. A real-time stream of data can minimize the need for human intervention in the oil field in case of a catastrophe by reducing the risk of a hazard, saving time, and increasing the environmental pollution control. IoT can be a vital transformation for the Oil and Gas industry. The aim of this thesis is to validate and prove that IoT solutions can be feasible in the oil industry specifically in the pipe leak detection solution ,by building a prototype that operates on low power communication protocol (LoRa®) and conducting experimental procedures on an actual pipe using water instead of oil due to practical difficulty of using oil for the experiment

Advanced Fault Diagnosis and Health Monitoring Techniques for Complex Engineering Systems

Over the last few decades, the field of fault diagnostics and structural health management has been experiencing rapid developments. The reliability, availability, and safety of engineering systems can be significantly improved by implementing multifaceted strategies of in situ diagnostics and prognostics. With the development of intelligence algorithms, smart sensors, and advanced data collection and modeling techniques, this challenging research area has been receiving ever-increasing attention in both fundamental research and engineering applications. This has been strongly supported by the extensive applications ranging from aerospace, automotive, transport, manufacturing, and processing industries to defense and infrastructure industries

Data-Driven Distributed Optical Vibration Sensors: A Review

Distributed optical vibration sensors (DOVS) have attracted much attention recently since it can be used to monitor mechanical vibrations or acoustic waves with long reach and high sensitivity. Phase-sensitive optical time domain reflectometry (Φ-OTDR) is one of the most commonly used DOVS schemes. For Φ-OTDR, the whole length of fiber under test (FUT) works as the sensing instrument and continuously generates sensing data during measurement. Researchers have made great efforts to try to extract external intrusions from the redundant data. High signal-to-noise ratio (SNR) is necessary in order to accurately locate and identify external intrusions in Φ-OTDR systems. Improvement in SNR is normally limited by the properties of light source, photodetector and FUT. But this limitation can also be overcome by post-processing of the received optical signals. In this context, detailed methodologies of SNR enhancement post-processing algorithms in Φ-OTDR systems have been described in this paper. Furthermore, after successfully locating the external vibrations, it is also important to identify the types of source of the vibrations. Pattern classification is a powerful tool in recognizing the intrusion types from the vibration signals in practical applications. Recent reports of Φ-OTDR systems employed with pattern classification algorithms are subsequently reviewed and discussed. This thorough review will provide a design pathway for improving the performance of Φ-OTDR while maintaining the cost of the system as no additional hardware is required