Locating Multiple Leaks in Water Distribution Networks Combining Physically Based and Data-Driven Models and High-Performance Computing

Water utilities are urged to decrease their real water losses, not only to reduce costs but also to assure long-term sustainability. Hardware- and software-based techniques have been broadly used to locate leaks; within the latter, previous works that have used data-driven models mostly focused on single leaks. This paper presents a methodology to locate multiple leaks in water distribution networks employing pressure residuals. It consists of two phases: one is to produce training data for the data-driven model and cluster the nodes based on their leak-flow-rate-independent signatures using an adapted hierarchical agglomerative algorithm; the second is to locate the leaks using a top-down approach. To identify the leaking clusters and nodes, we employed a custom-built k-nearest neighbor (k-NN) algorithm that compares the test instances with the generated training data. This instance-to-instance comparison requires substantial computational resources for classification, which was overcome by the use of high-performance computing. The methodology was applied to a real network located in a European town, comprising 144 nodes and a total length of pipes of 24 km. Although its multiple inlets add redundancy to the network increasing the challenge of leak location, the method proved to obtain acceptable results to guide the field pinpointing activities. Nearly 70% of the areas determined by the clusters were identified with an accuracy of over 90% for leak flows above 3.0 L/s, and the leaking nodes were accurately detected over 50% of the time for leak flows above 4.0 L/

Meteorological Drought Forecasting Based on Climate Signals Using Artificial Neural Network – A Case Study in Khanhhoa Province Vietnam

AbstractIn Khanhhoa Province (Vietnam) long-lasting droughts often occur, causing negative consequences for this region, so accurate drought forecasting is of paramount importance. Normally, drought index forecasting model uses previously lagged observations of the index itself and rainfall as input variables. Recently, climate signals are being also used as potential predictors. In this study, we use 3-month, 6-month, and 12-month of Standardized Precipitation Evapotranspiration Index (SPEI), with a calculation time during the period from 1977 to 2014. This paper aims at examining the lagged climate signals to predict SPEI at Khanhhoa province, using artificial neural network. Climate signals indices from Indian Ocean and Pacific Ocean surrounding study area were analysed to select five predictors for the model. These were combined with local variables (lagged SPEI and rainfall) and used as input variables in 16 different models for different forecast horizons. The results show that adding climate signals can achieve better prediction. Climate signals can be also used solely as predictors without using local variables – in this case they explain the variation SPEI (longer horizons, e.g.12-month) reaching 61 – 80%. The developed model can benefit developing long-term policies for reservoir and irrigation regulation and plant alternation schemes in the context of drought hazard

Multiobjective direct policy search using physically based operating rules in multireservoir systems

supplemental_data_wr.1943-5452.0001159_ritter.pdf (492 KB)This study explores the ways to introduce physical interpretability into the process of optimizing operating rules for multireservoir systems with multiple objectives. Prior studies applied the concept of direct policy search (DPS), in which the release policy is expressed as a set of parameterized functions (e.g., neural networks) that are optimized by simulating the performance of different parameter value combinations over a testing period. The problem with this approach is that the operators generally avoid adopting such artificial black-box functions for the direct real-time control of their systems, preferring simpler tools with a clear connection to the system physics. This study addresses this mismatch by replacing the black-box functions in DPS with physically based parameterized operating rules, for example by directly using target levels in dams as decision variables. This leads to results that are physically interpretable and may be more acceptable to operators. The methodology proposed in this work is applied to a network of five reservoirs and four power plants in the Nechi catchment in Colombia, with four interests involved: average energy generation, firm energy generation, flood hazard, and flow regime alteration. The release policy is expressed depending on only 12 parameters, which significantly reduces the computational complexity compared to existing approaches of multiobjective DPS. The resulting four-dimensional Pareto-approximate set offers a variety of operational strategies from which operators may choose one that corresponds best to their preferences. For demonstration purposes, one particular optimized policy is selected and its parameter values are analyzed to illustrate how the physically based operating rules can be directly interpreted by the operators.Peer ReviewedPreprin

Integrating geographic data and the SCS-CN method with LSTM networks for enhanced runoff forecasting in a complex mountain basin

IntroductionIn complex mountain basins, hydrological forecasting poses a formidable challenge due to the intricacies of runoff generation processes and the limitations of available data. This study explores the enhancement of short-term runoff forecasting models through the utilization of long short-term memory (LSTM) networks.MethodsTo achieve this, we employed feature engineering (FE) strategies, focusing on geographic data and the Soil Conservation Service Curve Number (SCS-CN) method. Our investigation was conducted in a 3,390 km2 basin, employing the GSMaP-NRT satellite precipitation product (SPP) to develop forecasting models with lead times of 1, 6, and 11 h. These lead times were selected to address the needs of near-real-time forecasting, flash flood prediction, and basin concentration time assessment, respectively.Results and discussionOur findings demonstrate an improvement in the efficiency of LSTM forecasting models across all lead times, as indicated by Nash-Sutcliffe efficiency values of 0.93 (1 h), 0.77 (6 h), and 0.67 (11 h). Notably, these results are on par with studies relying on ground-based precipitation data. This methodology not only showcases the potential for advanced data-driven runoff models but also underscores the importance of incorporating available geographic information into precipitation-ungauged hydrological systems. The insights derived from this study offer valuable tools for hydrologists and researchers seeking to enhance the accuracy of hydrological forecasting in complex mountain basins

Taking the pulse of Earth's tropical forests using networks of highly distributed plots

Tropical forests are the most diverse and productive ecosystems on Earth. While better understanding of these forests is critical for our collective future, until quite recently efforts to measure and monitor them have been largely disconnected. Networking is essential to discover the answers to questions that transcend borders and the horizons of funding agencies. Here we show how a global community is responding to the challenges of tropical ecosystem research with diverse teams measuring forests tree-by-tree in thousands of long-term plots. We review the major scientific discoveries of this work and show how this process is changing tropical forest science. Our core approach involves linking long-term grassroots initiatives with standardized protocols and data management to generate robust scaled-up results. By connecting tropical researchers and elevating their status, our Social Research Network model recognises the key role of the data originator in scientific discovery. Conceived in 1999 with RAINFOR (South America), our permanent plot networks have been adapted to Africa (AfriTRON) and Southeast Asia (T-FORCES) and widely emulated worldwide. Now these multiple initiatives are integrated via ForestPlots.net cyber-infrastructure, linking colleagues from 54 countries across 24 plot networks. Collectively these are transforming understanding of tropical forests and their biospheric role. Together we have discovered how, where and why forest carbon and biodiversity are responding to climate change, and how they feedback on it. This long-term pan-tropical collaboration has revealed a large long-term carbon sink and its trends, as well as making clear which drivers are most important, which forest processes are affected, where they are changing, what the lags are, and the likely future responses of tropical forests as the climate continues to change. By leveraging a remarkably old technology, plot networks are sparking a very modern revolution in tropical forest science. In the future, humanity can benefit greatly by nurturing the grassroots communities now collectively capable of generating unique, long-term understanding of Earth's most precious forests.Additional co-authors: Susan Laurance, William Laurance, Francoise Yoko Ishida, Andrew Marshall, Catherine Waite, Hannsjoerg Woell, Jean-Francois Bastin, Marijn Bauters, Hans Beeckman, Pfascal Boeckx, Jan Bogaert, Charles De Canniere, Thales de Haulleville, Jean-Louis Doucet, Olivier Hardy, Wannes Hubau, Elizabeth Kearsley, Hans Verbeeck, Jason Vleminckx, Steven W. Brewer, Alfredo Alarcón, Alejandro Araujo-Murakami, Eric Arets, Luzmila Arroyo, Ezequiel Chavez, Todd Fredericksen, René Guillén Villaroel, Gloria Gutierrez Sibauty, Timothy Killeen, Juan Carlos Licona, John Lleigue, Casimiro Mendoza, Samaria Murakami, Alexander Parada Gutierrez, Guido Pardo, Marielos Peña-Claros, Lourens Poorter, Marisol Toledo, Jeanneth Villalobos Cayo, Laura Jessica Viscarra, Vincent Vos, Jorge Ahumada, Everton Almeida, Jarcilene Almeida, Edmar Almeida de Oliveira, Wesley Alves da Cruz, Atila Alves de Oliveira, Fabrício Alvim Carvalho, Flávio Amorim Obermuller, Ana Andrade, Fernanda Antunes Carvalho, Simone Aparecida Vieira, Ana Carla Aquino, Luiz Aragão, Ana Claudia Araújo, Marco Antonio Assis, Jose Ataliba Mantelli Aboin Gomes, Fabrício Baccaro, Plínio Barbosa de Camargo, Paulo Barni, Jorcely Barroso, Luis Carlos Bernacci, Kauane Bordin, Marcelo Brilhante de Medeiros, Igor Broggio, José Luís Camargo, Domingos Cardoso, Maria Antonia Carniello, Andre Luis Casarin Rochelle, Carolina Castilho, Antonio Alberto Jorge Farias Castro, Wendeson Castro, Sabina Cerruto Ribeiro, Flávia Costa, Rodrigo Costa de Oliveira, Italo Coutinho, John Cunha, Lola da Costa, Lucia da Costa Ferreira, Richarlly da Costa Silva, Marta da Graça Zacarias Simbine, Vitor de Andrade Kamimura, Haroldo Cavalcante de Lima, Lia de Oliveira Melo, Luciano de Queiroz, José Romualdo de Sousa Lima, Mário do Espírito Santo, Tomas Domingues, Nayane Cristina dos Santos Prestes, Steffan Eduardo Silva Carneiro, Fernando Elias, Gabriel Eliseu, Thaise Emilio, Camila Laís Farrapo, Letícia Fernandes, Gustavo Ferreira, Joice Ferreira, Leandro Ferreira, Socorro Ferreira, Marcelo Fragomeni Simon, Maria Aparecida Freitas, Queila S. García, Angelo Gilberto Manzatto, Paulo Graça, Frederico Guilherme, Eduardo Hase, Niro Higuchi, Mariana Iguatemy, Reinaldo Imbrozio Barbosa, Margarita Jaramillo, Carlos Joly, Joice Klipel, Iêda Leão do Amaral, Carolina Levis, Antonio S. Lima, Maurício Lima Dan, Aline Lopes, Herison Madeiros, William E. Magnusson, Rubens Manoel dos Santos, Beatriz Marimon, Ben Hur Marimon Junior, Roberta Marotti Martelletti Grillo, Luiz Martinelli, Simone Matias Reis, Salomão Medeiros, Milton Meira-Junior, Thiago Metzker, Paulo Morandi, Natanael Moreira do Nascimento, Magna Moura, Sandra Cristina Müller, Laszlo Nagy, Henrique Nascimento, Marcelo Nascimento, Adriano Nogueira Lima, Raimunda Oliveira de Araújo, Jhonathan Oliveira Silva, Marcelo Pansonato, Gabriel Pavan Sabino, Karla Maria Pedra de Abreu, Pablo José Francisco Pena Rodrigues, Maria Piedade, Domingos Rodrigues, José Roberto Rodrigues Pinto, Carlos Quesada, Eliana Ramos, Rafael Ramos, Priscyla Rodrigues, Thaiane Rodrigues de Sousa, Rafael Salomão, Flávia Santana, Marcos Scaranello, Rodrigo Scarton Bergamin, Juliana Schietti, Jochen Schöngart, Gustavo Schwartz, Natalino Silva, Marcos Silveira, Cristiana Simão Seixas, Marta Simbine, Ana Claudia Souza, Priscila Souza, Rodolfo Souza, Tereza Sposito, Edson Stefani Junior, Julio Daniel do Vale, Ima Célia Guimarães Vieira, Dora Villela, Marcos Vital, Haron Xaud, Katia Zanini, Charles Eugene Zartman, Nur Khalish Hafizhah Ideris, Faizah binti Hj Metali, Kamariah Abu Salim, Muhd Shahruney Saparudin, Rafizah Mat Serudin, Rahayu Sukmaria Sukri, Serge Begne, George Chuyong, Marie Noel Djuikouo, Christelle Gonmadje, Murielle Simo-Droissart, Bonaventure Sonké, Hermann Taedoumg, Lise Zemagho, Sean Thomas, Fidèle Baya, Gustavo Saiz, Javier Silva Espejo, Dexiang Chen, Alan Hamilton, Yide Li, Tushou Luo, Shukui Niu, Han Xu, Zhang Zhou, Esteban Álvarez-Dávila, Juan Carlos Andrés Escobar, Henry Arellano-Peña, Jaime Cabezas Duarte, Jhon Calderón, Lina Maria Corrales Bravo, Borish Cuadrado, Hermes Cuadros, Alvaro Duque, Luisa Fernanda Duque, Sandra Milena Espinosa, Rebeca Franke-Ante, Hernando García, Alejandro Gómez, Roy González-M., Álvaro Idárraga-Piedrahíta, Eliana Jimenez, Rubén Jurado, Wilmar López Oviedo, René López-Camacho, Omar Aurelio Melo Cruz, Irina Mendoza Polo, Edwin Paky, Karen Pérez, Angel Pijachi, Camila Pizano, Adriana Prieto, Laura Ramos, Zorayda Restrepo Correa, James Richardson, Elkin Rodríguez, Gina M. Rodriguez M., Agustín Rudas, Pablo Stevenson, Markéta Chudomelová, Martin Dancak, Radim Hédl, Stanislav Lhota, Martin Svatek, Jacques Mukinzi, Corneille Ewango, Terese Hart, Emmanuel Kasongo Yakusu, Janvier Lisingo, Jean-Remy Makana, Faustin Mbayu, Benjamin Toirambe, John Tshibamba Mukendi, Lars Kvist, Gustav Nebel, Selene Báez, Carlos Céron, Daniel M. Griffith, Juan Ernesto Guevara Andino, David Neill, Walter Palacios, Maria Cristina Peñuela-Mora, Gonzalo Rivas-Torres, Gorky Villa, Sheleme Demissie, Tadesse Gole, Techane Gonfa, Kalle Ruokolainen, Michel Baisie, Fabrice Bénédet, Wemo Betian, Vincent Bezard, Damien Bonal, Jerôme Chave, Vincent Droissart, Sylvie Gourlet-Fleury, Annette Hladik, Nicolas Labrière, Pétrus Naisso, Maxime Réjou-Méchain, Plinio Sist, Lilian Blanc, Benoit Burban, Géraldine Derroire, Aurélie Dourdain, Clement Stahl, Natacha Nssi Bengone, Eric Chezeaux, Fidèle Evouna Ondo, Vincent Medjibe, Vianet Mihindou, Lee White, Heike Culmsee, Cristabel Durán Rangel, Viviana Horna, Florian Wittmann, Stephen Adu-Bredu, Kofi Affum-Baffoe, Ernest Foli, Michael Balinga, Anand Roopsind, James Singh, Raquel Thomas, Roderick Zagt, Indu K. Murthy, Kuswata Kartawinata, Edi Mirmanto, Hari Priyadi, Ismayadi Samsoedin, Terry Sunderland, Ishak Yassir, Francesco Rovero, Barbara Vinceti, Bruno Hérault, Shin-Ichiro Aiba, Kanehiro Kitayama, Armandu Daniels, Darlington Tuagben, John T. Woods, Muhammad Fitriadi, Alexander Karolus, Kho Lip Khoon, Noreen Majalap, Colin Maycock, Reuben Nilus, Sylvester Tan, Almeida Sitoe, Indiana Coronado G., Lucas Ojo, Rafael de Assis, Axel Dalberg Poulsen, Douglas Sheil, Karen Arévalo Pezo, Hans Buttgenbach Verde, Victor Chama Moscoso, Jimmy Cesar Cordova Oroche, Fernando Cornejo Valverde, Massiel Corrales Medina, Nallaret Davila Cardozo, Jano de Rutte Corzo, Jhon del Aguila Pasquel, Gerardo Flores Llampazo, Luis Freitas, Darcy Galiano Cabrera, Roosevelt García Villacorta, Karina Garcia Cabrera, Diego García Soria, Leticia Gatica Saboya, Julio Miguel Grandez Rios, Gabriel Hidalgo Pizango, Eurídice Honorio Coronado, Isau Huamantupa-Chuquimaco, Walter Huaraca Huasco, Yuri Tomas Huillca Aedo, Jose Luis Marcelo Peña, Abel Monteagudo Mendoza, Vanesa Moreano Rodriguez, Percy Núñez Vargas, Sonia Cesarina Palacios Ramos, Nadir Pallqui Camacho, Antonio Peña Cruz, Freddy Ramirez Arevalo, José Reyna Huaymacari, Carlos Reynel Rodriguez, Marcos Antonio Ríos Paredes, Lily Rodriguez Bayona, Rocio del Pilar Rojas Gonzales, Maria Elena Rojas Peña, Norma Salinas Revilla, Yahn Carlos Soto Shareva, Raul Tupayachi Trujillo, Luis Valenzuela Gamarra, Rodolfo Vasquez Martinez, Jim Vega Arenas, Christian Amani, Suspense Averti Ifo, Yannick Bocko, Patrick Boundja, Romeo Ekoungoulou, Mireille Hockemba, Donatien Nzala, Alusine Fofanah, David Taylor, Guillermo Bañares-de Dios, Luis Cayuela, Íñigo Granzow-de la Cerda, Manuel Macía, Juliana Stropp, Maureen Playfair, Verginia Wortel, Toby Gardner, Robert Muscarella, Hari Priyadi, Ervan Rutishauser, Kuo-Jung Chao, Pantaleo Munishi, Olaf Bánki, Frans Bongers, Rene Boot, Gabriella Fredriksson, Jan Reitsma, Hans ter Steege, Tinde van Andel, Peter van de Meer, Peter van der Hout, Mark van Nieuwstadt, Bert van Ulft, Elmar Veenendaal, Ronald Vernimmen, Pieter Zuidema, Joeri Zwerts, Perpetra Akite, Robert Bitariho, Colin Chapman, Eilu Gerald, Miguel Leal, Patrick Mucunguzi, Miguel Alexiades, Timothy R. Baker, Karina Banda, Lindsay Banin, Jos Barlow, Amy Bennett, Erika Berenguer, Nicholas Berry, Neil M. Bird, George A. Blackburn, Francis Brearley, Roel Brienen, David Burslem, Lidiany Carvalho, Percival Cho, Fernanda Coelho, Murray Collins, David Coomes, Aida Cuni-Sanchez, Greta Dargie, Kyle Dexter, Mat Disney, Freddie Draper, Muying Duan, Adriane Esquivel-Muelbert, Robert Ewers, Belen Fadrique, Sophie Fauset, Ted R. Feldpausch, Filipe França, David Galbraith, Martin Gilpin, Emanuel Gloor, John Grace, Keith Hamer, David Harris, Tommaso Jucker, Michelle Kalamandeen, Bente Klitgaard, Aurora Levesley, Simon L. Lewis, Jeremy Lindsell, Gabriela Lopez-Gonzalez, Jon Lovett, Yadvinder Malhi, Toby Marthews, Emma McIntosh, Karina Melgaço, William Milliken, Edward Mitchard, Peter Moonlight, Sam Moore, Alexandra Morel, Julie Peacock, Kelvin Peh, Colin Pendry, R. Toby Pennington, Luciana de Oliveira Pereira, Carlos Peres, Oliver L. Phillips, Georgia Pickavance, Thomas Pugh, Lan Qie, Terhi Riutta, Katherine Roucoux, Casey Ryan, Tiina Sarkinen, Camila Silva Valeria, Dominick Spracklen, Suzanne Stas, Martin Sullivan, Michael Swaine, Joey Talbot, James Taplin, Geertje van der Heijden, Laura Vedovato, Simon Willcock, Mathew Williams, Luciana Alves, Patricia Alvarez Loayza, Gabriel Arellano, Cheryl Asa, Peter Ashton, Gregory Asner, Terry Brncic, Foster Brown, Robyn Burnham, Connie Clark, James Comiskey, Gabriel Damasco, Stuart Davies, Tony Di Fiore, Terry Erwin, William Farfan-Rios, Jefferson Hall, David Kenfack, Thomas Lovejoy, Roberta Martin, Olga Martha Montiel, John Pipoly, Nigel Pitman, John Poulsen, Richard Primack, Miles Silman, Marc Steininger, Varun Swamy, John Terborgh, Duncan Thomas, Peter Umunay, Maria Uriarte, Emilio Vilanova Torre, Ophelia Wang, Kenneth Young, Gerardo A. Aymard C., Lionel Hernández, Rafael Herrera Fernández, Hirma Ramírez-Angulo, Pedro Salcedo, Elio Sanoja, Julio Serrano, Armando Torres-Lezama, Tinh Cong Le, Trai Trong Le, Hieu Dang Tra

Hybrid models for hydrological forecasting : integration of data-driven and conceptual modelling techniques; Dissertation, UNESCO-IHE Institute for Water Education, Delft.

This dissertation presents the investigation of different architectures of integrating hydrological knowledge and models with data-driven models for the purpose of hydrological flow forecasting. The models resulting from such integration are referred to as hybrid models. The book addresses the following topics: A classification of different hybrid modelling approaches in the context of flow forecasting. The methodological development and application of modular models based on clustering and baseflow empirical formulations. The integration of hydrological conceptual models with neural network error corrector models and the use of committee models for daily streamflow forecasting. The application of modular modelling and fuzzy committee models to the problem of downscaling weather information for hydrological forecasting

Sensitivity analysis of data-driven groundwater forecasts to hydroclimatic controls in irrigated croplands

In the last decades, advancements in computational science have greatly expanded the use of artificial neural networks (ANNs) in hydrogeology, including applications on groundwater forecast, variable selection, extended lead-times, and regime-specific analysis. However, ANN-model performance often omits the sensitivity to ob- servational uncertainties in hydroclimate forcings. The goal of this paper is to implement a data-driven modeling framework for assessing the sensitivity of ANN-based groundwater forecasts to the uncertainties in observational inputs across space, time, and hydrological regimes. The objectives are two-folded. The first objective is to couple an ANN model with the PAWN sensitivity analysis (SA). The second objective is to evaluate the scale- and process-dependent sensitivities of groundwater forecasts to hydroclimate inputs, computing the sensitivity index in groundwater wells (1) across the whole time-series (for the global sensitivity analysis); (2) across the output sub-regions with conditions of water deficit and water surplus (for the ‘regional’ sensitivity analysis); and (3) at each time step (for the time-varying sensitivity analysis). The implementation of the ANN-PAWN occurs in 68 wells across the Northern High Plains aquifer, USA, with pre-time-step rainfall, evapotranspiration, snowmelt, streamflow, and groundwater measurements as inputs. Results show that evapotranspiration and rainfall are the major sources of uncertainty, with the latter being particularly relevant in water surplus conditions and the former in water deficit conditions. The time-varying sensitivity analysis leads to the identification of localized sensitivities to other sources of uncertainty, as snowmelt in spring or river flow during the annual peak period at the groundwater level