Advances in Hyperspectral Image Classification Methods for Vegetation and Agricultural Cropland Studies

Hyperspectral data are becoming more widely available via sensors on airborne and unmanned aerial vehicle (UAV) platforms, as well as proximal platforms. While space-based hyperspectral data continue to be limited in availability, multiple spaceborne Earth-observing missions on traditional platforms are scheduled for launch, and companies are experimenting with small satellites for constellations to observe the Earth, as well as for planetary missions. Land cover mapping via classification is one of the most important applications of hyperspectral remote sensing and will increase in significance as time series of imagery are more readily available. However, while the narrow bands of hyperspectral data provide new opportunities for chemistry-based modeling and mapping, challenges remain. Hyperspectral data are high dimensional, and many bands are highly correlated or irrelevant for a given classification problem. For supervised classification methods, the quantity of training data is typically limited relative to the dimension of the input space. The resulting Hughes phenomenon, often referred to as the curse of dimensionality, increases potential for unstable parameter estimates, overfitting, and poor generalization of classifiers. This is particularly problematic for parametric approaches such as Gaussian maximum likelihoodbased classifiers that have been the backbone of pixel-based multispectral classification methods. This issue has motivated investigation of alternatives, including regularization of the class covariance matrices, ensembles of weak classifiers, development of feature selection and extraction methods, adoption of nonparametric classifiers, and exploration of methods to exploit unlabeled samples via semi-supervised and active learning. Data sets are also quite large, motivating computationally efficient algorithms and implementations. This chapter provides an overview of the recent advances in classification methods for mapping vegetation using hyperspectral data. Three data sets that are used in the hyperspectral classification literature (e.g., Botswana Hyperion satellite data and AVIRIS airborne data over both Kennedy Space Center and Indian Pines) are described in Section 3.2 and used to illustrate methods described in the chapter. An additional high-resolution hyperspectral data set acquired by a SpecTIR sensor on an airborne platform over the Indian Pines area is included to exemplify the use of new deep learning approaches, and a multiplatform example of airborne hyperspectral data is provided to demonstrate transfer learning in hyperspectral image classification. Classical approaches for supervised and unsupervised feature selection and extraction are reviewed in Section 3.3. In particular, nonlinearities exhibited in hyperspectral imagery have motivated development of nonlinear feature extraction methods in manifold learning, which are outlined in Section 3.3.1.4. Spatial context is also important in classification of both natural vegetation with complex textural patterns and large agricultural fields with significant local variability within fields. Approaches to exploit spatial features at both the pixel level (e.g., co-occurrencebased texture and extended morphological attribute profiles [EMAPs]) and integration of segmentation approaches (e.g., HSeg) are discussed in this context in Section 3.3.2. Recently, classification methods that leverage nonparametric methods originating in the machine learning community have grown in popularity. An overview of both widely used and newly emerging approaches, including support vector machines (SVMs), Gaussian mixture models, and deep learning based on convolutional neural networks is provided in Section 3.4. Strategies to exploit unlabeled samples, including active learning and metric learning, which combine feature extraction and augmentation of the pool of training samples in an active learning framework, are outlined in Section 3.5. Integration of image segmentation with classification to accommodate spatial coherence typically observed in vegetation is also explored, including as an integrated active learning system. Exploitation of multisensor strategies for augmenting the pool of training samples is investigated via a transfer learning framework in Section 3.5.1.2. Finally, we look to the future, considering opportunities soon to be provided by new paradigms, as hyperspectral sensing is becoming common at multiple scales from ground-based and airborne autonomous vehicles to manned aircraft and space-based platforms

Inferring efficient operating rules in multireservoir water resource systems: A review

[EN] Coordinated and efficient operation of water resource systems becomes essential to deal with growing demands and uncertain resources in water-stressed regions. System analysis models and tools help address the complexities of multireservoir systems when defining operating rules. This paper reviews the state of the art in developing operating rules for multireservoir water resource systems, focusing on efficient system operation. This review focuses on how optimal operating rules can be derived and represented. Advantages and drawbacks of each approach are discussed. Major approaches to derive optimal operating rules include direct optimization of reservoir operation, embedding conditional operating rules in simulation-optimization frameworks, and inferring rules from optimization results. Suggestions on which approach to use depend on context. Parametrization-simulation-optimization or rule inference using heuristics are promising approaches. Increased forecasting capabilities will further benefit the use of model predictive control algorithms to improve system operation. This article is categorized under: Engineering Water > Water, Health, and Sanitation Engineering Water > MethodsThe study has been partially funded by the ADAPTAMED project (RTI2018-101483-B-I00) from the Ministerio de Ciencia, Innovacion Universidades (MICINN) of Spain, and by the postdoctoral program (PAID-10-18) of the Universitat Politecnica de Valencia (UPV).Macian-Sorribes, H.; Pulido-Velazquez, M. (2019). Inferring efficient operating rules in multireservoir water resource systems: A review. Wiley Interdisciplinary Reviews Water. 7(1):1-24. https://doi.org/10.1002/wat2.1400S12471Aboutalebi, M., Bozorg Haddad, O., & Loáiciga, H. A. (2015). Optimal Monthly Reservoir Operation Rules for Hydropower Generation Derived with SVR-NSGAII. Journal of Water Resources Planning and Management, 141(11), 04015029. doi:10.1061/(asce)wr.1943-5452.0000553Ahmad, A., El-Shafie, A., Razali, S. F. M., & Mohamad, Z. S. (2014). Reservoir Optimization in Water Resources: a Review. Water Resources Management, 28(11), 3391-3405. doi:10.1007/s11269-014-0700-5Ahmadi, M., Bozorg Haddad, O., & Mariño, M. A. (2013). Extraction of Flexible Multi-Objective Real-Time Reservoir Operation Rules. Water Resources Management, 28(1), 131-147. doi:10.1007/s11269-013-0476-zAndreu, J., Capilla, J., & Sanchís, E. (1996). AQUATOOL, a generalized decision-support system for water-resources planning and operational management. Journal of Hydrology, 177(3-4), 269-291. doi:10.1016/0022-1694(95)02963-xAndreu, J., & Sahuquillo, A. (1987). Efficient Aquifer Simulation in Complex Systems. Journal of Water Resources Planning and Management, 113(1), 110-129. doi:10.1061/(asce)0733-9496(1987)113:1(110)Ashbolt, S. C., Maheepala, S., & Perera, B. J. C. (2016). Using Multiobjective Optimization to Find Optimal Operating Rules for Short-Term Planning of Water Grids. Journal of Water Resources Planning and Management, 142(10), 04016033. doi:10.1061/(asce)wr.1943-5452.0000675Ashbolt, S. C., & Perera, B. J. C. (2018). Multiobjective Optimization of Seasonal Operating Rules for Water Grids Using Streamflow Forecast Information. Journal of Water Resources Planning and Management, 144(4), 05018003. doi:10.1061/(asce)wr.1943-5452.0000902Azari, A., Hamzeh, S., & Naderi, S. (2018). Multi-Objective Optimization of the Reservoir System Operation by Using the Hedging Policy. Water Resources Management, 32(6), 2061-2078. doi:10.1007/s11269-018-1917-5Becker, L., & Yeh, W. W.-G. (1974). Optimization of real time operation of a multiple-reservoir system. Water Resources Research, 10(6), 1107-1112. doi:10.1029/wr010i006p01107Bellman, R. E., & Dreyfus, S. E. (1962). Applied Dynamic Programming. doi:10.1515/9781400874651Ben-Tal, A., El Ghaoui, L., & Nemirovski, A. (2009). Robust Optimization. doi:10.1515/9781400831050Bessler, F. T., Savic, D. A., & Walters, G. A. (2003). Water Reservoir Control with Data Mining. Journal of Water Resources Planning and Management, 129(1), 26-34. doi:10.1061/(asce)0733-9496(2003)129:1(26)Bhaskar, N. R., & Whitlatch, E. E. (1980). Derivation of monthly reservoir release policies. Water Resources Research, 16(6), 987-993. doi:10.1029/wr016i006p00987Bianucci, P., Sordo-Ward, Á., Moralo, J., & Garrote, L. (2015). Probabilistic-Multiobjective Comparison of User-Defined Operating Rules. Case Study: Hydropower Dam in Spain. Water, 7(12), 956-974. doi:10.3390/w7030956Biglarbeigi, P., Giuliani, M., & Castelletti, A. (2018). Partitioning the Impacts of Streamflow and Evaporation Uncertainty on the Operations of Multipurpose Reservoirs in Arid Regions. Journal of Water Resources Planning and Management, 144(7), 05018008. doi:10.1061/(asce)wr.1943-5452.0000945Bolouri-Yazdeli, Y., Bozorg Haddad, O., Fallah-Mehdipour, E., & Mariño, M. A. (2014). Evaluation of Real-Time Operation Rules in Reservoir Systems Operation. Water Resources Management, 28(3), 715-729. doi:10.1007/s11269-013-0510-1Borgomeo, E., Mortazavi-Naeini, M., Hall, J. W., O’Sullivan, M. J., & Watson, T. (2016). Trading-off tolerable risk with climate change adaptation costs in water supply systems. Water Resources Research, 52(2), 622-643. doi:10.1002/2015wr018164Bozorg-Haddad, O., Azarnivand, A., Hosseini-Moghari, S.-M., & Loáiciga, H. A. (2017). WASPAS Application and Evolutionary Algorithm Benchmarking in Optimal Reservoir Optimization Problems. Journal of Water Resources Planning and Management, 143(1), 04016070. doi:10.1061/(asce)wr.1943-5452.0000716Bozorg-Haddad, O., Karimirad, I., Seifollahi-Aghmiuni, S., & Loáiciga, H. A. (2015). Development and Application of the Bat Algorithm for Optimizing the Operation of Reservoir Systems. Journal of Water Resources Planning and Management, 141(8), 04014097. doi:10.1061/(asce)wr.1943-5452.0000498Breiman, L. (2001). Machine Learning, 45(1), 5-32. doi:10.1023/a:1010933404324Brown, C., Ghile, Y., Laverty, M., & Li, K. (2012). Decision scaling: Linking bottom-up vulnerability analysis with climate projections in the water sector. Water Resources Research, 48(9). doi:10.1029/2011wr011212Brown, C. M., Lund, J. R., Cai, X., Reed, P. M., Zagona, E. A., Ostfeld, A., … Brekke, L. (2015). The future of water resources systems analysis: Toward a scientific framework for sustainable water management. Water Resources Research, 51(8), 6110-6124. doi:10.1002/2015wr017114Cai, X., McKinney, D. C., & Lasdon, L. S. (2001). Piece-by-Piece Approach to Solving Large Nonlinear Water Resources Management Models. Journal of Water Resources Planning and Management, 127(6), 363-368. doi:10.1061/(asce)0733-9496(2001)127:6(363)Cai, X., Vogel, R., & Ranjithan, R. (2013). Special Issue on the Role of Systems Analysis in Watershed Management. Journal of Water Resources Planning and Management, 139(5), 461-463. doi:10.1061/(asce)wr.1943-5452.0000341Cancelliere, A., Giuliano, G., Ancarani, A., & Rossi, G. (2002). Water Resources Management, 16(1), 71-88. doi:10.1023/a:1015563820136Caseri, A., Javelle, P., Ramos, M. H., & Leblois, E. (2015). Generating precipitation ensembles for flood alert and risk management. Journal of Flood Risk Management, 9(4), 402-415. doi:10.1111/jfr3.12203Castelletti, A., Galelli, S., Restelli, M., & Soncini-Sessa, R. (2010). Tree-based reinforcement learning for optimal water reservoir operation. Water Resources Research, 46(9). doi:10.1029/2009wr008898Castelletti, A., Pianosi, F., & Restelli, M. (2013). A multiobjective reinforcement learning approach to water resources systems operation: Pareto frontier approximation in a single run. Water Resources Research, 49(6), 3476-3486. doi:10.1002/wrcr.20295Castelletti, A., Pianosi, F., & Soncini-Sessa, R. (2008). Water reservoir control under economic, social and environmental constraints. Automatica, 44(6), 1595-1607. doi:10.1016/j.automatica.2008.03.003Castelletti, A., & Soncini-Sessa, R. (2007). Bayesian networks in water resource modelling and management. Environmental Modelling & Software, 22(8), 1073-1074. doi:10.1016/j.envsoft.2006.06.001Castelletti, A., & Soncini-Sessa, R. (2007). Bayesian Networks and participatory modelling in water resource management. Environmental Modelling & Software, 22(8), 1075-1088. doi:10.1016/j.envsoft.2006.06.003Celeste, A. B., & Billib, M. (2009). Evaluation of stochastic reservoir operation optimization models. Advances in Water Resources, 32(9), 1429-1443. doi:10.1016/j.advwatres.2009.06.008Celeste, A. B., Curi, W. F., & Curi, R. C. (2009). Implicit Stochastic Optimization for deriving reservoir operating rules in semiarid Brazil. Pesquisa Operacional, 29(1), 223-234. doi:10.1590/s0101-74382009000100011Chandramouli, V., & Raman, H. (2001). Multireservoir Modeling with Dynamic Programming and Neural Networks. Journal of Water Resources Planning and Management, 127(2), 89-98. doi:10.1061/(asce)0733-9496(2001)127:2(89)Chang, L.-C., & Chang, F.-J. (2001). Intelligent control for modelling of real-time reservoir operation. Hydrological Processes, 15(9), 1621-1634. doi:10.1002/hyp.226Chazarra, M., García-González, J., Pérez-Díaz, J. I., & Arteseros, M. (2016). Stochastic optimization model for the weekly scheduling of a hydropower system in day-ahead and secondary regulation reserve markets. Electric Power Systems Research, 130, 67-77. doi:10.1016/j.epsr.2015.08.014Chen, D., Leon, A. S., Fuentes, C., Gibson, N. L., & Qin, H. (2018). Incorporating Filters in Random Search Algorithms for the Hourly Operation of a Multireservoir System. Journal of Water Resources Planning and Management, 144(2), 04017088. doi:10.1061/(asce)wr.1943-5452.0000876Coerver, H. M., Rutten, M. M., & van de Giesen, N. C. (2018). Deduction of reservoir operating rules for application in global hydrological models. Hydrology and Earth System Sciences, 22(1), 831-851. doi:10.5194/hess-22-831-2018Côté, P., & Leconte, R. (2016). Comparison of Stochastic Optimization Algorithms for Hydropower Reservoir Operation with Ensemble Streamflow Prediction. Journal of Water Resources Planning and Management, 142(2), 04015046. doi:10.1061/(asce)wr.1943-5452.0000575Cui, L., & Kuczera, G. (2005). Optimizing water supply headworks operating rules under stochastic inputs: Assessment of genetic algorithm performance. Water Resources Research, 41(5). doi:10.1029/2004wr003517Culley, S., Noble, S., Yates, A., Timbs, M., Westra, S., Maier, H. R., … Castelletti, A. (2016). A bottom-up approach to identifying the maximum operational adaptive capacity of water resource systems to a changing climate. Water Resources Research, 52(9), 6751-6768. doi:10.1002/2015wr018253Cunha, M. C., & Antunes, A. (2012). Simulated annealing algorithms for water systems optimization. WIT Transactions on State of the Art in Science and Engineering, 57-73. doi:10.2495/978-1-84564-664-6/04Dariane, A. B., & Momtahen, S. (2009). Optimization of Multireservoir Systems Operation Using Modified Direct Search Genetic Algorithm. Journal of Water Resources Planning and Management, 135(3), 141-148. doi:10.1061/(asce)0733-9496(2009)135:3(141)Das, B., Singh, A., Panda, S. N., & Yasuda, H. (2015). Optimal land and water resources allocation policies for sustainable irrigated agriculture. Land Use Policy, 42, 527-537. doi:10.1016/j.landusepol.2014.09.012Davidsen, C., Liu, S., Mo, X., Rosbjerg, D., & Bauer-Gottwein, P. (2016). The cost of ending groundwater overdraft on the North China Plain. Hydrology and Earth System Sciences, 20(2), 771-785. doi:10.5194/hess-20-771-2016Ehteram, M., Karami, H., & Farzin, S. (2018). Reservoir Optimization for Energy Production Using a New Evolutionary Algorithm Based on Multi-Criteria Decision-Making Models. Water Resources Management, 32(7), 2539-2560. doi:10.1007/s11269-018-1945-1Eisel, L. M. (1972). Chance constrained reservoir model. Water Resources Research, 8(2), 339-347. doi:10.1029/wr008i002p00339European Commission(2007). Communication from the Commission to the European Parliament and the Council: Addressing the challenge of water scarcity and droughts in the European Union COM(2007) 414 final. Brussels Belgium.European Commission. (2012a). Communication from the Commission to the European Parliament the Council the European Economic and Social Committee and the Committee of the Regions: A Blueprint to Safeguard Europe's Water Resources COM(2012) 673 final. Brussels Belgium.European Commission. (2012b). Communication from the Commission to the European Parliament the Council the European Economic and Social Committee and the Committee of the Regions: Report on the Review of the European Water Scarcity and Droughts Policy COM(2012) 672 final. Brussels Belgium.Fallah-Mehdipour, E., Bozorg Haddad, O., & Mariño, M. A. (2012). Real-Time Operation of Reservoir System by Genetic Programming. Water Resources Management, 26(14), 4091-4103. doi:10.1007/s11269-012-0132-zFazlali, A., & Shourian, M. (2017). A Demand Management Based Crop and Irrigation Planning Using the Simulation-Optimization Approach. Water Resources Management, 32(1), 67-81. doi:10.1007/s11269-017-1791-6Ficchì, A., Raso, L., Dorchies, D., Pianosi, F., Malaterre, P.-O., Van Overloop, P.-J., & Jay-Allemand, M. (2016). Optimal Operation of the Multireservoir System in the Seine River Basin Using Deterministic and Ensemble Forecasts. Journal of Water Resources Planning and Management, 142(1), 05015005. doi:10.1061/(asce)wr.1943-5452.0000571Fu, Q., Li, T., Cui, S., Liu, D., & Lu, X. (2017). Agricultural Multi-Water Source Allocation Model Based on Interval Two-Stage Stochastic Robust Programming under Uncertainty. Water Resources Management, 32(4), 1261-1274. doi:10.1007/s11269-017-1868-2Galelli, S., Goedbloed, A., Schwanenberg, D., & van Overloop, P.-J. (2014). Optimal Real-Time Operation of Multipurpose Urban Reservoirs: Case Study in Singapore. Journal of Water Resources Planning and Management, 140(4), 511-523. doi:10.1061/(asce)wr.1943-5452.0000342Giuliani, M., Castelletti, A., Pianosi, F., Mason, E., & Reed, P. M. (2016). Curses, Tradeoffs, and Scalable Management: Advancing Evolutionary Multiobjective Direct Policy Search to Improve Water Reservoir Operations. Journal of Water Resources Planning and Management, 142(2), 04015050. doi:10.1061/(asce)wr.1943-5452.0000570Giuliani, M., Herman, J. D., Castelletti, A., & Reed, P. (2014). Many-objective reservoir policy identification and refinement to reduce policy inertia and myopia in water management. Water Resources Research, 50(4), 3355-3377. doi:10.1002/2013wr014700Giuliani, M., Li, Y., Castelletti, A., & Gandolfi, C. (2016). A coupled human-natural systems analysis of irrigated agriculture under changing climate. Water Resources Research, 52(9), 6928-6947. doi:10.1002/2016wr019363Giuliani, M., Quinn, J. D., Herman, J. D., Castelletti, A., & Reed, P. M. (2018). Scalable Multiobjective Control for Large-Scale Water Resources Systems Under Uncertainty. IEEE Transactions on Control Systems Technology, 26(4), 1492-1499. doi:10.1109/tcst.2017.2705162Grüne, L., & Semmler, W. (2004). Using dynamic programming with adaptive grid scheme for optimal control problems in economics. Journal of Economic Dynamics and Control, 28(12), 2427-2456. doi:10.1016/j.jedc.2003.11.002Guariso, G., Rinaldi, S., & Soncini-Sessa, R. (1986). The Management of Lake Como: A Multiobjective Analysis. Water Resources Research, 22(2), 109-120. doi:10.1029/wr022i002p00109Gundelach, J., & ReVelle, C. (1975). Linear decision rule in reservoir management and design: 5. A general algorithm. Water Resources Research, 11(2), 204-207. doi:10.1029/wr011i002p00204Guo, X., Hu, T., Zeng, X., & Li, X. (2013). Extension of Parametric Rule with the Hedging Rule for Managing Multireservoir System during Droughts. Journal of Water Resources Planning and Management, 139(2), 139-148. doi:10.1061/(asce)wr.1943-5452.0000241Haddad, O. B., Afshar, A., & Mariño, M. A. (2006). Honey-Bees Mating Optimization (HBMO) Algorithm: A New Heuristic Approach for Water Resources Optimization. Water Resources Management, 20(5), 661-680. doi:10.1007/s11269-005-9001-3Hadka, D., Herman, J., Reed, P., & Keller, K. (2015). An open source framework for many-objective robust decision making. Environmental Modelling & Software, 74, 114-129. doi:10.1016/j.envsoft.2015.07.014Haguma, D., & Leconte, R. (2018). Long-Term Planning of Water Systems in the Context of Climate Non-Stationarity with Deterministic and Stochastic Optimization. Water Resources Management, 32(5), 1725-1739. doi:10.1007/s11269-017-1900-6Haguma, D., Leconte, R., & Côté, P. (2018). Evaluating Transition Probabilities for a Stochastic Dynamic Programming Model Used in Water System Optimization. Journal of Water Resources Planning and Management, 144(2), 04017090. doi:10.1061/(asce)wr.1943-5452.0000883Houck, M. H. (1979). A Chance Constrained Optimization Model for reservoir design and operation. Water Resources Research, 15(5), 1011-1016. doi:10.1029/wr015i005p01011Ji, C., Zhou, T., & Huang, H. (2014). Operating Rules Derivation of Jinsha Reservoirs System with Parameter Calibrated Support Vector Regression. Water Resources Management, 28(9), 2435-2451. doi:10.1007/s11269-014-0610-6Karamouz, M., & Houck, M. H. (1982). Annual and monthly reservoir operating rules generated by deterministic optimization. Water Resources Research, 18(5), 1337-1344. doi:10.1029/wr018i005p01337Karamouz, M., & Houck, M. H. (1987). COMPARISON OF STOCHASTIC AND DETERMINISTIC DYNAMIC PROGRAMMING FOR RESERVOIR OPERATING RULE GENERATION. Journal of the American Water Resources Association, 23(1), 1-9. doi:10.1111/j.1752-1688.1987.tb00778.xKaramouz, M., & Vasiliadis, H. V. (1992). Bayesian stochastic optimization of reservoir operation using uncertain forecasts. Water Resources Research, 28(5), 1221-1232. doi:10.1029/92wr00103Kasprzyk, J. R., Nataraj, S., Reed, P. M., & Lempert, R. J. (2013). Many objective robust decision making for complex environmental systems undergoing change. Environmental Modelling & Software, 42, 55-71. doi:10.1016/j.envsoft.2012.12.007Kelman, J., Stedinger, J. R., Cooper, L. A., Hsu, E., & Yuan, S.-Q. (1990). Sampling stochastic dynamic programming applied to reservoir operation. Water Resources Research, 26(3), 447-454. doi:10.1029/wr026i003p00447Keshtkar, A. R., Salajegheh, A., Sadoddin, A., & Allan, M. G. (2013). Application of Bayesian networks for sustainability assessment in catchment modeling and management (Case study: The Hablehrood river catchment). Ecological Modelling, 268, 48-54. doi:10.1016/j.ecolmodel.2013.08.003Kim, T., Heo, J.-H., Bae, D.-H., & Kim, J.-H. (2008). Single-reservoir operating rules for a year using multiobjective genetic algorithm. Journal of Hydroinformatics, 10(2), 163-179. doi:10.2166/hydro.2008.019Koutsoyiannis, D., & Economou, A. (2003). Evaluation of the parameterization-simulation-optimization approach for the control of reservoir systems. Water Resources Research, 39(6). doi:10.1029/2003wr002148Kumar, D. N., & Reddy, M. J. (2006). Ant Colony Optimization for Multi-Purpose Reservoir Operation. Water Resources Management, 20(6), 879-898. doi:10.1007/s11269-005-9012-0Nagesh Kumar, D., & Janga Reddy, M. (2007). Multipurpose Reservoir Operation Using Particle Swarm Optimization. Journal of Water Resources Planning and Management, 133(3), 192-201. doi:10.1061/(asce)0733-9496(2007)133:3(192)Kumar, K., & Kasthurirengan, S. (2018). Generalized Linear Two-Point Hedging Rule for Water Supply Reservoir Operation. Journal of Water Resources Planning and Management, 144(9), 04018051. doi:10.1061/(asce)wr.1943-5452.0000964Kwakkel, J. H., Haasnoot, M., & Walker, W. E. (2016). Comparing Robust Decision-Making and Dynamic Adaptive Policy Pathways for model-based decision support under deep uncertainty. Environmental Modelling & Software, 86, 168-183. doi:10.1016/j.envsoft.2016.09.017Labadie, J. W. (2004). Optimal Operation of Multireservoir Systems: State-of-the-Art Review. Journal of Water Resources Planning and Management, 130(2), 93-111. doi:10.1061/(asce)0733-9496(2004)130:2(93)Labadie J. W. Baldo M. &Larson R.(2000).MODSIM: Decision support system for river basin management. Documentation and user manual.Lee, J.-H., & Labadie, J. W. (2007). Stochastic optimization of multireservoir systems via reinforcement learning. Water Resources Research, 43(11). doi:10.1029/2006wr005627Lei, X., Tan, Q., Wang, X., Wang, H., Wen, X., Wang, C., & Zhang, J. (2018). Stochastic optimal operation of reservoirs based on copula functions. Journal of Hydrology, 557, 265-275. doi:10.1016/j.jhydrol.2017.12.038Lerma, N., Paredes-Arquiola, J., Andreu, J., & Solera, A. (2013). Development of operating rules for a complex multi-reservoir system by coupling genetic algorithms and network optimization. Hydrological Sciences Journal, 58(4), 797-812. doi:10.1080/02626667.2013.779777Lerma, N., Paredes-Arquiola, J., Andreu, J., Solera, A., & Sechi, G. M. (2015). Assessment of evolutionary algorithms for optimal operating rules design in real Water Resource Systems. Environmental Modelling & Software, 69, 425-436. doi:10.1016/j.envsoft.2014.09.024Li, Y., Giuliani, M., & Castelletti, A. (2017). A coupled human–natural system to assess the operational value of weather and climate services for agriculture. Hydrology and Earth System Sciences, 21(9), 4693-4709. doi:10.5194/hess-21-4693-2017Lin, N. M., & Rutten, M. (2016). Optimal Operation of a Network of Multi-purpose Reservoir: A Review. Procedia Engineering, 154, 1376-1384. doi:10.1016/j.proeng.2016.07.504Liu, P., Cai, X., & Guo, S. (2011). Deriving multiple near-optimal solutions to deterministic reservoir operation problems. Water Resources Research, 47(8). doi:10.1029/2011wr010998Loucks, D. P. (1970). Some Comments on Linear Decision Rules and Chance Constraints. Water Resources Research, 6(2), 668-671. doi:10.1029/wr006i002p00668Loucks

ARTIFICIAL INTELLIGENCE IN PHARMACY DRUG DESIGN

Drug discovery is said to be a multi-dimensional issue in which different properties of drug candidates including efficacy, pharmacokinetics, and safety need to be improved with respect to giving the final drug product. Current advances in fields such as artificial intelligence (AI) systems that refine the design thesis through report investigation, microfluidics-assisted chemical synthesis, and biological testing are now giving a cornerstone for the establishment of greater automation into detail of this process. AI has stimulated computer-aided drug discovery. This could likely speed up time duration for compound discovery and enhancement and authorize more productive hunts of related chemicals. However, such optimization also increases substantial theories, technical, and organizational queries, as well as suspicion about the ongoing boost around them. Machine learning, in particular deep learning, in multiple scientific disciplines, and the development in computing hardware and software, among other factors, continue to power this development worldwide

Query2GMM: Learning Representation with Gaussian Mixture Model for Reasoning over Knowledge Graphs

Logical query answering over Knowledge Graphs (KGs) is a fundamental yet complex task. A promising approach to achieve this is to embed queries and entities jointly into the same embedding space. Research along this line suggests that using multi-modal distribution to represent answer entities is more suitable than uni-modal distribution, as a single query may contain multiple disjoint answer subsets due to the compositional nature of multi-hop queries and the varying latent semantics of relations. However, existing methods based on multi-modal distribution roughly represent each subset without capturing its accurate cardinality, or even degenerate into uni-modal distribution learning during the reasoning process due to the lack of an effective similarity measure. To better model queries with diversified answers, we propose Query2GMM for answering logical queries over knowledge graphs. In Query2GMM, we present the GMM embedding to represent each query using a univariate Gaussian Mixture Model (GMM). Each subset of a query is encoded by its cardinality, semantic center and dispersion degree, allowing for precise representation of multiple subsets. Then we design specific neural networks for each operator to handle the inherent complexity that comes with multi-modal distribution while alleviating the cascading errors. Last, we define a new similarity measure to assess the relationships between an entity and a query's multi-answer subsets, enabling effective multi-modal distribution learning for reasoning. Comprehensive experimental results show that Query2GMM outperforms the best competitor by an absolute average of $5.5\%$. The source code is available at \url{https://anonymous.4open.science/r/Query2GMM-C42F}

A Data Mining Methodology for Vehicle Crashworthiness Design

This study develops a systematic design methodology based on data mining theory for decision-making in the development of crashworthy vehicles. The new data mining methodology allows the exploration of a large crash simulation dataset to discover the underlying relationships among vehicle crash responses and design variables at multiple levels and to derive design rules based on the whole-vehicle safety requirements to make decisions about component-level and subcomponent-level design. The method can resolve a major issue with existing design approaches related to vehicle crashworthiness: that is, limited abilities to explore information from large datasets, which may hamper decision-making in the design processes. At the component level, two structural design approaches were implemented for detailed component design with the data mining method: namely, a dimension-based approach and a node-based approach to handle structures with regular and irregular shapes, respectively. These two approaches were used to design a thin-walled vehicular structure, the S-shaped beam, against crash loading. A large number of design alternatives were created, and their responses under loading were evaluated by finite element simulations. The design variables and computed responses formed a large design dataset. This dataset was then mined to build a decision tree. Based on the decision tree, the interrelationships among the design parameters were revealed, and design rules were generated to produce a set of good designs. After the data mining, the critical design parameters were identified and the design space was reduced, which can simplify the design process. To partially replace the expensive finite element simulations, a surrogate model was used to model the relationships between design variables and response. Four machine learning algorithms, which can be used for surrogate model development, were compared. Based on the results, Gaussian process regression was determined to be the most suitable technique in the present scenario, and an optimization process was developed to tune the algorithm’s hyperparameters, which govern the model structure and training process. To account for engineering uncertainty in the data mining method, a new decision tree for uncertain data was proposed based on the joint probability in uncertain spaces, and it was implemented to again design the S-beam structure. The findings show that the new decision tree can produce effective decision-making rules for engineering design under uncertainty. To evaluate the new approaches developed in this work, a comprehensive case study was conducted by designing a vehicle system against the frontal crash. A publicly available vehicle model was simplified and validated. Using the newly developed approaches, new component designs in this vehicle were generated and integrated back into the vehicle model so their crash behavior could be simulated. Based on the simulation results, one can conclude that the designs with the new method can outperform the original design in terms of measures of mass, intrusion and peak acceleration. Therefore, the performance of the new design methodology has been confirmed. The current study demonstrates that the new data mining method can be used in vehicle crashworthiness design, and it has the potential to be applied to other complex engineering systems with a large amount of design data

New Concepts for Virtual Testbeds : Data Mining Algorithms for Blackbox Optimization based on Wait-Free Concurrency and Generative Simulation

Virtual testbeds have emerged as a key technology for improving and streamlining complex engineering processes by delivering long-term simulation and assessment of complex designs in virtual environments. In contrast to existing simulation technology, virtual testbeds focus on long-term physically-based simulation of the overall design in its (virtual) environment instead of only focussing on isolated, specific parts for short periods of time. This technology has the major advantage that costly testing, prototyping, and assessment in real-life environments are replaced by a cost-efficient simulation in virtual worlds for comprehensive and long-term analysis of designs. For this purpose, engineering models and their requirements are abstracted into software simulation models and objectives which are executed in virtual assessments. Simulation models are used to predict complex, real systems which can be further a subject to random influences. These predictions are used to examine the effects of individual configuration alternatives without actually realizing them and causing possible negative effects on the real system. Virtual testbeds further offer engineers the opportunity to immersively and naturally interact with their simulation model in these virtual assessments. This enables a greater and comprehensive understanding of possible design flaws early-on in the design process for engineers because they can directly assess their design in the virtual environment, based on the simulation objectives. The fact that virtual testbeds enable these realtime interactive virtual assessments, makes their underlying software infrastructure very complex. One major challenge is to minimize the development time of virtual testbeds in order to efficiently integrate them into the overall engineering process. Usually, this can be achieved by minimizing the underlying concurrency of the testbed and by simplifying its software architecture. However, this may result in a degradation of their very concurrent and asynchronous behavior, which is usually required for immersive and natural virtual interaction. A major goal of virtual testbeds in the engineering process is to find a set of optimal configurations of the simulation model which maximizes all simulation objectives for the specified virtual assessments. Once such a set has been computed, engineers can interactively explore it in the virtual environment. The main challenge is that sophisticated simulation models and their configuration are subject to a multiobjective optimization problem, which usually can not be solved manually by engineers or simulation analysts in feasible time. This is further aggravated because the relationships between simulation model configurations and simulation objectives are mostly unknown, leading to what is known as blackbox simulations. In this thesis, I propose novel data mining algorithms for computing Pareto optimal simulation model configurations, based on an approximation of the feasible design space, for deterministic and stochastic blackbox simulations in virtual testbeds for achieving above stated goal. These novel data mining algorithms lead to an automatic knowledge discovery process that does not need any supervision for its data analysis and assessment for multiobjective optimization problems of simulation model configurations. This achieves the previously stated goal of computing optimal configurations of simulation models for long-term simulations and assessments. Furthermore, I propose two complementary solutions for efficiently integrating massively-parallel virtual testbeds into engineering processes. First, I propose a novel multiversion wait-free data and concurrency management based on hash maps. These wait-free hash maps do not require any standard locking mechanisms and enable low-latency data generation, management and distribution for massively-parallel applications. Second, I propose novel concepts for efficiently code generating above wait-free data and concurrency management for arbitrary massively-parallel simulation applications of virtual testbeds. My generative simulation concept combines a state-of-the-art realtime interactive system design pattern for high maintainability with template code generation based on domain specific modelling. This concept is able to generate massively-parallel simulations and, at the same time, model checks its internal dataflow for possible interface errors. These generative concept overcomes the challenge of efficiently integrating virtual testbeds into engineering processes. These contributions enable for the first time a powerful collaboration between simulation, optimization, visualization and data analysis for novel virtual testbed applications but also overcome and achieve the presented challenges and goals

Design of optimal reservoir operating rules in large water resources systems combining stochastic programming, fuzzy logic and expert criteria

Given the high degree of development of hydraulic infrastructure in the developed countries, and with the increasing opposition to constructing new facilities in developing countries, the focus of water resource system analysis has turned into defining adequate operation strategies. Better management is necessary to cope with the challenge of supplying increasing demands and conflicts on water allocation while facing climate change impacts. To do so, a large set of mathematical simulation and optimization tools have been developed. However, the real application of these techniques is still limited. One of the main lines of research to fix this issue regards to the involvement of experts' knowledge in the definition of mathematical algorithms. To define operating rules in a way in which system operators could rely, their expert knowledge should be fully accounted and merged with the results from mathematical algorithms. This thesis develops a methodological framework and the required tools to improve the operation of large-scale water resource systems. In such systems, decision-making processes are complex and supported, at least partially, by the expert knowledge of decision-makers. This importance of expert judgment in the operation strategies requires mathematical tools able to embed and combine it with optimization algorithms. The methods and tools developed in this thesis rely on stochastic programming, fuzzy logic and the involvement of system operators during the whole rule-defining process. An extended stochastic programming algorithm, able to be used in large-scale water resource systems including stream-aquifer interactions, has been developed (the CSG-SDDP). The methodological framework proposed uses fuzzy logic to capture the expert knowledge in the definition of optimal operating rules. Once the current decision-making process is fairly reproduced using fuzzy logic and expert knowledge, stochastic programming results are introduced and thus the performance of the rules is improved. The framework proposed in this thesis has been applied to the Jucar river system (Eastern Spain), in which scarce resources are allocated following complex decision-making processes. We present two applications. In the first one, the CSG-SDDP algorithm has been used to define economically-optimal conjunctive use strategies for a joint operation of reservoirs andaquifers. In the second one, we implement a collaborative framework to couple historical records with expert knowledge and criteria to define a decision support system (DSS) for the seasonal operation of the reservoirs of the Jucar River system. The co-developed DSS tool explicitly reproduces the decision-making processes and criteria considered by the system operators. Two fuzzy logic systems have been developed and linked with this purpose, as well as with fuzzy regressions to preview future inflows. The DSS developed was validated against historical records. The developed framework offers managers a simple way to define a priori suitable decisions, as well as to explore the consequences of any of them. The resulting representation has been then combined with the CSG-SDDP algorithm in order to improve the rules following the current decision-making process. Results show that reducing pumping from the Mancha Oriental aquifer would lead to higher systemwide benefits due to increased flows by stream-aquifer interaction. The operating rules developed successfully combined fuzzy logic, expert judgment and stochastic programming, increasing water allocations to the demands by changing the way in which Alarcon, Contreras and Tous are balanced. These rules follow the same decision-making processes currently done in the system, so system operators would feel familiar with them. In addition, they can be contrasted with the current operating rules to determine what operation options can be coherent with the current management and, at the same time, achieve an optimal operationDado el alto número de infraestructuras construidas en los países desarrollados, y con una oposición creciente a la construcción de nuevas infraestructuras en los países en vías de desarrollo, la atención del análisis de sistemas de recursos hídricos ha pasado a la definición de reglas de operación adecuadas. Una gestión más eficiente del recurso hídrico es necesaria para poder afrontar los impactos del cambio climático y de la creciente demanda de agua. Para lograrlo, un amplio abanico de herramientas y modelos matemáticos de optimización se han desarrollado. Sin embargo, su aplicación práctica en la gestión hídrica sigue siendo limitada. Una de las más importantes líneas de investigación para solucionarlo busca la involucración de los expertos en la definición de dichos modelos matemáticos. Para definir reglas de operación en las cuales los gestores confíen, es necesario tener en cuenta su criterio experto y combinarlo con algoritmos de optimización. La presente tesis desarrolla una metodología, y las herramientas necesarias para aplicarla, con el fin de mejorar la operación de sistemas complejos de recursos hídricos. En éstos, los procesos de toma de decisiones son complicados y se sustentan, al menos en parte, en el juicio experto de los gestores. Esta importancia del criterio de experto en las reglas de operación requiere herramientas matemáticas capaces de incorporarlo en su estructura y de unirlo con algoritmos de optimización. Las herramientas y métodos desarrollados se basan en la optimización estocástica, en la lógica difusa y en la involucración de los expertos durante todo el proceso. Un algoritmo estocástico extendido, capaz de ser usado en sistemas complejos con interacciones río-acuífero se ha desarrollado (el CSG-SDDP). La metodología definida usa lógica difusa para capturar el criterio de experto en la definición de reglas óptimas. En primer lugar se reproducen los procesos de toma de decisiones actuales y, tras ello, el algoritmo de optimización estocástica se emplea para mejorar las reglas previamente obtenidas. La metodología propuesta en esta tesis se ha aplicado al sistema Júcar (Este de España), en el que los recursos hídricos son gestionados de acuerdo a complejos procesos de toma de decisiones. La aplicación se ha realizado de dos formas. En la primera, el algoritmo CSG-SDDP se ha utilizado para definir una estrategia óptima para el uso conjunto de embalses y acuíferos. En la segunda, la metodología se ha usado para reproducir las reglas de operación actuales en base a criterio de expertos. La herramienta desarrollada reproduce de forma explícita los procesos de toma de decisiones seguidos por los operadores del sistema. Dos sistemas lógicos difusos se han empleado e interconectado con este fin, así como regresiones difusas para predecir aportaciones. El Sistema de Ayuda a la Decisión (SAD) creado se ha validado comparándolo con los datos históricos. La metodología desarrollada ofrece a los gestores una forma sencilla de definir decisiones a priori adecuadas, así como explorar las consecuencias de una decisión concreta. La representación matemática resultante se ha combinado entonces con el CSG-SDDP para definir reglas óptimas que respetan los procesos actuales. Los resultados obtenidos indican que reducir el bombeo del acuífero de la Mancha Oriental conlleva una mejora en los beneficios del sistema debido al incremento de caudal por relación río-acuífero. Las reglas de operación han sido adecuadamente desarrolladas combinando lógica difusa, juicio experto y optimización estocástica, aumentando los suministros a las demandas mediante modificaciones el balance de Alarcón, Contreras y Tous. Estas reglas siguen los procesos de toma de decisiones actuales en el Júcar, por lo que pueden resultar familiares a los gestores. Además, pueden compararse con las reglas de operación actuales para establecer qué decisiones entreDonat l'alt nombre d'infraestructures construïdes en els països desenrotllats, i amb una oposició creixent a la construcció de noves infraestructures en els països en vies de desenrotllament, l'atenció de l'anàlisi de sistemes de recursos hídrics ha passat a la definició de regles d'operació adequades. Una gestió més eficient del recurs hídric és necessària per a poder afrontar els impactes del canvi climàtic i de la creixent demanda d'aigua. Per a aconseguir-ho, una amplia selecció de ferramentes i models matemàtics d'optimització s'han desenrotllat. No obstant això, la seua aplicació pràctica en la gestió hídrica continua sent limitada. Una de les més importants línies d'investigació per a solucionar-ho busca la col·laboració activa dels experts en la definició dels models matemàtics. Per a definir regles d'operació en les quals els gestors confien, és necessari tindre en compte el seu criteri expert i combinar-ho amb algoritmes d'optimització. La present tesi desenrotlla una metodologia, i les ferramentes necessàries per a aplicar-la, amb la finalitat de millorar l'operació de sistemes complexos de recursos hídrics. En estos, els processos de presa de decisions són complicats i se sustenten, almenys en part, en el juí expert dels gestors. Esta importància del criteri d'expert en les regles d'operació requereix ferramentes matemàtiques capaces d'incorporar-lo en la seua estructura i d'unir-lo amb algoritmes d'optimització. Les ferramentes i mètodes desenrotllats es basen en l'optimització estocàstica, en la lògica difusa i en la col·laboració activa dels experts durant tot el procés. Un algoritme estocàstic avançat, capaç de ser usat en sistemes complexos amb interaccions riu-aqüífer, s'ha desenrotllat (el CSG-SDDP) . La metodologia definida utilitza lògica difusa per a capturar el criteri d'expert en la definició de regles òptimes. En primer lloc es reprodueixen els processos de presa de decisions actuals i, després d'això, l'algoritme d'optimització estocàstica s'empra per a millorar les regles prèviament obtingudes. La metodologia proposada en esta tesi s'ha aplicat al sistema Xúquer (Est d'Espanya), en el que els recursos hídrics són gestionats d'acord amb complexos processos de presa de decisions. L'aplicació s'ha realitzat de dos formes. En la primera, l'algoritme CSG-SDDP s'ha utilitzat per a definir una estratègia òptima per a l'ús conjunt d'embassaments i aqüífers. En la segona, la metodologia s'ha usat per a reproduir les regles d'operació actuals basant-se en criteri d'experts. La ferramenta desenvolupada reprodueix de forma explícita els processos de presa de decisions seguits pels operadors del sistema. Dos sistemes lògics difusos s'han empleat i interconnectat amb este fi, al igual què regressions difuses per preveure cabdals. El Sistema d'Ajuda a la Decisió (SAD) creat s'ha validat comparant-lo amb les dades històriques. La metodologia desenvolupada ofereix als gestors una manera senzilla de definir decisions a priori adequades, així com per explorar les conseqüències d'una decisió concreta. La representació matemàtica resultant s'ha combinat amb el CSG-SDDP per a definir regles òptimes que respecten els processos actuals. Els resultats obtinguts indiquen que reduir el bombament de l'aqüífer de la Mancha Oriental comporta una millora en els beneficis del sistema a causa de l'increment de l'aigua per relació riu-aqüífer. Les regles d'operació han sigut adequadament desenrotllades combinant lògica difusa, juí expert i optimització estocàstica, augmentant els subministres a les demandes per mitjà de modificacions del balanç d'Alarcón, Contreras i Tous. Estes regles segueixen els processos de presa de decisions actuals en el Xúquer, per la qual cosa poden resultar familiars als gestors. A més, poden comparar-se amb les regles d'operació actuals per a establir quines decisions entre les possibles serien coherentsMacián Sorribes, H. (2017). Design of optimal reservoir operating rules in large water resources systems combining stochastic programming, fuzzy logic and expert criteria [Tesis doctoral no publicada]. Universitat Politècnica de València. https://doi.org/10.4995/Thesis/10251/82554TESI

Convolutive Blind Source Separation Methods

In this chapter, we provide an overview of existing algorithms for blind source separation of convolutive audio mixtures. We provide a taxonomy, wherein many of the existing algorithms can be organized, and we present published results from those algorithms that have been applied to real-world audio separation tasks

Multi-Fidelity Bayesian Optimization for Efficient Materials Design

Materials design is a process of identifying compositions and structures to achieve desirable properties. Usually, costly experiments or simulations are required to evaluate the objective function for a design solution. Therefore, one of the major challenges is how to reduce the cost associated with sampling and evaluating the objective. Bayesian optimization is a new global optimization method which can increase the sampling efficiency with the guidance of the surrogate of the objective. In this work, a new acquisition function, called consequential improvement, is proposed for simultaneous selection of the solution and fidelity level of sampling. With the new acquisition function, the subsequent iteration is considered for potential selections at low-fidelity levels, because evaluations at the highest fidelity level are usually required to provide reliable objective values. To reduce the number of samples required to train the surrogate for molecular design, a new recursive hierarchical similarity metric is proposed. The new similarity metric quantifies the differences between molecules at multiple levels of hierarchy simultaneously based on the connections between multiscale descriptions of the structures. The new methodologies are demonstrated with simulation-based design of materials and structures based on fully atomistic and coarse-grained molecular dynamics simulations, and finite-element analysis. The new similarity metric is demonstrated in the design of tactile sensors and biodegradable oligomers. The multi-fidelity Bayesian optimization method is also illustrated with the multiscale design of a piezoelectric transducer by concurrently optimizing the atomic composition of the aluminum titanium nitride ceramic and the device’s porous microstructure at the micrometer scale.Ph.D