Attention-Based Neural Network for Solving the Green Vehicle Routing Problem in Waste Management

23.08.23: Trekkes tilbake fra visning som løsning på at oppgaven ble ferdigstilt fra studieadministrasjonen litt for fort/IHTIThe transport sector is a major contributor to the emission of greenhouse gases and air pollution. As urbanization and population growth continue to increase, the demand for transportation services grows, emphasizing the need for sustainable practices. Therefore, incorporating sustainability into the transport sector can effectively reduce its negative impacts on the environment and optimize the utilization of resources. This thesis aims to address this issue by proposing a novel method that integrates neural networks into the development of a green vehicle routing model. By incorporating environmental considerations, particularly fuel consumption, into the optimization process, the model seeks to generate more sustainable route solutions. The integration of machine learning techniques, specifically an attention-based neural network, demonstrates the potential of combining machine learning with operations research for effective route optimization. While the effectiveness of the green vehicle routing problem (GVRP) has been demonstrated in providing sustainable routes, its practical applications in real-world scenarios are still limited. Therefore, this thesis proposes the implementation of the GVRP model in a real-world waste collection routing problem. The study utilizes data obtained from Remiks, a waste management company responsible for waste collection and handling in Tromsø and Karlsøy. The findings of this study highlight the promising synergy between machine learning and operations research for further advancements and real-world applications. Specifically, the application of the GVRP approach to waste management issues has been shown to reduce emissions during the waste collection process compared to routes optimized solely for distance minimization. The attention-based neural network approach successfully generates routes that minimize fuel consumption, outperforming distance-optimized routes. These results underscore the importance of leveraging the GVRP to address environmental challenges while enhancing decision-making efficiency and effectiveness. Overall, this thesis provides insights for developing sustainable and optimized routes for real-world problems

A Survey on Environmentally Friendly Vehicle Routing Problem and a Proposal of Its Classification

The growth of environmental awareness and more robust enforcement of numerous regulations to reduce greenhouse gas (GHG) emissions have directed efforts towards addressing current environmental challenges. Considering the Vehicle Routing Problem (VRP), one of the effective strategies to control greenhouse gas emissions is to convert the fossil fuel-powered fleet into Environmentally Friendly Vehicles (EFVs). Given the multitude of constraints and assumptions defined for different types of VRPs, as well as assumptions and operational constraints specific to each type of EFV, many variants of environmentally friendly VRPs (EF-VRP) have been introduced. In this paper, studies conducted on the subject of EF-VRP are reviewed, considering all the road transport EFV types and problem variants, and classifying and discussing with a single holistic vision. The aim of this paper is twofold. First, it determines a classification of EF-VRP studies based on different types of EFVs, i.e., Alternative-Fuel Vehicles (AFVs), Electric Vehicles (EVs) and Hybrid Vehicles (HVs). Second, it presents a comprehensive survey by considering each variant of the classification, technical constraints and solution methods arising in the literature. The results of this paper show that studies on EF-VRP are relatively novel and there is still room for large improvements in several areas. So, to determine future insights, for each classification of EF-VRP studies, the paper provides the literature gaps and future research needs

Deep Learning and Deep Reinforcement Learning for Graph Based Applications

Dyp læring har gitt state-of-the-art ytelse i mange applikasjoner som datasyn, tekstanalyse, biologi, osv. Suksessen med dyp læring har også hjulpet fremveksten av dyp forsterkende læring for optimal beslutningstaking og har vist stort potensiale, spesielt i optimaliseringsproblemer. I tillegg har grafer som matematisk representasjon for strukturerte komplekse systemer vist seg å være et kraftig verktøy for analyse og problemløsning, og gitt et nytt perspektiv på formuleringen av problemet. Ved å introdusere grafer som en inputmodalitet for maskinlæringsproblemer kan dyplæringsmodeller enten bruke strukturen til grafen i sine representasjonslæringsskjema, eller optimalisere grafstrukturen i en nedstrøms evalueringsoppgave. Dette vil også føre til modellmetoder og pipelines som utnytter den strukturelle informasjonen gitt av grafer til forbedret ytelse, sammenlignet med tradisjonelle maskinlæringsmodellers kapasitet. I denne oppgaven introduserer vi fem forskjellige use-case-applikasjoner, gjennom fem forskningsartikler, som kan modelleres som grafer og tar sikte på å skape nye modeller som adresserer problemer ved bruk av dyp grafrepresentasjonslæring og dype forsterkningslæringsmodeller. Våre tre viktigste applikasjonsdomener er bioinformatikk, datasyn og logistikk. Først tar vi sikte på å adressere to problemer innen bioinformatikk. I Paper I tar vi opp spørsmålet om integrering av kontinuerlige omics-datasett med biologiske nettverk. Vi introduserer et auto-koderskjema fokusert på representasjonslæring av nodefunksjoner i biologiske nettverk, og viser anvendelsen av det utformede rammeverket i et virkelighetseksempel gjennom imputering av manglende verdier i et eksempeldatasett for omics. Paper II ser på bruk av grafrepresentasjonslæring for å behandle metabolske nettverk. I den foreslåtte tilnærmingen introduserer vi en maskinlæringspipeline (fra funksjonsekstraksjon til modellarkitektur) basert på grafiske nevrale nettverk og evaluerer pipelinen basert på prediksjon av genessensalitet, som er en velkjent bruk av metabolske banenettverk. Det andre domenet av applikasjoner er datasynsdomenet, spesifikt problemet med gjenkjennelse av menneskelige gester. I Paper III, og oppfølgingen Paper IV, introduserer vi et gestgjenkjenningssystem som er både raskere og mer nøyaktig enn den avanserte prediksjonen av menneskelige motivbevegelser fra mmWave Radar genererte punktskyer. Vi oppnår dette ved å modellere inngangspunktskyen som en spatio-temporal graf og å bearbeide den opprettede grafen ved bruk av den foreslåtte læringsteknikken for grafrepresentasjon. Videre evaluerer vi systemet under forskjellige eksperimentelle forhold ut ifra vinkelen til emnet med hensyn til sansing, og foreslår en ensembletilnærming for å dempe effekten av å endre sansevinkelen på ytelsen til modellen. Den siste applikasjonen vi tar for oss er bruken av dyp forsterkningslæring for å optimalisere strukturen til grafene i kombinatoriske optimaliseringsproblemer i logistikk. Paper V introduserer en generell problemuavhengig hyperheuristikk som utnytter beslutningsevnen til dyp forsterkende læring, ved å bruke en problemuavhengig tilstandsfunksjonsinformasjon. Det foreslåtte rammeverket er trent på en generell belønningsfunksjon for å oppnå høykvalitets ytelse blant populære løsere innen kombinatorisk optimalisering. Vi evaluerer ytelsen til den foreslåtte tilnærmingen med tre eksempler på ruting problemer samt et planleggingsproblem, for å vise effektiviteten til metoden vår i forskjellige typer problemstillinger.Deep learning has provided state-of-the-art performance in many applications such as computer vision, text analysis, biology, etc. The success of deep learning has also helped with the emergence of deep reinforcement learning for optimal decision-making and has shown great promise, especially in optimization problems. Additionally, graphs as a mathematical representation for structured complex systems have proven to be a powerful tool for analysis and problem-solving that offer a fresh perspective on the formulation of the problem. Introducing graphs as an input modality for machine learning problems enables deep learning models to either utilize the structure of the graph in their representation learning scheme or optimize the graph structure for a downstream evaluation task. Doing so will also lead to model methods and pipelines that leverage the structural information provided by graphs to improve performance compared to traditional machine learning models. In this thesis, we introduce five different use-case applications, in the format of five research papers, that can be modeled as graphs and aim to provide novel models that address problems using deep graph representation learning and deep reinforcement learning models. Our main three application domains are bioinformatics, computer vision, and logistics. First, we aim to address two problems in the domain of bioinformatics. In Paper I, we address the issue of integration of continuous omics datasets with biological networks. We introduce an auto-encoder scheme focused on representation learning of node features in biological networks and showcase the application of the designed framework in a real-world example through the imputation of missing values in an example omics dataset. Paper II looks at utilizing graph representation learning for processing metabolic networks. In the proposed approach, we introduce a machine learning pipeline (from feature extraction to model architecture) based on graph neural networks and evaluate the pipeline on the task of gene essentiality prediction which is a well-known application of metabolic pathway networks. The second domain of applications is the computer vision domain specifically the problem of human gesture recognition. In Paper III and the follow-up Paper IV, we introduce a gesture recognition system that is both faster and more accurate compared to the state-of-the-art prediction of human subject gestures from mmWave Radar generated point clouds. We achieve this by modeling the input point cloud as a spatio-temporal graph and processing the created graph using the proposed graph representation learning technique. We further evaluate the system in different experimental conditions in terms of the angle of the subject with respect to sensing and propose an ensemble approach for mitigating the effect of changing the sensing angle on the performance of the model. The last application that we address is the use of deep reinforcement learning to optimize the structure of the graphs in combinatorial optimization problems in logistics. Paper V introduces a general problem-independent hyperheuristic that utilizes the decision-making capability of deep reinforcement learning using a problem-independent state feature information. The proposed framework is trained on a general reward function to achieve state-of-the-art performance among popular solvers in the field of combinatorial optimization. We evaluate the performance of the proposed approach on three example routing problems as well as a scheduling problem to showcase the effectiveness of our method in different problems.Doktorgradsavhandlin

Annual Report of Undergraduate Research Fellows, August 2011 to May 2012

Annual Report of Undergraduate Research Fellows from August 2011 to May 2012

Program and Abstracts Celebration of Student Scholarship, 2012

Program and Abstracts from the Celebration of Student Scholarship on April 25, 2012

IMPROVEMENT OF POWER QUALITY OF HYBRID GRID BY NON-LINEAR CONTROLLED DEVICE CONSIDERING TIME DELAYS AND CYBER-ATTACKS

Power Quality is defined as the ability of electrical grid to supply a clean and stable power supply. Steady-state disturbances such as harmonics, faults, voltage sags and swells, etc., deteriorate the power quality of the grid. To ensure constant voltage and frequency to consumers, power quality should be improved and maintained at a desired level. Although several methods are available to improve the power quality in traditional power grids, significant challenges exist in modern power grids, such as non-linearity, time delay and cyber-attacks issues, which need to be considered and solved. This dissertation proposes novel control methods to address the mentioned challenges and thus to improve the power quality of modern hybrid grids.In hybrid grids, the first issue is faults occurring at different points in the system. To overcome this issue, this dissertation proposes non-linear controlled methods like the Fuzzy Logic controlled Thyristor Switched Capacitor (TSC), Adaptive Neuro Fuzzy Inference System (ANFIS) controlled TSC, and Static Non-Linear controlled TSC. The next issue is the time delay introduced in the network due to its complexities and various computations required. This dissertation proposes two new methods such as the Fuzzy Logic Controller and Modified Predictor to minimize adverse effects of time delays on the power quality enhancement. The last and major issue is the cyber-security aspect of the hybrid grid. This research analyzes the effects of cyber-attacks on various components such as the Energy Storage System (ESS), the automatic voltage regulator (AVR) of the synchronous generator, the grid side converter (GSC) of the wind generator, and the voltage source converter (VSC) of Photovoltaic (PV) system, located in a hybrid power grid. Also, this dissertation proposes two new techniques such as a Non-Linear (NL) controller and a Proportional-Integral (PI) controller for mitigating the adverse effects of cyber-attacks on the mentioned devices, and a new detection and mitigation technique based on the voltage threshold for the Supercapacitor Energy System (SES). Simulation results obtained through the MATLAB/Simulink software show the effectiveness of the proposed new control methods for power quality improvement. Also, the proposed methods perform better than conventional methods

Artificial intelligence within the interplay between natural and artificial computation:Advances in data science, trends and applications

Artificial intelligence and all its supporting tools, e.g. machine and deep learning in computational intelligence-based systems, are rebuilding our society (economy, education, life-style, etc.) and promising a new era for the social welfare state. In this paper we summarize recent advances in data science and artificial intelligence within the interplay between natural and artificial computation. A review of recent works published in the latter field and the state the art are summarized in a comprehensive and self-contained way to provide a baseline framework for the international community in artificial intelligence. Moreover, this paper aims to provide a complete analysis and some relevant discussions of the current trends and insights within several theoretical and application fields covered in the essay, from theoretical models in artificial intelligence and machine learning to the most prospective applications in robotics, neuroscience, brain computer interfaces, medicine and society, in general.BMS - Pfizer(U01 AG024904). Spanish Ministry of Science, projects: TIN2017-85827-P, RTI2018-098913-B-I00, PSI2015-65848-R, PGC2018-098813-B-C31, PGC2018-098813-B-C32, RTI2018-101114-B-I, TIN2017-90135-R, RTI2018-098743-B-I00 and RTI2018-094645-B-I00; the FPU program (FPU15/06512, FPU17/04154) and Juan de la Cierva (FJCI-2017–33022). Autonomous Government of Andalusia (Spain) projects: UMA18-FEDERJA-084. Consellería de Cultura, Educación e Ordenación Universitaria of Galicia: ED431C2017/12, accreditation 2016–2019, ED431G/08, ED431C2018/29, Comunidad de Madrid, Y2018/EMT-5062 and grant ED431F2018/02. PPMI – a public – private partnership – is funded by The Michael J. Fox Foundation for Parkinson’s Research and funding partners, including Abbott, Biogen Idec, F. Hoffman-La Roche Ltd., GE Healthcare, Genentech and Pfizer Inc