An Optimal Control Approach for the Data Harvesting Problem

We propose a new method for trajectory planning to solve the data harvesting problem. In a two-dimensional mission space, $N$ mobile agents are tasked with the collection of data generated at $M$ stationary sources and delivery to a base aiming at minimizing expected delays. An optimal control formulation of this problem provides some initial insights regarding its solution, but it is computationally intractable, especially in the case where the data generating processes are stochastic. We propose an agent trajectory parameterization in terms of general function families which can be subsequently optimized on line through the use of Infinitesimal Perturbation Analysis (IPA). Explicit results are provided for the case of elliptical and Fourier series trajectories and some properties of the solution are identified, including robustness with respect to the data generation processes and scalability in the size of an event set characterizing the underlying hybrid dynamic system

An event-driven approach to control and optimization of multi-agent systems

This dissertation studies the application of several event-driven control schemes in multi-agent systems. First, a new cooperative receding horizon (CRH) controller is designed and applied to a class of maximum reward collection problems. Target rewards are time-variant with finite deadlines and the environment contains uncertainties. The new methodology adapts an event-driven approach by optimizing the control for a planning horizon and updating it for a shorter action horizon. The proposed CRH controller addresses several issues including potential instabilities and oscillations. It also improves the estimated reward-to-go which enhances the overall performance of the controller. The other major contribution is that the originally infinite-dimensional feasible control set is reduced to a finite set at each time step which improves the computational cost of the controller. Second, a new event-driven methodology is studied for trajectory planning in multi-agent systems. A rigorous optimal control solution is employed using numerical solutions which turn out to be computationally infeasible in real time applications. The problem is then parameterized using several families of parametric trajectories. The solution to the parametric optimization relies on an unbiased estimate of the objective function's gradient obtained by the "Infinitesimal Perturbation Analysis" method. The premise of event-driven methods is that the events involved are observable so as to "excite" the underlying event-driven controller. However, it is not always obvious that these events actually take place under every feasible control in which case the controller may be useless. This issue of event excitation, which arises specially in multi-agent systems with a finite number of targets, is studied and addressed by introducing a novel performance measure which generates a potential field over the mission space. The effect of the new performance metric is demonstrated through simulation and analytical results

An event-driven approach to control and optimization of multi-agent systems

This dissertation studies the application of several event-driven control schemes in multi-agent systems. First, a new cooperative receding horizon (CRH) controller is designed and applied to a class of maximum reward collection problems. Target rewards are time-variant with finite deadlines and the environment contains uncertainties. The new methodology adapts an event-driven approach by optimizing the control for a planning horizon and updating it for a shorter action horizon. The proposed CRH controller addresses several issues including potential instabilities and oscillations. It also improves the estimated reward-to-go which enhances the overall performance of the controller. The other major contribution is that the originally infinite-dimensional feasible control set is reduced to a finite set at each time step which improves the computational cost of the controller. Second, a new event-driven methodology is studied for trajectory planning in multi-agent systems. A rigorous optimal control solution is employed using numerical solutions which turn out to be computationally infeasible in real time applications. The problem is then parameterized using several families of parametric trajectories. The solution to the parametric optimization relies on an unbiased estimate of the objective function's gradient obtained by the "Infinitesimal Perturbation Analysis" method. The premise of event-driven methods is that the events involved are observable so as to "excite" the underlying event-driven controller. However, it is not always obvious that these events actually take place under every feasible control in which case the controller may be useless. This issue of event excitation, which arises specially in multi-agent systems with a finite number of targets, is studied and addressed by introducing a novel performance measure which generates a potential field over the mission space. The effect of the new performance metric is demonstrated through simulation and analytical results

Intelligent time-successive production modeling

A new framework is presented that uses production data history in order to build a field-wide performance prediction model. In this work artificial intelligence techniques and data driven modeling are utilized to perform a future production prediction for both synthetic and real field cases.;Production history is paired with geological information from the field to build large dataset containing the spatio-temporal dependencies amongst different wells. These spatio-temporal dependencies are addressed by information from Closest Offset Wells (COWs). This information includes geological characteristics (Spatial) and dynamic production data (Temporal) of all COWs.;Upon creation of the dataset, this framework calls for development of a series of single layer neural network, trained by back propagation algorithm. These networks are then fused together to form the Intelligent Time-Successive Production Modeling (ITSPM). Using only well log information along with production history of existing wells, this technique can provide performance predictions for new wells and initial hydrocarbon in place (IHIP) using a volumetric-geostatical method.;A synthetic oil reservoir is built and simulated using a commercial reservoir numerical simulation package. Production and well log data are extracted and converted to an all-inclusive dataset. Following the dataset generation several neural networks are trained and verified to predict different stages of production. ITSPM method is utilized to estimate the production profile for nine new wells in the reservoir. ITSPM is also applied to data from a real field. The field that is giant oil field in the Middle East includes more than 200 wells with forty years of production history. ITSPM\u27s production predictions of the four newest wells in this reservoir are compared to real production data