Mission-Phasing Techniques for Constrained Agents in Stochastic Environments.

Resource constraints restrict the set of actions that an agent can take, such that the agent might not be able to perform all its desired tasks. Computational time limitations restrict the number of states that an agent can model and reason over, such that the agent might not be able to formulate a policy that can respond to all possible eventualities. This work argues that, in either situation, one effective way of improving the agent's performance is to adopt a phasing strategy. Resource-constrained agents can choose to reconfigure resources and switch action sets for handling upcoming events better when moving from phase to phase; time-limited agents can choose to focus computation on high-value phases and to exploit additional computation time during the execution of earlier phases to improve solutions for future phases. This dissertation consists of two parts, corresponding to the aforementioned resource constraints and computational time limitations. The first part of the dissertation focuses on the development of automated resource-driven mission-phasing techniques for agents operating in resource-constrained environments. We designed a suite of algorithms which not only can find solutions to optimize the use of predefined phase-switching points, but can also automatically determine where to establish such points, accounting for the cost of creating them, in complex stochastic environments. By formulating the coupled problems of mission decomposition, resource configuration, and policy formulation into a single compact mathematical formulation, the presented algorithms can effectively exploit problem structure and often considerably reduce computational cost for finding exact solutions. The second part of this dissertation is the design of computation-driven mission-phasing techniques for time-critical systems. We developed a new deliberation scheduling approach, which can simultaneously solve the coupled problems of deciding both when to deliberate given its cost, and which phase decision procedures to execute during deliberation intervals. Meanwhile, we designed a heuristic search method to effectively utilize the allocated time within each phase. As illustrated in experimental results, the computation-driven mission-phasing techniques, which extend problem decomposition techniques with the across-phase deliberation scheduling and inner-phase heuristic search methods mentioned above, can help an agent generate a better policy within time limit.Ph.D.Computer Science & EngineeringUniversity of Michigan, Horace H. Rackham School of Graduate Studieshttp://deepblue.lib.umich.edu/bitstream/2027.42/60650/1/jianhuiw_1.pd

Resource Allocation Among Agents with MDP-Induced Preferences

Allocating scarce resources among agents to maximize global utility is, in general, computationally challenging. We focus on problems where resources enable agents to execute actions in stochastic environments, modeled as Markov decision processes (MDPs), such that the value of a resource bundle is defined as the expected value of the optimal MDP policy realizable given these resources. We present an algorithm that simultaneously solves the resource-allocation and the policy-optimization problems. This allows us to avoid explicitly representing utilities over exponentially many resource bundles, leading to drastic (often exponential) reductions in computational complexity. We then use this algorithm in the context of self-interested agents to design a combinatorial auction for allocating resources. We empirically demonstrate the effectiveness of our approach by showing that it can, in minutes, optimally solve problems for which a straightforward combinatorial resource-allocation technique would require the agents to enumerate up to 2^100 resource bundles and the auctioneer to solve an NP-complete problem with an input of that size

Scalable greedy algorithms for task/resource constrained multi-agent stochastic planning

National Research Foundation (NRF) Singapore under Corp Lab @ University schem

Theory and Practice of Supply Chain Synchronization

In this dissertation, we develop strategies to synchronize component procurement in assemble-to-order (ATO) production and overhaul operations. We focus on the high-tech and mass customization industries which are not only considered to be very important to create or keep U.S. manufacturing jobs, but also suffer most from component inventory burden. In the second chapter, we address the deterministic joint replenishment inventory problem with batch size constraints (JRPB). We characterize system regeneration points, derive a closed-form expression of the average product inventory, and formulate the problem of finding the optimal joint reorder interval to minimize inventory and ordering costs per unit of time. Thereafter, we discuss exact solution approaches and the case of variable reorder intervals. Computational examples demonstrate the power of our methodology. In the third chapter, we incorporate stochastic demand to the JRPB. We propose a joint part replenishment policy that balances inventory and ordering costs while providing a desired service level. A case study and guided computational experiments show the magnitudes of savings that are possible using our methodology. In the fourth chapter, we show how lack of synchronization in assembly systems with long and highly variable component supply lead times can rapidly deteriorate system performance. We develop a full synchronization strategy through time buffering of component orders, which not only guarantees meeting planned production dates but also drastically reduces inventory holding costs. A case study has been carried out to prove the practical relevance, assess potential risks, and evaluate phased implementation policies. The fifth chapter explores the use of condition information from a large number of distributed working units in the field to improve the management of the inventory of spare parts required to maintain those units. Synchronization is again paramount here since spare part inventory needs to adapt to the condition of the engine fleet. All needed parts must be available to complete the overhaul of a unit. We develop a complex simulation environment to assess the performance of different inventory policies and the value of health monitoring. The sixth chapter concludes this dissertation and outlines future research plans as well as opportunities

Air Force Institute of Technology Research Report 2006

This report summarizes the research activities of the Air Force Institute of Technology’s Graduate School of Engineering and Management. It describes research interests and faculty expertise; lists student theses/dissertations; identifies research sponsors and contributions; and outlines the procedures for contacting the school. Included in the report are: faculty publications, conference presentations, consultations, and funded research projects. Research was conducted in the areas of Aeronautical and Astronautical Engineering, Electrical Engineering and Electro-Optics, Computer Engineering and Computer Science, Systems and Engineering Management, Operational Sciences, Mathematics, Statistics and Engineering Physics

Game Theory and Prescriptive Analytics for Naval Wargaming Battle Management Aids

NPS NRP Technical ReportThe Navy is taking advantage of advances in computational technologies and data analytic methods to automate and enhance tactical decisions and support warfighters in highly complex combat environments. Novel automated techniques offer opportunities to support the tactical warfighter through enhanced situational awareness, automated reasoning and problem-solving, and faster decision timelines. This study will investigate how game theory and prescriptive analytics methods can be used to develop real-time wargaming capabilities to support warfighters in their ability to explore and evaluate the possible consequences of different tactical COAs to improve tactical missions. This study will develop a conceptual design of a real-time tactical wargaming capability. This study will explore data analytic methods including game theory, prescriptive analytics, and artificial intelligence (AI) to evaluate their potential to support real-time wargaming.N2/N6 - Information WarfareThis research is supported by funding from the Naval Postgraduate School, Naval Research Program (PE 0605853N/2098). https://nps.edu/nrpChief of Naval Operations (CNO)Approved for public release. Distribution is unlimited.

Air Force Institute of Technology Research Report 2007

This report summarizes the research activities of the Air Force Institute of Technology’s Graduate School of Engineering and Management. It describes research interests and faculty expertise; lists student theses/dissertations; identifies research sponsors and contributions; and outlines the procedures for contacting the school. Included in the report are: faculty publications, conference presentations, consultations, and funded research projects. Research was conducted in the areas of Aeronautical and Astronautical Engineering, Electrical Engineering and Electro-Optics, Computer Engineering and Computer Science, Systems and Engineering Management, Operational Sciences, Mathematics, Statistics and Engineering Physics

Wireless Sensor Networks

The aim of this book is to present few important issues of WSNs, from the application, design and technology points of view. The book highlights power efficient design issues related to wireless sensor networks, the existing WSN applications, and discusses the research efforts being undertaken in this field which put the reader in good pace to be able to understand more advanced research and make a contribution in this field for themselves. It is believed that this book serves as a comprehensive reference for graduate and undergraduate senior students who seek to learn latest development in wireless sensor networks

In pursuit of autonomous distributed satellite systems

Satellite imagery has become an essential resource for environmental, humanitarian, and industrial endeavours. As a means to satisfy the requirements of new applications and user needs, novel Earth Observation (EO) systems are exploring the suitability of Distributed Satellite Systems (DSS) in which multiple observation assets concurrently sense the Earth. Given the temporal and spatial resolution requirements of EO products, DSS are often envisioned as large-scale systems with multiple sensing capabilities operating in a networked manner. Enabled by the consolidation of small satellite platforms and fostered by the emerging capabilities of distributed systems, these new architectures pose multiple design and operational challenges. Two of them are the main pillars of this research, namely, the conception of decision-support tools to assist the architecting process of a DSS, and the design of autonomous operational frameworks based on decentralised, on-board decision-making. The first part of this dissertation addresses the architecting of heterogeneous, networked DSS architectures that hybridise small satellite platforms with traditional EO assets. We present a generic design-oriented optimisation framework based on tradespace exploration methodologies. The goals of this framework are twofold: to select the most optimal constellation design; and to facilitate the identification of design trends, unfeasible regions, and tensions among architectural attributes. Oftentimes in EO DSS, system requirements and stakeholder preferences are not only articulated through functional attributes (i.e. resolution, revisit time, etc.) or monetary constraints, but also through qualitative traits such as flexibility, evolvability, robustness, or resiliency, amongst others. In line with that, the architecting framework defines a single figure of merit that aggregates quantitative attributes and qualitative ones-the so-called ilities of a system. With that, designers can steer the design of DSS both in terms of performance or cost, and in terms of their high-level characteristics. The application of this optimisation framework has been illustrated in two timely use-cases identified in the context of the EU-funded ONION project: a system that measures ocean and ice parameters in Polar regions to facilitate weather forecast and off-shore operations; and a system that provides agricultural variables crucial for global management of water stress, crop state, and draughts. The analysis of architectural features facilitated a comprehensive understanding of the functional and operational characteristics of DSS. With that, this thesis continues to delve into the design of DSS by focusing on one particular functional trait: autonomy. The minimisation of human-operator intervention has been traditionally sought in other space systems and can be especially critical for large-scale, structurally dynamic, heterogeneous DSS. In DSS, autonomy is expected to cope with the likely inability to operate very large-scale systems in a centralised manner, to improve the science return, and to leverage many of their emerging capabilities (e.g. tolerance to failures, adaptability to changing structures and user needs, responsiveness). We propose an autonomous operational framework that provides decentralised decision-making capabilities to DSS by means of local reasoning and individual resource allocation, and satellite-to-satellite interactions. In contrast to previous works, the autonomous decision-making framework is evaluated in this dissertation for generic constellation designs the goal of which is to minimise global revisit times. As part of the characterisation of our solution, we stressed the implications that autonomous operations can have upon satellite platforms with stringent resource constraints (e.g. power, memory, communications capabilities) and evaluated the behaviour of the solution for a large-scale DSS composed of 117 CubeSat-like satellite units.La imatgeria per satèl·lit ha esdevingut un recurs essencial per assolir tasques ambientals, humanitàries o industrials. Per tal de satisfer els requeriments de les noves aplicacions i usuaris, els sistemes d’observació de la Terra (OT) estan explorant la idoneïtat dels Sistemes de Satèl·lit Distribuïts (SSD), on múltiples observatoris espacials mesuren el planeta simultàniament. Degut al les resolucions temporals i espacials requerides, els SSD sovint es conceben com sistemes de gran escala que operen en xarxa. Aquestes noves arquitectures promouen les capacitats emergents dels sistemes distribuïts i, tot i que són possibles gràcies a l’acceptació de les plataformes de satèl·lits petits, encara presenten molts reptes en quant al disseny i operacions. Dos d’ells són els pilars principals d’aquesta tesi, en concret, la concepció d’eines de suport a la presa de decisions pel disseny de SSD, i la definició d’operacions autònomes basades en gestió descentralitzada a bord dels satèl·lits. La primera part d’aquesta dissertació es centra en el disseny arquitectural de SSD heterogenis i en xarxa, imbricant tecnologies de petits satèl·lits amb actius tradicionals. Es presenta un entorn d’optimització orientat al disseny basat en metodologies d’exploració i comparació de solucions. Els objectius d’aquest entorn són: la selecció el disseny de constel·lació més òptim; i facilitar la identificació de tendències de disseny, regions d’incompatibilitat, i tensions entre atributs arquitecturals. Sovint en els SSD d’OT, els requeriments del sistema i l’expressió de prioritats no només s’articulen en quant als atributs funcionals o les restriccions monetàries, sinó també a través de les característiques qualitatives com la flexibilitat, l’evolucionabilitat, la robustesa, o la resiliència, entre d’altres. En línia amb això, l’entorn d’optimització defineix una única figura de mèrit que agrega rendiment, cost i atributs qualitatius. Així l’equip de disseny pot influir en les solucions del procés d’optimització tant en els aspectes quantitatius, com en les característiques dalt nivell. L’aplicació d’aquest entorn d’optimització s’il·lustra en dos casos d’ús actuals identificats en context del projecte europeu ONION: un sistema que mesura paràmetres de l’oceà i gel als pols per millorar la predicció meteorològica i les operacions marines; i un sistema que obté mesures agronòmiques vitals per la gestió global de l’aigua, l’estimació d’estat dels cultius, i la gestió de sequeres. L’anàlisi de propietats arquitecturals ha permès copsar de manera exhaustiva les característiques funcionals i operacionals d’aquests sistemes. Amb això, la tesi ha seguit aprofundint en el disseny de SSD centrant-se, particularment, en un tret funcional: l’autonomia. Minimitzar la intervenció de l’operador humà és comú en altres sistemes espacials i podria ser especialment crític pels SSD de gran escala, d’estructura dinàmica i heterogenis. En els SSD s’espera que l’autonomia solucioni la possible incapacitat d’operar sistemes de gran escala de forma centralitzada, que millori el retorn científic i que n’apuntali les seves propietats emergents (e.g. tolerància a errors, adaptabilitat a canvis estructural i de necessitats d’usuari, capacitat de resposta). Es proposa un sistema d’operacions autònomes que atorga la capacitat de gestionar els sistemes de forma descentralitzada, a través del raonament local, l’assignació individual de recursos, i les interaccions satèl·lit-a-satèl·lit. Al contrari que treballs anteriors, la presa de decisions autònoma s’avalua per constel·lacions que tenen com a objectius de missió la minimització del temps de revisita global