Human-Machine Collaborative Optimization via Apprenticeship Scheduling

Coordinating agents to complete a set of tasks with intercoupled temporal and resource constraints is computationally challenging, yet human domain experts can solve these difficult scheduling problems using paradigms learned through years of apprenticeship. A process for manually codifying this domain knowledge within a computational framework is necessary to scale beyond the ``single-expert, single-trainee" apprenticeship model. However, human domain experts often have difficulty describing their decision-making processes, causing the codification of this knowledge to become laborious. We propose a new approach for capturing domain-expert heuristics through a pairwise ranking formulation. Our approach is model-free and does not require enumerating or iterating through a large state space. We empirically demonstrate that this approach accurately learns multifaceted heuristics on a synthetic data set incorporating job-shop scheduling and vehicle routing problems, as well as on two real-world data sets consisting of demonstrations of experts solving a weapon-to-target assignment problem and a hospital resource allocation problem. We also demonstrate that policies learned from human scheduling demonstration via apprenticeship learning can substantially improve the efficiency of a branch-and-bound search for an optimal schedule. We employ this human-machine collaborative optimization technique on a variant of the weapon-to-target assignment problem. We demonstrate that this technique generates solutions substantially superior to those produced by human domain experts at a rate up to 9.5 times faster than an optimization approach and can be applied to optimally solve problems twice as complex as those solved by a human demonstrator.Comment: Portions of this paper were published in the Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI) in 2016 and in the Proceedings of Robotics: Science and Systems (RSS) in 2016. The paper consists of 50 pages with 11 figures and 4 table

Multi crteria decision making and its applications : a literature review

This paper presents current techniques used in Multi Criteria Decision Making (MCDM) and their applications. Two basic approaches for MCDM, namely Artificial Intelligence MCDM (AIMCDM) and Classical MCDM (CMCDM) are discussed and investigated. Recent articles from international journals related to MCDM are collected and analyzed to find which approach is more common than the other in MCDM. Also, which area these techniques are applied to. Those articles are appearing in journals for the year 2008 only. This paper provides evidence that currently, both AIMCDM and CMCDM are equally common in MCDM

Stochastic Shortest Path with Energy Constraints in POMDPs

We consider partially observable Markov decision processes (POMDPs) with a set of target states and positive integer costs associated with every transition. The traditional optimization objective (stochastic shortest path) asks to minimize the expected total cost until the target set is reached. We extend the traditional framework of POMDPs to model energy consumption, which represents a hard constraint. The energy levels may increase and decrease with transitions, and the hard constraint requires that the energy level must remain positive in all steps till the target is reached. First, we present a novel algorithm for solving POMDPs with energy levels, developing on existing POMDP solvers and using RTDP as its main method. Our second contribution is related to policy representation. For larger POMDP instances the policies computed by existing solvers are too large to be understandable. We present an automated procedure based on machine learning techniques that automatically extracts important decisions of the policy allowing us to compute succinct human readable policies. Finally, we show experimentally that our algorithm performs well and computes succinct policies on a number of POMDP instances from the literature that were naturally enhanced with energy levels.Comment: Technical report accompanying a paper published in proceedings of AAMAS 201

Multi-criteria decision analysis to assess the environmental and economic performance of using recycled gypsum cement and recycled aggregate to produce concrete: the case of Catalonia (Spain)

The production of virgin raw materials used in construction and the generation of construction and demolition waste (CDW) are key environmental issues in the construction industry. Portland cement and concrete are used extensively in the construction sector. Processing of CDW to produce recycled gypsum cement and recycled aggregates (RA) and their use in the production of structural and non-structural concrete are one way of slowing natural resource depletion and reducing the amount of CDW landfilled. This study proposes the application of multi-criteria decision analysis (MCDA) to compare the production of “green” concretes made from recycled gypsum cement (RGC) and RA with the production of conventional concrete made from natural aggregate and ordinary Portland cement. The VIKOR MCDA method was employed to determine the best or a set of good alternative(s) for concrete production, considering environmental and economic criteria. The life cycle assessment method was used to select the environmental evaluation criteria, and the reference cost of producing concrete alternatives in Spain was used to determine economic criteria. The results of this study, in which environmental and economic criteria were considered of equal weight, or one of the two criteria was given greater weight, showed that the best option for structural and non-structural concrete was the use of RGC and RA. In both cases, the worst alternative was conventional concrete. In conclusion, we found that the use of RGC and RA in concrete production is positive because it replaces the original raw material, reduces the environmental impact, and lowers the economic costs.Postprint (published version

Linear, integer separable and fuzzy programming problems: a united approach towards automatic reformulation

For mathematical programming (MP) to have greater impact as a decision tool, MP software systems must offer suitable support in terms of model communication and modelling techniques. In this paper modelling techniques that allow logical restrictions to be modelled in integer programming terms are described and their implications discussed. In addition it is demonstrated that many classes of non-linearities which are not variable separable may be after suitable algebraic manipulation put in a variable separable form. The methods of reformulating the fuzzy linear programming problem as a Max-Min problem is also introduced. It is shown that analysis of bounds plays a key role in the following four important contexts: model reduction, reformulation of logical restrictions as 0-1 mixed integer programs, reformulation of nonlinear programs as variable separable programs and reformulation of fuzzy linear programs. It is observed that as well as incorporating an interface between the modeller and the optimiser there is a need to make available to the modeller software facilities which support the model reformulation techniques described here