Working Notes from the 1992 AAAI Spring Symposium on Practical Approaches to Scheduling and Planning

The symposium presented issues involved in the development of scheduling systems that can deal with resource and time limitations. To qualify, a system must be implemented and tested to some degree on non-trivial problems (ideally, on real-world problems). However, a system need not be fully deployed to qualify. Systems that schedule actions in terms of metric time constraints typically represent and reason about an external numeric clock or calendar and can be contrasted with those systems that represent time purely symbolically. The following topics are discussed: integrating planning and scheduling; integrating symbolic goals and numerical utilities; managing uncertainty; incremental rescheduling; managing limited computation time; anytime scheduling and planning algorithms, systems; dependency analysis and schedule reuse; management of schedule and plan execution; and incorporation of discrete event techniques

Markov Decision Processes with Applications in Wireless Sensor Networks: A Survey

Wireless sensor networks (WSNs) consist of autonomous and resource-limited devices. The devices cooperate to monitor one or more physical phenomena within an area of interest. WSNs operate as stochastic systems because of randomness in the monitored environments. For long service time and low maintenance cost, WSNs require adaptive and robust methods to address data exchange, topology formulation, resource and power optimization, sensing coverage and object detection, and security challenges. In these problems, sensor nodes are to make optimized decisions from a set of accessible strategies to achieve design goals. This survey reviews numerous applications of the Markov decision process (MDP) framework, a powerful decision-making tool to develop adaptive algorithms and protocols for WSNs. Furthermore, various solution methods are discussed and compared to serve as a guide for using MDPs in WSNs

Joint Channel Assignment and Opportunistic Routing for Maximizing Throughput in Cognitive Radio Networks

In this paper, we consider the joint opportunistic routing and channel assignment problem in multi-channel multi-radio (MCMR) cognitive radio networks (CRNs) for improving aggregate throughput of the secondary users. We first present the nonlinear programming optimization model for this joint problem, taking into account the feature of CRNs-channel uncertainty. Then considering the queue state of a node, we propose a new scheme to select proper forwarding candidates for opportunistic routing. Furthermore, a new algorithm for calculating the forwarding probability of any packet at a node is proposed, which is used to calculate how many packets a forwarder should send, so that the duplicate transmission can be reduced compared with MAC-independent opportunistic routing & encoding (MORE) [11]. Our numerical results show that the proposed scheme performs significantly better that traditional routing and opportunistic routing in which channel assignment strategy is employed.Comment: 5 pages, 4 figures, to appear in Proc. of IEEE GlobeCom 201

Multi-agent based beam search for intelligent production planning and scheduling

Production planning and scheduling is a long standing research area of great practical value, while industrial demand for production planning and scheduling systems is acute. Regretfully, most research results are seldom applied in industry because existing planning and scheduling methods can barely meet the requirements for practical applications. This paper identifies four major requirements, namely generality, solution quality, computation efficiency, and implementation difficulty, for practical production planning and scheduling methods. Based on these requirements, method, a multi-agent based beam search (MABBS), is developed. It seamlessly integrates the multi-agent system (MAS) method and beam search (BS) method into a generic multi-stage multi-level decision making (MSMLDM) model to systematically address all the four requirements within a unified framework. A script language, called EXASL, and an open software platform are developed to simplify the implementation of the MABBS method. For solving complex real-world problems, an MABBS-based prototype production planning, scheduling and execution system is developed. The feasibility and effectiveness of this study is demonstrated with the prototype system and computation experiments. © 2010 Taylor & Francis.postprin