Strategies for a centralized single product multiclass M/G/1 make-to-stock queue

Make-to-stock queues are typically investigated in the M/M/1 settings. For centralized single-item systems with backlogs, the multilevel rationing (MR) policy is established as optimal and the strict priority (SP) policy is a practical compromise, balancing cost and ease of implementation. However, the optimal policy is unknown when service time is general, i.e., for M/G/1 queues. Dynamic programming, the tool commonly used to investigate the MR policy in make-to-stock queues, is less practical when service time is general. In this paper we focus on customer composition: the proportion of customers of each class to the total number of customers in the queue. We do so because the number of customers in M/G/1 queues is invariant for any nonidling and nonanticipating policy. To characterize customer composition, we consider a series of two-priority M/G/1 queues where the first service time in each busy period is different from standard service times, i.e., this first service time is exceptional. We characterize the required exceptional first service times and the exact solution of such queues. From our results, we derive the optimal cost and control for the MR and SP policies for M/G/1 make-to-stock queues

Low Power Dynamic Scheduling for Computing Systems

This paper considers energy-aware control for a computing system with two states: "active" and "idle." In the active state, the controller chooses to perform a single task using one of multiple task processing modes. The controller then saves energy by choosing an amount of time for the system to be idle. These decisions affect processing time, energy expenditure, and an abstract attribute vector that can be used to model other criteria of interest (such as processing quality or distortion). The goal is to optimize time average system performance. Applications of this model include a smart phone that makes energy-efficient computation and transmission decisions, a computer that processes tasks subject to rate, quality, and power constraints, and a smart grid energy manager that allocates resources in reaction to a time varying energy price. The solution methodology of this paper uses the theory of optimization for renewal systems developed in our previous work. This paper is written in tutorial form and develops the main concepts of the theory using several detailed examples. It also highlights the relationship between online dynamic optimization and linear fractional programming. Finally, it provides exercises to help the reader learn the main concepts and apply them to their own optimizations. This paper is an arxiv technical report, and is a preliminary version of material that will appear as a book chapter in an upcoming book on green communications and networking.Comment: 26 pages, 10 figures, single spac

Inventory control in multi-item production systems

This thesis focusses on the analysis and construction of control policies in multiitem production systems. In such systems, multiple items can be made to stock, but they have to share the finite capacity of a single machine. This machine can only produce one unit at a time and if it is set-up for one item, a switch-over or set-up time is needed to start the production of another item. Customers arrive to the system according to (compound) Poisson processes and if they see no stock upon arrival, they are either considered as a lost sale or backlogged. In this thesis, we look at production systems with backlog and production systems with lost sales. In production systems with lost sales, all arriving customers are considered lost if no stock is available and penalty costs are paid per lost customer. In production systems with backlog, arriving customers form a queue if they see no stock and backlogging costs are paid for every backlogged customer per time unit. These production systems find many applications in industry, for instance glass and paper production or bulk production of beers, see Anupindi and Tayur [2]. The objective for the production manager is to minimize the sum of the holding and penalty or backlogging costs. At each decision moment, the manager has to decide whether to switch to another product type, to produce another unit of the type that is set-up or to idle the machine. In order to minimize the total costs, a balance must be found between a fast switching scheme that is able to react to sudden changes in demand and a production plan with a little loss of capacity. Unfortunately, a fast switching scheme results in a loss of capacity, because switching from one product type to another requires a switch-over or set-up time. In the optimal production strategy, decisions depend on the complete state of the system. Because the processes at the different product flows depend on these decisions, the processes also depend on the complete state of the system. This means that the processes at the different product flows are not independent, which makes the analysis and construction of the optimal production strategy very complex. In fact, the complexity of the determination of this policy grows exponentially in the number of product types and if this number is too large, the optimal policy becomes intractable. Production strategies in which decisions depend on the complete system are defined as global lot sizing policies and are often difficult to construct or analyse, because of the dependence between the different product flows. However, in this thesis the construction of a global lot sizing policy is presented which also works for production systems with a large number of product types. The key factor that makes the construction possible is the fact that it is based on a fixed cycle policy. In Chapter 2, the fixed cycle policy is analysed for production systems with lost sales and in Chapter 6, the fixed cycle policy is analysed for production systems with backlog. The fixed cycle policy can be analysed per product flow and this decomposition property allows for the determination of the so called relative values. If it is assumed that one continues with a fixed cycle control, the relative values per product type represent the relative expected future costs for each decision. Based on these relative values, an improvement step (see Norman [65]) is performed which results in a ‘one step improvement’ policy. This policy is constructed and analysed in Chapters 2 and 7 for production systems with lost sales and production systems with backlog, respectively. This global lot sizing policy turns out to perform well compared to other, heuristic production strategies, especially in systems with a high load and demand processes with a high variability. A similar approach as for the production system with a single machine is performed in a system with two machines and lost sales in Chapter 3. Results show that in some cases the constructed strategy works well, although in some systems two separate one step improvement policies perform better. Examples of more heuristic production strategies are gated and exhaustive basestock policies. In these ’local lot sizing‘ policies, decisions depend only on the stock level of the product type that is set-up. But even in these policies, the processes at the different product flows are dependent. This makes the analysis difficult, but for production systems with backlog a translation can be made to a queueing system by looking at the number of products short to the base-stock level. So the machine becomes a server and each product flow becomes a queue. In these queueing systems, also known as polling systems, gated and exhaustive base-stock policies become gated and exhaustive visit disciplines. For polling systems, an exact analysis of the queue length or waiting time distribution is often possible via generating functions or Laplace-Stieltjes transforms. In Chapter 5, the determination of the sojourn time distribution of customers in a polling system with a (globally) gated visit discipline is presented, which comes down to the determination of the lead time distribution in the corresponding production system

Performance analysis of a decoupling stock in a make-to-order system

In a Make-to-Order system, products are only manufactured when orders are placed. As this may lead to overly long delivery times, a stock of semi-finished products can be installed to reduce production time: the so-called decoupling stock. As performance of the decoupling stock is critical to the overall performance and cost of the production system, we propose and analyse a Markovian model of the decoupling stock. In particular, we focus on a queueing model with two buffers, thereby accounting for both the decoupling stock as well as for possible backlog of orders. By means of numerical examples, we then quantify the impact of production inefficiency on delivery times and overall cost

A smoothing replenishment policy with endogenous lead times.

We consider a two echelon supply chain consisting of a single retailer and a single manufacturer. Inventory control policies at the retailer level often transmit customer demand variability to the manufacturer, sometimes even in an amplified form (known as the bullwhip effect). When the manufacturer produces in a make-to-order fashion though, he prefers a smooth order pattern. But dampening the variability in orders inflates the retailer's safety stock due to the increased variance of the retailers inventory levels. We can turn this issue of conflicting objectives into a win-win situation for both supply chain echelons when we treat the lead time as an endogenous variable. A less variable order pattern generates shorter and less variable (production/replenishment) lead times, introducing a compensating effect on the retailer's safety stock. We show that by including endogenous lead times, the order pattern can be smoothed to a considerable extent without increasing stock levels.Bullwhip effect; Demand; endogenous lead times; Fashion; Inventory; Inventory control; Markov processes; Order; Policy; Queueing; Research; Safety stock; Smoothing; Supply chain; Supply chain management; Time; Variability; Variance;

Numerical methods for queues with shared service

A queueing system is a mathematical abstraction of a situation where elements, called customers, arrive in a system and wait until they receive some kind of service. Queueing systems are omnipresent in real life. Prime examples include people waiting at a counter to be served, airplanes waiting to take off, traffic jams during rush hour etc. Queueing theory is the mathematical study of queueing phenomena. As often neither the arrival instants of the customers nor their service times are known in advance, queueing theory most often assumes that these processes are random variables. The queueing process itself is then a stochastic process and most often also a Markov process, provided a proper description of the state of the queueing process is introduced. This dissertation investigates numerical methods for a particular type of Markovian queueing systems, namely queueing systems with shared service. These queueing systems differ from traditional queueing systems in that there is simultaneous service of the head-of-line customers of all queues and in that there is no service if there are no customers in one of the queues. The absence of service whenever one of the queues is empty yields particular dynamics which are not found in traditional queueing systems. These queueing systems with shared service are not only beautiful mathematical objects in their own right, but are also motivated by an extensive range of applications. The original motivation for studying queueing systems with shared service came from a particular process in inventory management called kitting. A kitting process collects the necessary parts for an end product in a box prior to sending it to the assembly area. The parts and their inventories being the customers and queues, we get ``shared service'' as kitting cannot proceed if some parts are absent. Still in the area of inventory management, the decoupling inventory of a hybrid make-to-stock/make-to-order system exhibits shared service. The production process prior to the decoupling inventory is make-to-stock and driven by demand forecasts. In contrast, the production process after the decoupling inventory is make-to-order and driven by actual demand as items from the decoupling inventory are customised according to customer specifications. At the decoupling point, the decoupling inventory is complemented with a queue of outstanding orders. As customisation only starts when the decoupling inventory is nonempty and there is at least one order, there is again shared service. Moving to applications in telecommunications, shared service applies to energy harvesting sensor nodes. Such a sensor node scavenges energy from its environment to meet its energy expenditure or to prolong its lifetime. A rechargeable battery operates very much like a queue, customers being discretised as chunks of energy. As a sensor node requires both sensed data and energy for transmission, shared service can again be identified. In the Markovian framework, "solving" a queueing system corresponds to finding the steady-state solution of the Markov process that describes the queueing system at hand. Indeed, most performance measures of interest of the queueing system can be expressed in terms of the steady-state solution of the underlying Markov process. For a finite ergodic Markov process, the steady-state solution is the unique solution of $N-1$ balance equations complemented with the normalisation condition, $N$ being the size of the state space. For the queueing systems with shared service, the size of the state space of the Markov processes grows exponentially with the number of queues involved. Hence, even if only a moderate number of queues are considered, the size of the state space is huge. This is the state-space explosion problem. As direct solution methods for such Markov processes are computationally infeasible, this dissertation aims at exploiting structural properties of the Markov processes, as to speed up computation of the steady-state solution. The first property that can be exploited is sparsity of the generator matrix of the Markov process. Indeed, the number of events that can occur in any state --- or equivalently, the number of transitions to other states --- is far smaller than the size of the state space. This means that the generator matrix of the Markov process is mainly filled with zeroes. Iterative methods for sparse linear systems --- in particular the Krylov subspace solver GMRES --- were found to be computationally efficient for studying kitting processes only if the number of queues is limited. For more queues (or a larger state space), the methods cannot calculate the steady-state performance measures sufficiently fast. The applications related to the decoupling inventory and the energy harvesting sensor node involve only two queues. In this case, the generator matrix exhibits a homogene block-tridiagonal structure. Such Markov processes can be solved efficiently by means of matrix-geometric methods, both in the case that the process has finite size and --- even more efficiently --- in the case that it has an infinite size and a finite block size. Neither of the former exact solution methods allows for investigating systems with many queues. Therefore we developed an approximate numerical solution method, based on Maclaurin series expansions. Rather than focussing on structural properties of the Markov process for any parameter setting, the series expansion technique exploits structural properties of the Markov process when some parameter is sent to zero. For the queues with shared exponential service and the service rate sent to zero, the resulting process has a single absorbing state and the states can be ordered such that the generator matrix is upper-diagonal. In this case, the solution at zero is trivial and the calculation of the higher order terms in the series expansion around zero has a computational complexity proportional to the size of the state space. This is a case of regular perturbation of the parameter and contrasts to singular perturbation which is applied when the service times of the kitting process are phase-type distributed. For singular perturbation, the Markov process has no unique steady-state solution when the parameter is sent to zero. However, similar techniques still apply, albeit at a higher computational cost. Finally we note that the numerical series expansion technique is not limited to evaluating queues with shared service. Resembling shared queueing systems in that a Markov process with multidimensional state space is considered, it is shown that the regular series expansion technique can be applied on an epidemic model for opinion propagation in a social network. Interestingly, we find that the series expansion technique complements the usual fluid approach of the epidemic literature

Optimizing the Performance of Robotic Mobile Fulfillment Systems

A robotic mobile fulfillment system is a novel type of automated part-to-picker material handling system. In this type of system, robots transport mobile shelves, called pods, containing items between the storage area and the workstations. It is well suited to e-commerce, due to its modularity and it's ability to adapt to changing orders patterns. Robots can nearly instantaneously switch between inbound and outbound tasks, pods can be continually repositioned to allow for automatic sorting of the inventory, pods can contain many different types of items, and unloaded robots can drive underneath pods, allowing them to use completely different routes than loaded robots. This thesis studies the performance of robotic mobile fulfillment systems by solving decision problems related to warehouse design, inventory and resource allocation, and real-time operations. For warehouse design, a new queueing network is developed that incorporates realistic robot movement, storage zones, and multi-line orders. For inventory allocation, we develop a new type of queueing network, the cross-class matching multi-class semi-open queueing network, which can be applied to other systems as well. Resource (re)allocation is modeled by combining queueing networks with Markov decision processes while including time-varying demand. This model compares benchmark policies from practice wit