Deep controlled learning of dynamic policies with an application to lost-sales inventory control

Recent literature established that neural networks can represent good policies across a range of stochastic dynamic models in supply chain and logistics. We propose a new algorithm that incorporates variance reduction techniques, to overcome limitations of algorithms typically employed in literature to learn such neural network policies. For the classical lost sales inventory model, the algorithm learns neural network policies that are vastly superior to those learned using model-free algorithms, while outperforming the best heuristic benchmarks by an order of magnitude. The algorithm is an interesting candidate to apply to other stochastic dynamic problems in supply chain and logistics, because the ideas in its development are generic

Grid-Connected Distributed Wind-Photovoltaic Energy Management: A Review

Energy management comprises of the planning, operation and control of both energy production and its demand. The wind energy availability is site-specific, time-dependent and nondispatchable. As the use of electricity is growing and conventional sources are depleting, the major renewable sources, like wind and photovoltaic (PV), have increased their share in the generation mix. The best possible resource utilization, having a track of load and renewable resource forecast, assures significant reduction of the net cost of the operation. Modular hybrid energy systems with some storage as back up near load center change the scenario of unidirectional power flow to bidirectional with the distributed generation. The performance of such systems can be enhanced by the accomplishment of advanced control schemes in a centralized system controller or distributed control. In grid-connected mode, these can support the grid to tackle power quality issues, which optimize the use of the renewable resource. The chapter aims to bring recent trends with changing requirements due to distributed generation (DG), summarizing the research works done in the last 10 years with some vision of future trends