Application and Control Aware Communication Strategies for Transportation and Energy Cyber-Physical Systems

Cyber--Physical Systems (CPSs) are a generation of engineered systems in which computing, communication, and control components are tightly integrated. Some important application domains of CPS are transportation, energy, and medical systems. The dynamics of CPSs are complex, involving the stochastic nature of communication systems, discrete dynamics of computing systems, and continuous dynamics of control systems. The existence of communication between and among controllers of physical processes is one of the basic characteristics of CPSs. Under this situation, some fundamental questions are: 1) How does the network behavior (communication delay, packet loss, etc.) affect the stability of the system? 2) Under what conditions is a complex system stabilizable?;In cases where communication is a component of a control system, scalability of the system becomes a concern. Therefore, one of the first issues to consider is how information about a physical process should be communicated. For example, the timing for sampling and communication is one issue. The traditional approach is to sample the physical process periodically or at predetermined times. An alternative is to sample it when specific events occur. Event-based sampling requires continuous monitoring of the system to decide a sample needs to be communicated. The main contributions of this dissertation in energy cyber-physical system domain are designing and modeling of event-based (on-demand) communication mechanisms. We show that in the problem of tracking a dynamical system over a network, if message generation and communication have correlation with estimation error, the same performance as the periodic sampling and communication method can be reached using a significantly lower rate of data.;For more complex CPSs such as vehicle safety systems, additional considerations for the communication component are needed. Communication strategies that enable robust situational awareness are critical for the design of CPSs, in particular for transportation systems. In this dissertation, we utilize the recently introduced concept of model-based communication and propose a new communication strategy to address this need. Our approach to model behavior of remote vehicles mathematically is to describe the small-scale structure of the remote vehicle movement (e.g. braking, accelerating) by a set of dynamic models and represent the large-scale structure (e.g. free following, turning) by coupling these dynamic models together into a Markov chain. Assuming model-based communication approach, a novel stochastic model predictive method is proposed to achieve cruise control goals and investigate the effect of new methodology.;To evaluate the accuracy and robustness of a situational awareness methodology, it is essential to study the mutual effect of the components of a situational awareness subsystem, and their impact on the accuracy of situational awareness. The main components are estimation and networking processes. One possible approach in this task is to produce models that provide a clear view into the dynamics of these two components. These models should integrate continuous physical dynamics, expressed with ordinary differential equations, with the discrete behaviors of communication, expressed with finite automata or Markov chain. In this dissertation, a hybrid automata model is proposed to combine and model both networking and estimation components in a single framework and investigate their interactions.;In summary, contributions of this dissertation lie in designing and evaluating methods that utilize knowledge of the physical element of CPSs to optimize the behavior of communication subsystems. Employment of such methods yields significant overall system performance improvement without incurring additional communication deployment costs

From Network to Web dimension in supply chain management

Cette thèse soutient que la dimension réseau, étant actuellement la portée du domaine de la gestion de chaîne logistique, contraint l’avancement de ce domaine et restreint des innovations conceptuelles et fondamentales capables d’adresser les grands défis économiques, environnementaux et sociaux. Les concepts de chaîne et de réseau ne reflètent pas la complexité des flux physiques, informationnels et financiers générés par les interactions qui ont lieu dans des réseaux interconnectés. Ces concepts n’offrent pas les fondations théoriques pour supporter des interventions allant au-delà d’un seul réseau et laissent échapper des opportunités nécessitant une vision multi-réseau. Ainsi, la dimension “web”, celle des réseaux de réseaux, est proposée comme une extension de la dimension réseau. Cette extension peut être vue comme l’étape naturelle suivante dans la progression qui a commencé par le niveau de gestion des opérations internes, est passée au niveau de la chaîne logistique et se trouve actuellement au niveau du réseau logistique. Après l’investigation théorique des raisons et de la façon d’intégrer la dimension web dans le domaine de la gestion de la chaîne logistique, la thèse étudie des implications importantes de cette intégration sur la collaboration inter-organisationnelle et le processus de prise de décision dans des environnements de webs logistiques. Elle démontre, en exploitant l’exemple des réseaux interconnectés ouverts, des potentialités inimaginables sans une vision web. Une méthodologie de conception d’un modèle de simulation permettant l’évaluation et la comparaison des webs ouverts par rapport aux webs existants est proposée. Puisque l’aide à la décision est une composante importante de la gestion de la chaîne logistique, la thèse contribue à déterminer les besoins des gestionnaires et à identifier les lignes directrices de la conception des outils d’aide à la décision offrant le support adéquat pour faire face aux défis et à la complexité des webs logistiques. Ces lignes directrices ont été compilées dans un cadre de conception des logiciels d’aide à la décision supportant la dimension web. Ce cadre est exploité pour développer quatre applications logicielles offrant aux praticiens et aux chercheurs des outils nécessaires pour étudier, analyser et démêler la complexité des webs logistiques.This thesis argues that the network dimension as the current scope of supply chain management is confining the evolution of this field and restricting the conceptual and fundamental innovations required for addressing the major challenges imposed by the evolution of markets and the increased intricacies of business relationships. The concepts of chain and network are limitative when attempting to represent the complexity of physical, informational and financial flows resulting from the interactions occurring in overlapping networks. They lack the theoretical foundations necessary to explain and encompass initiatives that go beyond a single chain or network. They also lead to overlook substantial opportunities that require beyond a network vision. Therefore, the “web” dimension, as networks of networks, is proposed as an extension to the network dimension in supply chain management. This new scope is the natural next step in the progression from the internal operations management level to the supply chain level and then to the supply network level. After a theoretical investigation of why and how the web dimension should be integrated into the supply chain management field, the thesis studies and discusses important implications of this integration on inter-organisational collaboration and of the decision-making processes in the logistic web environments. It demonstrates through the example of open interconnected logistic webs some of the potentials that cannot be imagined without a web vision. A methodology for designing a simulation model to assess the impact of such open webs versus existing webs is proposed. Since decision support is a key element in supply chain management, the thesis contributes to determine the needs of supply chain managers and identify the important axes for designing decision support systems that provide adequate assistance in dealing with the challenges and complexity presented by logistic web environments. The identified elements result in the establishment of a foundation for designing software solutions required to handle the challenges revealed by the web dimension. This conceptual framework is applied to the prototyping of four applications that have the potential of providing practitioners and researchers with the appropriate understanding and necessary tools to deal with the complexity of logistics webs

HMC-Based Accelerator Design For Compressed Deep Neural Networks

Deep Neural Networks (DNNs) offer remarkable performance of classifications and regressions in many high dimensional problems and have been widely utilized in real-word cognitive applications. In DNN applications, high computational cost of DNNs greatly hinder their deployment in resource-constrained applications, real-time systems and edge computing platforms. Moreover, energy consumption and performance cost of moving data between memory hierarchy and computational units are higher than that of the computation itself. To overcome the memory bottleneck, data locality and temporal data reuse are improved in accelerator design. In an attempt to further improve data locality, memory manufacturers have invented 3D-stacked memory where multiple layers of memory arrays are stacked on top of each other. Inherited from the concept of Process-In-Memory (PIM), some 3D-stacked memory architectures also include a logic layer that can integrate general-purpose computational logic directly within main memory to take advantages of high internal bandwidth during computation. In this dissertation, we are going to investigate hardware/software co-design for neural network accelerator. Specifically, we introduce a two-phase filter pruning framework for model compression and an accelerator tailored for efficient DNN execution on HMC, which can dynamically offload the primitives and functions to PIM logic layer through a latency-aware scheduling controller. In our compression framework, we formulate filter pruning process as an optimization problem and propose a filter selection criterion measured by conditional entropy. The key idea of our proposed approach is to establish a quantitative connection between filters and model accuracy. We define the connection as conditional entropy over filters in a convolutional layer, i.e., distribution of entropy conditioned on network loss. Based on the definition, different pruning efficiencies of global and layer-wise pruning strategies are compared, and two-phase pruning method is proposed. The proposed pruning method can achieve a reduction of 88% filters and 46% inference time reduction on VGG16 within 2% accuracy degradation. In this dissertation, we are going to investigate hardware/software co-design for neural network accelerator. Specifically, we introduce a two-phase filter pruning framework for model compres- sion and an accelerator tailored for efficient DNN execution on HMC, which can dynamically offload the primitives and functions to PIM logic layer through a latency-aware scheduling con- troller. In our compression framework, we formulate filter pruning process as an optimization problem and propose a filter selection criterion measured by conditional entropy. The key idea of our proposed approach is to establish a quantitative connection between filters and model accuracy. We define the connection as conditional entropy over filters in a convolutional layer, i.e., distribution of entropy conditioned on network loss. Based on the definition, different pruning efficiencies of global and layer-wise pruning strategies are compared, and two-phase pruning method is proposed. The proposed pruning method can achieve a reduction of 88% filters and 46% inference time reduction on VGG16 within 2% accuracy degradation

Machine Learning and Multi-Agent Systems in Oil and Gas Industry Applications: A Survey

The oil and gas industry (OGI) has always been associated with challenges and complexities. It involves many processes and stakeholders, each generating a huge amount of data. Due to the global and distributed nature of the business, processing and managing this information is an arduous task. Many issues such as orchestrating different data sources, owners and formats; verifying, validating and securing data streams as they move along the complex business process pipeline; and getting insights from data for improving business efficiency, scheduling maintenance and preventing theft and fraud are to be addressed. Artificial intelligence (AI), and machine learning (ML) in particular, have gained huge acceptance in many areas recently, including the OGI, to help humans tackle such complex tasks. Furthermore, multi-agent systems (MAS) as a subfield of distributed AI meet the requirement of distributed systems and have been utilised successfully in a vast variety of disciplines. Several studies have explored the use of ML and MAS to increase operational efficiency, manage supply chain and solve various production- and maintenance-related tasks in the OGI. However, ML has only been applied to isolated tasks, and while MAS have yielded good performance in simulated environments, they have not gained the expected popularity among oil and gas companies yet. Further research in the fields is necessary to realise the potential of ML and MAS and encourage their wider acceptance in the OGI. In particular, embedding ML into MAS can bring many benefits for the future development of the industry. This paper aims to summarise the efforts to date of applying ML and MAS to OGI tasks, identify possible reasons for their low and slow uptake and suggest ways to ensure a greater adoption of these technologies in the OGI

Supply Chain

Traditionally supply chain management has meant factories, assembly lines, warehouses, transportation vehicles, and time sheets. Modern supply chain management is a highly complex, multidimensional problem set with virtually endless number of variables for optimization. An Internet enabled supply chain may have just-in-time delivery, precise inventory visibility, and up-to-the-minute distribution-tracking capabilities. Technology advances have enabled supply chains to become strategic weapons that can help avoid disasters, lower costs, and make money. From internal enterprise processes to external business transactions with suppliers, transporters, channels and end-users marks the wide range of challenges researchers have to handle. The aim of this book is at revealing and illustrating this diversity in terms of scientific and theoretical fundamentals, prevailing concepts as well as current practical applications