Markov Decision Processes with Applications in Wireless Sensor Networks: A Survey

Wireless sensor networks (WSNs) consist of autonomous and resource-limited devices. The devices cooperate to monitor one or more physical phenomena within an area of interest. WSNs operate as stochastic systems because of randomness in the monitored environments. For long service time and low maintenance cost, WSNs require adaptive and robust methods to address data exchange, topology formulation, resource and power optimization, sensing coverage and object detection, and security challenges. In these problems, sensor nodes are to make optimized decisions from a set of accessible strategies to achieve design goals. This survey reviews numerous applications of the Markov decision process (MDP) framework, a powerful decision-making tool to develop adaptive algorithms and protocols for WSNs. Furthermore, various solution methods are discussed and compared to serve as a guide for using MDPs in WSNs

Design of Wireless Communication Networks for Cyber-Physical Systems with Application to Smart Grid

Cyber-Physical Systems (CPS) are the next generation of engineered systems in which computing, communication, and control technologies are tightly integrated. On one hand, CPS are generally large with components spatially distributed in physical world that has lots of dynamics; on the other hand, CPS are connected, and must be robust and responsive. Smart electric grid, smart transportation system are examples of emerging CPS that have significant and far-reaching impact on our daily life. In this dissertation, we design wireless communication system for CPS. To make CPS robust and responsive, it is critical to have a communication subsystem that is reliable, adaptive, and scalable. Our design uses a layered structure, which includes physical layer, multiple access layer, network layer, and application layer. Emphases are placed on multiple access and network layer. At multiple access layer, we have designed three approaches, namely compressed multiple access, sample-contention multiple access, and prioritized multiple access, for reliable and selective multiple access. At network layer, we focus on the problem of creating reliable route, with service interruption anticipated. We propose two methods: the first method is a centralized one that creates backup path around zones posing high interruption risk; the other method is a distributed one that utilizes Ant Colony Optimization (ACO) and positive feedback, and is able to update multipath dynamically. Applications are treated as subscribers to the data service provided by the communication system. Their data quality requirements and Quality of Service (QoS) feedback are incorporated into cross-layer optimization in our design. We have evaluated our design through both simulation and testbed. Our design demonstrates desired reliability, scalability and timeliness in data transmission. Performance gain is observed over conventional approaches as such random access

Spacelab system analysis: The modified free access protocol: An access protocol for communication systems with periodic and Poisson traffic

The protocol definition and terminal hardware for the modified free access protocol, a communications protocol similar to Ethernet, are developed. A MFA protocol simulator and a CSMA/CD math model are also developed. The protocol is tailored to communication systems where the total traffic may be divided into scheduled traffic and Poisson traffic. The scheduled traffic should occur on a periodic basis but may occur after a given event such as a request for data from a large number of stations. The Poisson traffic will include alarms and other random traffic. The purpose of the protocol is to guarantee that scheduled packets will be delivered without collision. This is required in many control and data collection systems. The protocol uses standard Ethernet hardware and software requiring minimum modifications to an existing system. The modification to the protocol only affects the Ethernet transmission privileges and does not effect the Ethernet receiver

Advanced manned space flight simulation and training: An investigation of simulation host computer system concepts

The findings of a preliminary investigation by Southwest Research Institute (SwRI) in simulation host computer concepts is presented. It is designed to aid NASA in evaluating simulation technologies for use in spaceflight training. The focus of the investigation is on the next generation of space simulation systems that will be utilized in training personnel for Space Station Freedom operations. SwRI concludes that NASA should pursue a distributed simulation host computer system architecture for the Space Station Training Facility (SSTF) rather than a centralized mainframe based arrangement. A distributed system offers many advantages and is seen by SwRI as the only architecture that will allow NASA to achieve established functional goals and operational objectives over the life of the Space Station Freedom program. Several distributed, parallel computing systems are available today that offer real-time capabilities for time critical, man-in-the-loop simulation. These systems are flexible in terms of connectivity and configurability, and are easily scaled to meet increasing demands for more computing power

Medium Access Control Layer Implementation on Field Programmable Gate Array Board for Wireless Networks

Triple play services are playing an important role in modern telecommunications systems. Nowadays, more researchers are engaged in investigating the most efficient approaches to integrate these services at a reduced level of operation costs. Field Programmable Gate Array (FPGA) boards have been found as the most suitable platform to test new protocols as they offer high levels of flexibility and customization. This thesis focuses on implementing a framework for the Triple Play Time Division Multiple Access (TP-TDMA) protocol using the Xilinx FPGA Virtex-5 board. This flexible framework design offers network systems engineers a reconfigiirable platform for triple-play systems development. In this work, MicorBlaze is used to perform memory and connectivity tests aiming to ensure the establishment of the connectivity as well as board’s processor stability. Two different approaches are followed to achieve TP-TDMA implementa­tion: systematic and conceptual. In the systematic approach, a bottom-to-top design is chosen where four subsystems are built with various components. Each component is then tested individually to investigate its response. On the other hand, the concep­tual approach is designed with only two components, in which one of them is created with the help of Xilinx Integrated Software Environment (ISE) Core Generator. The system is integrated and then tested to check its overall response. In summary, the work of this thesis is divided into three sections. The first section presents a testing method for Virtex-5 board using MicroBlaze soft processor. The following two sections concentrate on implementing the TP-TDMA protocol on the board by using two design approaches: one based on designing each component from scratch, while the other one focuses more on the system’s broader picture

A critical analysis of research potential, challenges and future directives in industrial wireless sensor networks

In recent years, Industrial Wireless Sensor Networks (IWSNs) have emerged as an important research theme with applications spanning a wide range of industries including automation, monitoring, process control, feedback systems and automotive. Wide scope of IWSNs applications ranging from small production units, large oil and gas industries to nuclear fission control, enables a fast-paced research in this field. Though IWSNs offer advantages of low cost, flexibility, scalability, self-healing, easy deployment and reformation, yet they pose certain limitations on available potential and introduce challenges on multiple fronts due to their susceptibility to highly complex and uncertain industrial environments. In this paper a detailed discussion on design objectives, challenges and solutions, for IWSNs, are presented. A careful evaluation of industrial systems, deadlines and possible hazards in industrial atmosphere are discussed. The paper also presents a thorough review of the existing standards and industrial protocols and gives a critical evaluation of potential of these standards and protocols along with a detailed discussion on available hardware platforms, specific industrial energy harvesting techniques and their capabilities. The paper lists main service providers for IWSNs solutions and gives insight of future trends and research gaps in the field of IWSNs

A Survey of Medium Access Mechanisms for Providing QoS in Ad-Hoc Networks

n/

Controlo de acesso ao meio em comunicações veiculares de tempo-real

Despite several preventive measures, the number of roadway accidents is still very high, being considered even a problem of public health by some entities. This thesis has as global purpose of contributing to the reduction of that number of accidents, and consequent fatalities, by using safety-related applications that use communication among vehicles. In particular, the primary goal is guaranteeing that communication between users in vehicular environments is done with appropriate time bounds to transfer safety-critical information. In detail, it is studied how to manage the scheduling of message’s transmissions (medium access control - MAC), in order to define precisely who will communicate and when is the appropriate instant. The preferable situation where a communication infrastructure is present with full coverage (RSUs) is also studied, from which medium access control is defined precisely, and vehicles (OBUs) become aware of medium utilization. Also, sporadic situations (e.g., absence of RSUs) are studied in which the communication network is “ad hoc” and solely formed by the current vehicles. It is used the recently WAVE / IEEE 802.11p standard, specific for vehicular communications, and it is proposed a TDMA based solution, with appropriate coordination between RSUs in order to effectively disseminate a critical safety event. It is taken into account two different ways of choosing the instant for the initial broadcast, and both cases are compared. In case there is no infrastructure available, methods are derived to minimize communication medium access collisions, and to maximize the available bandwidth. The results reflect the total end-to-end delay, and show that adequate times are attained, and meet with the requisites for the type of applications being considered. Also, enhancements are obtained when using the alternate choice for the initial broadcast instant.Apesar de diversas medidas preventivas, o número de acidentes rodoviários continua a ser muito elevado, sendo mesmo considerado uma questão de saúde pública por algumas entidades. Esta tese tem como objetivo geral contribuir para a redução desse número de acidentes, e consequentes fatalidades, através da utilização de aplicações de segurança que envolvem comunicação entre veículos. Em particular, o objetivo principal é garantir que a comunicação entre utentes, em ambientes veiculares, seja efetuada com limites temporais apropriados à transferência de informações críticas. De forma mais detalhada, é estudada a gestão do escalonamento das transmissões (controlo de acesso ao meio – MAC) que irá definir quem vai comunicar e quando o pode fazer. São estudadas situações (desejadas) onde há uma infra-estrutura de comunicações com cobertura integral (RSUs), a partir da qual se faz a coordenação do acesso ao meio pelos veículos (OBUs), e situações (esporádicas, por ausência de RSU) em que a rede de comunicação é “ad hoc” e apenas constituída pelos veículos presentes. Utiliza-se a recente norma WAVE / IEEE 802.11p, específica para comunicações veiculares, e propõe-se uma solução baseada em TDMA, com coordenação apropriada entre RSUs para disseminação efetiva de um evento crítico de segurança. A escolha do instante para o broadcast inicial do evento de segurança também é tida em conta, e são comparados dois casos distintos. No caso da ausência de infraestrutura, derivam-se métodos para minimizar colisões no acesso ao meio de comunicação, e maximizar a largura de banda disponível. Os resultados refletem o atraso total end-to-end, mostrando tempos apropriados para os requisitos das aplicações em causa, e evidenciando melhorias aquando da escolha alternativa para o instante do broadcast inicial.Programa Doutoral em Engenharia Eletrotécnic

Token bus LAN performance : modeling and simulation

A simulation model based on CSIM, a process oriented simulated language, to analyze the performance of the Token Bus protocol is developed. Performance measures such as throughput, average delay and maximum delay per packet are presented. System performance is analyzed for different loads, number of stations, network lengths, different physical and logical distribution of the stations with packet length as a parameter. Previous studies were based on the delay-throughput analysis with no discussion on the effect of variation of the logical and physical distribution of the stations on the performance of the model which is done in the present thesis. The load is offered to the network in the form of a stream of data packets with uniformly distributed inter-arrival times. A comparison of the Token Bus model with that of a CSNIA/CD model shows that the physical distribution of the stations has a minimum effect on the performance of the model in the case of the Token Bus model but has a considerable effect on that of the CSMA/CD model