Methodologies for Analyzing Equilibria in Wireless Games

Under certain assumptions in terms of information and models, equilibria correspond to possible stable outcomes in conflicting or cooperative scenarios where rational entities interact. For wireless engineers, it is of paramount importance to be able to predict and even ensure such states at which the network will effectively operate. In this article, we provide non-exhaustive methodologies for characterizing equilibria in wireless games in terms of existence, uniqueness, selection, and efficiency.Comment: To appear in IEEE Signal Processing Magazine, Sep. 200

Pay for Intersection Priority: A Free Market Mechanism for Connected Vehicles

The rapid development and deployment of vehicle technologies offer opportunities to re-think the way traffic is managed. This paper capitalizes on vehicle connectivity and proposes an economic instrument and corresponding cooperative framework for allocating priority at intersections. The framework is compatible with a variety of existing intersection control approaches. Similar to free markets, our framework allows vehicles to trade their time based on their (disclosed) value of time. We design the framework based on transferable utility games, where winners (time buyers) pay losers (time sellers) in each game. We conduct simulation experiments of both isolated intersections and an arterial setting. The results show that the proposed approach benefits the majority of users when compared to other mechanisms both ones that employ an economic instrument and ones that do not. We also show that it drives travelers to estimate their value of time correctly, and it naturally dissuades travelers from attempting to cheat

Traffic Management System for the combined optimal routing, scheduling and motion planning of self-driving vehicles inside reserved smart road networks

The topic discussed in this thesis belongs to the field of automation of transport systems, which has grown in importance in the last decade, both in the innovation field (where different automation technologies have been gradually introduced in different sectors of road transport, in the promising view of making it more efficient, safer, and greener) and in the research field (where different research activities and publications have addressed the problem under different points of view). More in detail, this work addresses the problem of autonomous vehicles coordina tion inside reserved road networks by proposing a novel Traffic Management System (TMS) for the combined routing, scheduling and motion planning of the vehicles. To this aim, the network is assumed to have a modular structure, which results from a certain number of roads and intersections assembled together. The way in which roads and intersections are put together defines the network layout. Within such a system architecture, the main tasks addressed by the TMS are: (1) at the higher level, the optimal routing of the vehicles in the network, exploiting the available information coming from the vehicles and the various elements of the network; (2) at a lower level, the modeling and optimization of the vehicle trajectories and speeds for each road and for each intersection in the network; (3) the coordination between the vehicles and the elements of the network, to ensure a combined approach that considers, in a recursive way, the scheduling and motion planning of the vehicles in the various elements when solving the routing problem. In particular, the routing and the scheduling and motion planning problems are formulated as MILP optimization problems, aiming to maximize the performance of the entire network (routing model) and the performance of its single elements - roads and intersections (scheduling and motion planning model) while guaranteeing the requested level of safety and comfort for the passengers. Besides, one of the main features of the proposed approach consists of the integration of the scheduling decisions and the motion planning computation by means of constraints regarding the speed limit, the acceleration, and the so-called safety dynamic constraints on incompatible positions of conflicting vehicles. In particular, thanks to these last constraints, it is possible to consider the real space occupancy of the vehicles avoiding collisions. After the theoretical discussion of the proposed TMS and of its components and models, the thesis presents and discusses the results of different numerical experiments, aimed at testing the TMS in some specific scenarios. In particular, the routing model and the scheduling and motion planning model are tested on different scenarios, which demonstrate the effectiveness and the validity of such approach in performing the addressed tasks, also compared with more traditional methods. Finally, the computational effort needed for the problem solution, which is a key element to take into account, is discussed both for the road element and the intersection element

Improving Traffic Safety and Efficiency by Adaptive Signal Control Systems Based on Deep Reinforcement Learning

As one of the most important Active Traffic Management strategies, Adaptive Traffic Signal Control (ATSC) helps improve traffic operation of signalized arterials and urban roads by adjusting the signal timing to accommodate real-time traffic conditions. Recently, with the rapid development of artificial intelligence, many researchers have employed deep reinforcement learning (DRL) algorithms to develop ATSCs. However, most of them are not practice-ready. The reasons are two-fold: first, they are not developed based on real-world traffic dynamics and most of them require the complete information of the entire traffic system. Second, their impact on traffic safety is always a concern by researchers and practitioners but remains unclear. Aiming at making the DRL-based ATSC more implementable, existing traffic detection systems on arterials were reviewed and investigated to provide high-quality data feeds to ATSCs. Specifically, a machine-learning frameworks were developed to improve the quality of and pedestrian and bicyclist\u27s count data. Then, to evaluate the effectiveness of DRL-based ATSC on the real-world traffic dynamics, a decentralized network-level ATSC using multi-agent DRL was developed and evaluated in a simulated real-world network. The evaluation results confirmed that the proposed ATSC outperforms the actuated traffic signals in the field in terms of travel time reduction. To address the potential safety issue of DRL based ATSC, an ATSC algorithm optimizing simultaneously both traffic efficiency and safety was proposed based on multi-objective DRL. The developed ATSC was tested in a simulated real-world intersection and it successfully improved traffic safety without deteriorating efficiency. In conclusion, the proposed ATSCs are capable of effectively controlling real-world traffic and benefiting both traffic efficiency and safety

HARL: A Novel Hierachical Adversary Reinforcement Learning for Automoumous Intersection Management

As an emerging technology, Connected Autonomous Vehicles (CAVs) are believed to have the ability to move through intersections in a faster and safer manner, through effective Vehicle-to-Everything (V2X) communication and global observation. Autonomous intersection management is a key path to efficient crossing at intersections, which reduces unnecessary slowdowns and stops through adaptive decision process of each CAV, enabling fuller utilization of the intersection space. Distributed reinforcement learning (DRL) offers a flexible, end-to-end model for AIM, adapting for many intersection scenarios. While DRL is prone to collisions as the actions of multiple sides in the complicated interactions are sampled from a generic policy, restricting the application of DRL in realistic scenario. To address this, we propose a hierarchical RL framework where models at different levels vary in receptive scope, action step length, and feedback period of reward. The upper layer model accelerate CAVs to prevent them from being clashed, while the lower layer model adjust the trends from upper layer model to avoid the change of mobile state causing new conflicts. And the real action of CAV at each step is co-determined by the trends from both levels, forming a real-time balance in the adversarial process. The proposed model is proven effective in the experiment undertaken in a complicated intersection with 4 branches and 4 lanes each branch, and show better performance compared with baselines

Power Control in Two-Tier Femtocell Networks

In a two tier cellular network -- comprised of a central macrocell underlaid with shorter range femtocell hotspots -- cross-tier interference limits overall capacity with universal frequency reuse. To quantify near-far effects with universal frequency reuse, this paper derives a fundamental relation providing the largest feasible cellular Signal-to-Interference-Plus-Noise Ratio (SINR), given any set of feasible femtocell SINRs. We provide a link budget analysis which enables simple and accurate performance insights in a two-tier network. A distributed utility-based SINR adaptation at femtocells is proposed in order to alleviate cross-tier interference at the macrocell from cochannel femtocells. The Foschini-Miljanic (FM) algorithm is a special case of the adaptation. Each femtocell maximizes their individual utility consisting of a SINR based reward less an incurred cost (interference to the macrocell). Numerical results show greater than 30% improvement in mean femtocell SINRs relative to FM. In the event that cross-tier interference prevents a cellular user from obtaining its SINR target, an algorithm is proposed that reduces transmission powers of the strongest femtocell interferers. The algorithm ensures that a cellular user achieves its SINR target even with 100 femtocells/cell-site, and requires a worst case SINR reduction of only 16% at femtocells. These results motivate design of power control schemes requiring minimal network overhead in two-tier networks with shared spectrum.Comment: 29 pages, 10 figures, Revised and resubmitted to the IEEE Transactions on Wireless Communication

Reliability and Efficiency of Vehicular Network Applications

The DSRC/WAVE initiative is forecast to enable a plethora of applications, classified in two broad types of safety and non-safety applications. In the former type, the reliability performance is of tremendous prominence while, in the latter case, the efficiency of information dissemination is the key driving factor. For safety applications, we adopt a systematic approach to analytically investigate the reliability of the communication system in a symbiotic relationship with the host system comprising a vehicular traffic system and radio propagation environment. To this aim, the¬ interference factor is identified as the central element of the symbiotic relationship. Our approach to the investigation of interference and its impacts on the communication reliability departs from previous studies by the degree of realism incorporated in the host system model. In one dimension, realistic traffic models are developed to describe the vehicular traffic behaviour. In a second dimension, a realistic radio propagation model is employed to capture the unique signal propagation aspects of the host system. We address the case of non-safety applications by proposing a generic framework as a capstone architecture for the development of new applications and the efficiency evaluation of existing ones. This framework, while being independent from networking technology, enables accurate characterization of the various information dissemination tasks that a node performs in cooperation with others. As the central element of the framework, we propose a game theoretic model to describe the interaction of meeting nodes aiming to exchange information of mutual or social interests. An adaptive mechanism is designed to enable a mobile node to measure the social significance of various information topics, which is then used by the node to prioritize the forwarding of information objects