Enhancing cooperation in wireless networks using different concepts of game theory

PhDOptimizing radio resource within a network and across cooperating heterogeneous networks is the focus of this thesis. Cooperation in a multi-network environment is tackled by investigating network selection mechanisms. These play an important role in ensuring quality of service for users in a multi-network environment. Churning of mobile users from one service provider to another is already common when people change contracts and in a heterogeneous communication environment, where mobile users have freedom to choose the best wireless service-real time selection is expected to become common feature. This real time selection impacts both the technical and the economic aspects of wireless network operations. Next generation wireless networks will enable a dynamic environment whereby the nodes of the same or even different network operator can interact and cooperate to improve their performance. Cooperation has emerged as a novel communication paradigm that can yield tremendous performance gains from the physical layer all the way up to the application layer. Game theory and in particular coalitional game theory is a highly suited mathematical tool for modelling cooperation between wireless networks and is investigated in this thesis. In this thesis, the churning behaviour of wireless service users is modelled by using evolutionary game theory in the context of WLAN access points and WiMAX networks. This approach illustrates how to improve the user perceived QoS in heterogeneous networks using a two-layered optimization. The top layer views the problem of prediction of the network that would be chosen by a user where the criteria are offered bit rate, price, mobility support and reputation. At the second level, conditional on the strategies chosen by the users, the network provider hypothetically, reconfigures the network, subject to the network constraints of bandwidth and acceptable SNR and optimizes the network coverage to support users who would otherwise not be serviced adequately. This forms an iterative cycle until a solution that optimizes the user satisfaction subject to the adjustments that the network provider can make to mitigate the binding constraints, is found and applied to the real network. The evolutionary equilibrium, which is used to 3 compute the average number of users choosing each wireless service, is taken as the solution. This thesis also proposes a fair and practical cooperation framework in which the base stations belonging to the same network provider cooperate, to serve each other‘s customers. How this cooperation can potentially increase their aggregate payoffs through efficient utilization of resources is shown for the case of dynamic frequency allocation. This cooperation framework needs to intelligently determine the cooperating partner and provide a rational basis for sharing aggregate payoff between the cooperative partners for the stability of the coalition. The optimum cooperation strategy, which involves the allocations of the channels to mobile customers, can be obtained as solutions of linear programming optimizations

SCALABLE AND EFFICIENT VERTICAL HANDOVER DECISION ALGORITHMS IN VEHICULAR NETWORK CONTEXTS

A finales de los años noventa, y al comienzo del nuevo milenio, las redes inalámbricas han evolucionado bastante, pasando de ser sólo una tecnología prometedora para convertirse en un requisito para las actividades cotidianas en las sociedades desarrolladas. La infraestructura de transporte también ha evolucionado, ofreciendo comunicación a bordo para mejorar la seguridad vial y el acceso a contenidos de información y entretenimiento. Los requisitos de los usuarios finales se han hecho dependientes de la tecnología, lo que significa que sus necesidades de conectividad han aumentado debido a los diversos requisitos de las aplicaciones que se ejecutan en sus dispositivos móviles, tales como tabletas, teléfonos inteligentes, ordenadores portátiles o incluso ordenadores de abordo (On-Board Units (OBUs)) dentro de los vehículos. Para cumplir con dichos requisitos de conectividad, y teniendo en cuenta las diferentes redes inalámbricas disponibles, es necesario adoptar técnicas de Vertical Handover (VHO) para cambiar de red de forma transparente y sin necesidad de intervención del usuario. El objetivo de esta tesis es desarrollar algoritmos de decisión (Vertical Handover Decision Algorithms (VHDAs)) eficientes y escalables, optimizados para el contexto de las redes vehiculares. En ese sentido se ha propuesto, desarrollado y probado diferentes algoritmos de decisión basados en la infraestructura disponible en las actuales, y probablemente en las futuras, redes inalámbricas y redes vehiculares. Para ello se han combinado diferentes técnicas, métodos computacionales y modelos matemáticos, con el fin de garantizar una conectividad apropiada, y realizando el handover hacia las redes más adecuadas de manera a cumplir tanto con los requisitos de los usuarios como los requisitos de las aplicaciones. Con el fin de evaluar el contexto, se han utilizado diferentes herramientas para obtener información variada, como la disponibilidad de la red, el estado de la red, la geolocalizaciónMárquez Barja, JM. (2012). SCALABLE AND EFFICIENT VERTICAL HANDOVER DECISION ALGORITHMS IN VEHICULAR NETWORK CONTEXTS [Tesis doctoral no publicada]. Universitat Politècnica de València. https://doi.org/10.4995/Thesis/10251/17869Palanci

A Genetic Algorithm-based Framework for Soft Handoff Optimization in Wireless Networks

In this paper, a genetic algorithm (GA)-based approach is used to evaluate the probability of successful handoff in heterogeneous wireless networks (HWNs) so as to increase capacity and network performance. The traditional handoff schemes are prone to ping pong and corner effects and developing an optimized handoff scheme for seamless, faster, and less power consuming handoff decision is challenging. The GA scheme can effectively optimize soft handoff decision by selecting the best fit network for the mobile terminal (MT) considering quality of service (QoS) requirements, network parameters and user’s preference in terms of cost of different attachment points for the MT. The robustness and ability to determine global optima for any function using crossover and mutation operations makes GA a promising solution. The developed optimization framework was simulated in Matrix Laboratory (MATLAB) software using MATLAB’s optima tool and results show that an optimal MT attachment point is the one with the highest handoff success probability value which determines direction for successful handoff in HWN environment. The system maintained a 90%  with 4 channels and more while a 75% was obtained even at high traffic intensity

Prise de décision de handover vertical pour la gestion de mobilité dans les réseaux hétérogènes sans fil

L évolution des technologies réseaux sans fil, des terminaux mobiles ainsi que des contenus et des services créent des environnements hétérogènes de plus en plus complexes. Dans ce contexte, un compromis entre la mobilité, la transparence et la performance apparaît. Des utilisateurs mobiles, ayant différents profils et préférences, voudraient être toujours connectés au meilleur réseau à tout moment, sans avoir à se soucier des différentes transitions entre réseaux hétérogènes. Face à cette complexité, il parait nécessaire de proposer de nouvelles approches afin de rendre ces systèmes plus autonomes et de rendre les décisions de handover vertical plus efficaces. Cette thèse se concentre sur la gestion de mobilité verticale, plus précisément sur la prise de décision de handover vertical dans un environnement de réseaux hétérogènes sans fil. Après l identification des différents paramètres de prise de décision et l analyse de l état de l art relié à la gestion de la mobilité verticale, nous avons proposé un système de réputation qui permet de réduire les délais de prise de décision. La réputation d un réseau est introduite comme une nouvelle métrique de prise de décision qui peut être recueillie à partir des expériences précédentes des utilisateurs sur ce réseau. Nous montrons que la réputation est une métrique efficace qui permet l anticipation du handover et accélère la prise de décision. Bien que l objectif principal soit de garantir la meilleure qualité de service et l utilisation optimale des ressources radios, les aspects économiques doivent également être considérés, y compris la minimisation des coûts pour les utilisateurs et la maximisation des revenus pour les fournisseurs de services ou les opérateurs. Nous proposons alors, dans la deuxième partie de la thèse, un mécanisme de prise de décision basé sur la théorie des jeux. Ce dernier permet la maximisation des utilités des réseaux et des utilisateurs. Dans cette solution, chaque réseau disponible joue un jeu de Stackelberg avec un ensemble d utilisateurs, tandis que les utilisateurs jouent un jeu de Nash entre eux pour partager les ressources radios limitées. Un point d équilibre de Nash, qui maximise l utilité de l utilisateur et les revenus des fournisseurs de services, est trouvé et utilisé pour le contrôle d admission et la prise de décision de handover vertical. Dans la troisième partie de cette thèse, nous proposons et discutons deux différentes solutions architecturales sur lesquelles nos mécanismes de prise de décision proposés peuvent être intégrés. La première architecture proposée est basée sur la norme IEEE 802.21 à laquelle nous proposons certaines extensions. La seconde architecture proposée est basée sur un niveau de contrôle composé de deux couches de virtualisation. La virtualisation est assurée via des agents capables de faire un raisonnement et de prendre des décisions pour le compte d entités physiques qu ils représentent au sein du système. Cette architecture permet une plus grande flexibilitéMobility management over heterogeneous wireless networks is becoming a major interest area as new technologies and services continue to proliferate within the wireless networking market. In this context, seamless mobility is considered to be crucial for ubiquitous computing. Service providers aim to increase the revenue and to improve users satisfaction. However there are still many technical and architectural challenges to overcome before achieving the required interoperability and coexistence of heterogeneous wireless access networks. Indeed, the context of wireless networks is offering multiple and heterogeneous technologies (e.g. 2G to 4G, WiFi, Wimax, TETRA,...). On the one hand, this rich environment allows users to take profit from different capacities and coverage characteristics. Indeed, this diversity can provide users with high flexibility and allow them to seamlessly connect at any time and any where to the access technology that best fits their requirements. Additionally, cooperation between these different technologies can provide higher efficiency in the usage of the scarce wireless resources offering more economic systems for network providers. On the other hand, the heterogeneity of technologies and architectures and the multiplication of networks and service providers creates a complex environment where cooperation becomes challenging at different levels including and not limited to mobility management, radio resource provisioning, Quality of Service and security guarantees. This thesis is focusing on mobility management and mainly on decision making for Vertical handover within heterogeneous wireless network environments. After the analysis of the related state of the art, we first propose a reputation based approach that allows fast vertical handover decision making. A decision making scheme is then built on that approach. Network s reputation, is a new metric that can be gathered from previous users experiences in the networks. We show that it is an efficient construct to speed up the vertical handover decision making thanks to anticipation functionalities. While the main objective remains guaranteeing the best Quality of Service and optimal radio resource utilization, economical aspects have also to be considered including cost minimization for users and revenue maximization for network providers. For this aim, we propose, in the second part of the thesis, a game theoretic based scheme that allows maximizing benefits for both networks and users. In this solution, each available network plays a Stackelberg game with a finite set of users, while users are playing a Nash game among themselves to share the limited radio resources. A Nash equilibrium point, that maximizes the user s utility and the service provider revenue, is found and used for admission control and vertical handover decision making. The analyses of the optimal bandwidth/prices and the revenue at the equilibrium point show that there are some possible policies to use according to user s requirements in terms of QoS and to network capacities. For instance, we pointed out that networks having same capacities and different reputation values should charge users with different prices which makes reputation management very important to attract users and maximize networks revenue. In the third part of this thesis, we provide and discuss two different architectural and implementation solutions on which our proposed vertical handover decision mechanisms can be integrated. The first proposed architecture is a centralized one. It is based on the IEEE 802.21 standard to which some extensions are proposed. The second proposed architecture is distributed. It is based on an overlay control level composed of two virtualization layers able to make reasoning on behalf of physical entities within the system. This architecture allows higher flexibility especially for loosely coupled interconnected networksEVRY-INT (912282302) / SudocSudocFranceF

Cell Selection Mechanism Based on Q-learning Environment in Femtocell LTE-A Networks

Universal mobile networks require enhanced capability and appropriate quality of service (QoS) and experience (QoE). To achieve this, Long Term Evolution (LTE) system operators have intensively deployed femtocells (HeNBs) along with macrocells (eNBs) to offer user equipment (UE) with optimal capacity coverage and best quality of service. To achieve the requirement of QoS in the handover stage among macrocells and femtocells we need a seamless cell selection mechanism. Cell selection requirements are considered a difficult task in femtocell-based networks and effective cell selection procedures are essential to reduce the ping-pong phenomenon and to minimize needless handovers. In this study, we propose a seamless cell selection scheme for macrocell-femtocell LTE systems, based on the Q-learning environment. A novel cell selection mechanism is proposed for high-density femtocell network topologies to evaluate the target base station in the handover stage. We used the LTE-Sim simulator to implement and evaluate the cell selection procedures. The simulation results were encouraging: a decrease in the control signaling rate and packet loss ratio were observed and at the same time the system throughput was increased

A QoE-driven Vertical Handover Management Framework for Multimedia Services over Wireless Networks

With advances in wireless technology and mobile devices, the number of mobile users using multimedia services has increased significantly in recent years. Mobile devices can be connected and roam on heterogeneous wireless networks. The IEEE 802.21 group has designed a Media Independent Handover (MIH) standard to ensure seamless Vertical Handover (VHO) in heterogeneous networks. However, the standard currently depends on features of the network (e.g. the type of network and available bandwidth) to achieve seamless VHO. This approach is limited, as it does not consider how a Quality of Experience (QoE) can be provided and maintained for customers when delivering multimedia services in heterogeneous wireless networks. The aim of the project is to develop a novel QoE-driven VHO management framework for providing and maintaining an appropriate level of QoE of multimedia services as the mobile user’s actual requirements in heterogeneous wireless networks. A QoE-driven VHO algorithm is more efficient for maintaining this acceptable QoE of multimedia services than traditional network-based or QoS-based VHO algorithms. There are three main contributions during this project. Firstly, A thorough evaluation of the performance of voice and video services via Skype was carried out in terms of the QoE metric (i.e. MOS). This work identified the impact of video content and packet loss on the QoE metric for voice and video communication services over wireless networks. Secondly, a QoE-driven VHO algorithm was developed to provide and maintain an acceptable QoE of mobile video services for mobile users. Compared to a traditional network-based VHO algorithm, this algorithm can provide better QoE and maintain acceptable QoE. Lastly, the User-centric QoE-driven (UCQoE) VHO framework to provide satisfactory QoE of multimedia services according to the mobile user’s requirements. The framework allows users to set their own preferences (e.g. quality-guarantee or cost-free) and carry out VHO operations accordingly. The evaluation showed that the proposed framework can provide a better QoE for delivered video services than QoS-based and network-based VHO algorithms. Furthermore, the proposed framework can be used to avoid unnecessary cost of mobile data when the option of cost-free is preferred by the user. During this project, three international conference papers had been published and a journal paper has been submitted to IEEE Transactions on Mobile Computing. The main contribution-UCQoE VHO management framework can be developed to maintain QoE of all mobile services in the future

Network reputation-based quality optimization of video delivery in heterogeneous wireless environments

The mass-market adoption of high-end mobile devices and increasing amount of video traffic has led the mobile operators to adopt various solutions to help them cope with the explosion of mobile broadband data traffic, while ensuring high Quality of Service (QoS) levels to their services. Deploying small-cell base stations within the existing macro-cellular networks and offloading traffic from the large macro-cells to the small cells is seen as a promising solution to increase capacity and improve network performance at low cost. Parallel use of diverse technologies is also employed. The result is a heterogeneous network environment (HetNets), part of the next generation network deployments. In this context, this thesis makes a step forward towards the “Always Best Experience” paradigm, which considers mobile users seamlessly roaming in the HetNets environment. Supporting ubiquitous connectivity and enabling very good quality of rich mobile services anywhere and anytime is highly challenging, mostly due to the heterogeneity of the selection criteria, such as: application requirements (e.g., voice, video, data, etc.); different device types and with various capabilities (e.g., smartphones, netbooks, laptops, etc.); multiple overlapping networks using diverse technologies (e.g., Wireless Local Area Networks (IEEE 802.11), Cellular Networks Long Term Evolution (LTE), etc.) and different user preferences. In fact, the mobile users are facing a complex decision when they need to dynamically select the best value network to connect to in order to get the “Always Best Experience”. This thesis presents three major contributions to solve the problem described above: 1) The Location-based Network Prediction mechanism in heterogeneous wireless networks (LNP) provides a shortlist of best available networks to the mobile user based on his location, history record and routing plan; 2) Reputation-oriented Access Network Selection mechanism (RANS) selects the best reputation network from the available networks for the mobile user based on the best trade-off between QoS, energy consumptions and monetary cost. The network reputation is defined based on previous user-network interaction, and consequent user experience with the network. 3) Network Reputation-based Quality Optimization of Video Delivery in heterogeneous networks (NRQOVD) makes use of a reputation mechanism to enhance the video content quality via multipath delivery or delivery adaptation

Seamless Application Handover Across Radio Access Networks (SAHARA Net)

The explosion in mobile and data traffic in the last decade has led to a rapid proliferation in wireless networks. A plethora of wireless access technologies are available today each with a different offering. Some offer high data rates within a restricted coverage area such as 802.11 hotspots. Others, offer lower data rates but with a much wider coverage such as UMTS. This diversity can be harnessed in a way that creates a ubiquitous communications platform for the user. This is the premise of the heterogeneous networks vision/architecture: an environment where disparate technologies cooperate together and complement each other. However, there are various technical challenges in the way of such convergence. The first obstacle is enabling communication between disparate mobility protocols. Once this is achieved, the diversity of networks in itself poses a challenge for the user as to which network he connects to. This thesis answers the first question by reviewing the low-latency handover literature to identify the most credible solutions. The general consensus amongst researchers in the field has been to bridge the gap between the network and link layers so that IP protocols can react quickly to link changes. To answer the second question, this thesis defines a framework to assess handover decision algorithms based on application performance. The merit of the handover algorithm’s decision is measured by how well the application performs after handover. In order to facilitate this process, a simulation module was created within the NS2 network simulator that allows mobile devices to collect network measurements and feed that information into a decision algorithm to decide whether or not handover should be triggered. Through this evaluation process, a number of issues emerged as possible stumbling blocks. The first such issue is the inconsistency between local network conditions measured at the Access Point or Base Station, and the end to end conditions experienced by the user’s application. Another issue is the algorithm’s adaptability to user and application preferences. Personal users might be cost aware opting to trade off quality for a lower cost in certain circumstances. The Abstract IV handover algorithm must be able to accommodate such scenarios. Furthermore, algorithms must be able to adapt their decisions according to the application’s requirements. Using application profiles with thresholds or utility functions can result in better decisions than using absolute values. If an application is satisfied with the current network conditions, it might not be in its benefit to move to a different network even if it offered better conditions. In fact, it might suffer as a result of possible handover disruptions