Delay QoS Provisioning and Optimal Resource Allocation for Wireless Networks

Recent years have witnessed a significant growth in wireless communication and networking due to the exponential growth in mobile applications and smart devices, fueling unprecedented increase in both mobile data traffic and energy demand. Among such data traffic, real-time data transmissions in wireless systems require certain quality of service (QoS) constraints e.g., in terms of delay, buffer overflow or packet drop/loss probabilities, so that acceptable performance levels can be guaranteed for the end-users, especially in delay sensitive scenarios, such as live video transmission, interactive video (e.g., teleconferencing), and mobile online gaming. With this motivation, statistical queuing constraints are considered in this thesis, imposed as limitations on the decay rate of buffer overflow probabilities. In particular, the throughput and energy efficiency of different types of wireless network models are analyzed under QoS constraints, and optimal resource allocation algorithms are proposed to maximize the throughput or minimize the delay. In the first part of the thesis, the throughput and energy efficiency analysis for hybrid automatic repeat request (HARQ) protocols are conducted under QoS constraints. Approximations are employed for small QoS exponent values in order to obtain closed-form expressions for the throughput and energy efficiency metrics. Also, the impact of random arrivals, deadline constraints, outage probability and QoS constraints are studied. For the same system setting, the throughput of HARQ system is also analyzed using a recurrence approach, which provides more accurate results for any value of the QoS exponent. Similarly, random arrival models and deadline constraints are considered, and these results are further extended to the finite-blocklength coding regime. Next, cooperative relay networks are considered under QoS constraints. Specifically, the throughput performance in the two-hop relay channel, two-way relay channel, and multi-source multi-destination relay networks is analyzed. Finite-blocklength codes are considered for the two-hop relay channel, and optimization over the error probabilities is investigated. For the multi-source multi-destination relay network model, the throughput for both cases of with and without CSI at the transmitter sides is studied. When there is perfect CSI at the transmitter, transmission rates can be varied according to instantaneous channel conditions. When CSI is not available at the transmitter side, transmissions are performed at fixed rates, and decoding failures lead to retransmission requests via an ARQ protocol. Following the analysis of cooperative networks, the performance of both half-duplex and full-duplex operations is studied for the two-way multiple input multiple output (MIMO) system under QoS constraints. In full-duplex mode, the self-interference inflicted on the reception of a user due to simultaneous transmissions from the same user is taken into account. In this setting, the system throughput is formulated by considering the sum of the effective capacities of the users in both half-duplex and full-duplex modes. The low signal to noise ratio (SNR) regime is considered and the optimal transmission/power-allocation strategies are characterized by identifying the optimal input covariance matrices. Next, mode selection and resource allocation for device-to-device (D2D) cellular networks are studied. As the starting point, ransmission mode selection and resource allocation are analyzed for a time-division multiplexed (TDM) cellular network with one cellular user, one base station, and a pair of D2D users under rate and QoS constraints. For a more complicated setting with multiple cellular and D2D users, two joint mode selection and resource allocation algorithms are proposed. In the first algorithm, the channel allocation problem is formulated as a maximum-weight matching problem, which can be solved by employing the Hungarian algorithm. In the second algorithm, the problem is divided into three subproblems, namely user partition, power allocation and channel assignment, and a novel three-step method is proposed by combining the algorithms designed for the three subproblems. In the final part of the thesis, resource allocation algorithms are investigated for content delivery over wireless networks. Three different systems are considered. Initially, a caching algorithm is designed, which minimizes the average delay of a single-cell network. The proposed algorithm is applicable in settings with very general popularity models, with no assumptions on how file popularity varies among different users, and this algorithm is further extended to a more general setting, in which the system parameters and the distributions of channel fading change over time. Next, for D2D cellular networks operating under deadline constraints, a scheduling algorithm is designed, which manages mode selection, channel allocation and power maximization with acceptable complexity. This proposed scheduling algorithm is designed based on the convex delay cost method for a D2D cellular network with deadline constraints in an OFDMA setting. Power optimization algorithms are proposed for all possible modes, based on our utility definition. Finally, a two-step intercell interference (ICI)-aware scheduling algorithm is proposed for cloud radio access networks (C-RANs), which performs user grouping and resource allocation with the goal of minimizing delay violation probability. A novel user grouping algorithm is developed for the user grouping step, which controls the interference among the users in the same group, and the channel assignment problem is formulated as a maximum-weight matching problem in the second step, which can be solved using standard algorithms in graph theory

Machine Learning for Unmanned Aerial System (UAS) Networking

Fueled by the advancement of 5G new radio (5G NR), rapid development has occurred in many fields. Compared with the conventional approaches, beamforming and network slicing enable 5G NR to have ten times decrease in latency, connection density, and experienced throughput than 4G long term evolution (4G LTE). These advantages pave the way for the evolution of Cyber-physical Systems (CPS) on a large scale. The reduction of consumption, the advancement of control engineering, and the simplification of Unmanned Aircraft System (UAS) enable the UAS networking deployment on a large scale to become feasible. The UAS networking can finish multiple complex missions simultaneously. However, the limitations of the conventional approaches are still a big challenge to make a trade-off between the massive management and efficient networking on a large scale. With 5G NR and machine learning, in this dissertation, my contributions can be summarized as the following: I proposed a novel Optimized Ad-hoc On-demand Distance Vector (OAODV) routing protocol to improve the throughput of Intra UAS networking. The novel routing protocol can reduce the system overhead and be efficient. To improve the security, I proposed a blockchain scheme to mitigate the malicious basestations for cellular connected UAS networking and a proof-of-traffic (PoT) to improve the efficiency of blockchain for UAS networking on a large scale. Inspired by the biological cell paradigm, I proposed the cell wall routing protocols for heterogeneous UAS networking. With 5G NR, the inter connections between UAS networking can strengthen the throughput and elasticity of UAS networking. With machine learning, the routing schedulings for intra- and inter- UAS networking can enhance the throughput of UAS networking on a large scale. The inter UAS networking can achieve the max-min throughput globally edge coloring. I leveraged the upper and lower bound to accelerate the optimization of edge coloring. This dissertation paves a way regarding UAS networking in the integration of CPS and machine learning. The UAS networking can achieve outstanding performance in a decentralized architecture. Concurrently, this dissertation gives insights into UAS networking on a large scale. These are fundamental to integrating UAS and National Aerial System (NAS), critical to aviation in the operated and unmanned fields. The dissertation provides novel approaches for the promotion of UAS networking on a large scale. The proposed approaches extend the state-of-the-art of UAS networking in a decentralized architecture. All the alterations can contribute to the establishment of UAS networking with CPS

Radio resource management for V2X in cellular systems

The thesis focuses on the provision of cellular vehicle-to-everything (V2X) communications, which have attracted great interest for 5G due to the potential of improving traffic safety and enabling new services related to intelligent transportation systems. These types of services have strict requirements on reliability, access availability, and end-to-end (E2E) latency. V2X requires advanced network management techniques that must be developed based on the characteristics of the networks and traffic requirements. The integration of the Sidelink (SL), which enables the direct communication between vehicles (i.e., vehicle-to-vehicle (V2V)) without passing through the base station into cellular networks is a promising solution for enhancing the performance of V2X in cellular systems. In this thesis, we addressed some of the challenges arising from the integration of V2V communication in cellular systems and validated the potential of this technology by providing appropriate resource management solutions. Our main contributions have been in the context of radio access network slicing, mode selection, and radio resource allocation mechanisms. With regard to the first research direction that focuses on the RAN slicing management, a novel strategy based on offline Q-learning and softmax decision-making has been proposed as an enhanced solution to determine the adequate split of resources between a slice for eMBB communications and a slice for V2X. Then, starting from the outcome of the off-line Q-learning algorithm, a low-complexity heuristic strategy has been proposed to achieve further improvements in the use of resources. The proposed solution has been compared against proportional and fixed reference schemes. The extensive performance assessment have revealed the ability of the proposed algorithms to improve network performance compared to the reference schemes, especially in terms of resource utilization, throughput, latency and outage probability. Regarding the second research direction that focuses on the mode selection, two different mode selection solutions referred to as MSSB and MS-RBRS strategies have been proposed for V2V communication over a cellular network. The MSSB strategy decides when it is appropriate to use one or the other mode, i.e. sidelink or cellular, for the involved vehicles, taking into account the quality of the links between V2V users, the available resources, and the network traffic load situation. Moreover, the MS-RBRS strategy not only selects the appropriate mode of operation but also decides efficiently the amount of resources needed by V2V links in each mode and allows reusing RBs between different SL users while guaranteeing the minimum signal to interference requirements. The conducted simulations have revealed that the MS-RBRS and MSSB strategies are beneficial in terms of throughput, radio resource utilization, outage probability and latency under different offered loads comparing to the reference scheme. Last, we have focused on the resource allocation problem including jointly mode selection and radio resource scheduling. For the mode selection, a novel mode selection has been presented to decide when it is appropriate to select sidelink mode and use a distributed approach for radio resource allocation or cellular mode and use a centralized radio resource allocation. It takes into account three aspects: the quality of the links between V2V users, the available resources, and the latency. As for the radio resource allocation, the proposed approach includes a distributed radio resource allocation for sidelink mode and a centralized radio resource allocation for cellular mode. The proposed strategy supports dynamic assignments by allowing transmission over mini-slots. A simulation-based analysis has shown that the proposed strategies improved the network performance in terms of latency of V2V services, packet success rate and resource utilization under different network loads.La tesis se centra en la provisión de comunicaciones para vehículos sistemas celulares (V2X: Vehicle to Everything), que han atraído un gran interés en el contexto de 5G debido a su potencial de mejorar la seguridad del tráfico y habilitar nuevos servicios relacionados con los sistemas inteligentes de transporte. Estos tipos de servicios tienen requisitos estrictos en términos fiabilidad, disponibilidad de acceso y latencia de extremo a extremo (E2E). Para ello, V2X requiere técnicas avanzadas de gestión de red que deben desarrollarse en función de las características de las redes y los requisitos de tráfico. La integración del Sidelink (SL), que permite la comunicación directa entre vehículos (es decir, vehículo a vehículo (V2V)) sin pasar por la estación base de las redes celulares, es una solución prometedora para mejorar el rendimiento de V2X en el sistema celular. En esta tesis, abordamos algunos de los desafíos derivados de la integración de la comunicación V2V en los sistemas celulares y validamos el potencial de esta tecnología al proporcionar soluciones de gestión de recursos adecuadas. Nuestras principales contribuciones han sido en el contexto del denominado "slicing" de redes de acceso radio, la selección de modo y los mecanismos de asignación de recursos radio. Respecto a la primera dirección de investigación que se centra en la gestión del RAN slicing, se ha propuesto una estrategia novedosa basada en Q-learning y toma de decisiones softmax como una solución para determinar la división adecuada de recursos entre un slice para comunicaciones eMBB y un slice para V2X. Luego, a partir del resultado del algoritmo de Q-learning, se ha propuesto una estrategia heurística de baja complejidad para lograr mejoras adicionales en el uso de los recursos. La solución propuesta se ha comparado con esquemas de referencia proporcionales y fijos. La evaluación ha revelado la capacidad de los algoritmos propuestos para mejorar el rendimiento de la red en comparación con los esquemas de referencia, especialmente en términos de utilización de recursos, rendimiento, y latencia . Con respecto a la segunda dirección de investigación que se centra en la selección de modo, se han propuesto dos soluciones de diferentes llamadas estrategias MSSB y MS-RBRS para la comunicación V2V a través de una red celular. La estrategia MSSB decide cuándo es apropiado usar el modo SL o el modo celular, para los vehículos involucrados, teniendo en cuenta la calidad de los enlaces entre los usuarios de V2V, los recursos disponibles y la situación de carga de tráfico de la red. Además, la estrategia MS-RBRS no solo selecciona el modo de operación apropiado, sino que también decide eficientemente la cantidad de recursos que los enlaces V2V necesitan en cada modo, y permite que los RB se reutilicen entre diferentes usuarios de SL al tiempo que garantiza requisitos mínimos de señal a interferencia. Se ha presentado un análisis basado en simulación para evaluar el desempeño de las estrategias propuestas. Finalmente, nos hemos centrado en el problema conjunto de la selección de modo y la asignación de recursos de radio. Para la selección de modo, se ha presentado una nueva estrategia para decidir cuándo es apropiado seleccionar el modo SL y usar un enfoque distribuido para la asignación de recursos de radio o el modo celular y usar la asignación de recursos de radio centralizada. Tiene en cuenta tres aspectos: la calidad de los enlaces entre los usuarios de V2V, los recursos disponibles y la latencia. En términos de asignación de recursos de radio, el enfoque propuesto incluye una asignación de recursos de radio distribuida para el modo SL y una asignación de recursos de radio centralizada para el modo celular. La estrategia propuesta admite asignaciones dinámicas al permitir la transmisión a través de mini-slots. Los resultados muestran las mejoras en términos de latencia, tasa de recepción y la utilización de recursos bajo diferentes cargas de red.Postprint (published version

Secrecy-Optimized Resource Allocation for Device-to-Device Communication Undelaying Cellular Networks

L’objectif principal de l’introduction de la communication de périphérique-à-périphérique «device-to-device» (D2D) sous-jacente aux systèmes de communication sans fil de cinquième génération (5G), est d’augmenter l’efficacité spectrale (ES). Cependant, la communication D2D sous-jacente aux réseaux cellulaires peut entraîner une dégradation des performances causée par des co-interférences de canal sévères entre les liaisons cellulaires et D2D. De plus, en raison de la complexité du contrôle et de la gestion, les connexions directes entre les appareils à proximité sont vulnérables. En conséquence, la communication D2D n’est pas robuste contre les menaces de sécurité et l’écoute clandestine. Pourtant, les co-interférences de canal peuvent être adoptées pour aider les utilisateurs cellulaires (UC) et les paires D2D afin d’empêcher l’écoute clandestine. Dans cette thèse, nous étudions différents scénarios de problèmes d’allocation de ressources en utilisant le concept de sécurité de couche physique «physical layer security» (PLS) pour la communication D2D sous-jacente aux réseaux cellulaires, tout en satisfaisant les exigences minimales de qualité de service (QoS) des liaisons cellulaires et D2D. Dans le cas où PLS est pris en compte, l’interférence peut aider à réduire l’écoute clandestine. Premièrement, nous formulons un scénario d’allocation de ressources dans lequel chaque bloc de ressources (RB) temps-fréquence de multiplexage par répartition orthogonale en fréquence (OFDM) peut être partagé par une seule CU et une paire D2D dans un réseau unicellulaire. Le problème formulé est réduit au problème de correspondance tridimensionnelle, qui est généralement NP-difficile, et la solution optimale peut être obtenue par des méthodes compliquées, telles que la recherche par force brute et/ou l’algorithme de branchement et de liaison qui ont une complexité de calcul exponentielle. Nous proposons donc une méta-heuristique basée sur l’algorithme de recherche tabou «Tabu Search» (TS) avec une complexité de calcul réduite pour trouver globalement la solution d’allocation de ressources radio quasi-optimale.----------ABSTRACT: The primary goal of introducing device-to-device (D2D) communication underlying fifthgeneration (5G) wireless communication systems is to increase spectral efficiency (ES). However, D2D communication underlying cellular networks can lead to performance degradation caused by severe co-channel interference between cellular and D2D links. In addition, due to the complexity of control and management, direct connections between nearby devices are vulnerable. Thus, D2D communication is not robust against security threats and eavesdropping. On the other hand, the co-channel interference can be adopted to help cellular users (CUs) and D2D pairs to prevent eavesdropping. In this thesis, we investigate different resource allocation problem scenarios using the physical layer security (PLS) concept for the D2D communication underlying cellular networks, while satisfying the minimum quality of service (QoS) requirements of cellular and D2D link. If the PLS is taken into account, the interference can help reduce eavesdropping. First, we formulate a resource allocation scenario in which each orthogonal frequency-division multiplexing (OFDM) time-frequency resource block (RB) can be shared by one single CU and one D2D pair in a single-cell network. The formulated problem is reduced to the threedimensional matching problem, which is generally NP-hard, and the optimal solution can be obtained through the complicated methods, such as brute-force search and/or branch-andbound algorithm that have exponential computational complexity. We, therefore, propose a meta-heuristic based on Tabu Search (TS) algorithm with a reduced computational complexity to globally find the near-optimal radio resource allocation solution

Spatial spectrum reuse in heterogeneous wireless networks: interference management and access control

Διαχρονικά, η κυρίαρχη σχεδιαστική επιλογή για την βελτίωση της φασματικής απόδοσης των ασύρματων δικτύων κινητών επικοινωνιών είναι η χωρική επαναχρησιμοποίηση φάσματος, η δυνατότητα δηλαδή να επαναχρησιμοποιείται το ίδιο κομμάτι φάσματος πολλές φορές στο χώρο με την προϋπόθεση ότι διατηρούνται χαμηλά τα επίπεδα των παρεμβολών. Στα σύγχρονα δίκτυα κινητών επικοινωνιών μελετώνται δύο νέοι τρόποι χωρικής επαναχρησιμοποίησης φάσματος: α) η ανάπτυξη φεμτοκυψελών (femtocells), η ανάπτυξη δηλαδή μικρών κυψελών για εξυπηρέτηση κυρίως εσωτερικών χώρων στην ευρύτερη περιοχή κάλυψης μία κύριας κυψέλης, και β) η ενεργοποίηση επικοινωνιών συσκευής-σε-συσκευή (Device-to-Device – D2D), απευθείας δηλαδή επικοινωνιών χωρίς την διαμεσολάβηση του σταθμού βάσης της κυψέλης. Σκοπός της παρούσας διατριβής είναι να μελετηθούν και να αντιμετωπιστούν οι προκλήσεις που προκύπτουν από την εισαγωγή φεμτοκυψελών και την υιοθέτηση επικοινωνιών συσκευής-σε-συσκευή σε κυψελωτά δίκτυα προτυποποιημένα από την 3GPP (3rd Generation Partnership Project). Πιο συγκεκριμένα, μελετώνται τα προβλήματα της διαχείρισης του φάσματος και των παρεμβολών, καθώς και θέματα πρόσβασης στο φάσμα για Long Term Evolution (LTE) και LTE-Advanced (LTE-A) δίκτυα με φεμτοκυψέλες και με επικοινωνίες συσκευής-σε- συσκευή. Για το σκοπό αυτό, αρχικά μελετήθηκαν τα LTE/LTE-A κυψελωτά δίκτυα ως προς το φυσικό επίπεδο, την αρχιτεκτονική και τις παρεμβολές, αποτυπώνοντας και την τρέχουσα κατάσταση στο τομέα της προτυποποίησης των φεμτοκυψελών και των επικοινωνιών συσκευής-σε-συσκευή. Ακολούθησε μια συγκριτική μελέτη μηχανισμών διαχείρισης παρεμβολών σε κανάλια ελέγχου ενός LTE/LTE-A δικτύου με φεμτοκυψέλες και ένας καινοτόμος μηχανισμός ελέγχου ισχύος για μεταδόσεις φεμτοκυψελών, βασισμένος στην ποιότητα εμπειρίας στο τελικό χρήστη. Η δουλειά αυτή άνοιξε νέους ερευνητικούς ορίζοντες, όπου το επίπεδο ικανοποίησης του τελικού χρήστη παίζει ενεργό ρόλο στη διαχείριση του δικτύου και την παροχή των υπηρεσιών. Παρόλα αυτά, η περεταίρω μελέτη προς την κατεύθυνση αυτή είναι εκτός του σκοπού της παρούσας διατριβής. Στην συνέχεια, το κύριο βάρος της μελέτης μεταφέρθηκε στο πρόβλημα της διαχείρισης του φάσματος και των παρεμβολών στο πολύ πιο δυναμικό περιβάλλον ενός κυψελωτού δικτύου όπου επιτρέπονται οι επικοινωνίες συσκευής-σε-συσκευή. Σε πρώτη φάση, θεωρήθηκε ένα σύνολο από ζεύγη συσκευών που επικοινωνούν μεταξύ τους με επικοινωνίες συσκευής-σε-συσκευή και προτάθηκε ένας μηχανισμός συλλογής πληροφορίας παρεμβολών και ένα σχήμα ανάθεσης πόρων βασισμένο στη θεωρία γράφων. Το κύριο αποτέλεσμα της μελέτης αυτής ήταν πως αν και υψηλά επίπεδα χωρικής επαναχρησιμοποίησης μπορούν να επιτευχθούν, η συλλογή και η επεξεργασία πληροφορίας παρεμβολών είναι ένα πολύπλοκο πρόβλημα το οποίο απαιτεί και επιπλέον πόρους σηματοδοσίας. Έτσι, προτάθηκε και αναλύθηκε μίας λύση βασισμένη στον ανταγωνισμό. Πρακτικά οι χρήστες των επικοινωνιών συσκευής-σε-συσκευή εφαρμόζουν ένα σχήμα ανταγωνισμού όμοιο με αυτό που χρησιμοποιείται στα δίκτυα WiFi (Wireless Fidelity), προσαρμοσμένο όμως στο φυσικό επίπεδο των LTE/LTE-A δικτύων. Μαθηματική ανάλυση του σχήματος έδειξε ισχυρή εξάρτηση των επιδόσεων από το πλήθος των χρηστών που ανταγωνίζονται για το φάσμα. Σε μια προσπάθεια περιορισμού του πλήθους των ανταγωνιζόμενων χρηστών μόνο σε αυτούς που βρίσκονται σε γειτνίαση, και άρα μονό σε αυτούς που η άμεση επικοινωνία τους είναι εφικτή, μελετήθηκε το πρόβλημα της ανίχνευσης γειτονικής συσκευής. Με βάση τις τρέχουσες προδιαγραφές της 3GPP, για την επίλυση του προβλήματος ανίχνευσης γειτονικής συσκευής, μία συσκευή είτε ανακοινώνει με μετάδοση περιοδικών μηνυμάτων την παρουσία της σε μια συγκεκριμένη περιοχή, είτε αιτείται από κάποια συγκεκριμένη συσκευή πληροφορία ανίχνευσης. Υιοθετώντας τη δεύτερη περίπτωση, προτάθηκαν βελτιώσεις στο LTE/LTE-A δίκτυο πρόσβασης ώστε να επιτρέπεται η ανάθεση φάσματος για μεταδόσεις ανίχνευσης γειτονικών συσκευών. Παράλληλα, δεδομένου ότι και για τις μεταδόσεις αυτές απαιτείται η κατανάλωση φάσματος, σχεδιάστηκε και αξιολογήθηκε μία λύση βασισμένη στη χωρική επαναχρησιμοποίηση φάσματος. Το βασικό συμπέρασμα ήταν ότι λόγω των χαμηλών απαιτήσεων ποιότητας των μηνυμάτων ανίχνευσης, κάτω από ορισμένες συνθήκες πυκνότητας του δικτύου, μπορεί να επιτραπεί η χωρική επαναχρησιμοποίηση του κυψελωτού φάσματος για μεταδόσεις ανίχνευσης συσκευής.Historically, the spatial spectrum reuse has been the most efficient approach for improving cellular system capacity. Based on this observation, the 3rd Generation Partnership Project (3GPP) has proposed new spatial spectrum reuse schemes, towards fulfilling the International Mobile Telecommunications-Advanced (IMT-Advanced) requirements for the 4G networks. In this direction, a major shift is realized from wide-range cells with high transmit power (macrocells) to low-power small-sized cells (femtocells), while a lot of effort is allocated to the spatial spectrum reuse by enabling Device-to-Device (D2D) communications, i.e., direct communications in a cellular network, without the intervention of the base station. The scope of this thesis is to deal with challenges arising from the introduction of femtocells and D2D communications in cellular networks standardized by 3GPP Release 8 and beyond, i.e., Long Term Evolution (LTE) and LTE-Advanced (LTE-A). More specifically, for the case of femtocells, the interference management problem is studied, while for the D2D communications the radio resource management and the spectrum access challenges are addressed. First, a comprehensive description of the physical layer and architecture of the LTE/LTE-A networks is provided, and the current standardization efforts for the introduction of femtocells and D2D communications are described. Subsequently, different control channel interference management schemes for femtocell-overlaid LTE/LTE-A networks are studied, while an innovative power control scheme for the femtocell downlink transmissions is proposed, utilizing the end user’s quality of experience. This work brings to the surface new research challenges, where the end user’s satisfaction level plays an active role in network management and service provisioning. However, the further investigation of these challenges is out of this thesis’ scope. Considering the much more dynamic environment defined by the D2D communications in a cellular network, the major research effort is then shifted to the resource and interference management problem for D2D communications. Assuming a predefined set of D2D pairs in a cellular network, an interference information collection mechanism and a D2D resource allocation scheme, based on the graph-coloring theory, are proposed. Evaluation results showed that even high spatial spectrum reuse levels can be achieved, the interference collection and processing problem is quite complex, while additional signaling is needed. Taking this into account, a contention-based approach is proposed. Under this approach, the D2D devices compete for accessing the spectrum following a procedure similar with that used in WiFi (Wireless Fidelity) networks. Performance analysis shows that the efficiency of the proposed scheme depends on the number of competing devices. Towards restricting the number of competing devices, only to those that are in proximity and, thus, in valid positions for D2D communication, the device discovery problem is studied. According to the 3GPP standardization efforts, the solution of the device discovery problem requires frequent transmission of discovery signals from each device, either announcing its presence in a specific area, or requesting discovery information from a target device. Adopting the second option, enhancements in the 3GPP standardized access network are proposed, enabling a resource request / allocation procedure for device discovery transmissions. In parallel, a spatial spectrum reuse scheme is designed and evaluated, as an effort to reduce the consumption of radio resources for discovery transmissions. Analytical and simulation results show that, under certain conditions for the network density, a number of discovery transmissions can be enabled in a multi-cellular network even if no interference information is available

Reinforcement learning based resource management for 6G-enabled mIoT with hypergraph interference model

For the future 6G-enabled massive Internet of Things (mIoT), how to effectively manage spectrum resources to support huge data traffic under the large-scale overlapping caused by the dense deployment of massive devices is the imperative challenge. In this paper, a novel hypergraph interference model is designed, and two reinforcement learning (RL)-based resource management algorithms in the 6G-enabled mIoT are proposed to enhance the network throughput and avoid overlapping interference. Then, based on the hypergraph interference model, the resource management problem of execution network throughput maximization is theoretically formulated under large-scale overlapping interference scenarios. To handle this problem, we convert it into a Markov decision process (MDP) model and then deal with this MDP model through the advantage actor-critic (A2C)-based resource management algorithm and asynchronous advantage actor-critic (A3C)-based resource management algorithm, which aim to maximize network throughput of the spectrum resource allocation among massive devices. The simulation results verify that the proposed algorithms can not only avoid large-scale overlapping interference but also improve the network throughput