Resource Allocation Management of D2D Communications in Cellular Networks

To improve the system capacity, spectral performance, and energy efficiency, stringent requirements for increasing reliability, and decreasing delays have been intended for next-generation wireless networks. Device-to-device (D2D) communication is a promising technique in the fifth-generation (5G) wireless communications to enhance spectral efficiency, reduce latency and energy efficiency. In D2D communication, two wireless devices in close proximity can communicate with each other directly without pass through the Base Station (BS) or Core Network (CN). In this proposal, we identify compromises and challenges of integrating D2D communications into cellular networks and propose potential solutions. To maximize gains from such integration, resource management, and interference avoidance are key factors. Thus, it is important to properly allocate resources to guarantee reliability, data rate, and increase the capacity in cellular networks. In this thesis, we address the problem of resource allocation in D2D communication underlaying cellular networks. We provide a detailed review of the resource allocation problem of D2D communications. My Ph.D research will tackle several issues in order to alleviate the interference caused by a D2D user-equipment (DUE) and cellular-userequipment (CUE) in uplink multi-cell networks, the intra-cell and inter-cell interference are considered in this work to improve performance for D2D communication underlaying cellular networks. The thesis consists of four main results. First, the preliminary research proposes a resource allocation scheme to formulate the resource allocation problem through optimization of the utility function, which eventually reflects the system performance concerning network throughput. The formulated optimization problem of maximizing network throughput while guaranteeing predefined service levels to cellular users is non-convex and hence intractable. Thus, the original problem is broken down into two stages. The first stage is the admission control of D2D users while the second one is the power control for each admissible D2D pair and its reuse partner. Second, we proposed a spectrum allocation framework based on Reinforcement Learning (RL) for joint mode selection, channel assignment, and power control in D2D communication. The objective is to maximize the overall throughput of the network while ensuring the quality of transmission and guaranteeing low latency requirements of D2D communications. The proposed algorithm uses reinforcement learning (RL) based on Markov Decision Process (MDP) with a proposed new reward function to learn the policy by interacting with the D2D environment. An Actor-Critic Reinforcement Learning (AC-RL) approach is then used to solve the resource management problem. The simulation results show that our learning method performs well, can greatly improve the sum rate of D2D links, and converges quickly, compared with the algorithms in the literature. Third, a joint channel assignment, power allocation and resource allocation algorithm is proposed. The algorithm designed to allow multiple DUEs to reuse the same CUE channel for D2D communications underlaying multi-cell cellular networks with the consideration of the inter-cell and intra-cell interferences. Obviously, under satisfying the QoS requirements of both DUEs and CUEs, the more the number of the allowed accessing DUEs on a single CUE channel is, the higher the spectrum efficiency is, and the higher the network throughput can be achieved. Meanwhile, implementing resource allocation strategies at D2D communications allows to effectively mitigate the interference caused by the D2D communications at both cellular and D2D users. In this part, the formulated optimization problem of maximizing network throughput while guaranteeing predefined service levels to cellular users. Therefore, we propose an algorithm that solves this nonlinear mixed-integer problem in three steps wherein the first step, subchannel assignment is carried out, the second one is the power allocation, while the third step of the proposed algorithm is the resource allocation for multiple D2D pairs based on genetic algorithm. The simulation results verify the effectiveness of our proposed algorithm. Fourth, integrating D2D communications and Femtocells in Heterogeneous Networks (HetNets) is a promising technology for future cellular networks. Which have attracted a lot of attention since it can significantly improve the capacity, energy efficiency and spectral performance of next-generation wireless networks (5G). D2D communication and femtocell are introduced as underlays to the cellular systems by reusing the cellular channels to maximize the overall throughput in the network. In this part, the problem is formulated to maximize the network throughput under the QoS constraints for CUEs, DUEs and FUEs. This problem is a mixed-integer non-linear problem that is difficult to be solved directly. To solve this problem, we propose a joint channel selection, power control, and resource allocation scheme to maximize the sum rate of the cellular network system. The simulation results show that the proposed scheme can effectively reduce the computational complexity and improve the overall system throughput compared with existing well-known methods