Inicio  /  Future Internet  /  Vol: 9 Núm: 4 Par: Decembe (2017)  /  Artículo
ARTÍCULO
TITULO

Throughput-Aware Cooperative Reinforcement Learning for Adaptive Resource Allocation in Device-to-Device Communication

Muhidul Islam Khan    
Muhammad Mahtab Alam    
Yannick Le Moullec and Elias Yaacoub    

Resumen

Device-to-device (D2D) communication is an essential feature for the future cellular networks as it increases spectrum efficiency by reusing resources between cellular and D2D users. However, the performance of the overall system can degrade if there is no proper control over interferences produced by the D2D users. Efficient resource allocation among D2D User equipments (UE) in a cellular network is desirable since it helps to provide a suitable interference management system. In this paper, we propose a cooperative reinforcement learning algorithm for adaptive resource allocation, which contributes to improving system throughput. In order to avoid selfish devices, which try to increase the throughput independently, we consider cooperation between devices as promising approach to significantly improve the overall system throughput. We impose cooperation by sharing the value function/learned policies between devices and incorporating a neighboring factor. We incorporate the set of states with the appropriate number of system-defined variables, which increases the observation space and consequently improves the accuracy of the learning algorithm. Finally, we compare our work with existing distributed reinforcement learning and random allocation of resources. Simulation results show that the proposed resource allocation algorithm outperforms both existing methods while varying the number of D2D users and transmission power in terms of overall system throughput, as well as D2D throughput by proper Resource block (RB)-power level combination with fairness measure and improving the Quality of service (QoS) by efficient controlling of the interference level.

 Artículos similares

       
 
Roman Odarchenko, Maksim Iavich, Giorgi Iashvili, Solomiia Fedushko and Yuriy Syerov    
It is clear that 5G networks have already become integral to our present. However, a significant issue lies in the fact that current 5G communication systems are incapable of fully ensuring the required quality of service and the security of transmitted ... ver más

 
Vasileios Cheimaras, Athanasios Trigkas, Panagiotis Papageorgas, Dimitrios Piromalis and Emmanouil Sofianopoulos    
During a ship evacuation, many people panic as they do not know the direction that leads to the emergency muster station. Moreover, sometimes passengers get crowded in corridors or stairs, so they cannot save their lives. This paper proposes an IoT-enabl... ver más
Revista: Future Internet

 
Keerthana John, Sherin Rahman, Bidur Kafle, Matthias Weiss, Klaus Hansen, Mohamed Elchalakani, Nilupa Udawatta, M. Reza Hosseini and Riyadh Al-Ameri    
Revista: Buildings

 
Kai Hoth, Tom Steffen, Béla Wiegel, Amine Youssfi, Davood Babazadeh, Marcus Venzke, Christian Becker, Kathrin Fischer and Volker Turau    
The intermittent energy supply from distributed resources and the coupling of different energy and application sectors play an important role for future energy systems. Novel operational concepts require the use of widespread and reliable Information and... ver más
Revista: Infrastructures

 
Robert Miehe, Lorena Buckreus, Steffen Kiemel, Alexander Sauer and Thomas Bauernhansl    
A sustainable design of production systems is essential for the future viability of the economy. In this context, biointelligent production systems (BIS) are currently considered one of the most innovative paths for a comprehensive reorientation of exist... ver más