Inicio  /  Applied Sciences  /  Vol: 13 Par: 3 (2023)  /  Artículo
ARTÍCULO
TITULO

Dynamic Computation Offloading with Deep Reinforcement Learning in Edge Network

Yang Bai    
Xiaocui Li    
Xinfan Wu and Zhangbing Zhou    

Resumen

With the booming proliferation of user requests in the Internet of Things (IoT) network, Edge Computing (EC) is emerging as a promising paradigm for the provision of flexible and reliable services. Considering the resource constraints of IoT devices, for some delay-aware user requests, a heavy-workload IoT device may not respond on time. EC has sparked a popular wave of offloading user requests to edge servers at the edge of the network. The orchestration of user-requested offloading schemes creates a remarkable challenge regarding the delay in user requests and the energy consumption of IoT devices in edge networks. To solve this challenge, we propose a dynamic computation offloading strategy consisting of the following: (i) we propose the concept of intermediate nodes, which can minimize the delay in user requests and the energy consumption of the current tasks handled by IoT devices by dynamically combining task-offloading and service migration strategies; (ii) based on the workload of the current network, the intermediate node selection problem is modeled as a multi-dimensional Markov Decision Process (MDP) space, and a deep reinforcement learning algorithm is implemented to reduce the large MDP space and make a fast decision. Experimental results show that this strategy is superior to the existing baseline methods to reduce delays in user requests and the energy consumption of IoT devices.

 Artículos similares

       
 
Bin Li, Caijie Yang and Zhongzhen Yang    
In response to the evolving challenges of the integration and combination of multiple container terminal operations under berth water depth constraints, the multi-terminal dynamic and continuous berth allocation problem emerges as a critical issue. Based... ver más

 
Yuancheng Li and Yongtai Qin    
In today?s business environment, reducing costs is crucial due to the variety of Internet of Things (IoT) devices and security infrastructure. However, applying security measures to complex business scenarios can lead to performance degradation, making i... ver más
Revista: Information

 
Artem T. Turov, Yuri A. Konstantinov, Fedor L. Barkov, Dmitry A. Korobko, Igor O. Zolotovskii, Cesar A. Lopez-Mercado and Andrei A. Fotiadi    
Moving differential and dynamic window moving averaging are simple and well-known signal processing algorithms. However, the most common methods of obtaining sufficient signal-to-noise ratios in distributed acoustic sensing use expensive and precise equi... ver más
Revista: Algorithms

 
Higuatzi Moreno and Alexander Schaum    
Batteries are complex systems involving spatially distributed microscopic mechanisms on different time scales whose adequate interplay is essential to ensure a desired functioning. Describing these phenomena yields nonlinearly coupled partial differentia... ver más
Revista: Algorithms

 
Xiaocheng Wang, Hui Zhao and Li Li    
Collective behaviors in nature and human societies have been intensively studied in recent decades. The Vicsek model is one of the typical models that explain self-ordered particle systems well. In the original Vicsek model, the neighbor strategy takes a... ver más
Revista: Applied Sciences