Inicio  /  Applied Sciences  /  Vol: 13 Par: 3 (2023)  /  Artículo
ARTÍCULO
TITULO

Dynamic Computation Offloading with Deep Reinforcement Learning in Edge Network

Yang Bai    
Xiaocui Li    
Xinfan Wu and Zhangbing Zhou    

Resumen

With the booming proliferation of user requests in the Internet of Things (IoT) network, Edge Computing (EC) is emerging as a promising paradigm for the provision of flexible and reliable services. Considering the resource constraints of IoT devices, for some delay-aware user requests, a heavy-workload IoT device may not respond on time. EC has sparked a popular wave of offloading user requests to edge servers at the edge of the network. The orchestration of user-requested offloading schemes creates a remarkable challenge regarding the delay in user requests and the energy consumption of IoT devices in edge networks. To solve this challenge, we propose a dynamic computation offloading strategy consisting of the following: (i) we propose the concept of intermediate nodes, which can minimize the delay in user requests and the energy consumption of the current tasks handled by IoT devices by dynamically combining task-offloading and service migration strategies; (ii) based on the workload of the current network, the intermediate node selection problem is modeled as a multi-dimensional Markov Decision Process (MDP) space, and a deep reinforcement learning algorithm is implemented to reduce the large MDP space and make a fast decision. Experimental results show that this strategy is superior to the existing baseline methods to reduce delays in user requests and the energy consumption of IoT devices.

 Artículos similares

       
 
Bin Li, Caijie Yang and Zhongzhen Yang    
In response to the evolving challenges of the integration and combination of multiple container terminal operations under berth water depth constraints, the multi-terminal dynamic and continuous berth allocation problem emerges as a critical issue. Based... ver más

 
Wen Chen, Kaijun Ren, Yongchui Zhang, Yuyao Liu, Yu Chen, Lina Ma and Silin Chen    
The sound speed profile (SSP) is a necessary prerequisite for acoustic field computation and underwater target localization and monitoring. Due to the dynamic nature of the ocean, the reconstruction of SSPs with surface characteristics is a big challenge... ver más

 
Zhou Yu, Zhangyong Jin, Kaichuang Wang, Chunyue Zhang and Jiawang Chen    
This paper aims to explore the current state of research on submarine cable burial machines and proposes a novel mechanical burial machine design employing a chain-type structure based on a combination of theoretical considerations and practical requirem... ver más

 
Artem T. Turov, Yuri A. Konstantinov, Fedor L. Barkov, Dmitry A. Korobko, Igor O. Zolotovskii, Cesar A. Lopez-Mercado and Andrei A. Fotiadi    
Moving differential and dynamic window moving averaging are simple and well-known signal processing algorithms. However, the most common methods of obtaining sufficient signal-to-noise ratios in distributed acoustic sensing use expensive and precise equi... ver más
Revista: Algorithms

 
Higuatzi Moreno and Alexander Schaum    
Batteries are complex systems involving spatially distributed microscopic mechanisms on different time scales whose adequate interplay is essential to ensure a desired functioning. Describing these phenomena yields nonlinearly coupled partial differentia... ver más
Revista: Algorithms