Inicio  /  Applied Sciences  /  Vol: 12 Par: 9 (2022)  /  Artículo
ARTÍCULO
TITULO

MARL-Based Dual Reward Model on Segmented Actions for Multiple Mobile Robots in Automated Warehouse Environment

Hyeoksoo Lee    
Jiwoo Hong and Jongpil Jeong    

Resumen

The simple and labor-intensive tasks of workers on the job site are rapidly becoming digital. In the work environment of logistics warehouses and manufacturing plants, moving goods to a designated place is a typical labor-intensive task for workers. These tasks are rapidly undergoing digital transformation by leveraging mobile robots in automated warehouses. In this paper, we studied and tested realistically necessary conditions to operate mobile robots in an automated warehouse. In particular, considering conditions for operating multiple mobile robots in an automated warehouse, we added more complex actions and various routes and proposed a method for improving sparse reward problems when learning paths in a warehouse with reinforcement learning. Multi-Agent Reinforcement Learning (MARL) experiments were conducted with multiple mobile robots in an automated warehouse simulation environment, and it was confirmed that the proposed reward model method makes learning start earlier even there is a sparse reward problem and learning progress was maintained stably. We expect this study to help us understand the actual operation of mobile robots in an automated warehouse further.

 Artículos similares

       
 
Daniela Szpaczynska, Marian Janusz Lopatka and Piotr Krogul    
The elastic-damping properties of the rubber track structure can have a significant impact on the running gear performance of lightweight mobile robots. Taking these properties into account is particularly important for modeling obstacle negotiation and ... ver más
Revista: Applied Sciences

 
Kay Smarsly, Kosmas Dragos, Jan Stührenberg and Mathias Worm    
With the advancements in information, communication, and sensing technologies, structural health monitoring (SHM) has matured into a substantial pillar of infrastructure maintenance. In particular, wireless sensor networks have gradually been incorporate... ver más
Revista: Infrastructures

 
Liyana Wijayathunga, Alexander Rassau and Douglas Chai    
The capabilities of autonomous mobile robotic systems have been steadily improving due to recent advancements in computer science, engineering, and related disciplines such as cognitive science. In controlled environments, robots have achieved relatively... ver más
Revista: Applied Sciences

 
Caterina Feletti, Carlo Mereghetti and Beatrice Palano    
In the field of robotics, a lot of theoretical models have been settled to formalize multi-agent systems and design distributed algorithms for autonomous robots. Among the most investigated problems for such systems, the study of the Uniform Circle Forma... ver más
Revista: Applied Sciences

 
Thuy Duy Truong, Nguyen Huu Loc Khuu, Quoc Dien Le, Tran Thanh Cong Vu, Hoa Binh Tran and Tuong Quan Vo    
Research and development on a global scale have been conducted on overhead hoist transportation systems (OHTSs) in recent years. The majority of these systems are utilized in manufacturing facilities that are either semiautomated or fully automated. By u... ver más
Revista: Applied Sciences