Inicio  /  Algorithms  /  Vol: 17 Par: 2 (2024)  /  Artículo
ARTÍCULO
TITULO

Transfer Reinforcement Learning for Combinatorial Optimization Problems

Gleice Kelly Barbosa Souza    
Samara Oliveira Silva Santos    
André Luiz Carvalho Ottoni    
Marcos Santos Oliveira    
Daniela Carine Ramires Oliveira and Erivelton Geraldo Nepomuceno    

Resumen

Reinforcement learning is an important technique in various fields, particularly in automated machine learning for reinforcement learning (AutoRL). The integration of transfer learning (TL) with AutoRL in combinatorial optimization is an area that requires further research. This paper employs both AutoRL and TL to effectively tackle combinatorial optimization challenges, specifically the asymmetric traveling salesman problem (ATSP) and the sequential ordering problem (SOP). A statistical analysis was conducted to assess the impact of TL on the aforementioned problems. Furthermore, the Auto_TL_RL algorithm was introduced as a novel contribution, combining the AutoRL and TL methodologies. Empirical findings strongly support the effectiveness of this integration, resulting in solutions that were significantly more efficient than conventional techniques, with an 85.7% improvement in the preliminary analysis results. Additionally, the computational time was reduced in 13 instances (i.e., in 92.8% of the simulated problems). The TL-integrated model outperformed the optimal benchmarks, demonstrating its superior convergence. The Auto_TL_RL algorithm design allows for smooth transitions between the ATSP and SOP domains. In a comprehensive evaluation, Auto_TL_RL significantly outperformed traditional methodologies in 78% of the instances analyzed.

 Artículos similares

       
 
Rafet Durgut, Mehmet Emin Aydin and Abdur Rakib    
In the past two decades, metaheuristic optimisation algorithms (MOAs) have been increasingly popular, particularly in logistic, science, and engineering problems. The fundamental characteristics of such algorithms are that they are dependent on a paramet... ver más
Revista: Algorithms

 
Ji-Hyeon Yoo, Ho-Jin Jung, Jang-Hyeon Kim, Dae-Han Sim and Han-Ul Yoon    
Geduldspiele cubes (also known as patience cubes in English) are interesting problems to solve with robotic systems on the basis of machine learning approaches. Generally, highly dexterous hand and finger movement is required to solve them. In this paper... ver más
Revista: Applied Sciences

 
Rytis Maskeliunas, Robertas Damasevicius, Andrius Paulauskas, Maria Gabriella Ceravolo, Marina Charalambous, Maria Kambanaros, Eliada Pampoulou, Francesco Barbabella, Arianna Poli and Carlos V. Carvalho    
This paper describes a serious game based on a knowledge transfer model using deep reinforcement learning, with an aim to improve the caretakers? knowledge and abilities in post-stroke care. The iTrain game was designed to improve caregiver knowledge and... ver más
Revista: Information

 
Chang-Bae Gil and Jee-Hyong Lee    
Manufacturing sites encounter various scheduling problems, which must be dealt with to efficiently manufacture products and reduce costs. With the development of smart factory technology, many elements at manufacturing sites have become unmanned and more... ver más
Revista: Applied Sciences

 
Baris Eren Perk and Gokhan Inalhan    
To control unmanned aerial systems, we rarely have a perfect system model. Safe and aggressive planning is also challenging for nonlinear and under-actuated systems. Expert pilots, however, demonstrate maneuvers that are deemed at the edge of plane envel... ver más
Revista: Aerospace