Inicio  /  Information  /  Vol: 14 Par: 5 (2023)  /  Artículo
ARTÍCULO
TITULO

Simulated Autonomous Driving Using Reinforcement Learning: A Comparative Study on Unity?s ML-Agents Framework

Yusef Savid    
Reza Mahmoudi    
Rytis Maskeliunas and Robertas Dama?evicius    

Resumen

Advancements in artificial intelligence are leading researchers to find use cases that were not as straightforward to solve in the past. The use case of simulated autonomous driving has been known as a notoriously difficult task to automate, but advancements in the field of reinforcement learning have made it possible to reach satisfactory results. In this paper, we explore the use of the Unity ML-Agents toolkit to train intelligent agents to navigate a racing track in a simulated environment using RL algorithms. The paper compares the performance of several different RL algorithms and configurations on the task of training kart agents to successfully traverse a racing track and identifies the most effective approach for training kart agents to navigate a racing track and avoid obstacles in that track. The best results, value loss of 0.0013 and a cumulative reward of 0.761, were yielded using the Proximal Policy Optimization algorithm. After successfully choosing a model and algorithm that can traverse the track with ease, different objects were added to the track and another model (which used behavioral cloning as a pre-training option) was trained to avoid such obstacles. The aforementioned model resulted in a value loss of 0.001 and a cumulative reward of 0.068, proving that behavioral cloning can help achieve satisfactory results where the in game agents are able to avoid obstacles more efficiently and complete the track with human-like performance, allowing for a deployment of intelligent agents in racing simulators.

 Artículos similares

       
 
Andrea Malgarini, Vittorio Franzese and Francesco Topputo    
This paper investigates the use of pulsar-based navigation for deep-space CubeSats. A novel approach for dealing with the onboard computation of navigational solutions and timekeeping capabilities of a spacecraft in a deep-space cruise is shown, and the ... ver más
Revista: Aerospace

 
Beini Zhang, Liping Li, Yetao Lyu, Shuguang Chen, Lin Xu and Guanhua Chen    
As an important part of the industrialization process, fully automated instrument monitoring and identification are experiencing an increasingly wide range of applications in industrial production, autonomous driving, and medical experimentation. However... ver más
Revista: Applied Sciences

 
Yong-Jin Shin, Moon Chan Kim, Kyuong-Wan Lee, Woo Seok Jin and Jin Wook Kim    
The maneuverability performance of a KCS with energy-saving devices was investigated. A bulb-type wavy rudder and an asymmetric pre-swirl stator were used as energy-saving devices because their use resulted in considerable efficiency gain. A validated si... ver más

 
Sergey Smirnov, Grigory Dolgikh, Igor Yaroshchuk, Alexander Lazaryuk, Alexandra Kosheleva, Alex Shvyrev, Alexander Pivovarov and Aleksandr Samchenko    
To study the features of resonant oscillations in the water column of the Peter the Great Gulf of the Sea of Japan, in situ measurements were carried out on its shelf, combined with numerical simulation of these processes. The observational data were obt... ver más

 
Saurabh Mittal, Robert L. Wittman, John Gibson, Josh Huffman and Hans Miller    
Autonomous and AI-enabled systems present a challenge for integration within the System of Sys-tems (SoS) paradigm. A full system of systems (SoS) testbed is necessary to verify the integrity of a given system and preserve the modularization and accounta... ver más
Revista: Information