Redirigiendo al acceso original de articulo en 19 segundos...
ARTÍCULO
TITULO

APPROACH TO BUILDING A GLOBAL MOBILE AGENT WAY BASED ON Q-LEARNING

Vitalii Martovytskyi    
Oleksandr Ivaniuk    

Resumen

Today, the problem of navigation of autonomous mobile systems in a space where disturbances are possible is urgent. The task of finding a route for a mobile robot is a complex and non-trivial task. At the moment, there are many algorithms that allow you to solve such problems in accordance with the specified criteria for building a route. Most of these algorithms are modifications of "basic" path planning methods that are optimized for specific conditions. The subject of research in the article is the process of building a global path for a mobile agent. The purpose of the work is to create an algorithm for planning the route of autonomous mobile systems in space using the Q-learning algorithm. The following tasks are solved in the article: development of an approach to training and support of a reinforcement learning algorithm for building a global path of a mobile agent; testing the agent's ability to find a path in environments that are not in the training set. The following methods are used: graph theory, queuing theory, Markov decision-making process theory and mathematical programming methods. The research is based on scientific articles and other materials from foreign conferences and archives in the field of machine learning, deep learning and deep reinforcement learning. The following results were obtained: an approach was formulated to construct the global path of a mobile agent based on the accumulated data in the process of interaction with the external environment. The environment rewards these actions and the agent continues to carry them out. This approach will allow this method to be applied to a wide range of situations and devices. Conclusions: This approach allows accumulating the knowledge of the outside world for further decision-making when planning a route where the robot can acquire the skill of self-learning, studying and training like a human, and finding the path from the initial state to the target state in an unknown environment. In the modern world, the use of robots and autonomous systems is spreading, designed to replace or facilitate human labor, make it safer and speed it up. Adaptive autonomous path finding algorithms are very important in many robotics applications. Thus, navigation tasks with limited information are relevant today, since this is the main task that the agent solves, and one of the tasks that are part of the robot during operation.

 Artículos similares

       
 
Junbing Liu, Maohui Zheng, Jinwei Gao, Xinshu Wang, Hu Zhang and Simin Jiang    
This article addresses the challenge of simulating rainstorm waterlogging in urban-scale areas where reliable drainage pipe network data are often lacking. Although methods have been developed to tackle this issue, there remains a gap in their effectiven... ver más
Revista: Water

 
Achini Adikari, Su Nguyen, Rashmika Nawaratne, Daswin De Silva and Damminda Alahakoon    
The proliferation of online hotel review platforms has prompted decision-makers in the hospitality sector to acknowledge the significance of extracting valuable information from this vast source. While contemporary research has primarily focused on extra... ver más
Revista: Applied Sciences

 
Haiyang Xu, Huaxing Lu and Shichen Liu    
The Sky View Factor (SVF) stands as a critical metric for quantitatively assessing urban spatial morphology and its estimation method based on Street View Imagery (SVI) has gained significant attention in recent years. However, most existing Street View-... ver más
Revista: Applied Sciences

 
Elise Bertheau, Valérie Simon and Christine Delgado Raynaud    
Wood-based panels are ubiquitous in our daily lives, both as building materials and as furnishing materials. Numerous studies have revealed that these materials emit volatile organic compounds, such as formaldehyde, into indoor air, which can be harmful ... ver más
Revista: Applied Sciences

 
MohammadMoein Shafi, Arash Habibi Lashkari, Vicente Rodriguez and Ron Nevo    
The distributed denial of service attack poses a significant threat to network security. Despite the availability of various methods for detecting DDoS attacks, the challenge remains in creating real-time detectors with minimal computational overhead. Ad... ver más
Revista: Information