A Vision-based Robotic Navigation Method Using an Evolutionary and Fuzzy Q-Learning Approach

Abstract

The paper presents a Fuzzy Q-Learning (FQL) and optical flow based autonomous navigation approach. The FQL method takes decisions in an unknown environment and without mapping, using motion information and through a reinforcement signal into an evolutionary algorithm. The reinforcement signal is calculated by estimating the optical flow densities in areas of the camera to determine whether they are “dense” or “thin” which has a relationship with the proximity of objects. The results obtained show that the present approach improves the rate of learning compared with a method with a simple reward system and without the evolutionary component. The proposed system was implemented in a virtual robotics system using the CoppeliaSim software and in communication with Python.