Research on AGV path tracking method based on global vision and reinforcement learning

As the key to the movement of automated guided vehicle (AGV), the design of control algorithm directly affects whether AGV can follow the preset path. Aiming at the difficulty of AGV control, an AGV path tracking control method based on global vision and reinforcement learning is proposed. Firstly, the global view is obtained by the visual sensor, and the position information of obstacles and AGV is obtained by the target detection algorithm. Secondly, the path planning algorithm is used to obtain the driving path information which is used to establish a virtual environment. Thirdly, the position and pose of the physical AGV are introduced into the virtual environment by the visual sensor, and the virtual AGV is reset. Finally, the image obtained by virtual vehicle camera is input into the reinforcement learning model and the output action is sent to the physical AGV for execution. In the experimental part, this method can not only plan the driving path in different environments but also well control AGV to drive along the specified path, which proves that this method has strong robustness and feasibility.