Optimising Trajectories in Simulations with Deep Reinforcement Learning for Industrial Robots in Automotive Manufacturing

This paper outlines the concept of optimising trajectories for industrial robots by applying deep reinforcement learning in simulations. An application of high technical relevance is considered in a production line of an automotive manufacturer (AUDI AG), where industrial manipulators apply sealant on a car body to prevent water intrusion and hence corrosion. A methodology is proposed that supports the human expert in the tedious task of programming the robot trajectories. A deep reinforcement learning agent generates trajectories in virtual instances where the use case is simulated. By making use of the automatically generated trajectories, the expert’s task is reduced to minor changes instead of developing the trajectory from scratch. This paper describes an appropriate way to model the agent in the context of Markov decision processes and gives an overview of the employed technologies. The use case outlined in this paper is a proof of concept to demonstrate the applicability of reinforcement learning for industrial robotics.Disclaimer: This chapter is published under Attribution-Non Commercial 4.0 International (CC BY-NC 4.0) license (https://www.riverpublishers.com/policies.php?pid=6). All River Publishers Open Access books, including Monographs and Edited Volumes, are distributed under the Creative Commons Attribution-Non Commercial 4.0 International (CC BY-NC 4.0). The full book is available at: https://www.riverpublishers.com/research_details.php?book_id=967 River Publishers Series in Communications Artificial Intelligence for Digitising Industry - Applications Editors: Ovidiu Vermesan, SINTEF, Norway Reiner John, AVL List, Austria Cristina De Luca, Infineon Technologies, Germany Marcello Coppola, STMicroelectronics, France ISBN: 9788770226646, e-ISBN: 978877022663