Optimal formation control for multiple rotation-translation coupled satellites using reinforcement learning

In this paper, the model-free formation control problem is addressed for multiple satellites, whose dynamics involves rotation-translation coupling and nonlinearities. A two-step adaptive control strategy is proposed based on the reinforcement learning theory to iteratively solve the optimal formation control problem without knowledge of each satellite dynamics. The resulted controller is composed of an attitude controller to achieve the desired attitude, and a relative position controller to construct the satellite formation. The proposed global closed-loop control system is proven to be asymptotically stable. Simulation results on rotation-translation coupled satellite system confirm the effectiveness of the proposed adaptive optimal formation control strategy.