A Comparison of Sampling Strategies for Parameter Estimation of a Robot Simulator

Abstract. Methods for dealing with the problem of the “reality gap” in evolutionary robotics are described. The focus is on simulator tuning, in which simulator parameters are adjusted in order to more accurately model reality. We investigate sample selection, which is the method of choosing the robot controllers, evaluated in reality, that guide simulator tuning. Six strategies for sample selection are compared on a robot lo-comotion task. It is found that strategies that select samples that show high fitness in simulation greatly outperform those that do not. One such strategy, which selects the sample that is the expected fittest as well as the most informative (in the sense of producing the most disagreement between potential simulators), results in the creation of a nearly optimal simulator in the first iteration of the simulator tuning algorithm