Results of the european land robot trial and their usability for benchmarking outdoor robot systems

It is generally a problematic task to compare different approaches and methods in the field of outdoor robotics [1]. In the majority of cases, results are reported only for a specific robotic system. All tasks are solved in a static and often specially defined environment, making it hard to compare the outcome with results from other research groups, other approaches, and other robots. The commonly used means of "proof by video" or "proof by (one) example" are insufficient for obvious reasons. As one possible solution, robot competitions can be a benchmark for real robot systems [2]