AAAI Publications, 2013 AAAI Spring Symposium Series

Font Size: 
Benchmarking Intelligent Service Robots through Scientific Competitions: The RoboCup@Home Approach
Dirk Holz, Luca Iocchi, Tijn van der Zant

Last modified: 2013-03-15


The dynamical and uncertain environments of domestic service robots, which include humans, require rethinking of the benchmarking principles for testing these robots. In RoboCup@Home, statistical procedures are used to track and steer the progress of domestic service robots since 2006. This paper explains the procedures and shows outcomes of these international benchmarking efforts. Although aspects such as shopping in a supermarket receive a fair amount of attention in the robotics community, the authors think that a recently started test is the most important outcome of RoboCup@Home, namely the benchmarking of robot cognition.


Benchmark, cognitive systems, RoboCup@Home

Full Text: PDF