Adapting the turing test for embodied neurocognitive evaluation of biologically-inspired cognitive agents

Contents

The field of artificial intelligence has long surpassed the notion of verbal intelligence envisioned by Turing (1950). Consequently, the Turing Test is primarily viewed as a philosopher's debate or a publicity stunt, and has little relevance to AI researchers. This paper describes the motivation and design of a set of behavioral tests called the Cognitive Decathlon, which were developed to be a useable version of an embodied Turing Test that is relevant and achievable by state-of-the-art AI algorithms in the next five years. We describe some of the background motivation for developing this test, and then provide a detailed account of the tasks that make up the Decathlon, and the types of results that should be expected.