Grounding Abstraction is Predictive Representations

Brian Tanner, Vadim Bulitko, Anna Koop, Cosmin Paduraru

This paper proposes a systematic approach of representing abstract features in terms of low-level, subjective state representations. We demonstrate that a mapping between the agent's predictive state representation and an abstract feature representation can be derived automatically from high-level training data supplied by the designer. Our empirical evaluation demonstrates that an experience-oriented state representation built around a single-bit sensor can represent useful abstract features such as "back against a wall," "in a corner," or "in a room". As a result, the agent gains virtual sensors that could be used by its control policy.

Subjects: 12.1 Reinforcement Learning; 12. Machine Learning and Discovery

Submitted: Oct 16, 2006

This page is copyrighted by AAAI. All rights reserved. Your use of this site constitutes acceptance of all of AAAI's terms and conditions and privacy policy.