Boot Camp for Cognitive Systems

Book One

Volume

Proceedings of the AAAI Conference on Artificial Intelligence, 21

Student Abstracts

With traditional engineering projects, evaluation can be done in a straightforward manner determining if the documented requirements of the system have been met. Agent-based capabilities and other network centric capabilities complicate matters because the environment that they will operate under constantly changes. Add to that complication, the ability to learn new capabilities, and testing whether or not a new agent is ready to be deployed becomes a problem beyond the current state of art and practice. In this paper an initial experiment design is discussed as well as a description of a broader approach for evaluation in transitioning cognitive systems that learn into an operational environment.