Since the early nineties, interest has been growing in different facets of cognitive architectures and, inspired by advances in AI tools and methodologies, competing proposals have been put forward by various research communities. This gives the task of evaluating the various architectures importance. This paper outlines our proposals for the design and running of a Cognitive Architectures Competition to tackle this issue. Especially, this will involve creating an international community of researchers, developers and users, current and potential, who will have vested interests in the design of the competition. To evaluate entries, the competition’s community will be required to develop a classification of Cognitive Architecture-based systems’ current, and near future, capabilities and their potential range of desirable, practical applications. The community will need to address important technical issues and in doing so will help set a future research and development agenda.