AAAI Publications, Twelfth Artificial Intelligence and Interactive Digital Entertainment Conference

Font Size: 
Recognizing Actions in Motion Trajectories Using Deep Neural Networks
Kunwar Yashraj Singh, Nicholas Davis, Chih-Pin Hsiao, Mikhail Jacob, Krunal Patel, Brian Magerko

Last modified: 2016-09-19


This paper reports on the progress of a co-creative pretend play agent designed to interact with users by recognizing and responding to playful actions in a 2D virtual environment. In particular, we describe the design and evaluation of a classifier that recognizes 2D motion trajectories from the user’s actions. The performance of the classifier is evaluated using a publicly available dataset of labeled actions highly relevant to the domain of pretend play. We show that deep convolutional neural networks perform significantly better in recognizing these actions than previously employed methods. We also describe the plan for implementing a virtual play environment using the classifier in which the users and agent can collaboratively construct narratives during improvisational pretend play.


convolutional neural network; pretend play; motion trajectory; deep learning

Full Text: PDF