AAAI Publications, 2010 AAAI Fall Symposium Series

Font Size: 
Tensor Product of Correlated Textual and Visual Features: A Quantum Theory Inspired Image Retrieval Framework
Jun Wang, Dawei Song, Leszek Kaliciak

Last modified: 2010-11-01


In multimedia information retrieval, where a document may contain both textual and visual content features, the ranking of documents is often computed by heuristically combining the feature spaces of different media types or combining the ranking scores computed independently from different feature spaces. In this paper, we propose a principled approach inspired by quantum theory. Specifically, we propose a tensor product based model aiming to represent textual and visual content features of an image as a non-separable composite system. The ranking scores of the images are then computed in the form of a quantum measurement. In addition, the correlations between features of different media types are incorporated in the framework. Experiments on ImageClef2007 show a promising performance of the tensor based approach.


tensor, multimedia retrieval, correlation

Full Text: PDF