Responsive Information Architect: A Context-Sensitive Multimedia Conversation Framework for Information Seeking

Book One

Volume

Proceedings of the AAAI Conference on Artificial Intelligence, 19

Intelligent Systems Demonstrations

We are building a context-sensitive framework, called Responsive Information Architect (RIA), which engages users in automatically generated multimedia conversations. Unlike existing information browsing paradigm that forces users to explore information following pre-defined paths (e.g., GUI menus), RIA allows users to express their information requests flexibly using a mixture of input modalities, including speech, text, and gesture. Using a rich context, such as conversation history and data semantics, RIA is capable of understanding user inputs, including these complex data queries.