Integration of Pattern Information and Natural Language Information for Image Analysis and Retrieval

Intelligent Integration and Use of Text, Image, Video, and Audio Corpora

Volume

Papers from the 1997 AAAI Spring Symposium

Contents

Cooperative use of pattern information and natural language information is quite effective for sophisticated and flexible information processing. Therefore, it is important to investigate the integration of these kinds of information (especially in multimedia). For this purpose, we propose method for image analysis by using the natural language information extracted from the explanation text of image data. First, we describe the method of extraction of color information from the explanation text. Then, we describe how this color information is used for the extraction of objects from the image data. We report experimental results to show the effectiveness of our method. Also, we report an experimental multimedia database system for pictorial book of flora which we developed by using the results of the experiment.