Cooperative use of pattern information and natural language information is quite effective for sophisticated and flexible information processing. Therefore, it is important to investigate the integration of these kinds of information (especially in multimedia). For this purpose, we propose method for image analysis by using the natural language information extracted from the explanation text of image data. First, we describe the method of extraction of color information from the explanation text. Then, we describe how this color information is used for the extraction of objects from the image data. We report experimental results to show the effectiveness of our method. Also, we report an experimental multimedia database system for pictorial book of flora which we developed by using the results of the experiment.