Evaluation Strategies for Automatic Linguistic Indexing of Pictures

James Z. Wang, Jia Li, Sui Ching Lin
The Pennsylvania State University, University Park, PA 16802
Abstract:

With the rapid technological advances in machine learning and data mining, it is now possible to train computers with hundreds of semantic concepts for the purpose of annotating images automatically using keywords and textual descriptions. We have developed a system, the Automatic Linguistic Indexing of Pictures (ALIP) system, using a 2-D multiresolution hidden Markov model. The evaluation of such approaches opens up challenges and interesting research questions. The goals of linguistic indexing are often different from those of other fields including image retrieval, image classification, and computer vision. In many application domains, computer programs that can provide semantically relevant keyword annotations are desired, even if the predicted annotations are different from those of the gold standard. In this paper, we discuss evaluation strategies for automatic linguistic indexing of pictures. We provide both objective and subjective evaluation methods. Finally, we report experimental results using our ALIP system.


Full Paper in Color

(PDF, 0.7MB)

More Information


Citation: James Z. Wang, Jia Li and Sui Ching Lin, ``Evaluation Strategies for Automatic Linguistic Indexing of Pictures,'' Proc. IEEE International Conference on Image Processing (ICIP), vol. 3, pp. 617-620, Barcelona, Spain, IEEE, September 2003.

Copyright 2003 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works, must be obtained from the IEEE.

Last Modified: May 9, 2003
© 2003