Summary generation for toponym-referenced images using object type language models

This paper presents a novel approach to au-tomatic captioning of toponym-referenced im-ages. The automatic captioning procedure works by summarizing multiple web-documents that contain information related to an image’s lo-cation. Our summarizer can generate both query-based and language model-biased multi-document summaries. The models are created from large numbers of existing articles pertaining to places of the same “object type”. Evaluation relative to human written captions shows that when language models are used to bias the sum-marizer the summaries score more highly than the non-biased ones