Multi-class Object Layout with Unsupervised Image Classification and Object Localization

Abstract. Recognizing the presence of object classes in an image, or image clas-sification, has become an increasingly important topic of interest. Equally impor-tant, however, is also the capability to locate these object classes in the image. We consider in this paper an approach to these two related problems with the primary goal of minimizing the training requirements so as to allow for ease of adding new object classes, as opposed to approaches that favor training a suite of object-specific classifiers. To this end, we provide the analysis of an exemplar-based approach that leverages unsupervised clustering for classification purpose, and sliding window matching for localization. While such exemplar based ap-proach by itself is brittle towards intraclass and viewpoint variations, we achieve robustness by introducing a novel Conditional Random Field model that facili-tates a straightforward accept/reject decision of the localized object classes. Per-formance of our approach on the PASCAL Visual Object Challenge 2007 dataset demonstrates its efficacy.