Visual Recognition by Exploiting Latent Social Links in Image Collections

Abstract. Social network study has become an important topic in many research fields. Early works on social network analysis focus on real world social interac-tions in either human society or animal world. With the explosion of Internet data, social network researchers start to pay more attention to the tremendous amount of online social network data. There are ample space for exploring social network research on large-scale online visual content. In this paper, we focus on studying multi-label collective classification problem and develop a model that can harness the mutually beneficial information among the visual appearance, related seman-tic content and the social network structure simultaneously. Our algorithm is then tested on CelebrityNet, a social network constructed by inferring implicit rela-tionship of people based on online multimedia content. We apply our model to a few important multimedia applications such as image annotation and commu-nity classification. We demonstrate that our algorithm significantly outperforms traditional methods on community classification and image annotation.