Eye Specular Highlights Telltales For Digital Forensics: A Machine Learning Approach

Among the possible forms of photographic fabrication and manipulation, there is an increasing number of composite pictures containing people. With such compositions, it is very common to see politicians depicted side-by-side with criminals during election campaigns, or even Hollywood superstars relationships being wrecked by allegedly affairs depicted in gossip magazines. Thinking about this problem, in this paper we analyze telltales obtained from highlights in the eyes of every person standing in a picture in order to decide whether or not those people were really together at the moment of such image acquisition. We validate our approach with a data set containing realistic photographic compositions, as well as authentic unchanged pictures. As a result, our proposed extension improves the classification accuracy of the state-of-art solution in more than 20%. © 2011 IEEE.19371940 IEEE,IEEE Signal Processing SocietyRocha, A., Scheirer, W., Boult, T.E., Goldenstein, S., Vision of the unseen: Current trends and challenges in digital image and video forensics (2011) ACM Computing Surveys (CSUR), , no. To AppearHe, J., Lin, Z., Wang, L., Tang, X., Detecting doctored jpeg images via DCT coefficient analysis (2006) ECCV, (3), pp. 423-435Popescu, A.C., Farid, H., Exposing digital forgeries by detecting traces of resampling (2005) IEEE Transactions on Signal Processing, 53 (2 II), pp. 758-767. , DOI 10.1109/TSP.2004.839932Lint, Z., Wang, R., Tang, X., Shum, H.-Y., Detecting doctored images using camera response normality and consistency (2005) IEEE CVPR, pp. 1087-1092Hsu, Y.-F., Chang, S.-F., Image splicing detection using camera response function consistency and automatic segmentation (2007) IEEE ICME, pp. 28-31Johnson, M.K., Farid, H., Exposing digital forgeries by detecting inconsistencies in lighting (2005) ACM MM&SECJohnson, M.K., Farid, H., Exposing digital forgeries through specular highlights on the eye (2007) IHWJohnson, M.K., Farid, H., Exposing digital forgeries in complex lighting environments (2007) IEEE Transactions on Information Forensics and Security, 2 (3), pp. 450-461. , DOI 10.1109/TIFS.2007.903848Hogan, M., Alvarado, J., Weddell, J., (1971) Histology of the Human Eye, , W.B. Saunders CompanyHe, Z., Tan, T., Sun, Z., Qiu, X., Toward accurate and fast iris segmentation for iris biometrics (2009) IEEE TPAMI, 31, pp. 1670-1684. , Septembe