A deep learning architecture for image representation, visual interpretability and automated basal-cell carcinoma cancer detection

Abstract. This paper presents and evaluates a deep learning architecture for automated basal cell carcinoma cancer detection that integrates (1) image repre-sentation learning, (2) image classification and (3) result interpretability. A novel characteristic of this approach is that it extends the deep learning architecture to also include an interpretable layer that highlights the visual patterns that con-tribute to discriminate between cancerous and normal tissues patterns, working akin to a digital staining which spotlights image regions important for diagnos-tic decisions. Experimental evaluation was performed on set of 1,417 images from 308 regions of interest of skin histopathology slides, where the presence of absence of basal cell carcinoma needs to be determined. Different image rep-resentation strategies, including bag of features (BOF), canonical (discrete cosine transform (DCT) and Haar-based wavelet transform (Haar)) and proposed learned-from-data representations, were evaluated for comparison. Experimental results show that the representation learned from a large histology image data set has the best overall performance (89.4 % in F-measure and 91.4 % in balanced accuracy), which represents an improvement of around 7 % over canonical representations and 3 % over the best equivalent BOF representation.