Overlap Training to Mitigate Inconsistencies Caused by Image Tiling in CNNs

The 40th SGAI International Conference on Artificial Intelligence (AI-2020), Cambridge, United Kingdom (held online due to Coronavirus outbreak), 15–17 December 2020This paper focuses on the problem of inconsistent predictions of modern convolutional neural networks (CNN) at patch (i.e. sub-image) boundaries. Limited by the graphics processing unit (GPU) resources, image tiling and stitching countermeasure have been applied for most megapixel images, that is, cutting images into overlapping tiles as CNN input, and then stitching CNN outputs together. However, we found that stitched (i.e. recovered) predictions have discontinuous grid-like noise. We propose a simple yet efficient overlap training framework to mitigate the inconsistent prediction at patch boundaries without changing the model architecture while improving the stability, robustness of the model. We have applied our solution to various CNNs (such as U-Net, DeepLab, RCF) and tested them on two real-world datasets. Extensive experiments suggest that the new framework is sufficient in reducing inconsistency and outperform these countermeasures. The source code and coloured figures are made publicly available online at: https://github.com/anyuzoey/Overlap-Training.git.Science Foundation IrelandInsight Research Centre2021-02-24 JG: broken PDF replace