Variational Image Fusion with Optimal Local Contrast

Multispectral imaging Exposure fusion Decolourisation Figure 1: Exemplary applications of our general variational image fusion technique. Each of the resulting composite images (top) condenses the most important information from the input stack (bottom). (Input images: [14], J. Joffre [5], [17]) In this paper, we present a general variational method for image fusion. In particular, we combine different images of the same subject to a single composite that offers optimal exposedness, saturation, and local contrast. Previous research approaches this task by first pre-computing application specific weights based on the input, and then combining these weights with the images to the final composite later on. In contrast, we design our model assumptions directly on the fu-sion result. To this end, we formulate the output image as a convex combination of the input and incorporate concepts from perceptually inspired contrast enhancement such as a local and nonlinear response. This output-driven approach it the key to the versatility of our general image fusion model. In this regard, we demonstrate the performance of our fusion scheme with several applications such as exposure fu-sion, multispectral imaging, and decolourisation. For all application domains, we conduct thorough validations that illustrate the improve-ments compared to state-of-the-art approaches that are tailored to the individual tasks.