Fusion of 3D real-time echocardiography and cine MRI using a saliency analysis

International audiencePurpose - This paper presents a novel 3D multimodal registration strategy to fuse 3D real-time echocardiography images with cardiac cine MRI images. This alignment is performed in a saliency space, which is designed to maximize similarity between the two imaging modalities. This fusion improves the quality of the available information. Methods - The method performs in two steps: temporal and spatial registrations. A temporal alignment is firstly achieved by nonlinearly matching pairs of correspondences between the two modalities using a dynamic time warping. A temporal registration is then carried out by applying nonrigid transformations in a common saliency space where normalized cross correlation between temporal pairs of salient volumes is maximized. Results - The alignment performance was evaluated with a set of 18 subjects, 3 with cardiomyopathies and 15 healthy, by computing the Dice score and Hausdorff distance with respect to manual delineations of the left ventricle cavity in both modalities. A Dice score and Hausdorff distance of [Formula: see text] and [Formula: see text], respectively, were obtained. In addition, the deformation field was estimated by quantifying its foldings, obtaining a 98% of regularity in the deformation field. Conclusions - The 3D multimodal registration strategy presented is performed in a saliency space. Unlike state-of-the-art methods, the presented one takes advantage of the temporal information of the heart to construct this common space, ending up with two well-aligned modalities and regular deformation fields. This preliminary study was evaluated on heterogeneous data composed of two different datasets, healthy and pathological cases, showing similar performances in both cases. Future work will focus on testing the presented strategy in a larger dataset with a balanced number of classes