We present new ATCA 17- and 24-GHz radio images and ESO-NTT optical spectra of the radio-loud Seyfert galaxy IC 5063, the first galaxy in which a fast (~600 km s-1) outflow of neutral hydrogen was discovered. The new radio data confirm the triple radio structure with a central, unresolved flat-spectrum core and two resolved radio lobes with steep spectral index. This implies that the previously detected fast outflow of neutral gas is occurring off-nucleus, near a radio lobe about 0.5 kpc from the core. The ionised gas shows highly complex kinematics in the region co-spatial with the radio emission. Broad and blueshifted (~500 km s-1) emission is observed in the region of the radio lobe, at the same location as the blueshifted $\ion{H}{i}$ ...