There are many Markov chains on infinite dimensional spaces whose one-step transition kernels are mutually singular when starting from different initial conditions. We give results which prove unique ergodicity under minimal assumptions on one hand and the existence of a spectral gap under conditions reminiscent of Harris' theorem. The first uses the existence of couplings which draw the solutions together as time goes to infinity. Such "asymptotic couplings" were central to (Mattingly and Sinai in Comm Math Phys 219(3):523-565, 2001; Mattingly in Comm Math Phys 230(3):461-462, 2002; Hairer in Prob Theory Relat Field 124:345-380, 2002; Bakhtin and Mattingly in Commun Contemp Math 7:553-582, 2005) on which this work builds. As in Bakhtin and...