We continue our study of intermittency for the parabolic Anderson equation, i.e., the spatially discrete heat equation on the d-dimensional integer lattice with a space-time random potential. The solution of the equation describes the evolution of a reactant under the influence of a catalyst . In this paper we focus on the case where the random field is an exclusion process with a symmetric random walk transition kernel, starting from Bernoulli equilibrium. We consider the annealed Lyapunov exponents, i.e., the exponential growth rates of the successive moments of the solution. We show that these exponents are trivial when the random walk is recurrent, but display an interesting dependence on the diffusion constant when the random walk ...