While mathematical models, in particular self-propelled particle models, capture many properties of large fish schools, they do not always capture the interactions of smaller shoals. Nor do these models tend to account for the use of intermittent locomotion, often referred to as burst-and-glide, by many species. In this paper, we propose a model of social burst-and-glide motion by combining a well-studied model of neuronal dynamics, the FitzHugh-Nagumo model, with a model of fish motion. We first show that our model can capture the motion of a single fish swimming down a channel. Extending to a two-fish model, where visual stimulus of a neighbour affects the internal burst or glide state of the fish, we observe a rich set of dynamics found ...