This work is a contribution towards the understanding of certain features of mathematical models of single neurons. Emphasis is set on neuronal firing, for which the first passage time (FPT) problem bears a fundamental relevance. We focus the attention on modeling the change of the neuron membrane potential between two consecutive spikes by Gaussian stochastic processes, both of Markov and of non-Markov types. Methods to solve the FPT problems, both of a theoretical and of a computational nature, are sketched, including the case of random initial values. Significant similarities or diversities between computational and theoretical results are pointed out, disclosing the role played by the correlation time that has been used to characterize ...