Many real-world time series have been observed to have strong positive correlation between their long-term observed values, and this behaviour is known as long memory or long-range dependence. However, many statistical models and estimation techniques are built under the assumption of short memory (or sometimes complete independence) and identically distributed data. This challenges the modelling and estimation of time series with long memory. In the first half of this thesis, we investigate several parametric models for time series with long memory, which are commonly known as fractional models. We focus on the challenge of parameter estimation from sampled time series, and compare numerous existing and novel methods in wide-ranging simula...